RemoteLeaf Logo
Log in Sign up

AI Quality Analyst

2 hours, 7 minutes ago
United States, Canada, United Kingdom
Part-time
Junior
AI (Artificial Intelligence)
Artificial Intelligence and Machine Learning
Git JSON VS Code
Apply Now
Sports Academy

Sports Academy

Sports Academy offers a transformative educational experience that integrates sports and academics, fostering resilience, teamwork, and leadership skills in students to prepare them for success in both their educational and personal lives.

Education Services
Founded 2014
View All Jobs 11

Description

  • Review production conversations to identify problematic bot responses.
  • Create JSON test files that reproduce reported issues.
  • Update Markdown knowledge base content, including WRONG/RIGHT examples, to correct bot behavior.
  • Run test suites to verify fixes and detect regressions.
  • Maintain and expand the knowledge base as the program evolves.
  • Read test reports and use results to guide follow-up fixes.
  • Work with Git for basic branching, commits, and pushes.
  • Use terminal commands and scripts to operate the testing workflow.

Requirements

  • Native-level English fluency is required.
  • Comfortable editing JSON and Markdown in an IDE.
  • Able to run terminal commands independently without hand-holding.
  • Extreme attention to detail.
  • Able to learn a complex domain quickly, including education and state government programs.
  • Experience writing test cases or QA documentation is a plus.
  • Experience with chatbot QA, conversational AI testing, or LLM evaluation is a plus.
  • Available for about 30 hours per week to start, with ramp-up as needed.
  • Must be available during US time zones.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Mindrift.ai: Be the “I” in AI

Material Scientist with Python - Freelance AI Trainer

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is seeking part-time, project-based material scientists and engineers to create and verify engineering-focused AI evaluation tasks for leading tech companies.

Australia Part-time Junior AI (Artificial Intelligence) Training Specialist
Up to $73k
C MATLAB NumPy Pandas Python R SciPy SQL
12 minutes ago
Mindrift.ai: Be the “I” in AI

Optical Engineer - Freelance AI Trainer

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is seeking optical and physics specialists for project-based AI work focused on designing and validating challenging optics and physics problems for leading tech companies.

Kuwait Qatar Saudi Arabia Turkey Israel Jordan Part-time Junior AI (Artificial Intelligence)
Up to $73k
39 minutes ago
CrowdGen by Appen

AI Translation Evaluator; Russian-English

CrowdGen by Appen Internet Software & Services

Appen is hiring a remote independent contractor to evaluate Russian-English AI translations for accuracy and adherence to user-specific context and requirements.

Anywhere Contract Mid Level AI (Artificial Intelligence) Translator
$42k-$42k
1 hour, 24 minutes ago
FutureSight

Co-Founder & CEO - AI Communication Agents for Freight & Logistics

FutureSight 11-50 Internet Software & Services

FutureSight is seeking a Co-Founder & CEO to build and lead HawkAI, an enterprise AI venture for US logistics brokerages, carriers, and warehouse operators focused on automating high-volume freight communications.

Canada Full-time Executive AI (Artificial Intelligence) Head of Sales
LLM
1 hour, 31 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers