RemoteLeaf Logo
Log in Sign up

AI Quality Analyst

3 weeks ago
United States, Canada, United Kingdom
Part-time
Junior
AI (Artificial Intelligence)
Artificial Intelligence and Machine Learning
Git JSON VS Code
Apply Now
Sports Academy

Sports Academy

Sports Academy offers a transformative educational experience that integrates sports and academics, fostering resilience, teamwork, and leadership skills in students to prepare them for success in both their educational and personal lives.

Education Services
Founded 2014
View All Jobs 13

Description

  • Review production conversations to identify problematic bot responses.
  • Create JSON test files that reproduce reported issues.
  • Update Markdown knowledge base content, including WRONG/RIGHT examples, to correct bot behavior.
  • Run test suites to verify fixes and detect regressions.
  • Maintain and expand the knowledge base as the program evolves.
  • Read test reports and use results to guide follow-up fixes.
  • Work with Git for basic branching, commits, and pushes.
  • Use terminal commands and scripts to operate the testing workflow.

Requirements

  • Native-level English fluency is required.
  • Comfortable editing JSON and Markdown in an IDE.
  • Able to run terminal commands independently without hand-holding.
  • Extreme attention to detail.
  • Able to learn a complex domain quickly, including education and state government programs.
  • Experience writing test cases or QA documentation is a plus.
  • Experience with chatbot QA, conversational AI testing, or LLM evaluation is a plus.
  • Available for about 30 hours per week to start, with ramp-up as needed.
  • Must be available during US time zones.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Mindrift.ai: Be the “I” in AI

Mortgage Underwriter - Freelance AI Trainer

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is seeking mortgage underwriting and loan origination professionals for project-based AI evaluation work focused on testing and improving mortgage-related AI outputs and compliance decisions.

Greece Portugal Italy Part-time Mid Level AI (Artificial Intelligence) Financial Analyst
Up to $104k
14 hours, 4 minutes ago
Mindrift.ai: Be the “I” in AI

Claims Processing Agent - Freelance AI Trainer

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is seeking part-time project-based insurance and claims specialists to evaluate and improve AI systems for auto insurance decision-making, fraud detection, and subrogation testing.

United States Part-time Mid Level AI (Artificial Intelligence)
Up to $125k
14 hours, 4 minutes ago
Toloka

Record Your Daily Routine & Get Paid - AI Training (Remote)

Toloka 251-1K Internet Software & Services

Project-based freelance opportunity with an AI training platform recording first-person videos of everyday household activities to help train AI systems and robots.

Guatemala Freelance Entry Level AI (Artificial Intelligence)
$12k-$12k
14 hours, 4 minutes ago
Mindrift.ai: Be the “I” in AI

Freelance Agent Evaluation Engineer

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is seeking a project-based software specialist to create realistic coding evaluation tasks and tests for AI agents in simulated development environments.

France Part-time Senior AI (Artificial Intelligence) Software Engineer
Up to $104k
Docker FastAPI JavaScript Kafka PostgreSQL Python React Redis TypeScript
14 hours, 4 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers