AI Quality Analyst

1 month, 1 week ago
Part-time
Junior
Artificial Intelligence and Machine Learning
Sports Academy

Sports Academy

Sports Academy offers a transformative educational experience that integrates sports and academics, fostering resilience, teamwork, and leadership skills in students to prepare them for success in both their educational and personal lives.

Education Services
Founded 2014

Description

  • Review production conversations to identify problematic bot responses.
  • Create JSON test files that reproduce reported issues.
  • Update Markdown knowledge base content, including WRONG/RIGHT examples, to correct bot behavior.
  • Run test suites to verify fixes and detect regressions.
  • Maintain and expand the knowledge base as the program evolves.
  • Read test reports and use results to guide follow-up fixes.
  • Work with Git for basic branching, commits, and pushes.
  • Use terminal commands and scripts to operate the testing workflow.

Requirements

  • Native-level English fluency is required.
  • Comfortable editing JSON and Markdown in an IDE.
  • Able to run terminal commands independently without hand-holding.
  • Extreme attention to detail.
  • Able to learn a complex domain quickly, including education and state government programs.
  • Experience writing test cases or QA documentation is a plus.
  • Experience with chatbot QA, conversational AI testing, or LLM evaluation is a plus.
  • Available for about 30 hours per week to start, with ramp-up as needed.
  • Must be available during US time zones.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

TCAC Test Analyst (Job 1405)

DLH 1K-5K Construction & Engineering

DLH is seeking a TCAC Test Analyst to support SIGINT/EW systems testing and integration for U.S. Marine Corps and MARSOC operations.

Active Directory JIRA Linux
16 hours, 14 minutes ago

Sr Quality Assurance Engineer

ELEVI Associates 11-50 Internet Software & Services

ELEVI is hiring a Senior Quality Assurance tester to support federal system upgrades and modernization efforts across web applications, databases, reporting interfaces, and secure enterprise environments.

Cybersecurity GitLab Java Windows Server
16 hours, 28 minutes ago

Staff Supplier Industrialization Engineer, Interiors Coverstock

Lucid Motors 1K-5K Automotive

Lucid Motors is hiring a Staff Supplier Industrialization Engineer, Interior Trim and Coverstock to industrialize suspension and interior component suppliers and ensure product quality across development through mass production.

16 hours, 28 minutes ago

AI Agent Safety Evaluation Engineer with Python - Freelance AI Trainer

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is seeking project-based software engineers to design and evaluate AI coding tasks and tests that measure whether frontier coding agents complete work honestly and within scope.

CI/CD GitHub JavaScript Python TypeScript
16 hours, 44 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers