AI Voice Evaluation Specialist

40 minutes ago
Mid Level
Artificial Intelligence and Machine Learning
Innodata

Innodata

Innodata Inc. is a global leader in data engineering, offering end-to-end AI solutions and platforms for businesses worldwide, combining AI and human expertise to solve complex data challenges.

IT Services
1K-5K
Founded 1988

Description

  • Review assigned scenarios and roleplay natural conversations with two AI models.
  • Conduct comparable interactions while keeping the scenario, conversational approach, and number of turns consistent.
  • Record voice interactions and assess the quality and behavior of model responses.
  • Evaluate each model across five defined dimensions and categorize relevant audio or conversational error clusters.
  • Compare Model A and Model B using the evaluation framework and select the stronger performer.
  • Write detailed rationales supported by specific examples from both conversations.
  • Apply evaluation guidelines consistently across scenarios and interactions.

Requirements

  • Bachelor’s degree.
  • Strong attention to detail and ability to identify subtle differences in conversational quality.
  • Excellent listening and comprehension skills.
  • Strong written communication skills for explaining observations clearly and objectively.
  • Ability to follow detailed evaluation guidelines consistently.
  • Comfort speaking naturally and roleplaying varied conversational scenarios.
  • Ability to compare interactions fairly without personal bias.
  • Strong critical-thinking and analytical skills.
  • Reliability and consistency in structured evaluation work.
  • Familiarity with AI assistants, voice-based AI, or conversational systems.

Benefits

  • Hourly pay of $20–$27, based on experience, skills, and qualifications.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

AI Conversation Specialist - (Khaleeji/Gulf) Saudi Arabic

RWS Group 5K-10K Internet Software & Services

RWS is seeking freelance AI Business Conversation Analysts fluent in Saudi Arabic (Khaleeji Gulf) to conduct structured bilingual conversations that support the development and improvement of AI models in business and analytical domains.

41 minutes ago

Generative Audio Evaluation - Arabic (Qatar)

RWS Group 5K-10K Internet Software & Services

RWS is seeking remote, part-time Generative Audio Evaluation Specialists in Qatar/GCC to assess AI-generated audio and provide structured feedback that improves a generative audio model.

Generative AI
41 minutes ago

[Job 31798] AI Orchestrator

CI&T 5K-10K Internet Software & Services

Liderar uma squad de desenvolvimento agêntico, coordenando pessoas e agentes de IA para otimizar o SDLC, reduzir gargalos e garantir entregas de qualidade alinhadas ao Product Owner.

41 minutes ago

Generative Audio Evaluation - Arabic (UAE)

RWS Group 5K-10K Internet Software & Services

RWS is seeking remote UAE/GCC freelance Generative Audio Evaluation Specialists to assess AI-generated audio for video and text-to-audio tasks and provide structured feedback to improve model performance.

Generative AI
41 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers