Senior Product Quality Analyst - AI Voice

1 hour, 22 minutes ago
Full-time
Senior
Artificial Intelligence and Machine Learning
Spotify

Spotify

Spotify is a leading global audio streaming service empowering artists and inspiring fans worldwide with over 70 million tracks. It has 365 million users, including 165 million subscribers, across 178 markets.

Media
Founded 2006

Description

  • Own the quality bar for Spotify’s AI voice models across products, audiences, languages, and use cases.
  • Design evaluation rubrics and build evaluation approaches that assess naturalness, tone, pacing, pronunciation, accent, audio quality, and overall experience.
  • Plan and run evaluation campaigns and translate findings into recommendations for Voice Production, Speak, and product teams.
  • Establish an ongoing evaluation cadence for reassessing model quality as products and technology evolve.
  • Benchmark Spotify’s AI voices against third-party models and competitors.
  • Help determine quality trade-offs as Spotify expands into additional languages and regions.
  • Partner with voice experts, machine learning teams, product partners, and vendors to maintain a consistent quality bar.
  • Surface meaningful gaps in model performance and use evaluation insights to influence research and technical priorities.

Requirements

  • Experience in product quality, evaluation, data curation, or a closely related field using human judgment to assess model or product performance.
  • Ability to independently define evaluation criteria and turn subjective qualities into clear, repeatable rubrics.
  • Experience designing and running qualitative and MOS-style evaluations, with the ability to synthesize results into actionable insights.
  • Understanding of voice or audio quality, including naturalness, pacing, tone, accent, and pronunciation, or the ability to develop that expertise quickly.
  • Strong judgment and the ability to balance competing product requirements, markets, and stakeholder perspectives.
  • Comfort working autonomously and establishing evaluation processes and cadence over time.
  • Ability to communicate clearly across creative, technical, and product teams and serve as a reliable point of contact for partners and vendors.
  • Curiosity about generative AI, speech technology, and the evolving AI voice landscape.
  • Based in New York or Los Angeles.
  • Equal opportunity employer; accommodations available during the interview process.

Benefits

  • Base salary range of $114,486–$163,552 USD plus equity.
  • Health insurance.
  • Six-month paid parental leave.
  • 401(k) retirement plan.
  • Monthly meal allowance.
  • 23 paid days off.
  • Paid flexible holidays.
  • Paid sick leave.
  • Flexible work-from-home arrangement with some in-person meetings.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

QA Analyst (AI Systems)

CodeRoad 51-250 Internet Software & Services

CodeRoad is hiring a Junior AI Agent Quality Engineer to validate autonomous AI systems, with a focus on testing agent reliability across agentic workflows, RAG, and Python-based APIs.

Docker JMeter JSON Locust OpenTelemetry Playwright Pytest Python REST API Selenium
22 minutes ago

Senior GenAI Transformation Lead

OLIVER 1K-5K Media

OLIVER is hiring a Senior GenAI Transformation Lead in Singapore to drive the identification, implementation, and scaling of AI-enabled transformation across client accounts and internal agency operations.

Generative AI LLM
37 minutes ago

Director- Applied AI & Machine Learning (SME)

3Cloud 251-1K Internet Software & Services

3Cloud is hiring a Director, Applied AI & Machine Learning to lead Microsoft-based AI and data solution strategy for enterprise clients across pre-sales, architecture, and executive engagement.

Azure Databricks Machine Learning
1 hour, 7 minutes ago

Manager, AI Operations

Xsolis 251-1K IT Services

Xsolis is hiring an AI Operations leader to oversee the reliability, observability, and secure production support of its AI portfolio across traditional ML, Generative AI, and agentic AI systems in healthcare.

AWS Datadog Generative AI Machine Learning MLOps
1 hour, 7 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers