Senior Product Quality Analyst - AI Voice

1 hour, 15 minutes ago
Senior
Artificial Intelligence and Machine Learning
Spotify

Spotify

Spotify is a leading global audio streaming service empowering artists and inspiring fans worldwide with over 70 million tracks. It has 365 million users, including 165 million subscribers, across 178 markets.

Media
Founded 2006

Description

  • Own the quality bar for Spotify’s AI voice models across different products, audiences, languages and use cases.
  • Design evaluation rubrics and build evaluation methods to assess naturalness, tone, pacing, pronunciation, accent, audio quality and overall experience.
  • Plan and run evaluation campaigns and turn findings into recommendations for Voice Production, Speak and product teams.
  • Establish an ongoing evaluation cadence to reassess model quality as products and technology evolve.
  • Benchmark Spotify’s AI voices against third-party models and competitors.
  • Help determine quality trade-offs as Spotify expands into new languages and regions.
  • Partner with voice experts, machine learning teams, product partners and vendors to maintain a consistent quality bar.
  • Identify the most meaningful model gaps and use evaluation insights to influence research and technical priorities.

Requirements

  • Experience in product quality, evaluation, data curation or a closely related field using human judgment to assess model or product performance.
  • Ability to independently define evaluation criteria and convert subjective qualities into clear, repeatable rubrics.
  • Experience designing and running qualitative and MOS-style evaluations, with the ability to synthesize results into actionable insights.
  • Understanding of voice or audio quality, including naturalness, pacing, tone, accent and pronunciation, or the ability to develop that expertise quickly.
  • Strong judgment and the ability to balance different product requirements, markets and stakeholder perspectives.
  • Comfort working autonomously and establishing processes and cadence for ongoing evaluation.
  • Strong communication skills across creative, technical and product teams, with experience serving as a reliable point of contact for internal partners and external vendors.
  • Curiosity about generative AI, speech technology and the evolving AI voice landscape.
  • Role is based in London.
  • Flexibility to work from home with some in-person meetings.

Benefits

  • Flexible work setup with the ability to work where you work best, including from home.
  • Some in-person meetings while still maintaining work-from-home flexibility.
  • Reasonable accommodations available during the interview and application process.
  • Inclusive and accessible recruitment process.
  • Equal opportunity workplace.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

QA Analyst (AI Systems)

CodeRoad 51-250 Internet Software & Services

CodeRoad is hiring a Junior AI Agent Quality Engineer to validate autonomous AI systems, with a focus on testing agent reliability across agentic workflows, RAG, and Python-based APIs.

Docker JMeter JSON Locust OpenTelemetry Playwright Pytest Python REST API Selenium
15 minutes ago

Senior GenAI Transformation Lead

OLIVER 1K-5K Media

OLIVER is hiring a Senior GenAI Transformation Lead in Singapore to drive the identification, implementation, and scaling of AI-enabled transformation across client accounts and internal agency operations.

Generative AI LLM
30 minutes ago

Director- Applied AI & Machine Learning (SME)

3Cloud 251-1K Internet Software & Services

3Cloud is hiring a Director, Applied AI & Machine Learning to lead Microsoft-based AI and data solution strategy for enterprise clients across pre-sales, architecture, and executive engagement.

Azure Databricks Machine Learning
1 hour ago

Manager, AI Operations

Xsolis 251-1K IT Services

Xsolis is hiring an AI Operations leader to oversee the reliability, observability, and secure production support of its AI portfolio across traditional ML, Generative AI, and agentic AI systems in healthcare.

AWS Datadog Generative AI Machine Learning MLOps
1 hour ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers