RemoteLeaf Logo
Log in Sign up

Senior Product Quality Analyst - AI Voice

2 months ago
United Kingdom
Senior
AI (Artificial Intelligence)
Artificial Intelligence and Machine Learning
Generative AI
Apply Now
Spotify

Spotify

Spotify is a leading global audio streaming service empowering artists and inspiring fans worldwide with over 70 million tracks. It has 365 million users, including 165 million subscribers, across 178 markets.

Media
Founded 2006
View All Jobs 12

Description

  • Own the quality bar for Spotify’s AI voice models across different products, audiences, languages and use cases.
  • Design evaluation rubrics and build evaluation methods to assess naturalness, tone, pacing, pronunciation, accent, audio quality and overall experience.
  • Plan and run evaluation campaigns and turn findings into recommendations for Voice Production, Speak and product teams.
  • Establish an ongoing evaluation cadence to reassess model quality as products and technology evolve.
  • Benchmark Spotify’s AI voices against third-party models and competitors.
  • Help determine quality trade-offs as Spotify expands into new languages and regions.
  • Partner with voice experts, machine learning teams, product partners and vendors to maintain a consistent quality bar.
  • Identify the most meaningful model gaps and use evaluation insights to influence research and technical priorities.

Requirements

  • Experience in product quality, evaluation, data curation or a closely related field using human judgment to assess model or product performance.
  • Ability to independently define evaluation criteria and convert subjective qualities into clear, repeatable rubrics.
  • Experience designing and running qualitative and MOS-style evaluations, with the ability to synthesize results into actionable insights.
  • Understanding of voice or audio quality, including naturalness, pacing, tone, accent and pronunciation, or the ability to develop that expertise quickly.
  • Strong judgment and the ability to balance different product requirements, markets and stakeholder perspectives.
  • Comfort working autonomously and establishing processes and cadence for ongoing evaluation.
  • Strong communication skills across creative, technical and product teams, with experience serving as a reliable point of contact for internal partners and external vendors.
  • Curiosity about generative AI, speech technology and the evolving AI voice landscape.
  • Role is based in London.
  • Flexibility to work from home with some in-person meetings.

Benefits

  • Flexible work setup with the ability to work where you work best, including from home.
  • Some in-person meetings while still maintaining work-from-home flexibility.
  • Reasonable accommodations available during the interview and application process.
  • Inclusive and accessible recruitment process.
  • Equal opportunity workplace.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Praxent

LATAM Senior QA Analyst (Data & ETL)

Praxent 51-250 Capital Markets

Praxent is hiring a remote QA and data testing specialist to validate complex financial-services applications and data flows while helping sprint teams deliver reliable, high-quality work.

Mexico Colombia El Salvador Full-time Senior QA Engineer
Azure Git Power BI SQL SQL Server
34 minutes ago
National Information Solutions Cooperative

Member Value Consultant - AI Assistant

National Information Solutions Cooperative 1K-5K Internet Software & Services

NISC is seeking a Member Value Consultant to help energy and communications cooperatives adopt and measure the value of its AI Assistant and agentic workflows through consulting, training, and change management.

Remote
Full-time Senior AI (Artificial Intelligence)
Generative AI
50 minutes ago
Mindrift.ai: Be the “I” in AI

Physician (MD/DO) - Medical AI Evaluation

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is seeking US-based, actively practicing MDs or DOs to evaluate clinical EHR vignettes and improve medical AI systems through project-based work.

United States Part-time Senior AI (Artificial Intelligence)
Up to $208k
50 minutes ago
Lifeforce

Clinical Quality Assurance Lead (Physician, NP, or PA)

Lifeforce 11-50 Health Care Providers & Services

Lifeforce is hiring a Clinical Quality Assurance Lead to run its remote clinical QA program, auditing telehealth care, managing Rippit workflows, and converting findings into actionable quality, training, and safety improvements.

Anywhere Full-time Senior QA Engineer
$135k-$160k
50 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers