Impress employers and recruiters.
Choose from hundreds of resume examples.
Impress employers and recruiters.
Choose from hundreds of resume examples.
Tailor your resume to this Senior Product Quality Analyst - AI Voice role.
Rezi rewrites your resume against Spotify's job description. Free.
Tailor your resume to this Senior Product Quality Analyst - AI Voice role.
Rezi rewrites your resume against Spotify's job description. Free.
Don't guess if your resume is good enough.
See how it scores against the Senior Product Quality Analyst - AI Voice posting at Spotify — free, in seconds.
Don't guess if your resume is good enough.
See how it scores against the Senior Product Quality Analyst - AI Voice posting at Spotify — free, in seconds.
About the Role
The Personalization team enhances music and podcast discovery with features like Blend and Discover Weekly. The Voice Production Team focuses on AI voice experiences, considering casting and performance aspects for various applications. As a Senior Product Quality Analyst, you will define and measure AI voice quality, ensuring it meets Spotify's specific needs.
Responsibilities
- Own the quality bar for Spotify’s AI voice models, defining quality standards for different products, audiences, languages, and use cases.
- Independently design evaluation rubrics and build an evaluation approach to measure qualities like naturalness, tone, pacing, pronunciation, accent, audio quality, and overall experience.
- Plan and execute evaluation campaigns, translating qualitative and quantitative findings into clear recommendations for Voice Production, Speak, and product teams.
- Establish an ongoing evaluation rhythm for reassessing model quality as technology and products evolve.
- Benchmark Spotify’s AI voices against third-party models and competitors to identify areas of leadership, differentiation, and improvement.
- Help determine appropriate quality trade-offs for expanding into additional languages and regions, considering product use cases and market needs.
- Partner with voice experts, machine learning teams, product partners, and vendors to maintain a consistent quality bar across competing priorities.
- Surface meaningful gaps in model performance and use evaluation insights to influence future research and technical priorities.
Requirements
- Experience in product quality, evaluation, data curation, or a related field using human judgment to assess model or product performance.
- Ability to independently define evaluation criteria and translate subjective qualities into clear, repeatable rubrics.
- Comfort in designing and conducting qualitative and MOS-style evaluations and synthesizing results into actionable insights.
- Understanding of voice or audio quality, including naturalness, pacing, tone, accent, and pronunciation, or the ability to develop this expertise quickly.
- Strong judgment to maintain a consistent quality bar while balancing different product requirements, markets, and stakeholder perspectives.
- Comfort working autonomously, identifying evaluation needs, and establishing processes and cadence for useful evaluation over time.
- Clear communication skills across creative, technical, and product teams, serving as a reliable point of contact for internal partners and external vendors.
- Curiosity about generative AI, speech technology, and the evolving AI voice landscape, with the ability to translate industry changes into meaningful benchmarks.
Skills
- Product Quality Analysis
- Evaluation Design
- Data Curation
- Human Judgment
- Rubric Development
- Qualitative Evaluation
- MOS-style Evaluation
- Voice Quality Assessment
- Audio Quality Assessment
- Naturalness Assessment
- Tone Assessment
- Pacing Assessment
- Pronunciation Assessment
- Accent Assessment
- Benchmarking
- Cross-functional Collaboration
- Generative AI
- Speech Technology
Location
- London
Work Type
- Hybrid
- Remote
- Onsite (for meetings)
Experience Level
- Senior
About the Company
- Spotify's Personalization team creates features like Blend and Discover Weekly to improve music and podcast discovery.
- The Voice Production Team develops AI voice experiences, focusing on casting and performance for applications like AI DJ, Generative AI Ads, Personalized Podcasts, and Agent Voice Chat.
- Spotify is committed to inclusivity and ensuring the recruitment process is accessible to everyone, offering reasonable accommodations.
Equal Opportunity
- Spotify is an equal opportunity employer.
- Spotify welcomes individuals from all backgrounds, valuing diversity in its workforce.
- Spotify strives for a workplace where diverse voices are represented and amplified.
- Spotify is passionate about inclusivity and accessibility throughout the recruitment process.
- Reasonable accommodations can be requested during the interview process.