Impress employers and recruiters.
Choose from hundreds of resume examples.
Impress employers and recruiters.
Choose from hundreds of resume examples.
Tailor your resume to this Senior Product Quality Analyst - AI Voice role.
Rezi rewrites your resume against Spotify's job description. Free.
Tailor your resume to this Senior Product Quality Analyst - AI Voice role.
Rezi rewrites your resume against Spotify's job description. Free.
Don't guess if your resume is good enough.
See how it scores against the Senior Product Quality Analyst - AI Voice posting at Spotify — free, in seconds.
Don't guess if your resume is good enough.
See how it scores against the Senior Product Quality Analyst - AI Voice posting at Spotify — free, in seconds.
About the Role
The Personalization team enhances music and podcast discovery with features like Blend and Discover Weekly. The Voice Production Team focuses on AI voice experiences, considering casting and performance aspects for various applications. As a Senior Product Quality Analyst, you will define and measure AI voice quality, ensuring it meets Spotify's specific needs.
Responsibilities
- Own the quality bar for Spotify’s AI voice models, defining quality standards for different products, audiences, languages, and use cases.
- Independently design evaluation rubrics and build an evaluation approach to measure qualities such as naturalness, tone, pacing, pronunciation, accent, audio quality, and overall experience.
- Plan and execute evaluation campaigns, translating qualitative and quantitative findings into clear recommendations for Voice Production, Speak, and product teams.
- Establish an ongoing evaluation rhythm for reassessing model quality as technology and products evolve.
- Benchmark Spotify’s AI voices against third-party models and competitors to identify areas of leadership, differentiation, and improvement.
- Help determine appropriate quality trade-offs for expanding into additional languages and regions, considering product use cases and market needs.
- Partner with voice experts, machine learning teams, product partners, and vendors to maintain a consistent quality bar across competing priorities.
- Surface meaningful gaps in model performance and use evaluation insights to influence future research and technical priorities.
Requirements
- Experience in product quality, evaluation, data curation, or a related field using human judgment to assess model or product performance.
- Ability to independently define evaluation criteria and translate subjective qualities into clear, repeatable rubrics.
- Comfort in designing and running both qualitative and MOS-style evaluations and synthesizing results into actionable insights.
- Understanding of voice or audio quality, including naturalness, pacing, tone, accent, and pronunciation, or the ability to develop this expertise quickly.
- Strong judgment and ability to maintain a consistent quality bar while balancing different product requirements, markets, and stakeholder perspectives.
- Comfort working autonomously, identifying evaluation needs, and establishing processes and cadence for useful evaluation over time.
- Clear communication skills across creative, technical, and product teams, serving as a reliable point of contact for internal partners and external vendors.
- Curiosity about generative AI, speech technology, and the evolving AI voice landscape, with the ability to translate industry changes into meaningful benchmarks.
Skills
- Product Quality Analysis
- Evaluation Design
- Data Curation
- Human Judgment
- Rubric Development
- Qualitative Evaluation
- MOS-style Evaluation
- Voice Quality Assessment
- Audio Quality Assessment
- Naturalness Assessment
- Tone Assessment
- Pacing Assessment
- Pronunciation Assessment
- Accent Assessment
- Generative AI
- Speech Technology
- Benchmarking
- Cross-functional Communication
Location
- New York
- Los Angeles
Work Type
- Hybrid
Experience Level
- Senior
Salary/Compensations
- $114,486–$163,552 USD
Benefits
- Equity
- Health insurance
- Six-month paid parental leave
- 401(k) retirement plan
- Monthly meal allowance
- 23 paid days off
- Paid flexible holidays
- Paid sick leave
About the Company
- Spotify is an equal opportunity employer.
- Our platform is for everyone, and so is our workplace.
- We are passionate about inclusivity and making sure our entire recruitment process is accessible to everyone.
- We have ways to request reasonable accommodations during the interview process and help assist in what you need.
Equal Opportunity
- You are welcome at Spotify for who you are, no matter where you come from, what you look like, or what’s playing in your headphones.
- The more voices we have represented and amplified in our business, the more we will all thrive, contribute, and be forward-thinking!
- So bring us your personal experience, your perspectives, and your background. It’s in our differences that we will find the power to keep revolutionizing the way the world listens.
- If you need accommodations at any stage of the application or interview process, please let us know - we’re here to support you in any way we can.