Principal Data Scientist at Yoodli AI Roleplays | Seattle, WA, US | Rezi

Principal Data Scientist at Yoodli AI Roleplays

Principal Data Scientist

Yoodli AI Roleplays · Seattle, WA, US

3 weeks ago

Principal Data Scientist

Yoodli AI Roleplays · Seattle, WA, US

23 days ago
Resume preview

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now
Resume preview

Tailor your resume to this Principal Data Scientist role.

Rezi rewrites your resume against Yoodli AI Roleplays's job description. Free.

Resume score gauge reading 58 out of 100

Don't guess if your resume is good enough.

See how it scores against the Principal Data Scientist posting at Yoodli AI Roleplays — free, in seconds.

About the Role

As the most senior data scientist, you will own the data function end to end, setting the measurement strategy for a product whose core output is generated by LLMs. You will define what measurable skills development means in numbers and prove its improvement. This principal-level, high-autonomy role requires influencing product strategy with data-driven evidence and helping customers quantify their impact with Yoodli.

Responsibilities

  • Own the measurement strategy for the platform, defining metrics for learner improvement and holding the company accountable.
  • Design and run the experimentation program, including A/B tests, holdouts, and LLM evaluation, setting standards for other teams.
  • Build the data foundation: pipelines, semantic layer, dashboards, and models for internal decisions and customer-facing analytics.
  • Partner with product, design, and engineering to translate ambiguous questions into impactful analyses.
  • Work directly with customers' BI and enablement teams to showcase Yoodli's impact within their organizations.
  • Build models to translate communication signals into product value, including scoring, skill progression, benchmarking, and churn/expansion prediction.
  • Translate analysis into clear recommendations for executives and the board, and defend them.
  • Set the technical bar for data at Yoodli by reviewing analyses, mentoring team members, and laying the groundwork for a future team.

Requirements

  • 8+ years in data science, product analytics, or a closely related field, including experience as the most senior data person on a product or business line.
  • Deep expertise in SQL and Python, with comfort in shipping production-grade analytical code.
  • A track record of running an experimentation program, including power analysis, sequential testing, and guardrail metrics.
  • Experience evaluating LLM or other generative systems, including building eval sets, designing rubrics, and measuring quality without clean ground truth.
  • Fluency with modern data stacks (dbt, Snowflake, BigQuery) and BI tooling (Looker, Mode, Hex, or similar).
  • Demonstrated influence on product strategy at the executive level.
  • Excellent communication skills and the ability to be the clearest thinker in a room.
  • Ability to be on-site at our Seattle, WA office on Monday, Tuesday, and Thursday.

Skills

  • SQL
  • Python
  • Experimentation program management
  • LLM evaluation
  • Modern data stacks (dbt, Snowflake, BigQuery)
  • BI tooling (Looker, Mode, Hex)
  • Communication skills
  • Speech analytics
  • NLP
  • Conversational AI
  • Embedded analytics
  • Customer-facing analytics

Location

  • Greater Seattle Area
  • Seattle, WA

Work Type

  • Hybrid
  • On-site

Experience Level

  • Principal-level
  • 8+ years

Salary/Compensations

  • $200k – $220k

Benefits

  • Competitive compensation
  • Meaningful equity
  • Flexible work environment

About the Company

  • Yoodli is a venture-backed company building an AI Platform for Human Skills, helping people get measurably better in their careers by supporting them in the flow of work.
  • The team includes former employees from Google, Apple, Microsoft, Tableau, and beyond, united by a passion for empowering people using AI.
  • Headquartered in Seattle, WA, with a culture built on failing fast, iterating constantly, and taking bold bets.
  • Values humility, a bias for action, and the belief that we win together.
  • Raised $60M, including a $40M Series B led by WestBridge Capital, backed by Madrona, Neotribe, Cercano, and incubated at the Allen Institute for AI.
  • Valued at $300M and grew revenue 900% year over year.
  • Customers include Google Cloud, Snowflake, Databricks, RingCentral, SAP, FranklinCovey, Korn Ferry, Sandler Training, Toastmasters, and many more, with learners in over 150 countries.
  • Featured in TechCrunch, Axios, The Information, Forbes, Fast Company, and more.