About the Role
This deeply technical, hands-on role involves working directly with engineers on system design, evaluation, and trade-offs. You will define requirements and shape how AI systems function for global users, bridging user needs, model capability, and system constraints to turn AI potential into reliable, real-world application behavior.
Responsibilities
- Research and define end-to-end Artificial Intelligence (AI) system requirements from capability to behavior to user impact.
- Translate model capabilities, data constraints, and evaluation results into clear product and system decisions.
- Make hard trade-offs across quality, latency, cost, reliability, and UX.
- Work closely with Machine Learning (ML), backend, and mobile engineers on system design, evaluation, and iteration.
- Define and evolve evaluation frameworks across offline metrics, online experiments, and human feedback.
- Drive execution with clear specs, strong judgment, and disciplined prioritization.
- Ensure systems ship quickly, safely, and reliably, with strong feedback loops.
- Own product quality end-to-end correctness, predictability, and user trust.
Requirements
- Hands-on exposure to Artificial Intelligence (AI)-powered products, including LLM-based systems.
- Artificial Intelligence (AI) experience required.
- Experience working with model evaluation, prompt or pipeline iteration, and feedback loops.
- Strong intuition for model limitations, hallucinations, bias, and drift.
- Strong grounding in computer science fundamentals, including algorithms, data structures, and system design.
- Solid understanding of Machine Learning (ML) fundamentals and how modern Artificial Intelligence (AI) systems behave in production.
- Comfort reading, reviewing, and discussing technical design documents.
- Significant experience owning complex, technical products end-to-end.
- Proven ability to work closely with senior engineers and ML teams.
- Strong judgment and decision-making ability in ambiguous, fast-moving environments.
- Ability to balance ambition with technical and operational reality.
- Experience shipping Artificial Intelligence (AI)-heavy consumer products is a plus.
- Background as an engineer or highly technical product manager is a plus.
- Experience defining evaluation metrics for Machine Learning (ML) systems is a plus.
- Strong intuition for Artificial Intelligence (AI) User Experience (UX) patterns and failure handling is a plus.
- Prior experience in zero-to-one product environments is a plus.
Skills
- Artificial Intelligence (AI)
- LLM
- ML
- Machine Learning
- Technical Product Manager
- UX
- User Experience
Location
- San Francisco, CA
- Remote
Work Type
- Work From Home
- Remote
- Full-time
Salary/Compensations
- USD 185000 - USD 210000 - yearly
Benefits
- Medical insurance
- Dental
- Vision
- Savings Plan Options
- PTO
