About the Role
As our Product Operations Manager - AI, you will run the quality engine behind Rec's AI agent, Seb. You will manage evaluations, annotation, and defect triage, serving as the connective tissue for AI initiatives across product, engineering, and business teams. You will ensure AI initiatives are on track and that the AI agent improves based on real-world performance.
Responsibilities
- Run Seb's evaluation and quality operations, including building and maintaining eval sets, managing annotation queues, and classifying issues.
- Own the feedback loop between real-world agent performance and the roadmap, translating quality signals into prioritized fixes.
- Drive cross-functional AI program management, keeping roadmaps, launches, and dependencies on track.
- Build and refine operational infrastructure for AI quality at scale.
- Partner with engineering on shipping AI features, including instrumentation, monitoring, and rollout sequencing.
- Identify patterns in evaluations and feedback to address potential product or trust issues.
- Inform AI leadership and stakeholders on program status, quality trends, and risks.
Requirements
- 5+ years in product operations, program management, or a related operational role, ideally with AI/ML product exposure.
- Comfortable with evals, annotation tools, and quality frameworks, even without a formal ML background.
- Highly organized with the ability to manage multiple workstreams simultaneously.
- Clear communicator capable of translating technical details into simple updates.
- Genuinely curious about AI and its production behavior.
- Comfortable operating in ambiguous environments and building processes.
- Possesses a bias toward action and high attention to detail.
Skills
- AI/ML product operations
- Program management
- Quality operations
- Evaluation management
- Annotation management
- Defect triage
- Cross-functional program management
- Operational infrastructure development
- AI feature shipping
- Monitoring
- Rollout sequencing
- Pattern identification
- Stakeholder communication
Location
- San Francisco
Work Type
- In-office (most days)
Experience Level
- 5+ years
Salary/Compensations
- $150K-$180K
Benefits
- Flexible PTO
- Top-tier health/dental/vision
- 401(k) plan
- Meaningful equity
About the Company
- Rec (recreation.ai) is using AI to reimagine how the world plays, participates in community, and gets active, aiming for more recreation for everyone.
- The company operates at the intersection of a consumer product and an enterprise platform.
- The team includes founders from Uber and leaders from Google, Microsoft, Strava, Hipcamp, and Airbnb.
- People join Rec to build AI that encourages real-world activity and to work with talented individuals.
