About the Role
Nimble Brain is seeking a Data Quality & Annotation Lead to establish and manage the quality standards for operational data used to train their AI robots. This role involves defining acceptance criteria, building audit workflows, and managing a remote annotation team to ensure a continuous flow of high-quality labeled data for model training. It is a hands-on, metrics-driven position based at the San Francisco HQ, with significant time spent at collection sites.
Responsibilities
- Own episode acceptance criteria for every task family, translating research and engineering data needs into operational, auditable standards.
- Build and manage teams and workflows to scale the annotation and episode-review queue.
- Stand up and manage a remote annotation team with an overnight turnaround SLA.
- Design and run a sampling-based QA audit program with explicit coverage targets and inter-rater reliability checks.
- Run the operator quality feedback loop, delivering operator-level quality scorecards within 24 hours.
- Define quality metrics and build operational dashboards for the team.
- Own the certification bar for new operator onboarding.
- Drive a weekly loop with research and engineering on failure modes and evolving quality standards.
Requirements
- 3+ years in data operations, annotation/labeling operations, or data collection QA for ML systems, with a strong preference for robotics, autonomy, or teleoperation data.
- Proven track record of building quality standards from scratch (rubrics, SOPs, QC workflows).
- Experience managing annotation or review teams, including remote/offshore or vendor/BPO teams, and driving performance against SLAs.
- Experience delivering direct, frequent quality feedback to operators or annotators.
- Data fluency, with the ability to build and own reporting and analyze data (SQL, BI tools, or AI-assisted).
- Meticulous judgment on edge cases combined with pragmatism to ship initial versions.
- High agency and comfort with ambiguity in a fast-paced, high-growth environment.
- Ability to work in person at the San Francisco HQ with regular time at collection sites.
- Alignment with Nimble's core values: relentlessly resourceful, humble, dependable, and committed to legendary impact.
Skills
- Data Operations
- Annotation Operations
- Data Collection QA
- ML Systems
- Robotics Data
- Autonomy Data
- Teleoperation Data
- Quality Standards Development
- Rubric Creation
- SOP Development
- QC Workflow Design
- Team Management
- Remote Team Management
- Offshore Team Management
- Vendor/BPO Management
- SLA Management
- Quality Feedback Delivery
- Data Analysis
- SQL
- BI Tools
- AI-assisted Analysis
- Edge Case Judgment
- Pragmatism
- High Agency
- Ambiguity Tolerance
- Imitation Learning
- Robot Learning Data
- Annotation Scaling
- Rater Team Scaling
- Pod Management
- Shift Lead Management
- Inter-rater Reliability Programs
- Offshore Annotation Vendor Management
- Direct Offshore Team Setup
- Multi-site Operations
Location
- San Francisco HQ
- Collection Sites
Work Type
- In-person
- Full-time
Experience Level
- 3+ years experience
Salary/Compensations
- $100,000 - $120,000/year
Benefits
- Unlimited Flexible Time Off
- Medical Insurance
- Dental Insurance
- Vision Insurance
- Paid Parental Leave
- Commuter Benefits
- Referral Bonus
- 401k
- Equity
About the Company
- Nimble is an AI robotics company building the autonomous supply chain for fast, efficient, and economical commerce.
- They are training robot AGI to power a generalist supply chain superhumanoid capable of performing thousands of tasks.
- The company has raised over $220M at over a $1B valuation and has a strategic alliance with FedEx to build autonomous warehouses.
- Nimble's mission is to empower mankind by inventing robots that liberate humans from menial tasks.
- The founding team comes from AI labs at Stanford and Carnegie Mellon.
- Their board includes notable figures in AI and robotics like Fei-Fei Li, Marc Raibert, and Sebastian Thrun.
- Nimble fosters an ambitious, humble, and resourceful culture focused on building legendary products, teams, and legacies.
- Core values include being relentlessly resourceful, legendary, humble, and dependable.
Equal Opportunity
- Nimble Robotics, Inc. is an equal opportunity employer.
- Employment decisions are based solely on merit.
- Provides equal employment opportunity to all applicants and employees without discrimination on the basis of race, color, religion, national origin, ancestry, disability, medical condition, genetic information, marital status, sex, gender, gender identity, gender expression, sexual orientation, age, military or veteran status, or any other characteristic protected by applicable state, federal or local laws.
