About the Role
Invent new ways to detect and scale the data that makes frontier AI models smarter. Develop scalable systems that generate, curate, and improve high-quality supervision across coding, multimodal, and agentic tasks. Opportunity to be forward-deployed and work directly with researchers at frontier labs to scale new model capability strategies.
Responsibilities
- Train and improve preference, reward, and ranking models from millions of human interactions
- Develop infrastructure for large-scale experimentation, model training, and specialize in online evaluation techniques
- Design systems that transform human preference data into reliable signals for downstream model evaluation and training
Requirements
- Data-pilled. Understand that data quality is the real bottleneck to superintelligence.
- Strong STEM background. Studied Computer Science, Machine Learning, Data Science, Statistics, Math, Engineering, Physics, or a related field.
- Experience building ML systems. Trained preference models, built data pipelines, or worked on ML infrastructure that runs in production.
- Interested in how AI learns from human feedback. Excited by solving problems at the intersection of human-model interaction.
Location
- San Francisco, Levi’s Plaza
Work Type
- Full-time
Education Level
- Computer Science
- Machine Learning
- Data Science
- Statistics
- Math
- Engineering
- Physics
- Related field
Salary/Compensations
- Competitive salary + meaningful equity
Benefits
- Visa sponsorship
- Relocation assistance
About the Company
- Intelligence is the product lab company behind DesignArena, a platform with 5.2M+ users in 8 months.
- The team is talent-dense, backed by Tier 1 VC Index Ventures, YC, SV Angel, Lenny Rachitsky, Paul Graham, Figma Ventures.
- One of the fastest-growing seed-stage startups in SF.
- Trusted by frontier model providers like OpenAI to evaluate state-of-the-art multimodal models.
- Design Arena is the most referenced benchmark for AI-generated visuals with over 5.3M+ users across 192 countries.
- Prediction Arena was the first platform for autonomous model trading.
- Social Arena tested AI models' ability to grow and engage audiences on X.
