Impress employers and recruiters.
Choose from hundreds of resume examples.
Impress employers and recruiters.
Choose from hundreds of resume examples.
Tailor your resume to this Founding Engineer, Environments + Data role.
Rezi rewrites your resume against Clera's job description. Free.
Tailor your resume to this Founding Engineer, Environments + Data role.
Rezi rewrites your resume against Clera's job description. Free.
Don't guess if your resume is good enough.
See how it scores against the Founding Engineer, Environments + Data posting at Clera — free, in seconds.
Don't guess if your resume is good enough.
See how it scores against the Founding Engineer, Environments + Data posting at Clera — free, in seconds.
About the Role
Build evaluation environments and benchmarks to measure AI agent performance against real-world company work and human capabilities. This founding engineering role bridges agent evaluation research and production readiness, establishing evidence of agent capability.
Responsibilities
- Design synthetic company environments with realistic email, records, and files for agents.
- Build graders and evaluation systems for advanced agents, including those requiring specialized expertise.
- Develop benchmarks that correlate with real-world production performance.
- Identify and address evaluation failure modes like reward hacking and benchmark gaming.
- Simulate software tools such as inboxes and CRMs with sufficient fidelity for large-scale agent interactions.
Requirements
- Hands-on research experience in synthetic data pipelines, benchmarks, evaluations, or model post-training.
- Experience building environments or benchmarks for agent training/evaluation at a frontier AI lab.
- Experience implementing graders or evaluation systems for AI agents.
- 1-2 years at a fast-growing or AI-focused startup.
- Mid-level or senior engineering or research experience.
- Experience simulating software systems for agent tool use.
- Experience identifying benchmark flaws.
- Experience detecting and fixing reward hacking in evaluation systems.
Skills
- Synthetic data pipelines
- Benchmarks
- Evaluations
- Model post-training
- AI agents
- Reward hacking
- Benchmark gaming
- Software simulation
Location
- San Francisco, California, United States
Work Type
- On-site
Experience Level
- Mid-level
- Senior
Education Level
- Degree from a highly selective university or equivalent credential
Salary/Compensations
- $200,000 to $300,000 annually
- Up to $350,000 for exceptional candidates
- Additional commission-style bonus of up to $200,000 or more
- Meaningful founding equity
Benefits
- Visa sponsorship