Lead Research Scientist/Engineer (Embedded Evaluations) at Apollo Research | GB | Rezi

Lead Research Scientist/Engineer (Embedded Evaluations) at Apollo Research

Lead Research Scientist/Engineer (Embedded Evaluations)

Apollo Research · GB

1 weeks ago

Lead Research Scientist/Engineer (Embedded Evaluations)

Apollo Research · GB

8 days ago
Resume preview

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now
Resume preview

Tailor your resume to this Lead Research Scientist/Engineer (Embedded Evaluations) role.

Rezi rewrites your resume against Apollo Research's job description. Free.

Resume score gauge reading 58 out of 100

Don't guess if your resume is good enough.

See how it scores against the Lead Research Scientist/Engineer (Embedded Evaluations) posting at Apollo Research — free, in seconds.

About the Role

Apollo Research is seeking experienced senior researchers to execute embedded evaluation plans at frontier AI labs. This role is critical in setting the standard for embedded evaluations, which are the best existing method to ensure AI alignment is on track, especially given the predicted timeline for automated researchers.

Responsibilities

  • Conduct interviews, review evidence, gather new evidence, and write reports at frontier AI labs.
  • Execute and adapt evaluation playbooks under unforeseen circumstances.
  • Prepare on-site evaluators before they are embedded and support them during their assignments.
  • Perform conceptual work to determine evidence supporting safety claims.
  • Write playbooks for on-site evaluators to optimize evidence gathering speed.
  • Develop tooling for embedded evaluators, both proactively and on demand.
  • Bridge fundamental research and on-site evaluators by translating methodologies into practical code and procedures.
  • Own ambitious projects end-to-end under tight deadlines.
  • Keep research projects on schedule despite unexpected delays or surprising experiment results.
  • Keep months-long evaluations on track.
  • Make plans that are robust to changing circumstances and short turnarounds.
  • Handle all interactions with partners autonomously for extended periods.
  • Tactfully resolve disagreements with partners and stand firm in negotiations.

Requirements

  • Ability to extract signal from large, messy datasets.
  • Comfort with quantitative analysis and knowing when qualitative assessment is more appropriate.
  • Ability to identify anomalies and unexpected model behaviors.
  • Experience writing about qualitative and quantitative findings for diverse stakeholders.
  • Ability to synthesize unorganized technical information for various audiences.
  • Capability to use AI to accelerate work, including understanding different models, their appropriate use cases, and when not to use AI.
  • Experience experimenting with new AI workflows.
  • Strong conceptual understanding of metagaming, evaluation awareness, deception, and reward-seeking.
  • Familiarity with classic and modern research on AI power-seeking and existential risk.
  • Deep knowledge of frontier RL and its complexities.
  • Experience owning ambitious projects end-to-end under hard deadlines.
  • Experience managing strong individual contributors.
  • Unimpeachable professional conduct.
  • Commitment to the mission of preventing catastrophic AI risks.

Skills

  • Data Analysis
  • Pattern Recognition
  • Quantitative Analysis
  • Qualitative Assessment
  • Technical Writing
  • AI Proficiency
  • AI Workflow Experimentation
  • Conceptual Understanding of AI Safety Topics
  • Frontier RL Expertise
  • Project Management
  • Team Management
  • Professional Communication
  • Negotiation
  • Software Engineering (Python)
  • Auditing
  • Consulting

Location

  • London, UK
  • San Francisco, US
  • Remote (with travel requirement)

Work Type

  • Full-time
  • In-person
  • Flexible working hours
  • WFH arrangements

Experience Level

  • Senior Researcher
  • Lead or Individual Contributor
  • Recognised experts who can lead projects of significant scope
  • Strong individual contributors

Salary/Compensations

  • Recognised experts who can lead projects of significant scope: USD 350,000 - USD 590,000 or £230,000 - £395,000
  • Strong individual contributors: USD 245,000 - USD 405,000 or £160,000 - £270,000

Benefits

  • Market-competitive salary
  • Equity
  • Competitive benefits
  • Unlimited vacation
  • Unlimited sick leave
  • Up to 6 months of paid parental leave
  • Comprehensive health, dental and vision insurance
  • Retirement savings with competitive employer matching (e.g. 401(k) for US employees)
  • Lunch, dinner, and snacks provided on workdays
  • Paid work trips, including staff retreats, business trips, and relevant conferences
  • A yearly $1,000 (USD) professional development budget
  • Relocation support and visa fees
  • Visa sponsorship (UK and US)

About the Company

  • Apollo Research is primarily concerned with risks from AI Loss of Control, specifically deceptive alignment and scheming.
  • The company works on the detection of scheming, the science of scheming, and scheming mitigations.
  • Apollo Research collaborates closely with frontier AI companies to test models and conduct fundamental research.
  • The company culture emphasizes truth-seeking, goal-orientation, constructive feedback, and friendliness.
  • Apollo Research is committed to preventing catastrophic AI risks.

Equal Opportunity

  • Apollo Research is an Equal Opportunity Employer.
  • We value diversity and are committed to providing equal opportunities to all, regardless of age, disability, gender reassignment, marriage and civil partnership, pregnancy and maternity, race, religion or belief, sex, or sexual orientation.
  • We are committed to protecting your data, ensuring fairness, and adhering to workplace fairness principles in our recruitment process.
  • AI-powered tools are used to assist with tasks such as resume screening, designed and deployed in compliance with internationally recognized AI governance frameworks.
  • Personal data is handled securely and transparently.
  • A human-centred approach is adopted: all resumes are screened by a human and final hiring decisions are made by our team.