Impress employers and recruiters.
Choose from hundreds of resume examples.
Impress employers and recruiters.
Choose from hundreds of resume examples.
Tailor your resume to this Manager / Senior Manager, AI Safety Data and Evaluation Program role.
Rezi rewrites your resume against Lila Sciences's job description. Free.
Tailor your resume to this Manager / Senior Manager, AI Safety Data and Evaluation Program role.
Rezi rewrites your resume against Lila Sciences's job description. Free.
Don't guess if your resume is good enough.
See how it scores against the Manager / Senior Manager, AI Safety Data and Evaluation Program posting at Lila Sciences — free, in seconds.
Don't guess if your resume is good enough.
See how it scores against the Manager / Senior Manager, AI Safety Data and Evaluation Program posting at Lila Sciences — free, in seconds.
About the Role
We're building a talent-dense, high-agency AI safety team at Lila to engage all core teams within the organization to identify and mitigate risks from scientific superintelligence while retaining the core scientific discovery capabilities of the stack. The initial focus will be to build and implement a bespoke safety strategy for Lila, tailored to its specific goals and deployment strategies. This will involve technical safety strategy development, broader ecosystem engagement, safety-focused evaluations, safety systems to mitigate risks, and a research agenda that explores longer-term needs such as oversight of superintelligent scientific systems.
Responsibilities
- Translate agreed scientific briefs into executable plans covering tasks, contributor needs, instructions, milestones, quality standards and delivery expectations.
- Source and coordinate external experts with scientific colleagues, and organize access to relevant expertise within Lila.
- Manage contributor onboarding, task assignment, training and support so specialists can contribute effectively and consistently.
- Run expert-data collection, annotation, red-teaming and evaluation programs, tracking progress and resolving delivery problems.
- Establish quality controls covering completeness, consistency, provenance and adherence to rubrics; coordinate calibration, review, disagreement resolution and rework with scientific owners.
- Maintain clear records, versioned guidance and usable datasets, and improve workflows based on quality findings and researcher feedback.
- Identify questions that require scientific judgment and bring them to the appropriate specialists, ensuring decisions are reflected in program materials and subsequent work.
Requirements
- Experience delivering expert-data, research-operations, evaluation or similarly demanding programs involving specialist contributors.
- A substantial working understanding of AI safety, including how threat models, capability evaluations, red teaming and safeguards inform one another.
- Ability to interpret a safety research brief, recognize its assumptions and the consequences of data-quality failures, and identify when a question needs scientific escalation.
- Evidence of applying AI safety understanding in research, evaluation or expert-data work, including how it shaped the scoping, execution or review of a program.
- Strong operational judgment and the ability to manage dependencies, changing requirements and several parallel workstreams.
- A track record of setting measurable quality standards, detecting recurring problems and improving the processes that produce data.
- Clear communication, careful documentation and the ability to build effective relationships with researchers, experts and vendors.
- Sufficient technical and scientific fluency to understand research briefs, clarify ambiguity and work productively with subject-matter experts.
Skills
- AI safety
- Scientific misuse risks
- Program execution
- Data quality
- Red-teaming
- Evaluation campaigns
- Technical safety strategy development
- Ecosystem engagement
- Safety-focused evaluations
- Safety systems
- Research agenda development
- Data analysis
- Scripting
- Annotation platforms
- Tools for tracking research workflows
- Data provenance
Work Type
- Full-time
Salary/Compensations
- $180,000—$256,000 USD
Benefits
- Medical, dental, and vision coverage
- Employer-paid life and disability insurance
- Flexible time off with generous company wide holidays
- Paid parental leave
- Educational assistance program
- Commuter benefits, including bike share memberships for office based employees
- Company subsidized lunch program
About the Company
- Lila Sciences is building Scientific Superintelligence™ to solve humankind's greatest challenges.
- We believe science is the most inspiring frontier for AI.
- Rather than hard-coding expert knowledge into tools, LILA builds systems that can learn for themselves.
- LILA combines advanced AI models with proprietary AI Science Factory™ instruments into an operating system for science that executes the entire scientific method autonomously, accelerating discovery at unprecedented speed, scale, and impact across medicine, materials, and energy.
- Guided by our core values of truth, trust, curiosity, grit, and velocity, we move with startup speed while tackling problems of historic importance.
Equal Opportunity
- Lila Sciences is committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status.