About the Role
LatchBio is developing benchmarks for AI labs to evaluate and train models on biological reasoning. RefusalBench assesses AI systems' ability to differentiate legitimate biological research from requests posing biosecurity risks. We seek scientists with expertise in biosecurity, biosafety, pathogen genomics, infectious disease research, synthetic biology, biodefense, and public health to define the boundaries between routine scientific work and dangerous biological capabilities.
Responsibilities
- Review biological tasks, datasets, protocols, and research workflows to determine whether they should be accepted or refused from a biosecurity perspective.
- Identify specific risk categories, including pathogen engineering, immune evasion, enhanced transmissibility, countermeasure resistance, and other dual-use concerns.
- Source real-world examples from the scientific literature and convert them into evaluation tasks with clear ground truth and supporting rationale.
- Document reasoning and evidence supporting each decision for scientifically defensible and consistently graded evaluations.
- Review agent outputs to determine if models correctly identify risks, over-refuse legitimate research, or fail to recognize dangerous capabilities.
- Contribute to building a high-quality corpus of biosecurity evaluations grounded in real biological research and real-world risk assessment.
Requirements
- Deep expertise in areas such as biosecurity, biosafety, pathogen genomics, infectious disease research, synthetic biology, biodefense, and public health.
- Ability to review real-world biological analyses, protocols, datasets, and research papers to establish ground truth for AI evaluations.
- Skill in identifying relevant risks and justifying decisions.
- Experience converting examples into structured evaluations that test AI system conclusions.
Skills
- Biosecurity
- Biosafety
- Pathogen genomics
- Infectious disease research
- Synthetic biology
- Biodefense
- Public health
- Risk assessment
- Molecular epidemiology
- Biotechnology governance
- Pandemic preparedness
- Emerging infectious disease programs
- Infectious disease surveillance
- Outbreak response
Location
- San Francisco, CA
Work Type
- In-person
- Fully remote
Salary/Compensations
- $120k–$180k (base + performance pay that scales with output)
Benefits
- Equity
- 100% premium-covered Blue Shield Platinum health plan ($0/$0)
- Unlimited PTO
- Visa sponsorship available
About the Company
- At LatchBio, we build the benchmarks that frontier AI labs use to evaluate and train models on biological reasoning.
