About the Role
We are seeking a Clinical Research Scientist to develop advanced evaluations for AI systems in mental health and other sensitive clinical areas. This role involves designing clinician-informed benchmarks, creating new evaluation methodologies, and building datasets to assess AI behavior in realistic interactions. The position blends clinical research, behavioral science, and AI evaluation, offering opportunities for publication and collaboration with leading academic institutions.
Responsibilities
- Design clinician-informed benchmarks, datasets, and evaluation methods for AI systems used in mental health and other clinically sensitive domains.
- Design and conduct validation studies to ensure benchmark performance reflects real-world model behavior.
- Partner with psychologists, psychiatrists, researchers, and academic collaborators to identify important evaluation problems and translate them into rigorous benchmarks.
- Build collaborative research projects with universities, hospitals, and nonprofit organizations.
- Analyze model behavior, publish research findings, and communicate results through technical reports and presentations.
- Collaborate with research engineers to implement large-scale evaluation pipelines and benchmark infrastructure.
- Help shape our research agenda in mental health AI evaluation and identify emerging research directions.
Requirements
- PhD, PsyD, MD, or equivalent research experience in Clinical Psychology, Psychiatry, Behavioral Science, Public Health, or a related field.
- Demonstrated experience designing and leading research projects, including study design, data collection, statistical analysis, and scientific writing.
- Track record of publishing independent research in peer-reviewed journals or conferences.
- Demonstrated ability to initiate and lead collaborative research with external partners, including universities, hospitals, or other research organizations.
- Strong understanding of behavioral research methods, human subjects research, survey design, psychometrics, qualitative or quantitative methods, or clinical study design.
- Excellent written and verbal communication skills, including experience presenting research to diverse audiences.
Skills
- Clinical Psychology
- Psychiatry
- Behavioral Science
- Public Health
- Research project design
- Study design
- Data collection
- Statistical analysis
- Scientific writing
- Behavioral research methods
- Human subjects research
- Survey design
- Psychometrics
- Qualitative methods
- Quantitative methods
- Clinical study design
- AI evaluation
- Large language models
- Longitudinal studies
- Conversation analysis
- Real-world behavioral datasets
- IRB management
- Multi-site studies
- Inter-institutional collaboration
Location
- Remote
Work Type
- Full-time
Experience Level
- PhD
- MD
- PsyD
- Equivalent research experience
Education Level
- PhD
- MD
- PsyD
- Equivalent research experience
Salary/Compensations
- Highly competitive salary
Benefits
- Meaningful ownership
- Relocation and transportation support
- Health/dental insurance coverage
- Lunch and dinner provided
- Free snacks/coffee/drinks
- Unlimited PTO
- Opportunity to publish and present your work
About the Company
- The core methodology behind this platform originates from NLP evaluation research conducted at Stanford.
- The company raised a $5M seed round from prominent investors.
- The team comprises individuals with prior experience at NVIDIA, Meta, Microsoft, Palantir, and HRT.
- The team has collectively published over 300 citations.
- The early team includes Stanford PhDs, ex-Jane Street quants, and the first designer at Snorkel.
- The tech stack includes Python, Django, React, and AWS with CDK for Infrastructure as Code.
