About the Role
Scale works with leading AI labs to provide high-quality data and accelerate GenAI research. This role focuses on optimizing data curation and evaluation to enhance LLM capabilities in text and multimodal modalities, developing novel methods for alignment and generalization, and collaborating with researchers and engineers on best practices in data-driven AI development.
Responsibilities
- Research and develop novel post-training techniques, including SFT, RLHF, and reward modeling, to enhance LLM core capabilities in both text and multimodal modalities.
- Design and experiment with new approaches to preference optimization.
- Analyze model behavior, identify weaknesses, and propose solutions for bias mitigation and model robustness.
- Publish research findings in top-tier AI conferences.
Requirements
- Ph.D. or Master's degree in Computer Science, Machine Learning, AI, or a related field.
- Deep understanding of deep learning, reinforcement learning, and large-scale model fine-tuning.
- Experience with post-training techniques such as RLHF, preference modeling, or instruction tuning.
- Excellent written and verbal communication skills.
- Published research in areas of machine learning at major conferences (NeurIPS, ICML, ICLR, ACL, EMNLP, CVPR, etc.) and/or journals.
- Previous experience in a customer-facing role.
Skills
- LLM post-training
- SFT
- RLHF
- Reward modeling
- Data curation
- Data evaluation
- Text modalities
- Multimodal modalities
- Deep learning
- Reinforcement learning
- Large-scale model fine-tuning
- Preference optimization
- Bias mitigation
- Model robustness
Location
- San Francisco
- New York
- Seattle
Work Type
- Full-time
Education Level
- Ph.D. or Master's degree in Computer Science, Machine Learning, AI, or a related field.
Salary/Compensations
- $180,600—$225,750 USD
Benefits
- Comprehensive health, dental and vision coverage
- Retirement benefits
- Learning and development stipend
- Generous PTO
- Commuter stipend
About the Company
- Scale's mission is to develop reliable AI systems for the world's most important decisions.
- Their products provide high-quality data and full-stack technologies powering leading models and helping enterprises and governments build, deploy, and oversee AI applications.
- They work with industry leaders like Meta, Ernst & Young, Mayo Clinic, Time Inc., the Government of Qatar, and U.S. government agencies including the Army and Air Force.
- They are expanding their team to accelerate the development of AI applications.
Equal Opportunity
- Scale is an inclusive and equal opportunity workplace.
- They are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability status, gender identity or Veteran status.
- They are committed to working with and providing reasonable accommodations to applicants with physical and mental disabilities.
- They comply with the United States Department of Labor's Pay Transparency provision.
