About the Role
JetBrains Research is seeking a Senior Research Engineer to focus on Code World Models, which learn how software systems behave, change, execute, and interact with developer tools. This role is centered on model pre-training and mid-training for code-centric foundation models, involving data, training pipelines, evaluation, and experiments to enhance model understanding of programs and workflows.
Responsibilities
- Design and run pre-training, continued pre-training, and mid-training experiments for code models.
- Build and improve data pipelines for large-scale model training, including filtering, deduplication, mixture design, and dataset quality checks.
- Work with code corpora, repositories, tests, execution traces, and synthetic data.
- Develop evaluations for complex repository-level code reasoning tasks.
- Collaborate with researchers and engineers working on ML for code and AI developer tools.
Requirements
- Hands-on experience with model pre-training, continued training, or mid-training.
- Strong engineering skills in Python and experience with modern ML frameworks.
- Understanding of large-scale ML training workflows, including data processing, distributed training, checkpointing, evaluation, experiment tracking, and debugging.
- Experience working with large datasets and attention to data quality, contamination, sampling, and reproducibility.
- Background in NLP, ML for software engineering, or a similar domain.
- Enjoyment of working on research problems with high uncertainty and turning ideas into working experiments.
Skills
- Python
- Modern ML frameworks
- Large-scale ML training workflows
- Data processing
- Distributed training
- Checkpointing
- Evaluation
- Experiment tracking
- Debugging
- Large datasets
- Data quality
- Contamination
- Sampling
- Reproducibility
- NLP
- ML for software engineering
Location
- Remote
Work Type
- Full-time
Experience Level
- Senior
About the Company
- JetBrains is a global software company that creates intelligent tools for software developers and teams.
- Since 2000, JetBrains has built products that help developers work more productively, write higher-quality code, and stay focused on solving real problems.
Equal Opportunity
- We are an equal opportunity employer.
- We know great ideas can come from anyone, anywhere. That’s why we do our best to create an open and inclusive workplace – one that welcomes everyone regardless of their background, identity, religion, age, accessibility needs, or orientation.
- We process the data provided in your job application in accordance with the Recruitment Privacy Policy.
