Impress employers and recruiters.
Choose from hundreds of resume examples.
Impress employers and recruiters.
Choose from hundreds of resume examples.
Tailor your resume to this Research Engineer - Pretraining Data role.
Rezi rewrites your resume against Prime Intellect's job description. Free.
Tailor your resume to this Research Engineer - Pretraining Data role.
Rezi rewrites your resume against Prime Intellect's job description. Free.
Don't guess if your resume is good enough.
See how it scores against the Research Engineer - Pretraining Data posting at Prime Intellect — free, in seconds.
Don't guess if your resume is good enough.
See how it scores against the Research Engineer - Pretraining Data posting at Prime Intellect — free, in seconds.
About the Role
Prime Intellect is building the open superintelligence stack, providing infrastructure for ambitious AI teams. Our platform unifies compute, environments, evaluations, secure sandboxes, high-performance training, and deployment for post-training at frontier scale. We are developing open frontier AI, including open-source models and the platform used to build them. We seek individuals passionate about building at the intersection of frontier research, real infrastructure, and go-to-market for a nascent category.
Responsibilities
- Find, evaluate, and collect valuable training data from web, code, and technical sources.
- Build scalable pipelines for data extraction, cleaning, deduplication, and filtering.
- Develop and implement data quality, coverage, and contamination checks.
- Collaborate with researchers on data mixtures and sampling strategies for pretraining and midtraining.
- Prepare and evaluate data for long-context learning, reasoning, and coding, including synthetic data.
- Conduct controlled data experiments and use model evaluations to scale successful data choices.
- Ensure large-scale data processing is efficient, reproducible, recoverable, and includes provenance and versioning.
Requirements
- Strong Python programming skills and experience building reliable data-processing or distributed systems.
- Experience managing large datasets, considering tradeoffs in storage, compute, throughput, and reproducibility.
- Ability to diagnose data quality issues and translate research goals into measurable checks and experiments.
- Comfort owning evolving technical problems end-to-end and collaborating with researchers.
Skills
- Web crawling
- Document extraction
- Code-data collection
- Large-scale corpus curation
- Deduplication
- Text classification
- Quality scoring
- Synthetic data
- Training-data contamination analysis
- Data-mixture experiments
- Curriculum learning
- Measuring dataset impact on model performance
- Language-model pretraining dataset preparation
- Continued pretraining dataset preparation
- Midtraining dataset preparation
- Distributed processing frameworks (Spark, Ray, or comparable)
- Multilingual data
- Mathematical data
- Scientific data
- Repository-level code data
- Tokenization
- Training data loaders
- Large model-training run requirements
- Data acquisition
- Scalable processing
- Data research
Location
- San Francisco
- Remote
Work Type
- Remote
- In-person
Experience Level
- Mid-level
- Senior
Salary/Compensations
- $150,000 - $350,000
Benefits
- Cash compensation including equity incentives
- Flexible work arrangements
- Visa sponsorship
- Relocation assistance
- Quarterly team off-sites
- Hackathons
- Conferences
- Learning opportunities
About the Company
- Prime Intellect is building the open superintelligence stack, the infrastructure frontier AI labs build internally, made available to every ambitious AI team.
- Our platform, Lab, unifies compute, environments, evaluations, secure sandboxes, high-performance training, and deployment into one full-stack system for post-training at frontier scale.
- We are building open frontier AI: open-source models trained end to end for long-horizon tasks like autonomous research, and the full-stack platform our own research team uses to build them.
- The next generation of AI companies, enterprises, and research teams need the ability to turn their own workflows, tools, data, and feedback loops into superintelligence they own.
- Prime Intellect has raised $150M in total funding from Founders Fund, Radical Ventures, NVIDIA, and exceptional AI, infrastructure, and enterprise operators.
- We are looking for people who want to build at the intersection of frontier research, real infrastructure, and go-to-market for a category that does not fully exist yet.