About the Role
NVIDIA is seeking an Evaluation/ML-Systems Engineer to own the measurement program for AI-powered tooling that finds, validates, and patches software vulnerabilities. This role is critical in ensuring the program's conclusions are evidence-based and reproducible, defining progress through robust benchmarks and transparent systems.
Responsibilities
- Build benchmarking and reproducibility systems.
- Define metrics and protocols for measurement.
- Map results to the code and runs that produced them.
- Ensure findings are reviewable and conclusions are traceable.
Requirements
- Bachelor's degree (or equivalent experience) with 5+ years in ML engineering or evaluation.
- Experience designing benchmarks, metrics, and statistically sound comparisons for ML systems.
- A careful, skeptical approach to metrics, baselines, and claims.
- Solid Python engineering for shared infrastructure, including experiment tracking and data pipelines.
Skills
- Python
- ML engineering
- Evaluation
- Benchmarking
- Metrics definition
- Reproducibility systems
- Data pipelines
- Experiment tracking
- Security evaluation
- Agentic systems measurement
- LLM behavior measurement
Experience Level
- 5+ years
Education Level
- Bachelor's degree or equivalent experience
Salary/Compensations
- 152,000 USD - 241,500 USD
Benefits
- Equity
- Generous benefits package
About the Company
- NVIDIA is a highly sought-after employer with dedicated people.
- We believe open-weight models are foundational to American AI leadership and cybersecurity.
- Trust in AI grows through participation, transparency, and broad scientific scrutiny.
- We have some of the most forward-thinking and versatile people in the world.
- Our engineering teams are growing fast in Confidential Computing and Data.
Equal Opportunity
- NVIDIA is committed to fostering an inclusive work environment and is proud to be an equal opportunity employer.
- We do not discriminate on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.
