Impress employers and recruiters.
Choose from hundreds of resume examples.
Impress employers and recruiters.
Choose from hundreds of resume examples.
Tailor your resume to this Principal AI Evaluations Platform Engineer role.
Rezi rewrites your resume against Microsoft AI's job description. Free.
Tailor your resume to this Principal AI Evaluations Platform Engineer role.
Rezi rewrites your resume against Microsoft AI's job description. Free.
Don't guess if your resume is good enough.
See how it scores against the Principal AI Evaluations Platform Engineer posting at Microsoft AI — free, in seconds.
Don't guess if your resume is good enough.
See how it scores against the Principal AI Evaluations Platform Engineer posting at Microsoft AI — free, in seconds.
About the Role
Microsoft AI is seeking an experienced engineer to help build and operate the evaluation platform that supports large-scale model training and development. This role will work closely with researchers and training teams across European offices to ensure evaluations are reliable, efficient, and available when teams need them.
Responsibilities
- Serve as a primary engineer for the evaluation platform during European hours, providing dedicated coverage for the evaluation stack supporting large-scale model training.
- Develop and extend core evaluation platform capabilities, including benchmark configurations, problem sets, graders, and evaluation runners.
- Improve evaluation throughput and scheduling efficiency.
- Build and maintain monitoring, alerting, and dashboards to proactively detect evaluation degradation.
- Partner closely with researchers and training teams across European offices to define evaluation requirements, coordinate launches, and unblock experiments.
- Contribute to technical design and code reviews across the evaluation platform stack, and maintain high-quality operational documentation and on-call runbooks.
- Embody our culture and values.
Requirements
- Bachelor's Degree in Computer Science, Engineering, Mathematics, or a related field AND 4+ years of technical engineering experience with coding in languages including, but not limited to, Python, C++, Go, or Rust; OR Master's Degree in Computer Science, Engineering, Mathematics, or a related field AND 2+ years of technical engineering experience with coding in languages including, but not limited to, Python, C++, Go, or Rust; OR equivalent experience.
- Demonstrated experience operating production distributed systems, including participation in a formal on-call rotation.
- Strong proficiency in Python, including experience working in a large, shared, typed codebase.
- Experience debugging distributed system failures across the stack, including scheduling, resource exhaustion, networking, and process-level faults.
- Willingness and availability to participate in a scheduled on-call rotation covering European business hours.
Skills
- Python
- C++
- Go
- Rust
- GPU-based workloads
- distributed training
- large-scale inference infrastructure
- distributed compute frameworks
- schedulers
- Kubernetes
- Slurm
- observability
- alerting tooling
- Datadog
- Prometheus
- Grafana
- LLM evaluation
- benchmarking
- reinforcement learning training infrastructure
Location
- London, U.K.
- Zurich, Switzerland
Work Type
- Hybrid (work in office four days per week)
Experience Level
- 4+ years of technical engineering experience
- 2+ years of technical engineering experience
Education Level
- Bachelor's Degree in Computer Science, Engineering, Mathematics, or a related field
- Master's Degree in Computer Science, Engineering, Mathematics, or a related field
Salary/Compensations
- CHF 183,800.00 - CHF 309,700.00 per year
Benefits
- Certain roles may be eligible for benefits and other compensation.
About the Company
- Microsoft's mission is to empower every person and every organization on the planet to achieve more.
- As employees, we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals.
- Each day, we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Equal Opportunity
- Microsoft is an equal opportunity employer.
- All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances.
- If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.