Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now

Tailor your resume to this Lead Research Engineer – AI Evaluation & Benchmarking role.

Rezi rewrites your resume against Thomson Reuters's job description. Free.

Resume score gauge reading 58 out of 100

Don't guess if your resume is good enough.

See how it scores against the Lead Research Engineer – AI Evaluation & Benchmarking posting at Thomson Reuters — free, in seconds.

About the Role

Thomson Reuters Labs is seeking a Lead Research Engineer to lead the design and delivery of production-ready software for AI model evaluation and benchmarking. You will build scalable evaluation infrastructure that enables research and product teams to compare LLMs, measure quality, cost, and latency, and make informed decisions about model selection and development. You will own the engineering approach from early prototypes through reliable, maintainable tools, collaborating closely with research scientists, engineering teams, and product partners while helping shape technical direction and engineering delivery.

Responsibilities

Lead technical delivery and engineering planning, including defining priorities, breaking projects into stages, estimating effort, recommending staffing, and adapting plans.
Design and build scalable evaluation infrastructure, extending existing tools and developing production-quality Python software, APIs, and frameworks.
Turn research methods into working software by building automated evaluation pipelines for comparing LLMs and other AI models.
Ensure reliable and reproducible model comparisons by maintaining repeatable experiments and traceable results.
Build practical tools for researchers and product teams, including user interfaces, documentation, and diagnostic capabilities.
Own production reliability, performance, and responsible data use, integrating automated testing, deployment, and monitoring.
Collaborate, mentor, and guide engineering decisions, aligning interfaces and delivery plans with cross-functional teams.

Requirements

8-10+ years of relevant software engineering experience, including building and maintaining production systems involving machine learning or complex data.
Strong hands-on Python programming skills, including API design, automated testing, and working with structured and unstructured data.
Technical leadership and end-to-end delivery experience, including architecture decisions, engineering planning, and project execution.
Experience collaborating with research scientists or machine learning practitioners to translate experiments into working software.
Experience integrating or testing machine learning models, interpreting evaluation results, and applying findings to engineering decisions.
Understanding of language models and the ability to recognize unreliable comparisons or test-data leakage.
Cloud engineering experience using AWS, Azure, or a comparable platform.
Working knowledge of SQL and experience developing software that processes structured and unstructured data.
Strong collaboration, communication, problem-solving, and mentoring skills.
Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.

Skills

Python programming
API design
Automated testing
Structured data
Unstructured data
Machine learning
Cloud engineering (AWS, Azure)
Distributed workflows
Automated deployment
Monitoring
SQL
Collaboration
Communication
Problem-solving
Mentoring

Location

New York City, NY
San Francisco, CA
Los Angeles, CA
Irvine, CA
McLean, VA
Washington, DC
Ontario, Canada

Work Type

Hybrid
Remote (up to 8 weeks per year)

Experience Level

Lead
8-10+ years of relevant software engineering experience

Education Level

Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.

Salary/Compensations

$146,800 USD - $272,600 USD (US locations)
$127,400 USD - $236,600 USD (Other US locations)
$140,000 CAD - $175,000 CAD (Ontario, Canada)

Benefits

Hybrid Work Model
Flexibility & Work-Life Balance (Flex My Way, work from anywhere up to 8 weeks/year)
Career Development and Growth (Grow My Way programming)
Industry Competitive Benefits (flexible vacation, Mental Health Days off, Headspace app access, retirement savings, tuition reimbursement, employee incentive programs)
Globally recognized, award-winning reputation for inclusion and belonging
Social Impact opportunities (two paid volunteer days off annually, pro-bono consulting, ESG initiatives)
Market competitive health, dental, vision, disability, and life insurance programs
Competitive 401k plan with company match
Competitive vacation, sick and safe paid time off, paid holidays
Parental leave, sabbatical leave
Optional hospital, accident and sickness insurance
Optional life and AD&D insurance
Flexible Spending and Health Savings Accounts
Fitness reimbursement
Employee Assistance Program
Group Legal Identity Theft Protection
529 Plan
Commuter benefits
Adoption & Surrogacy Assistance
Tuition Reimbursement
Employee Stock Purchase Plan

About the Company

Thomson Reuters informs the way forward by bringing together trusted content and technology for decision-making.
Serves professionals across legal, tax, accounting, compliance, government, and media.
Combines specialized software and insights to empower professionals and institutions.
Reuters is a world leading provider of trusted journalism and news.
Powered by 26,000 employees across more than 70 countries.
Committed to objectivity, accuracy, fairness, and transparency.
More information can be found on thomsonreuters.com.

Equal Opportunity

As a global business, we rely on the unique backgrounds, perspectives, and experiences of all employees to deliver on our business goals.
We seek talented, qualified employees in all our operations around the world regardless of race, color, sex/gender, including pregnancy, gender identity and expression, national origin, religion, sexual orientation, disability, age, marital status, citizen status, veteran status, or any other protected classification under applicable law.
Thomson Reuters is proud to be an Equal Employment Opportunity Employer providing a drug-free workplace.
Thomson Reuters makes reasonable accommodations for applicants with disabilities, including veterans with disabilities, and for sincerely held religious beliefs in accordance with applicable law.
In the United States, Thomson Reuters offers a comprehensive benefits package to our employees.