Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now

About the Role

We are seeking an experienced QA Automation Engineer to ensure the quality, reliability, and performance of AI-powered applications. The ideal candidate has expertise in automated testing and software quality engineering, with experience building scalable testing frameworks and leveraging AI-powered testing tools to improve test development, maintenance, and coverage. They combine deep QA automation expertise with practical experience using AI to enhance testing workflows. Experience testing AI/ML applications or validating machine learning models is an asset.

Responsibilities

Design and maintain automated test suites, evaluation scenarios, metrics, and test datasets for AI-powered features
Automate QA workflows using Python and CI/CD (e.g., GitHub Actions, Jenkins), leveraging AI-powered testing tools to improve test development, maintenance, and coverage
Create and maintain test harnesses for AI services, applications, and APIs
Perform API testing for AI services and backend systems
Define quality strategy and acceptance criteria for AI-powered applications across functional, API, integration, and AI/ML features
Test AI/ML applications and machine learning models from a product and user perspective
Evaluate AI/ML model outputs for correctness, consistency, and expected application behavior
Define structured rubrics that translate qualitative findings into measurable evaluation gates
Build quality gates for CI/CD and deployment pipelines, including automated regression and integration testing
Mentor teams on QA automation best practices and consistent quality standards for AI-powered applications
Contribute to multi-team projects and codebases, ensuring code quality and consistency
Participate in code reviews and provide constructive feedback to peers
Document and present findings and ideas across the company

Requirements

Bachelor’s degree in Computer Science, Engineering, or equivalent experience
5+ years of professional experience in software quality assurance, test automation, or software engineering
Strong programming skills in Python, with experience in test automation
Hands-on experience using AI-powered testing tools or AI coding assistants to improve test automation, productivity, and quality
Experience with CI/CD tools and processes
Familiarity with popular CAD environments and tooling
Proficient in automation and UAT test suites/frameworks
Experience designing QA frameworks or platforms used by multiple teams
Excellent problem-solving skills and attention to detail
Strong communication and collaboration skills
Understanding of software architecture and design patterns
Ability to work in an Agile development environment

Skills

Python
CI/CD
GitHub Actions
Jenkins
API testing
AI/ML applications
Machine learning models
Data validation tooling
Great Expectations
Labeling workflows
ML frameworks
PyTorch
TensorFlow
Data pipelines
Orchestration tools
Airflow
Metaflow
MLOps practices
Model monitoring
Drift detection
Deployment validation
ML evaluation methods
Metrics
Benchmarking
Cloud providers
AWS
Azure
Google Cloud Platform
Experiment tracking tools
Comet
MLflow
Weights & Biases
Automation
UAT test suites/frameworks
QA frameworks
QA platforms

Location

Work Type

Full-time

Experience Level

Senior
5+ years of professional experience

Education Level

Bachelor’s degree in Computer Science, Engineering, or equivalent experience

Benefits

Annual cash bonuses
Stock grants
Comprehensive benefits package

About the Company

Welcome to Autodesk! Amazing things are created every day with our software – from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made. We take great pride in our culture here at Autodesk – it’s at the core of everything we do. Our culture guides the way we work and treat each other, informs how we connect with customers and partners, and defines how we show up in the world. When you’re an Autodesker, you can do meaningful work that helps build a better world designed and made for all. Ready to shape the world and your future? Join us!

Equal Opportunity

We take pride in cultivating a culture of belonging where everyone can thrive.