Impress employers and recruiters.
Choose from hundreds of resume examples.

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now

About the Role

We're looking for an AI QA Engineer to work across product quality, AI behaviour evaluation, and defect investigation. This role involves reviewing AI agent conversations, assessing responses for accuracy and appropriateness, and supporting release testing. You will also investigate production and customer-reported issues, identify problem types, and escalate defects to engineering teams.

Responsibilities

• Review AI agent conversations and assess response accuracy, appropriateness, and alignment with expected customer experience.
• Support release testing and regression prevention across the platform.
• Carry out structured manual QA across key journeys during release cycles.
• Improve automated coverage and refine QA processes outside of release periods.
• Investigate product or AI-related issues raised internally.
• Investigate production and customer-reported issues.
• Identify whether problems are expected behaviour, configuration issues, or genuine defects.
• Escalate clear issues to engineering teams.

Requirements

• Strong manual QA experience.
• Experience building or maintaining automated test coverage.
• Solid, hands-on experience working within an agentic software delivery lifecycle.
• Comfortable with tooling, workflows, and quality considerations specific to agentic systems.
• Strong written English and communication skills.
• Ability to assess nuanced conversations and provide clear feedback.
• Confidence investigating issues independently and making sound judgement calls.
• Ability to think on your feet and reason about unfamiliar problem domains.

Skills

• AI behaviour evaluation
• Defect investigation
• Manual QA
• Automated test coverage
• Agentic software delivery lifecycle
• Agentic systems
• Communication skills
• Judgement
• Attention to detail

Location

• UK-based applicants only
• Within 30 miles of Edinburgh
• Within 30 miles of Newcastle
• Within 30 miles of Leeds
• Within 30 miles of Manchester
• Within 30 miles of London

Work Type

• Full-time Contract
• Flexible (remote, hybrid, or in-office)

Experience Level

• Strong manual QA experience
• Experience building or maintaining automated test coverage
• Solid, hands-on experience working within an agentic software delivery lifecycle

Benefits

• Varied role combining QA, AI evaluation, automation improvement, and product investigation.
• Opportunity to work on AI-driven products where quality depends on judgement and context.
• Real ownership over how quality processes evolve.
• Exposure to modern AI and agentic systems in a production environment.
• Chance to work closely with Product, Engineering, and AI teams on complex problems.

About the Company

• A digital product consultancy with 20 years of experience.
• Helping organisations solve complex problems through technology, design, and delivery.