Impress employers and recruiters.
Choose from hundreds of resume examples.
Impress employers and recruiters.
Choose from hundreds of resume examples.
Tailor your resume to this Senior AI Quality Engineer role.
Rezi rewrites your resume against R/GA Careers Page's job description. Free.
Tailor your resume to this Senior AI Quality Engineer role.
Rezi rewrites your resume against R/GA Careers Page's job description. Free.
Don't guess if your resume is good enough.
See how it scores against the Senior AI Quality Engineer posting at R/GA Careers Page — free, in seconds.
Don't guess if your resume is good enough.
See how it scores against the Senior AI Quality Engineer posting at R/GA Careers Page — free, in seconds.
About the Role
Ensure high-quality AI solutions through methodical testing and collaboration with engineering. This role requires a test-and-verify mindset, exploring system architecture, writing test plans, and analyzing results to ensure quality. You will stress-test AI systems under various conditions, evolving quality into a measurable discipline with a structured adversarial mindset.
Responsibilities
- Translate product and technical requirements into structured test plans covering functional behavior, edge cases, failure modes, and AI-specific risks.
- Write test scripts, set up logging frameworks, and analyze agent behavior to identify failure points and improvement opportunities.
- Systematically red-team AI systems before launch, probing LLM behaviors, agent decision chains, and multi-model pipelines for failure modes.
- Act as the quality gate on launches, raising blockers, documenting failure cases, and upholding ship criteria.
- Build and maintain lightweight evaluation frameworks and test harnesses for recurring system types to systematize QA and red teaming practices.
- Develop shared quality standards for AI systems across the project portfolio.
- Document failure patterns, red team findings, and test results in an actionable format for engineers and PMs.
- Trace tool interactions across reasoning steps to pinpoint root causes of failures.
Requirements
- 4+ years of software QA, test engineering, or quality engineering experience.
- 1–2 years of experience working on AI-powered or LLM-based systems.
- Deep familiarity with failure modes specific to generative AI systems (hallucination, prompt injection, context window degradation, inconsistent persona adherence, retrieval errors, agent loop failures, non-determinism, temperature, retrieval mechanics, context windows, grounding, and context adherence).
- Ability to read code and understand system architecture to write meaningful test plans and probe system seams.
- Experience writing structured test plans and evaluation criteria, including trajectory-level assessment of multi-step reasoning and judgment.
- Hands-on fluency with AI development tools, agent frameworks, and prompt engineering.
- Comfort operating with modern collaboration tools (e.g., Notion, Google Workspace, Figma/FigJam, Slack) and AI capabilities.
Skills
- AI Quality Engineering
- Test Planning
- Agentic Testing
- AI Red Teaming
- Launch Gating
- Regression & Evaluation Frameworks
- Cross-Project Quality Standards
- Tracing and Documentation
- Problem Solving
- Adaptability
- Adversarial Mindset
- Collaboration
- Communication (Written and Verbal)
- Curiosity
- Forward-Thinking
- Prompt Engineering
- AI Development Tools
- Agent Frameworks
Location
- NYC / Tri-State Area
- Greater Los Angeles Area
- San Francisco Bay Area
Work Type
- Hybrid
Experience Level
- Senior
Salary/Compensations
- $135,000 to $150,000
About the Company
- Addition is R/GA's applied intelligence studio, working with leading brands to solve problems at the intersection of frontier AI and human-centered design.
- R/GA is an award-winning product and marketing agency with design, technology, communications, ventures, and IP practices, known for creating meaningful and memorable experiences across digital platforms.
- R/GA believes disruptive thinking happens when experts in design, technology, and culture collide.