Impress employers and recruiters.
Choose from hundreds of resume examples.

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now

About the Role

We are seeking the first dedicated QA Engineer for our AI products. This role involves standardizing and automating evaluation workflows to improve product quality, working closely with product development, MLOps, and data engineers to refine the entire feedback loop. The goal is to build a practical quality feedback loop led by QA, even with limited user feedback.

Responsibilities

• Define quality dimensions for AI products, including accuracy, consistency, safety, fairness, and UX.
• Conduct scenario-based testing, exploratory testing, and red teaming.
• Analyze LLM outputs to identify behavioral trends and failure patterns.
• Design quality evaluation processes using user feedback such as logs, ratings, and inquiries.
• Standardize evaluation processes and structure them in a reusable, scalable manner.
• Automate quality evaluation workflows.
• Collect and aggregate evaluation data.
• Establish mechanisms for continuous and recurring quality checks.
• Build and operate quality feedback loops in collaboration with development, MLOps, and data engineering teams.
• Document quality issues and risks, and communicate them clearly to relevant teams.

Requirements

• 3+ years experience in QA or testing with products that use LLMs.
• Experience in test design, including defining test perspectives and creating test cases.
• Ability to evaluate systems with ambiguous specifications or non-unique “correct” answers by establishing clear judgment criteria.
• Experience automating test or evaluation processes.
• Experience collaborating with development teams to drive quality improvements.
• Business-level proficiency in both English and Japanese.

Skills

• Natural language processing
• Japanese language

Location

• Hybrid

Work Type

• Hybrid

Experience Level

• 3+ years

Salary/Compensations

• Competitive Salary - Based on experience

Benefits

• Flexible working time
• 20 days paid holiday per year (prorated)
• 6 days sick leave per year (prorated)
• Japanese Social Insurance (Health Insurance, Pension, Workers’ Comp, and Unemployment Insurance, Long-term care insurance)
• Housing Allowance
• Retirement Benefits
• Rental Cars Support
• In-house Training Program (software study/language study)

About the Company

• Woven by Toyota is enabling Toyota’s once-in-a-century transformation into a mobility company.
• Inspired by a legacy of innovating for the benefit of others, our mission is to challenge the current state of mobility through human-centric innovation — expanding what “mobility” means and how it serves society.
• Our work centers on four pillars: AD/ADAS, our autonomous driving and advanced driver assist technologies; Arene, our software development platform for software-defined vehicles; Woven City, a test course for mobility; and Cloud & AI, the digital infrastructure powering our collaborative foundation.
• Business-critical functions empower these teams to execute, and together, we’re working toward one bold goal: a world with zero accidents and enhanced well-being for all.
• Toyota is redefining what it means to move. We're challenging the current state of mobility by enhancing the movement of people, goods, information and energy.
• Centered around three core concepts - A Living Laboratory™, Human-Centered, and Ever Evolving City™ - Woven City serves as a test course for mobility to fulfill our purpose of well-being for all.
• We do this by bringing together a diverse community of people with a shared passion for the future of mobility to co-create, develop and refine innovative products and services.
• This cross-section of social infrastructure, mobility, and people provides a unique opportunity for inventors, residents and visitors to interact seamlessly with new technologies throughout daily life in an environment that emulates a real city.
• For more information about Woven City, please visit: https://www.woven-city.global/

Equal Opportunity

• We are an equal opportunity employer and value diversity.
• Any information we receive from you will be used only in the hiring and onboarding process. Please see our privacy notice for more details.