Impress employers and recruiters.
Choose from hundreds of resume examples.
Impress employers and recruiters.
Choose from hundreds of resume examples.
Tailor your resume to this Senior Test Engineer - Metrics Quality role.
Rezi rewrites your resume against Avride's job description. Free.
Tailor your resume to this Senior Test Engineer - Metrics Quality role.
Rezi rewrites your resume against Avride's job description. Free.
Don't guess if your resume is good enough.
See how it scores against the Senior Test Engineer - Metrics Quality posting at Avride — free, in seconds.
Don't guess if your resume is good enough.
See how it scores against the Senior Test Engineer - Metrics Quality posting at Avride — free, in seconds.
About the Role
You will own the quality of the metrics themselves. Our data scientists build them; you decide whether they can be trusted before release decisions are made. This role requires understanding the metric's implementation, the product, and the users' needs to identify potential issues.
Responsibilities
- Own the acceptance of new and changed metrics, ensuring they count what they should and that the implementation aligns with expectations.
- Build and maintain the case space for each metric, covering all situations it must handle, including those where it should remain silent.
- Hunt for silent failures where a metric should report a defect but does not.
- Read the implementation against the case space to identify unhandled real-world situations.
- Build necessary test data, sourcing it efficiently and seeking better methods.
- Present findings to engineers with concrete examples and impact analysis.
- Consider the perspective of metric consumers to ensure metrics reveal degradations across datasets.
- Own the release cycle for metrics, qualifying each release and maintaining regressions.
- Improve the speed and cost-efficiency of the metrics release cycle.
Requirements
- 6+ years in software testing or test engineering, with depth in data-heavy or analytical systems.
- Strong Python and SQL skills for analysis scripts and independent reference computations.
- Statistical literacy, including distributions, variance, sample size, and aggregation traps.
- Product thinking: understanding the purpose of a number before testing it.
- Conviction to challenge assumptions and see findings through with evidence.
- Fluent use of LLMs as a working tool for analysis, test-data generation, code reading, and reasoning.
- Clear written English for communicating findings to stakeholders.
Skills
- Python
- SQL
- Statistical analysis
- LLM usage
- Written communication
Location
- US
Work Type
- Onsite
Experience Level
- Senior
About the Company
- Avride is developing autonomous driving software.
- The QA organization is critical for ensuring the reliability of metrics used in decision-making.
Equal Opportunity
- Avride is an equal opportunity employer.
- Committed to providing reasonable accommodations to qualified applicants and employees with disabilities.
- Complies with the Americans with Disabilities Act (ADA).