About the Role
Architect and build Lila's test automation platform and quality engineering practice for AI-powered scientific and lab automation products. Own the test automation system, CI/CD test infrastructure, AI-driven test tooling, and the eval discipline. This is a builder-leader role focused on driving quality vision, making build-vs-buy decisions, and leading a small team.
Responsibilities
- Architect and ship the test automation platform, including frameworks, fixtures, golden datasets, test orchestration, and reporting.
- Set standards for unit, integration, contract, end-to-end, regression, performance, and chaos testing.
- Treat platform adoption, flake rate, and time-to-signal as first-class engineering metrics.
- Own the buy/build/borrow strategy across test infrastructure, eval platforms, browser/device clouds, observability, and lab QC tooling.
- Justify choices with TCO, signal quality, integration cost, and time-to-leverage.
- Bias toward leverage: buy commodity capabilities, build differentiators.
- Own the test execution layer of CI/CD, including parallelization, caching, hermetic environments, ephemeral preview envs, and affected-only test selection.
- Build retry, quarantine, and impact-analysis systems.
- Drive change-failure rate, MTTR, Test effectiveness, pipeline efficiency, coverage, and PR-to-prod lead time as outcomes.
- Apply LLMs across the full test lifecycle: test generation, self-healing UI tests, synthesis, visual regression, and AI-assisted failure triage.
- Validate every AI-generated test through evals.
- Establish the eval discipline for Lila's AI/agent stack.
- Define and operate the quality metrics system, including quality SLOs and adoption metrics.
- Build dashboards that make quality visible from PR to executive review.
- Apply Google SRE practices to prioritize investment.
- Design the validation framework, harnesses, and contracts for lab automation QC.
- Embed ALCOA+ principles for data integrity, audit trails, and lineage.
- Partner with Research Ops on validation patterns for autonomous lab execution.
- Build a 3–5 person team of test automation engineers.
- Coach engineering teams on test design, quality investments, and adoption.
- Translate UX and customer issues into testable contracts and platform improvements.
Requirements
- 10+ years in software engineering, with 5+ years leading test automation, quality engineering, or platform/SRE-adjacent functions.
- 3+ years managing engineers, including building or scaling a team.
- Strong software architect/engineer.
- Deep CI/CD expertise.
- Demonstrated build-vs-buy judgment.
- Hands-on AI-driven test automation experience.
- Track record of standing up a test automation platform that engineering teams adopted.
- Working knowledge of Google's SRE practices.
- Metrics-driven leader who drives outcomes through platform leverage and influence.
- Customer- and UX-first instincts.
Skills
- Python
- Typescript
- GitHub Actions
- Nx
- Turborepo
- Bazel
- LLMs
- Google SRE practices
Location
- U.S.
Work Type
- Full-time
Experience Level
- Senior
- Director
Salary/Compensations
- $260,000—$390,000 USD
Benefits
- Medical, dental, and vision coverage
- Employer-paid life and disability insurance
- Flexible time off with generous company wide holidays
- Paid parental leave
- Educational assistance program
- Commuter benefits, including bike share memberships
- Company subsidized lunch program
- International benefits tailored to region
About the Company
- Lila Sciences is building Scientific Superintelligence™ to solve humankind's greatest challenges.
- We believe science is the most inspiring frontier for AI.
- LILA builds systems that can learn for themselves.
- LILA combines advanced AI models with proprietary AI Science Factory™ instruments into an operating system for science that executes the entire scientific method autonomously.
- Guided by our core values of truth, trust, curiosity, grit, and velocity, we move with startup speed while tackling problems of historic importance.
Equal Opportunity
- Lila Sciences is committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status.
- Information you provide during your application process will be handled in accordance with our Candidate Privacy Policy.
