Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now

Tailor your resume to this Senior QA Engineer role.

Rezi rewrites your resume against Vanilla Steel Gmbh's job description. Free.

Resume score gauge reading 58 out of 100

Don't guess if your resume is good enough.

See how it scores against the Senior QA Engineer posting at Vanilla Steel Gmbh — free, in seconds.

About the Role

A senior, hands-on engineering role focused on ensuring the quality and accuracy of a software platform and its AI workflows. The goal is to automate the release process by verifying software execution, business data, and AI decisions for accuracy, safety, and commercial sense.

Responsibilities

Define and own the testing strategy across the platform, including unit, component, contract, integration, end-to-end, and production verification.
Develop automated test coverage for the React web app, backend APIs, services, auth, database operations, third-party integrations, email/document ingestion, background jobs, async workflows, and end-to-end journeys.
Conduct API and integration testing, focusing on schema validation, error handling, idempotency, timeouts, retries, data consistency, and tenant isolation.
Perform AI and LLM evaluations using versioned datasets, targeting extraction accuracy, matching, classification, agent decision-making, content generation, grounding, hallucination frequency, and instruction adherence.
Test agent workflows by inspecting the execution path, tool selection, argument validity, data source usage, permission adherence, recovery mechanisms, uncertainty handling, and outcome alignment with business objectives.
Utilize bounded AI agents to analyze requirements, suggest scenarios, generate tests, explore journeys, create adversarial inputs, reproduce defects, and analyze traces, while maintaining validation responsibility.
Define and maintain release readiness criteria, including critical journey success, API contract stability, accuracy thresholds, and performance limits.
Investigate regressions across various layers (browser, API, logs, agent traces, database, jobs, model outputs) and convert production failures into reproducible test cases.

Requirements

5+ years in SDET, quality engineering, test automation, or software engineering.
Strong TypeScript or Python skills with experience designing maintainable test frameworks.
Proficiency in Playwright, pytest, or comparable automation tools.
Advanced API and integration testing knowledge.
Experience defining test strategy for a platform or organization.
Experience testing asynchronous and distributed systems.
SQL, logging, and production-debugging skills.
Experience with CI/CD and automated release gates.
Strong judgment for ambiguous requirements and the ability to distinguish technical from business correctness.
EU work permission.

Skills

TypeScript
Python
Playwright
pytest
API testing
Integration testing
Test automation
Test strategy
Asynchronous systems
Distributed systems
SQL
Logging
Production debugging
CI/CD
Automated release gates
LLM evaluations
Agent evaluations
Trace-based debugging
Model-based grading
Prompt-injection
Adversarial testing
Multi-tenant SaaS
Email processing
Document processing

Location

Berlin

Work Type

Full-time

Experience Level

Senior

About the Company

A Berlin-based startup operating a leading digital-first trading company for industrial metals across Europe.
The company aims to integrate smart technology and data into the steel industry to drive decisions, transactions, and workflows.
Their technologies and services increase liquidity, accelerate transactions, reduce scrapping rates, and enhance trading convenience for hundreds of steel and metal distributors in Europe.