Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now

About the Role

We are looking for an Engineer with strong data engineering and AI systems experience to build the data, evaluation, and observability foundation for production-grade LLM agents used in complex audit workflows. This role sits at the intersection of backend engineering, data engineering, AI infrastructure, and LLM operations. You will work hands-on in our backend and agent architecture, building the systems that help us evaluate, monitor, debug, optimize, and continuously improve AI agents in production. This is not a traditional analytics, BI, or dashboarding role. You should expect to write production code, design infrastructure, work inside backend systems, and directly improve the quality, cost, reliability, and performance of LLM-based agents.

Responsibilities

Building online and offline evaluation systems for LLM agents, including pipelines that use golden datasets, ground-truth data, human review workflows, and experiment results.
Creating automated quality gates so changes to prompts, context, models, or agent logic can be tested before reaching production.
Analyzing large volumes of agent traces and executions to identify failure modes, quality regressions, latency issues, reliability gaps, and cost optimization opportunities.
Working with columnar data stores and analytical databases such as BigQuery, ClickHouse, or similar technologies.
Building reliable data retention and replay mechanisms for long-term analysis of production agent behaviour.
Creating observability tooling for trace analysis, experiment monitoring, production dashboards, logging, tracing, and debugging.
Working inside our core backend and agent architecture, including building new agents or improving existing agents when needed.

Requirements

Strong Python and/or backend engineering experience.
Strong SQL skills and comfort working with large datasets.
Experience deploying and operating systems in the cloud, ideally on GCP.
Practical experience designing data pipelines, ETL/ELT workflows, event-processing systems, or feedback loops for production data.
Comfort working with analytical databases, data warehouses, columnar stores, and high-volume event or trace data.
Understanding of system design, reliability, observability, monitoring, logging, debugging, and operational trade-offs.
Ability to work in complex existing systems and quickly build a mental model of how they operate.
Senior-level engineering judgment: ability to make architectural decisions, communicate trade-offs, and build extensible systems.
Comfort with ambiguity, ability to reason from first principles, and excitement to build infrastructure for AI systems actively used in production.
Experience building infrastructure around LLM-based products or agentic systems, including optimizing LLM usage, context windows, reasoning tokens, or model selection.
Experience working with production traces from complex distributed systems.
Experience building internal platforms for engineers, domain experts, or operations teams.
Familiarity with workflow orchestration systems such as Temporal or similar.
Familiarity with audit, finance, compliance, or other high-accuracy domains.
Experience in an early-stage startup or fast-moving engineering environment.

Skills

Data Engineering
AI Systems
LLM Agents
Backend Engineering
AI Infrastructure
LLM Operations
Python
SQL
GCP
ETL/ELT
Event-processing systems
Feedback loops
Analytical databases
Data warehouses
Columnar stores
Observability
Monitoring
Logging
Debugging
System Design
Retrieval Systems
Pipelines
LLM Usage Optimization
Context Window Optimization
Reasoning Token Optimization
Model Selection
Distributed Systems
Internal Platform Development
Workflow Orchestration
Temporal

Location

Berlin

Work Type

On-site
Full-time

Experience Level

Senior-level

Salary/Compensations

Competitive salary plus significant equity

Benefits

High impact & growth opportunities
Mission-driven culture
Attractive compensation
Significant equity
Personal development budget for courses and conferences
Flexible vacation
Team lunches
Retreats
Central Berlin office

About the Company

Cortea is a Berlin startup transforming audits with AI.
Our AI-powered software and specialized AI agents remove repetitive work, allowing auditors to focus on judgment.
We are backed by top-tier VCs with over 15 million funding.
We have a working product and paying customers, and are rapidly scaling.
We value first-principles thinking, speed, trust, and kindness.
We build side by side in our Berlin office.

Equal Opportunity

We’re an equal-opportunity team and encourage women and underrepresented groups to apply.