Lead Software Engineer - Agent Safety at Kraken | Berlin, DEU | Rezi

Lead Software Engineer - Agent Safety at Kraken

Lead Software Engineer - Agent Safety

Kraken · Berlin, DEU

1 weeks ago

Lead Software Engineer - Agent Safety

Kraken · Berlin, DEU

12 days ago
Resume preview

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now

About the Role

As AI agents take on more autonomous tasks across Kraken's internal workflows, this role is critical to ensuring they do so securely and predictably. You will define the technical strategy for how we evaluate models, enforce safety guardrails, and govern AI behavior across internal platforms, skills, and harnesses.

Responsibilities

  • Lead the technical direction for internal agent safety, designing and implementing systems focused on the reliability, security, and determinism of LLMs and autonomous agents.
  • Build robust evaluation frameworks, developing scalable harnesses and evals tailored to internal workflows and skills.
  • Implement guardrails and governance, creating and enforcing pre- and post-generation guardrails, and managing the overarching governance of AI models.
  • Drive AI security and observability by building dedicated auth/permissions for internal AI agents, establishing monitoring/observability pipelines, and defining incident response protocols.
  • Lead continuous verification efforts and red teaming exercises to proactively identify vulnerabilities, prompt injections, or unpredictable behaviours.
  • Operate in AWS, deploying, running, and supporting high-throughput, low-latency safety services for internal use cases.

Requirements

  • Strong technical leadership with proven experience leading technical initiatives or teams.
  • Senior/advanced capability in designing secure components end-to-end, testing thoroughly, and reasoning heavily about system design, concurrency, and architecture tradeoffs.
  • Expertise in AI Evaluation and Safety, with a deep understanding of LLM behavior nuances.
  • Experience building harnesses to measure AI output quality reproducibly.
  • Security and Governance mindset with experience in threat modeling, authentication, red teaming, or building guardrails.
  • Comfortable running internal services, owning reliability/scalability, and collaborating with platform/techops/security partners in AWS.
  • Excellent communication skills, able to synthesize complex safety and eval metrics into actionable insights.

Skills

  • Python
  • AI Evaluation
  • AI Safety
  • LLM behavior
  • Security
  • Governance
  • AWS
  • Threat modeling
  • Authentication
  • Red teaming
  • Guardrails
  • Observability
  • Incident response
  • Verification
  • Prompt injection
  • System design
  • Concurrency
  • Architecture tradeoffs

Location

  • Remote

Work Type

  • Full-time

Experience Level

  • Lead
  • Senior
  • Advanced

About the Company

  • Kraken powers innovative global developments in energy, focusing on creating a smart, sustainable energy system.
  • Kraken is the operating system for the energy transition, helping companies transform operations for a zero-carbon future.
  • Kraken builds technology that solves real problems at scale across data, software, and AI.
  • AI is a key investment area for Kraken Technologies, with a focus on broadening foundational infrastructure for effective AI use.
  • Kraken is a certified Great Place to Work in multiple countries and recognized for its positive work environment.

Equal Opportunity

  • As an equal opportunity employer, Kraken does not discriminate on the basis of any protected attribute.
  • Kraken considers all applicants without regard to race, color, religion, national origin, age, sex, gender identity or expression, sexual orientation, marital or veteran status, disability, or any other legally protected status.