About the Role
You will build the platform infrastructure that powers three AI products for banks, insurers, and health plans. This includes the model gateway, agent runtime, evaluation infrastructure, guardrail engine, and shared services. The role involves production infrastructure for regulated industries, leveraging AI for development and aiming to serve frontier models, close the loop from production feedback to reinforcement learning, and train custom LLMs and SLMs.
Responsibilities
- Own one or more platform components end-to-end, including model gateway, agent runtime and orchestration, evaluation harness, guardrail engine, tool and agent registry, or shared product services.
- Manage the training and adaptation loop, including pipelines for reinforcement learning and fine-tuning datasets, and the infrastructure for training, evaluating, and serving NewCo-tuned LLMs and SLMs.
- Ensure the reliability, latency, and cost-effectiveness of built components.
- Develop self-service surfaces for product engineers, including documentation and sensible defaults.
- Collaborate with product teams to build new shared services, embedding them with product lines before graduating them to platform services.
Requirements
- Strong production engineering skills with Python and a systems language (Go or Rust).
- Experience with Kubernetes and infrastructure-as-code.
- Proficiency in at least one major cloud platform.
- Hands-on experience with LLM infrastructure, including model gateway patterns, model serving, and vector or retrieval systems.
- Agent-systems experience with an agent orchestration framework and understanding of tool calling and the Model Context Protocol (MCP).
- Experience with evaluation engineering, including building or operating eval harnesses.
- Fluency in post-training activities such as fine-tuning or post-training a model, building data pipelines, or reproducing recent paper techniques in production.
- Daily, hands-on use of AI coding assistants in your development workflow.
Skills
- Python
- Go
- Rust
- Kubernetes
- Infrastructure-as-code
- Cloud platforms
- LLM infrastructure
- Model gateway patterns
- Model serving
- Vector systems
- Retrieval systems
- Agent orchestration frameworks
- Tool calling
- Model Context Protocol (MCP)
- Evaluation engineering
- Fine-tuning
- Post-training
- AI coding assistants
Location
- Hybrid
Work Type
- Hybrid
Experience Level
- Senior
Benefits
- Core and flexible benefits
- Peer Recognition Portal called Applaud
- Accredited Great Place to Work for Wellbeing in 2024
- Trained Mental Health Champions
- Wellbeing apps such as Thrive and Peppy
- Learning for life mindset
- Countless training and development opportunities
- Access to 250,000 courses
- External certifications from AWS, Microsoft, Harvard ManageMentor, Cybersecurity qualifications
About the Company
- [NewCo] is a new AI-native product organisation within Capgemini Financial Services that builds software products for insurance claims, payment operations, and health operations.
- Capgemini is an AI-powered global business and technology transformation partner, delivering tangible business value.
- With a heritage of nearly 60 years, Capgemini is a responsible and diverse group of 420,000 team members in more than 50 countries.
- Capgemini reports 2024 global revenues of €22.1 billion.
Equal Opportunity
- We are a Disability Confident Employer
- Capgemini is proud to be a Disability Confident Employer (Level 2) under the UK Government’s Disability Confident scheme.
- As part of our commitment to inclusive recruitment, we will offer an interview to all candidates who declare they have a disability and meet the minimum essential criteria for the role.
- Please opt in during the application process.
