About the Role
The Corporate Engineering AI (CE AI) team is responsible for the central enablement and platform delivery for LSEG’s internal agentic AI ecosystem. The team's mission is to scale safe, high-quality AI capabilities across the enterprise by providing shared platforms, patterns, governance, and delivery support. CE AI owns and operates core AI platforms including LSEG AI Assist, the Question Answering Service (QAS), and the Internal MCP Gateway. The team enables product engineering groups to expose knowledge, data, and actions to AI agents in a consistent, governed, and repeatable way.
Responsibilities
- Define and implement evaluation frameworks for MCP tools and Skills covering correctness, safety, and regression impact.
- Build and maintain automated test pipelines for agentic behaviours, including tool invocation and multi-step workflows.
- Evaluate and mitigate agentic failure modes such as hallucination, tool misuse, invalid inputs, and latency amplification.
- Produce testing evidence required for Permit to Build (PTB) and Permit to Operate (PTO).
- Partner with ML Engineers to embed testability and evaluation hooks into MCP servers and Skills.
- Help define the long-term quality and governance model for federated MCP contributions across LSEG.
Requirements
- Strong Python experience for test harnesses and automation.
- Experience with LLM and RAG evaluation frameworks or custom evaluation pipelines.
- Test automation expertise covering unit, integration, and regression testing.
- Understanding of agentic system risks and failure modes.
- Ability to assess solutions against governance, security, and audit expectations.
- Experience working in regulated or highly governed engineering environments.
Location
- London
Work Type
- Full-time
Experience Level
- Senior Associate
Benefits
- Healthcare
- Retirement planning
- Paid volunteering days
- Wellbeing initiatives
About the Company
- LSEG is a leading global financial markets infrastructure and data provider.
- Our purpose is driving financial stability, empowering economies and enabling customers to create sustainable growth.
- Our culture of connecting, creating opportunity and delivering excellence shapes how we think, how we do things and how we help our people fulfil their potential.
- Our Data & Analytics, Capital Markets and Post Trade divisions have a combined power that provides a comprehensive, integrated suite of trusted financial market infrastructure services to help our customers pursue their ambitions.
- LSEG is headquartered in the United Kingdom, with significant operations in 70 countries across Europe, the Middle East, Africa, North America, Latin America and Asia Pacific.
- We are proud to be an equal opportunities employer.
- We are committed to sustainability across our global business and we are proud to partner with our customers to help them meet their sustainability objectives.
- Our charity, the LSEG Foundation provides charitable grants to community groups that help people access economic opportunities and build a secure future with financial independence.
- Colleagues can get involved through fundraising and volunteering.
Equal Opportunity
- We do not discriminate on the basis of anyone’s race, religion, colour, national origin, gender, sexual orientation, gender identity, gender expression, age, marital status, veteran status, pregnancy or disability, or any other basis protected under applicable law.
- Conforming with applicable law, we can reasonably accommodate applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs.
