Impress employers and recruiters.
Choose from hundreds of resume examples.

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now

About the Role

We seek a talented and passionate AI Engineer with proven experience building and evaluating AI-driven applications to join our dynamic AI squad. You will be a founding member of the AI team, helping to shape our evaluation culture, tooling choices, and team growth. You will work on cutting-edge agentic AI product development and evaluation, building and running evaluation pipelines for AI products, and developing an internal AI guild to ensure Paloma is an AI-native organization.

Responsibilities

• Design, develop, and maintain AI-driven applications and agents, and integrate them into existing clinical applications.
• Design and run the evaluation pipelines that gate AI outputs for quality and safety, building eval sets in partnership with clinicians, product and operations, versioning every prompt and pipeline change and measuring the effect of each change before it ships.
• Champion evaluation-driven development across the wider engineering team, helping colleagues build the same habits.
• Document code and technical specifications in line with healthcare regulatory requirements.

Requirements

• Bachelor's or Master's degree in Computer Science, Artificial Intelligence, or a related field, or equivalent practical experience.
• A track record of building AI products in a systematic, data-driven way with at least two years of industry experience or equivalent.
• Hands-on experience building and evaluating LLM-powered products that reached real users – you have owned features through the full loop of build, evaluate and improve, not just experimented with prompts.
• Excellent analytical and problem-solving skills.
• Proficiency in Python, with a strong grasp of clean, typed, tested code and good software engineering practices.
• Understanding of prompt engineering principles and techniques.
• Experience with systematic LLM evaluation techniques – for example, golden/regression datasets, LLM-as-judge pipelines, synthetic data for evaluation, structured error analysis, human-in-the-loop review with domain experts.
• Strong communication skills, including the ability to translate complex technical topics into understandable language for colleagues across product and clinical domains.
• Familiarity with Vertex AI/Gemini Enterprise and the wider Google Cloud Platform (e.g. Cloud Run, Pub/Sub, Cloud Storage).
• Experience with an LLM observability or evaluation platform such as Langfuse, LangSmith, Braintrust or Arize Phoenix.
• Understanding of MCP and integration of tools with agentic systems.
• Experience grounding LLM output in data via techniques such as RAG.
• Experience with an LLM orchestration or agent framework such as LangGraph or Agent Development Kit.
• Experience working with health data and adhering to regulatory requirements.

Skills

• Python
• Prompt Engineering
• LLM Evaluation Techniques
• Vertex AI
• Gemini Enterprise
• Google Cloud Platform
• Cloud Run
• Pub/Sub
• Cloud Storage
• LLM Observability
• Langfuse
• LangSmith
• Braintrust
• Arize Phoenix
• RAG
• LangGraph
• Agent Development Kit

Location

• London, UK
• Remote

Work Type

• Hybrid

Experience Level

• 2+ years of industry experience

Education Level

• Bachelor's or Master's degree in Computer Science, Artificial Intelligence, or a related field, or equivalent practical experience.

Salary/Compensations

• £100,000 per year

Benefits

• 5% employer pension contribution
• Equity compensation through Share Options in Paloma Health
• Optional Private Medical Insurance
• Employee Assistance Programme
• Home Office Equipment Allowance
• Professional Registration Fees Allowance for clinicians
• 37 days of annual leave (28 standard days, plus eight bank holidays, plus your birthday off)
• Option to buy an additional 5 days per year
• 2 days per year of special leave
• Premium performance company laptop
• NHS discounts, including the Blue Light Card

About the Company

• Paloma's mission is to make NHS autism and ADHD assessments and care accessible within 4 weeks of a GP referral, helping every child achieve their potential.
• Paloma has reduced wait times to 3 months by taking a product-first approach to redesign the care pathway, building in-house AI tools to free clinicians from documentation burdens, and investing in expanding the clinician workforce.
• Paloma is loved by families (4.9/5 Trustpilot and Google ratings), CQC registered, clinically-led with over 80 clinicians, and backed by leading healthcare investors.
• Paloma is a community of passionate, mission-driven, and innovative team members who challenge the status quo.

Equal Opportunity

• Paloma Health is an equal opportunity employer committed to diversity and inclusion in the workplace and throughout the application process. We do not discriminate based on any protected characteristic.
• Accommodations are available for candidates who need adjustments throughout the hiring process.
• Safer recruitment practices are in place, including Disclosure and Barring Service (DBS) checks.