About the Role
The Senior Data Engineer will be the technical owner of the ClarusONE data platform, responsible for building and delivering data pipelines, improving platform reliability, scalability, security, and quality, and shaping its future direction. This role is central to establishing engineering patterns, frameworks, and best practices to support the platform at scale, with a focus on infrastructure, deployment practices, and architecture. The engineer will operate within the ClarusONE data governance framework, ensuring data protection and traceability, and collaborate with various teams to maintain an efficient and compliant data environment, communicating effectively with business stakeholders.
Responsibilities
- Take technical ownership of platform components, ensuring quality and consistency.
- Establish, apply, and evolve engineering best practices, design patterns, and coding standards.
- Define reusable patterns and frameworks across the data platform.
- Identify opportunities to improve performance, cost efficiency, scalability, and reliability.
- Contribute to the target architecture and long-term platform direction.
- Design and build robust, scalable data pipelines using Snowflake, dbt, Airflow, ADF, and Python.
- Apply strong practices in test-driven development, monitoring, logging, and observability.
- Own complex technical solutions and problem-solving.
- Support production issues and drive root-cause improvements.
- Ensure data lineage and traceability across the data lifecycle.
- Ensure sensitive data is appropriately protected within the ClarusONE data governance framework.
- Work with IT teams to ensure solutions meet governance and compliance requirements.
- Manage the implications of production changes within a controlled release process.
- Contribute to and maintain Infrastructure as Code for the platform using Azure and AKS.
- Work within and help mature CI/CD pipelines, deployment workflows, and governance processes.
- Continuously improve how the team builds, tests, and deploys data pipelines.
- Bring forward ideas to improve the platform, tooling, and developer experience.
- Evaluate emerging technologies and contribute to adoption decisions.
- Support platform evolution, including re-architecture and migration activities.
- Support other Data Engineers by sharing best practices and technical approaches.
- Collaborate closely with Analytics & Data Insights, Software Engineering, and IT/Infrastructure.
- Present technical work and recommendations to a range of audiences.
- Build strong working relationships with business stakeholders and translate technical concepts into clear, practical terms.
Requirements
- Degree or equivalent and typically requires 7+ years of relevant experience.
- 6+ years' experience in data engineering or platform engineering, including at least 2 years at senior or lead level.
- 4+ years' experience building and maintaining CI/CD pipelines, deployment workflows, and associated governance processes.
- Advanced SQL and Python, with hands-on experience building data pipelines and transformations at scale.
- Hands-on experience with a modern cloud data stack, including Snowflake, dbt, Airflow, and Databricks, on a cloud platform (Azure preferred).
- Demonstrated experience delivering data lineage and traceability within a regulated environment.
- Experience contributing to platform migrations, re-architecture, or modernisation programmes.
- Proven ability to present technical concepts to non-technical and senior stakeholders and influence decisions.
Skills
- Snowflake
- dbt
- Airflow
- ADF
- Python
- Azure
- AKS
- SQL
- Infrastructure as Code (IaC)
- CI/CD pipelines
- Test-driven development
- Monitoring
- Logging
- Observability
- Data lineage
- Data traceability
- PySpark
Location
- UK
Work Type
- Hybrid
Experience Level
- Senior
- Lead
Education Level
- Bachelor's degree level or above
About the Company
- McKesson has become aware of online recruiting-related scams in which individuals who are not affiliated with or authorized by McKesson are using McKesson’s (or affiliated entities, like CoverMyMeds or RxCrossroads) name in fraudulent emails, job postings or social media messages.
- McKesson Talent Advisors will never solicit money or credit card information in connection with a McKesson job application.
- McKesson Talent Advisors do not communicate with candidates via online chatrooms or using email accounts such as Gmail or Hotmail. Note that McKesson does rely on a virtual assistant (Gia) for certain recruiting-related communications with candidates.
- McKesson job postings are posted on our career site: careers.mckesson.com.
