About the Role
We are seeking a Data Engineer with a strong background in bioinformatics and genetics to build data pipelines for Our Future Health’s Clinical Research Recruitment Service. This role offers the chance to combine genetics, bioinformatics, and modern data engineering, working with large-scale data to contribute to research aimed at improving disease prevention, detection, and treatment.
Responsibilities
- Support the build of re-usable data pipelines used to identify prospective clinical trial participants.
- Produce logic for data transformation steps as code, meeting end-user requirements and building well-curated, accessible, and quality-controlled data for analysis.
- Develop prototypes for pipelines for complex transformations drawing on existing industry and academic workflows.
- Keep abreast of best practice in data engineering across industry, research, and Government, facilitating the adoption of standards.
- Provide technical input into the upstream parts of the data pipeline, including the specification and transfer of data from data providers.
- Perform routine ad-hoc data curation activities requiring hands-on development of bespoke ETL cleaning scripts using languages such as Python.
- Work with researchers to understand data requirements and deliver the necessary data for their projects.
Requirements
- Experience building and maintaining robust, scalable, and efficient data pipelines capable of processing very large amounts of data from multiple systems using a range of technologies.
- Ability to listen to the needs of technical and business stakeholders, interpret them, and effectively manage stakeholder expectations.
- Detailed knowledge and understanding of genomic data (experience in genotyping and imputation is advantageous).
- Experience using bioinformatics file standards (VCF, BGEN etc) and tools (PLINK, bcftools, QCtools etc).
- Highly proficient in Python.
- Highly proficient in version control and Git/GitHub.
- Experience of workflow management tools, e.g. Nextflow, WDL/Cromwell, Airflow, Prefect, Dagster.
- Understanding of containerisation (e.g. Docker) and deployment (e.g. Kubernetes).
- Good understanding of cloud environments (ideally Azure), distributed computing, and scaling workflows and pipelines.
- Understanding of common data transformation and storage formats, e.g. Apache Parquet.
- Awareness of data standards such as GA4GH and FAIR.
- Experience with Spark, Databricks, data lakes.
- Follow best practices like code reviews, clean code, and unit tests.
- Experience working in an agile development team.
Skills
- Bioinformatics
- Genetics
- Genomic data
- Genotyping
- Imputation
- VCF
- BGEN
- PLINK
- bcftools
- QCtools
- Python
- Git
- GitHub
- Nextflow
- WDL/Cromwell
- Airflow
- Prefect
- Dagster
- Docker
- Kubernetes
- Azure
- Apache Parquet
- GA4GH
- FAIR
- Spark
- Databricks
- Data lakes
- Code reviews
- Clean code
- Unit tests
- Agile development
Location
- UK
- Remote
- London
Work Type
- Flexible working
- Remote working
Experience Level
- Mid-level
Salary/Compensations
- £62,000 per annum
Benefits
- Generous Pension Scheme – employer contributions of up to 12%
- 30 Days Holiday pro rata + Bank Holidays
- Enhanced Parental Leave
- Cycle to Work Scheme
- Home & Tech Savings
- EV Scheme
- £1,000 Employee Referral Bonus
- Wellbeing Support – Access to Mental Health First Aiders, 24/7 online GP services and Employee Assistance Programme
About the Company
- Our Future Health is an ambitious collaboration between the public, charity, and private sectors, designed to help people live healthier lives for longer through better prevention, earlier detection, and improved treatment of diseases.
- We will speed up the discovery of new methods of early disease detection and the evaluation of new diagnostic tools.
- With over 2.7M volunteers across the UK, we’re now the world’s biggest health research programme of its kind, and our volunteer group is also more diverse than other, similar health research programmes.
- Technology and data are central to our mission. Our systems power web sites, clinics across the UK, secure analytics and research systems, and pipelines that process highly sensitive health and genetic data.
- Our Clinical Research Recruitment Service helps life sciences and academic organisations identify potential participants for clinical studies.
- As the service grows, we need to turn scientific workflows and manual processes into robust, reusable, and scalable production pipelines.
Equal Opportunity
- At Our Future Health, we recognise the importance of having a diverse workforce and ensuring that all candidates, regardless of their background, have equitable access to our application process.
- We proactively encourage applicants who identify as having a disability, neurodiversity, or long-term health conditions to let us know if they require any reasonable adjustments as part of their application process.
