About the Role
Methods is recruiting for a permanent Mid/Senior Data Engineer to join the Data and AI Capability Centre. This role will support complex client engagements where data engineering is used to stabilize business-critical processes, improve reporting confidence, and establish repeatable data foundations across enterprise systems.
Responsibilities
- Design, build, and improve ETL and ELT pipelines that support data ingestion, profiling, reconciliation, cleansing, and reporting across enterprise source systems.
- Build data catalogues, data flows, interface views, and trusted source views.
- Design and architect modern data solutions that align with business objectives and technical requirements, supporting current-state and target-state data architecture.
- Help clients improve confidence in operational, workforce, procurement, and financial reporting through timely, accurate, and reconcilable data.
- Build highly scalable and performant data solutions leveraging cloud platforms and open-source software.
- Develop data models to handle enterprise-level analytical needs.
- Optimize large-scale data processing systems for performance and cost-efficiency.
- Implement robust data quality frameworks and monitoring solutions.
- Evaluate new technologies to enhance data engineering capabilities.
- Collaborate with stakeholders to translate business requirements into technical specifications.
- Present technical solutions to leadership and non-technical stakeholders.
- Contribute to the development of the Methods Analytics Engineering Practice by participating in our internal community of practice.
Requirements
- Experience working with data from Ariba, Workday, SAP S/4HANA, or comparable procurement, workforce, timesheet, finance, supplier invoice, or locally maintained spreadsheet sources.
- Hands-on experience profiling data quality issues, defining cleansing rules, mapping data between systems, validating reconciliation outputs, and documenting exceptions for business review.
- Ability to work iteratively with architects, process owners, finance, procurement, workforce, and operational stakeholders to turn ambiguous business issues into clear data analysis, engineering actions, and controlled tactical fixes.
- Understanding of data ownership, stewardship, lineage, metadata, controls, and data quality monitoring, with the ability to produce documentation that can be reused as part of an enduring data governance model.
- Experience implementing and advocating for test-driven development methodologies in data pipeline workflows, including unit testing, integration testing, and data quality validation frameworks.
- Proven experience leading technical aspects of data projects.
- Strong data architecture and modeling skills with the ability to design scalable data solutions.
- Deep understanding of data warehouse design principles and methodologies.
- Advanced knowledge of optimization techniques for large-scale data processing.
- Strong proficiency in SQL and Python for handling complex data problems.
- Hands-on experience with Apache Spark (PySpark or Spark SQL).
- Experience with the Azure data stack.
- Knowledge of workflow orchestration tools like Azure Data Factory or Apache Airflow.
- Experience with containerization technologies like Docker.
- Proficiency in dimensional modeling techniques.
- Experience with CI/CD pipelines for data solutions.
- Strong communication skills for translating complex technical concepts.
- Experience designing and implementing data mesh or data fabric architectures.
- Knowledge of cost optimization strategies for cloud data platforms.
- Experience with data quality frameworks and implementation.
- Experience with data visualization tools like Power BI or Apache Superset.
- Experience with other cloud data platforms like AWS, GCP, or Oracle.
- Experience with modern unified data platforms like Databricks or Microsoft Fabric.
- Experience with Kubernetes for container orchestration.
- Understanding of streaming technologies (Apache Kafka, event-based architectures).
- Experience with high-performance, large-scale data systems.
- UKSV (United Kingdom Security Vetting) clearance is required for this role, with Security Check (SC) as the minimum standard, either already held or with a willingness to undergo the process.
- Some roles/projects may require Developed Vetting (DV) clearance; while not mandatory, a willingness to obtain DV clearance would be beneficial.
- Candidates will be asked to complete a Baseline Personnel Security Standard (BPSS) as part of the onboarding process.
Skills
- Data Profiling
- Data Cleansing
- Data Mapping
- Data Reconciliation
- Data Integration
- ETL
- ELT
- Data Catalogues
- Data Flows
- Interface Views
- Source Views
- Data Architecture
- Data Modeling
- Cloud Platforms
- Open-Source Software
- Data Quality Frameworks
- SQL
- Python
- Apache Spark
- PySpark
- Spark SQL
- Azure Data Stack
- Azure Data Factory
- Apache Airflow
- Docker
- Dimensional Modelling
- CI/CD Pipelines
- Communication Skills
- Data Mesh
- Data Fabric
- Cloud Cost Optimization
- Data Visualization
- Power BI
- Apache Superset
- AWS
- GCP
- Oracle
- Databricks
- Microsoft Fabric
- Kubernetes
- Apache Kafka
- Event-Based Architectures
- High-Performance Data Systems
Location
- Remote
- London
- Sheffield
- Bristol
Work Type
- Permanent
- Remote
- Hybrid
Experience Level
- Mid-Level
- Senior
Benefits
- Autonomy to develop and grow skills and experience
- Part of exciting project work making a difference in society
- Strong, inspiring, and thought-provoking leadership
- Supportive and collaborative environment
- Development opportunities including LinkedIn Learning, management development programme, and training
- 24/7 confidential employee assistance programme
- Flexible working including home working and part time
- Social events
- 25 days of annual leave plus bank holidays
- Option to buy extra days of annual leave each year
- 2 paid days per year to volunteer
- Salary Exchange Scheme with 4% employer contribution and 5% employee contribution
- Discretionary Company Bonus
- Life Assurance of 4 times base salary
- Non-contributory Private Medical Insurance (spouse and dependants included)
- Non-contributory Worldwide Travel Insurance (spouse and dependants included)
- Enhanced Maternity and Paternity Pay
- Season ticket loan
- Cycle to work scheme
About the Company
- Methods is passionate about its people; we want our colleagues to develop the things they are good at and enjoy.
