About the Role
Methods Analytics (MA) is seeking Data Engineers to join our Public Sector Business unit. This role is primarily remote with flexibility for travel to client sites and offices in London, Sheffield, and Bristol.
Responsibilities
- Work closely with cross-functional teams, translating complex technical concepts into clear, accessible language for non-technical audiences and aligning data solutions with business needs.
- Collaborate with a dynamic delivery team on innovative projects, transforming raw data into powerful insights that shape strategic decisions and drive business transformation.
- Utilise platforms and tools such as Microsoft Fabric, Azure Data Factory, Azure Synapse, Databricks, and PowerBI to build robust, scalable, and future-proof end-to-end data solutions.
- Design and implement efficient ETL and ELT pipelines, ensuring seamless integration and transformation of data from various sources to deliver clean, reliable data.
- Develop and maintain sophisticated data models, employing dimensional modelling techniques to support comprehensive data analysis and reporting.
- Implement and uphold best practices in data governance, security, and compliance, using tools like Azure Purview, Unity Catalog, and Apache Atlas to maintain data integrity and trust.
- Ensure data quality and integrity through meticulous attention to detail and rigorous QA processes, continually refining and optimising data queries for performance and cost-efficiency.
- Develop intuitive and visually compelling Power BI dashboards that provide actionable insights to stakeholders across the organisation.
- Monitor and tune solution performance, identifying opportunities for optimisation to enhance the reliability, speed, and functionality of data systems.
- Stay ahead of industry trends and advancements, continuously enhancing your skills and incorporating the latest Data Engineering tools, languages, and methodologies into your work.
- Enable business leaders to make informed decisions with confidence by providing them with timely, accurate, and actionable data insights.
- Be at the forefront of data innovation, driving the adoption and understanding of modern tooling, architectures, and platforms.
- Deliver seamless and intuitive data solutions that enhance the user experience, from real-time streaming data services to interactive dashboards.
- Play a key role in cultivating a data-driven culture within the organisation, mentoring team members, and contributing to the continuous improvement of the Engineering Practice.
Requirements
- Proficiency in SQL and Python.
- Strong grasp of the principles and implementation of Data Lakehouse architecture.
- Experience with Spark-based platforms like Azure Synapse, Databricks, Microsoft Fabric, or on-premise Spark clusters, using PySpark or Spark SQL.
- Skilled in building robust ETL and ELT pipelines, mostly in Azure, utilising Azure Data Factory and Spark-based solutions.
- Ability to craft and optimise queries to be both cost-effective and high-performing.
- Experience in creating insightful and interactive Power BI dashboards.
- Adept at applying dimensional modelling techniques.
- Work within Continuous Integration and Continuous Deployment (CI/CD) environments.
- Ability to understand business requirements and translate them into precise technical specifications.
- Strong communication skills: Ability to effectively translate complex technical topics into clear, accessible language for non-technical audiences.
- Commitment to continuous learning and professional development.
- Familiarity with Microsoft Fabric and its capabilities is advantageous.
- Experience handling large-scale data systems with high performance and low latency.
- Understanding and experience with Delta Tables or Apache Iceberg.
- Experience with data governance tools like Azure Purview, Unity Catalog, or Apache Atlas.
- Experience with technologies such as Kafka, Azure Event Hub, and Spark Streaming.
- Familiarity with the SOLID principles of object-oriented programming.
- Familiarity with agile development methodologies such as SCRUM.
- Knowledge of recent innovations such as GenAI, RAG, and Microsoft Copilot.
- Experience working with data tailored for data science, AI, and ML applications.
- Experience working with public sector clients.
- Must have or be willing to undergo Security Clearance.
Skills
- SQL
- Python
- Data Lakehouse Architecture
- Spark
- Azure Synapse
- Databricks
- Microsoft Fabric
- PySpark
- Spark SQL
- ETL
- ELT
- Azure Data Factory
- Power BI
- Dimensional Modelling
- CI/CD
- Communication
- Continuous Learning
- Delta Tables
- Apache Iceberg
- Azure Purview
- Unity Catalog
- Apache Atlas
- Kafka
- Azure Event Hub
- Spark Streaming
- SOLID Principles
- Agile Development
- SCRUM
- GenAI
- RAG
- Microsoft Copilot
Location
- Remote
- London
- Sheffield
- Bristol
Work Type
- Permanent
- Remote
- Hybrid
Experience Level
- Data Engineer
Salary/Compensations
- £60,000 to £75,000
Benefits
- Autonomy to develop and grow skills and experience
- Part of exciting project work making a difference in society
- Strong, inspiring, and thought-provoking leadership
- Supportive and collaborative environment
- Development access to LinkedIn Learning, a management development programme and training
- Wellness 24/7 Confidential employee assistance programme
- Social events (office parties, pizza Friday, commitment to charitable causes)
- 25 days of annual leave plus bank holidays
- Option to buy 5 extra days of annual leave each year
- 2 paid days per year to volunteer
- Pension Salary Exchange Scheme with 4% employer contribution
- Life Assurance of 4 times base salary
- Private Medical Insurance (non-contributory, spouse and dependants included)
- Worldwide Travel Insurance (non-contributory, spouse and dependants included)
About the Company
- Methods Analytics (MA) exists to improve society by helping people make better decisions with data.
- Combines passionate people, sector-specific insight, and technical excellence to provide an end-to-end data service.
- Uses a collaborative, creative, and user-centric approach to data to do good and solve difficult problems.
- Ensures outputs are transparent, robust, and transformative.
- Values discussion and debate, questioning assumptions, ambition, and process with respect and humility.
- Relishes difficult problems and overcomes them with innovation, creativity, and technical freedom.
- Ethics, privacy, and quality are at the heart of their work.
- Treats data with respect and uses it only for the right purpose.
- People are positive, dedicated, and relentless.
- Strives for interactions that are engaging, informative, and fun, with a focus on outcomes and delivering quality products.
- Passionate about people, wanting colleagues to develop their strengths and enjoy their work.
