Senior Data Engineer at Shell | England, GBR | Rezi

Senior Data Engineer at Shell

Senior Data Engineer

Shell · England, GBR

Today

Senior Data Engineer

Shell · England, GBR

11 hours ago
Resume preview

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now

About the Role

Are you a Senior Data Engineer passionate about building scalable data solutions and turning data into business value? In this role, you'll work on data engineering projects within IT – T&S, delivering complex data management solutions by leveraging industry best practices. You will collaborate closely with project teams to design, build, and optimize efficient data pipelines and data platforms that enable the business to unlock insights and maximize the value of its data. If you thrive in solving complex data challenges and enjoy creating high-quality, reliable data solutions, then this role is for you.

Responsibilities

  • Understanding the business vision from the data solutions and work with all project stakeholders to enable that.
  • Working alongside multiple other project team members to drive towards the common goal.
  • Helping the business analysts to create data mapping documents that define the end to end pipeline.
  • Building and delivering data pipelines that ingests, transform & load data (structured and unstructured) from multiple sources into the target data lake/database.
  • Building the data management layer in line with the business needs and standards defines.
  • Triaging problems in the pipelines or data layers and effectively fix them based on the priority.
  • Automating data loading during initial or incremental loads.
  • Supporting the operations team during critical issues and helps them in faster resolution.
  • Leveraging agentic workflows to generate data pipelines
  • Deep query analysis and optimization ability using Azure SQL Databases

Requirements

  • IT industry experience, with at least good exposure on Big data technologies.
  • Interest and passion in Big Data technologies and appreciates the value that can be brought in with an effective data management solution.
  • Has worked on real data challenges and handled huge volume, velocity and variety of data.
  • Understands Infrastructure concepts and has worked with multiple cloud tenants.
  • Proficient with data warehousing and traditional ETL technologies.
  • Experience in building cloud native Data Pipelines with modularization, containerization & unit test frameworks.
  • Strong experience in writing stored procedure, functions and triggers in SQL.
  • Strong experience on Azure ecosystem and has worked with data management on Databricks, Delta Lake, ADF, Blob Store, ADLS etc.
  • Strong coding experience in Apache Spark – primarily PySpark. Must be able to effectively churn out complex transformation requirements with ease.
  • Strong coding experience in Polars dataframe technology. Must be able to effectively churn out complex transformation requirements with ease.
  • Solid programming skills primarily in Python.
  • Proficient with agentic workflows using GitHub Copilot.
  • Implement complex data processing algorithms in real time in and efficient manner using Spark and other technologies.
  • Worked with both structured and unstructured data
  • Knowledge on data visualisation and modelling tools.
  • Excellent analytical & problem-solving skills, willingness to take ownership and resolve technical challenges.
  • Excellent communication and stakeholder management skills
  • Industry certification in Data Engineering is an added advantage.
  • Knowledge on latest database technologies like MongoDB, Cosmos, Cassandra etc. would be an advantage

Skills

  • Big data technologies
  • Data warehousing
  • ETL technologies
  • Cloud native Data Pipelines
  • Modularization
  • Containerization
  • Unit test frameworks
  • Stored procedure
  • Functions
  • Triggers
  • SQL
  • Azure ecosystem
  • Databricks
  • Delta Lake
  • ADF
  • Blob Store
  • ADLS
  • Apache Spark
  • PySpark
  • Polars dataframe
  • Python
  • Agentic workflows
  • GitHub Copilot
  • Spark
  • Data visualisation
  • Data modelling
  • MongoDB
  • Cosmos
  • Cassandra

Location

  • United Kingdom

Work Type

  • Regular
  • Flexible working hours
  • Possibility of remote/mobile working

Experience Level

  • Experienced Professionals

Salary/Compensations

  • Competitive starting salary
  • Annual performance related salary increase

Benefits

  • Paid parental leave, including for non-birthing parents.
  • Access to a wide range of training and development programmes.

About the Company

  • Shell is a vital contributor to the UK, supporting energy security, jobs and economic value. We provide energy to fuel homes, hospitals, schools, vehicles, machinery and factories. Our history here dates back over 125 years. A UK-headquartered global energy leader, and leading FTSE multinational, we are active across the country’s energy system.
  • In the years ahead, as the UK looks to strengthen energy security and deliver its 2050 net-zero goal, Shell UK aims to play a crucial role. We aim to be a major investor in the UK energy system by helping our customers decarbonise with a focus on transport and industry.

Equal Opportunity

  • Shell is an Equal Opportunity Employer.
  • We strongly encourage applicants of all genders, ages, ethnicities, cultures, abilities, sexual orientation, and life experiences to apply.
  • Shell is working to advance an inclusive, psychologically safe and accessible environment where people with disabilities can excel. If you require any accommodations or accessibility adjustments (e.g. assistive technology, communication support, any other) during the application or interview process, please let us know directly via careers@shell.com . We strive to ensure that our process and workplace is accessible to everyone and are dedicated to making reasonable adjustments to support your needs.