About the Role
The Data Engineering Lead will be responsible for delivering and operating data products within IAG Cargo's Digital and Information function. This role is key to the data leadership team, ensuring data solutions align with the organization's vision and strategic direction. The position is crucial for a major program to modernize data infrastructure, tooling, and processes by migrating to a cloud-native environment.
Responsibilities
- Lead the design, development, and deployment of scalable and efficient data pipelines and architectures.
- Manage and mentor a team of data engineers, ensuring a culture of collaboration and excellence.
- Manage demand for data engineering resources, prioritizing tasks and projects based on business needs and strategic goals.
- Monitor and report on the progress of data engineering projects, addressing any issues or risks.
- Collaborate closely with Analytics Leads, Data Architects, and the wider Digital and Information team for seamless integration.
- Develop and implement a robust data operations capability for the smooth running and reliability of our data estate.
- Drive the adoption of cloud technologies and modern data engineering practices.
- Ensure data governance and compliance with relevant regulations and standards.
- Define and implement best practices for data engineering, including coding standards, documentation, and version control.
Requirements
- Expert in SQL and database concepts including performance tuning and optimisation.
- Solid understanding of data warehousing principles and data modelling practice.
- Strong engineering skills, preferably in AWS services (S3, EC2, Lambda, Glue), ETL Tools (e.g. Apache Airflow), Streaming processing tools (e.g. Kinesis), Snowflake, and Python.
- Excellent knowledge of creation and maintenance of data pipelines.
- Skilled in establishing and managing pipelines and change with CI/CD tooling.
- Strong problem-solving and analytical skills, with the ability to troubleshoot and resolve complex data-related issues.
- Proficient in data integration techniques including APIs and real-time ingestion.
- Excellent communication and collaboration skills to work effectively with cross-functional teams.
- Capable of building, leading, and developing a team of data engineers.
- Strong project management skills and an ability to manage multiple projects and priorities.
- Experienced and confident leadership of data engineering activities.
- Expert in data engineering practice on cloud data platforms.
- Background in data analysis and preparation, including experience with large data sets and unstructured data.
- Knowledge of AI/Data Science principles.
Skills
- SQL
- Database concepts
- Performance tuning
- Optimization
- Data warehousing principles
- Data modelling
- AWS services (S3, EC2, Lambda, Glue)
- ETL Tools (e.g. Apache Airflow)
- Streaming processing tools (e.g. Kinesis)
- Snowflake
- Python
- Data pipeline creation and maintenance
- CI/CD tooling
- Problem-solving
- Analytical skills
- Data integration techniques
- APIs
- Real-time ingestion
- Communication skills
- Collaboration skills
- Team leadership
- Team development
- Project management
Location
- Hybrid
Work Type
- Hybrid
- Full-time
Experience Level
- Experienced leadership of data engineering activities
- Expert in data engineering practice on cloud data platforms
Education Level
- Bachelor’s degree in Computer Science or equivalent
- Professional certifications in relevant technologies (e.g., AWS Certified Solutions Architect, Snowflake SnowPro Certification)
Benefits
- Competitive salary
- Bonus
- Hybrid environment with 3 days a week in the office and two from home
- Unlimited basic and premium standby tickets on British Airways and group airlines
- Up to 30 discounted ‘Hotline’ airfares per year for yourself, friends, and family
- Flexible bank holiday policy
- Access to LinkedIn learning
- Access to Rosetta Stone Language courses
- Free onsite gym facility
- Access to the UNMIND app
- Community of Mental Health First Aiders
- Access to discounts on Apple, Cinema tickets and loads of other goodies through Perks at work
About the Company
- IAG Cargo is one of the world’s largest airfreight logistics organisations.
- We are in the business of moving things, from antibiotics to rhinoceros, gold bullion to avocados.
- We are the logistics and cargo brand of International Airlines Group (Aer Lingus, British Airways, Iberia, Level and Vueling).
- We believe in keeping the world’s economies turning, and do everything with determined attitudes, curious minds, collaborative actions and heartfelt pride.
- We are building a great place to work for customers and colleagues alike.
Equal Opportunity
- Our recruitment procedures positively support our equity, diversity, and inclusion agenda.
- All candidates are considered strictly on their merits in relation to the criteria for the role, treated fairly and consistently and have their individual needs responded to throughout the process.
