About the Role
As a Senior Data Engineer, you will play a key role in building and maintaining production-ready data and machine-learning systems that support critical business decisions. You’ll work across the full lifecycle, from engaging with stakeholders and shaping data/model outputs, to deploying and maintaining real-time services in a cloud environment. A significant part of this role involves developing and evolving our cloud-based infrastructure, including containerised applications, automated deployment pipelines, and infrastructure-as-code. You’ll also help shape engineering best practices and support the growth of modern, scalable data platforms. You’ll join our small stream-aligned agile team, working closely with domain experts to understand business needs and deliver high-impact solutions.
Responsibilities
- Design, build, and operate production-level data and machine-learning services, including real-time API endpoints that serve 10 million + requests daily
- Build and deploy and orchestrate docker containers, optimizing for performance and resource utilization
- Design, build and maintain cloud R&D solutions using IaC tools like Terraform
- Building, improving and maintaining monitoring systems to track model performance, infrastructure health and ensure reliability, scalability, and security of ML systems
- Develop CICD processes to help automate workflows using tools like Azure DevOps
- Write high-quality, well-tested Python for production-grade data pipelines and services.
- Deliver data extracts, transformations, and features to support modelling and analytics.
- Work within an agile workflow, managing your own tickets and collaborating with team members and across disciplines to deliver products
- Communicate technical decisions and findings to both technical and non-technical audiences.
- Taking time to stay up to date with the newest cloud and data tech as you contribute to continuous improvement across cloud tooling, engineering standards, and platform development.
Requirements
- Experience deploying, monitoring and maintaining production services
- Hands-on experience with Containerisation (Docker) & Service orchestration (Kubernetes or similar)
- Experience managing and maintaining real-time endpoints or APIs
- Experience with Automated deployment into production environments
- Experience building or supporting cloud infrastructure for data or predictive services
- Experience with Terraform (highly desirable)
- Experience with Azure (preferred), or other public cloud platforms
- Experience with Infrastructure patterns for scalable, secure services
- Experience with Azure DevOps or GitHub Actions
- Experience with Automated testing, packaging, and deployment processes
- Proficient SQL
- Familiarity with PySpark is beneficial
- Experience with dbt
- Experience with Microsoft Fabric
- Experience with SQLMesh
- Strong Python, with good documentation and unit testing practices
- Comfortable in an agile delivery environment
- Able to communicate clearly with non-technical teams
- Demonstrates curiosity, continuous learning, and a collaborative mindset
- Understanding of GDPR and data governance (Desirable)
- Experience in insurance or financial services (Desirable)
- Familiarity with LLMs (e.g., GPT, OpenAI) (Desirable)
- Knowledge of infrastructure monitoring, backup, or disaster recovery (Desirable)
Skills
- Containerisation (Docker)
- Service orchestration (Kubernetes or similar)
- Real-time endpoints or APIs
- Automated deployment
- Cloud infrastructure
- Terraform
- Azure
- Infrastructure patterns
- CI/CD Automation
- Azure DevOps
- GitHub Actions
- Automated testing
- Packaging
- Deployment processes
- SQL
- PySpark
- dbt
- Microsoft Fabric
- SQLMesh
- Python
- Unit testing
- Agile delivery
- Communication
- GDPR
- Data governance
- Insurance
- Financial services
- LLMs
- GPT
- OpenAI
- Infrastructure monitoring
- Backup
- Disaster recovery
Location
- London
- Bristol
- Bournemouth
Work Type
- Hybrid
- Full-time
Experience Level
- Senior
- Circa £60,000 per annum, dependent on experience, skills, and location
Salary/Compensations
- Circa £60,000 per annum
Benefits
- Flexible buy/sell holiday options
- Hybrid working
- Annual performance related bonus
- Contributory pension scheme
- Development days
- A discount up to 50% on a range of insurance products including car, home and pet
- Retail discounts
- Volunteering days
- Flexible working options
- Global career opportunities across the wider Allianz Group
- Fantastic career development and training
About the Company
- Allianz is the world's number one insurance brand.
Equal Opportunity
- At Allianz, we believe in fostering an inclusive workforce and are proud to be an equal opportunity employer.
- Our commitment to equal opportunities, gender equity, and balanced gender representation, is demonstrated by our numerous accreditations: EDGE certified for gender inclusion, Women in Finance Charter members, Disability Confident employer, Stonewall Diversity Champion, Business in the Community’s Race at Work Charter signatories, and Armed Forces Covenant gold standard employer.
- We embrace neurodiversity and welcome applications from neurodivergent and disabled candidates, offering tailored adjustments to ensure your success.
- We encourage our employees to advocate for their needs, whether it’s assistive technology, ergonomic equipment, mentoring, coaching, or flexible work arrangements
- As part of the Disability Confident Scheme, we support candidates with disabilities or long-term health conditions through the Offer an Interview Scheme, for those meeting the essential skills for the role.
