About the Role
Lead the design, build, and evolution of intelligent data and AI systems for next-generation platforms. This role operates at the intersection of data engineering, AI engineering, platform architecture, and DevOps, shaping scalable, secure, and production-grade solutions to drive operational efficiency, sustainability, and intelligent decision-making. Define technical direction, engineering standards, and platform patterns for AirTrunk’s AI and Data Platform, mentoring others and driving complex, cross-functional initiatives.
Responsibilities
- Lead the design and delivery of scalable AI and ML solutions that enhance AirTrunk’s operations, from predictive maintenance and optimisation to intelligent automation and decision support.
- Architect and guide the development of agentic AI systems, including multi-agent patterns, retrieval-augmented generation (RAG), and Model Context Protocol (MCP) implementations.
- Drive the integration of LLM and generative AI technologies into enterprise platforms, workflows, and data products using tools such as Databricks, OpenAI, Anthropic, and LangChain.
- Establish reusable patterns, guardrails, and engineering standards for AI applications to ensure reliability, security, scalability, and maintainability in production.
- Lead the design and optimisation of robust batch and streaming data pipelines that support analytics, operational systems, and AI workloads at scale.
- Own the medallion architecture standards within Databricks Unity Catalog, bronze through semantic layers, ensuring trusted, governed, and reusable datasets.
- Shape scalable data architectures across the AI & Data Platform, including lakehouse, medallion, event-driven, and real-time processing patterns where appropriate.
- Drive improvements in data quality, lineage, observability, discoverability, and platform reliability through strong engineering practices and technical leadership.
- Define and evolve platform architecture for data and AI workloads across Azure, Databricks, and related technologies, ensuring alignment with enterprise standards and long-term platform strategy.
- Lead the implementation of end-to-end MLOps and DataOps capabilities, including CI/CD, testing, deployment, monitoring, orchestration, and lifecycle management.
- Standardise tooling, infrastructure patterns, and automation approaches using Git, Terraform, Docker, Kubernetes, and related platform services.
- Ensure robust observability, validation, resilience, and operational support models are in place across data pipelines, models, and AI systems.
- Embed Responsible AI, security, privacy, and data governance practices into the design and operation of data and AI solutions.
- Partner with technology and business stakeholders to implement risk-aware engineering controls, compliance requirements, and trustworthy platform practices.
- Evaluate emerging technologies and architectural approaches with a pragmatic lens, balancing innovation, delivery value, and operational sustainability.
- Drive the adoption of engineering disciplines that improve platform trust, transparency, and production readiness across the AI & Data estate.
- Provide technical leadership across complex initiatives, influencing architecture, design decisions, delivery approaches, and engineering quality across multiple teams or domains.
- Collaborate closely with AI, Data, Platform, Product, and business stakeholders to translate strategic priorities into scalable technical solutions.
- Mentor senior and junior engineers, raising the bar for engineering excellence, reusable design, and operational maturity across the team.
- Actively contribute to AirTrunk’s Data & AI community of practice by sharing knowledge, shaping standards, and building capability across the broader organisation.
Requirements
- 10+ years’ experience in data engineering, AI/ML engineering, software engineering, or platform engineering.
- Strong track record of delivering production-grade data and AI solutions in complex enterprise cloud environments.
- Demonstrated ability to architect and lead scalable, high-performance, secure, and resilient data and AI platforms that meet enterprise standards and support multiple business domains and use cases.
- Deep experience designing, building, and evolving robust batch and streaming data pipelines, event-driven architectures, and curated data models that enable analytics, operational workloads, and AI applications at scale.
- Strong hands-on expertise in modern data architecture patterns, including lakehouse and medallion architectures, real-time data processing, data product thinking, and platform-oriented engineering practices.
- Proven experience designing and deploying AI/ML solutions in production, including LLM-based applications, intelligent automation, retrieval-augmented generation (RAG), and agentic AI patterns where appropriate.
- Strong experience with Azure and Databricks preferred.
- Proficiency with modern data and integration technologies such as dbt, Kafka, Azure Event Hubs, orchestration frameworks, and associated cloud-native services.
- Advanced programming capability in Python and SQL.
- Practical experience in software engineering disciplines such as testing, code quality, version control, and automation.
- Experience with JavaScript or Shell is beneficial.
- Deep understanding of MLOps and DataOps practices, including CI/CD, model and pipeline lifecycle management, monitoring, observability, validation, containerisation (Docker/Kubernetes), and infrastructure as code (Terraform).
- Experience establishing technical standards, reusable patterns, and platform guardrails that improve engineering consistency, delivery quality, and operational supportability across teams.
- Strong understanding of data governance, privacy, security, and Responsible AI principles.
- Ability to embed data governance, privacy, security, and Responsible AI principles into architecture, platform design, and engineering workflows.
- Demonstrated ability to lead complex, cross-functional technical initiatives.
- Ability to influence architecture, delivery, and engineering decisions across multiple teams, domains, or platforms.
- Strong stakeholder engagement and communication skills.
- Ability to translate strategic objectives into practical technical direction and execution.
- Proven capability to mentor engineers, uplift technical capability, and drive a culture of engineering excellence, pragmatism, and continuous improvement.
Skills
- AI Engineering
- Machine Learning Solutions Design and Delivery
- Agentic AI Systems (multi-agent patterns, RAG, MCP)
- LLM and Generative AI Integration
- Databricks
- OpenAI
- Anthropic
- LangChain
- Data Engineering
- Batch Data Pipelines
- Streaming Data Pipelines
- Medallion Architecture
- Databricks Unity Catalog
- Lakehouse Architecture
- Event-Driven Architectures
- Real-time Data Processing
- Data Quality Management
- Data Lineage
- Data Observability
- Data Discoverability
- Platform Architecture (Azure, Databricks)
- MLOps
- DataOps
- CI/CD
- Testing
- Deployment
- Monitoring
- Orchestration
- Lifecycle Management
- Git
- Terraform
- Docker
- Kubernetes
- Responsible AI Principles
- Security and Privacy Practices
- Data Governance
- Risk-aware Engineering
- Technical Leadership
- Cross-functional Collaboration
- Mentoring
- Python
- SQL
- dbt
- Kafka
- Azure Event Hubs
- JavaScript (beneficial)
- Shell Scripting (beneficial)
- Software Engineering Practices (code quality, version control, automation)
- Stakeholder Engagement
- Communication Skills
- Architectural Judgement
- Problem Solving
- Platform-oriented Engineering Practices
- Data Product Thinking
Experience Level
- 10+ years’ experience
- Highly experienced
About the Company
- AirTrunk is a technology company focused on scaling and sustaining the relentless growth of the Asia Pacific & Middle East (APME) region’s digital future.
- Redefines and delivers hyperscale data centres that meet the needs of transformational companies sustainably.
- Operates a platform of hyperscale data centres across the APME region, backed by investors including Blackstone.
- Fosters a culture of challengers and collaborative problem solvers.
- Values dynamism, transparency, and responsiveness.
- Promotes a flexible, safe, and welcoming working environment that embraces diverse perspectives.
Equal Opportunity
- AirTrunk values unique backgrounds and diverse perspectives.
- Provides a flexible, safe, and welcoming working environment where everyone feels welcome.
