About the Role
The Lead Data Engineer will design, develop, and maintain data integration solutions connecting the AEC’s on-premises and cloud-based enterprise applications using Microsoft Azure tools. This role involves creating efficient data pipelines, ensuring data quality, optimizing performance, adhering to security and compliance standards, collaborating with cross-functional teams, troubleshooting integration issues, and staying current with emerging data engineering trends to contribute to the agency’s data-driven success.
Responsibilities
- Design data integration solutions with stakeholders using Microsoft Azure tools like Azure Data Factory and SQL.
- Develop, implement, and maintain efficient and secure ETL pipelines.
- Design and maintain scalable and performant data models, ensuring accuracy, consistency, and availability.
- Implement data validation and quality checks to rectify data anomalies, errors, and inconsistencies.
- Monitor and optimise data integration processes for performance, latency, and resource consumption.
- Create and maintain comprehensive documentation for data integration solutions.
- Collaborate with cross-functional teams to align integrations with business objectives.
- Troubleshoot and resolve data integration issues.
- Stay updated on emerging data engineering technologies and industry trends.
- Perform additional duties as directed.
Requirements
- Proven experience in data engineering, data integration, ETL processes, and data modelling.
- Strong SQL skills.
- Experience with data warehousing concepts.
- Knowledge of data governance, security, and compliance best practices.
- Excellent problem-solving skills.
- Ability to work effectively in a collaborative team environment.
- Effective communication skills for technical and non-technical stakeholders.
- Demonstrated ability to build and maintain effective working relationships.
- Ability to work independently and be self-motivated.
- Must have a Baseline security clearance.
Skills
- Microsoft Azure tools
- Azure Data Factory
- SQL
- Data modelling
- ETL processes
- Data validation
- Data quality checks
- Data integration
- Data warehousing
- Data governance
- Data security
- Azure SQL Database
Location
- NSW
Work Type
- Hybrid
- Contract until 30 June 2027
Experience Level
- Proven experience in data engineering
Education Level
- Bachelor's degree in Computer Science, Information Technology, or a related field (or equivalent experience)
- Microsoft Azure Data Engineer certification (advantageous)
- AWS Certified Data Analytics certification (advantageous)
Salary/Compensations
- $100 - $120 per hour (including super)
About the Company
- The Australian Electoral Commission (AEC) has an Enterprise Strategy and Transformation Division (ESTD).
- The ESTD drives the AEC’s transformation agenda and delivers the Election Systems Modernisation Program (Indigo Program).
- The Indigo Program is a large-scale transformation to modernise business capabilities and replace core election ICT systems.
- The program aims to transform AEC’s electoral services delivery and ensure electoral system integrity.
- Tranche 2 focuses on business process re-engineering, data management, legislative compliance, and replacing aging systems.
