About the Role
The NSW Department of Education is seeking an energetic and ambitious Senior Data Engineer to join their Data Integration and AI Engineering team. You will lead the preparation, maintenance, and operation of pipelines and data solutions that integrate source systems into the department's full-stack data services, supporting Data Architecture and Engineering processes and standards, and promoting Azure DevOps–driven practices.
Responsibilities
- Lead the preparation, maintenance, and operation of pipelines and data solutions that integrate source systems into the NSW Department of Education’s full-stack data services.
- Support Data Architecture and Engineering processes and standards.
- Deliver and promote Azure DevOps–driven practices.
- Translate business requirements into technical specifications.
- Communicate complex concepts to non-technical stakeholders.
- Design, develop, and maintain end-to-end scalable data solutions to meet departmental needs.
- Perform root cause analysis and defect triage to maintain data reliability.
- Interpret trends for prescriptive and predictive modelling.
Requirements
- Proven experience (5 years+) in working with multiple data sets, computing tools, and data transformation languages such as SQL and Python in a cloud environment.
- 3+ years' expert-level PySpark and SQL experience.
- Experience optimizing performance and cost for Spark/Delta workloads at scale.
- Extensive experience in agile data development and operations.
- Hands-on experience with Azure Synapse Analytics and Microsoft Fabric (Spark + Pipelines).
- Experience designing and implementing lakehouse and data platform frameworks.
- Knowledge of and commitment to implementing the Department’s Aboriginal Education Policy.
- Commitment to upholding the Department’s Partnership Agreement with the NSW AECG.
- Commitment to ensuring quality outcomes for Aboriginal people.
- Demonstrated understanding of and commitment to the value of public education.
- Must have Australian work rights (citizens, permanent residents, New Zealand citizens or a valid work visa).
- Successful candidates will be required to undertake pre-employment screening, including a National Criminal History Check.
- Successful candidates not currently employed by the Department must provide a valid Working with Children Check (WWCC) clearance number.
Skills
- SQL
- Python
- PySpark
- Azure Synapse Analytics
- Microsoft Fabric
- Spark
- Delta Lake
- Data Integration
- Data Engineering
- Cloud Environment
- Agile Data Development
- Data Platform Frameworks
- Lakehouse Frameworks
Location
- Eveleigh
- Flexible working arrangements available across NSW Department of Education offices
Work Type
- Ongoing
- Full-Time
- Flexible working arrangements
Experience Level
- Senior
- 5 years+ experience
- 3+ years' expert-level PySpark and SQL
Education Level
- Tertiary qualifications in a relevant discipline (Computer Science, Statistics, Mathematics, Engineering or related field) or equivalent industry experience.
Salary/Compensations
- Competitive remuneration ranging from $154,231 to $178,369 plus super & annual leave loading.
Benefits
- Flexible working arrangements
- 35 hour working week
- Competitive salary sacrificing
- Employer’s contribution to superannuation
- Annual leave loading
- Flex Leave entitlements
- Generous holidays & leave conditions
- Opportunities for advancement and mobility across the Department
About the Company
- At the NSW Department of Education, we educate and inspire lifelong learners – from early childhood, through schooling to vocational education and training.
Equal Opportunity
- We welcome applications from people of all backgrounds, including but not limited to Aboriginal and/or Torres Strait Islander people, people of any age or gender, people from culturally and linguistically diverse groups and/or from the LGBTQIA+ community, veterans, refugees, people with disability, people with sensory differences, and neurodiverse people. If we can make some adjustments to our recruitment/interview process to better help you shine, please reach out to the contact person for this recruitment, details listed above. For more information, visit the NSW Department of Education’s Diversity, equity and inclusion webpage.
