About the Role
Drive a high-priority transformation initiative by uplifting and modernizing the enterprise Data Ingestion framework on Google Cloud Platform (GCP). Combine high-level architectural design with deep data engineering expertise to define scalable, secure, and event-driven data pipeline architectures.
Responsibilities
- Design and architect the next-generation, enterprise-wide GCP Data Ingestion framework, transitioning legacy ingestion patterns toward real-time, scalable, and automated cloud workflows.
- Author comprehensive End-to-End Solution Design Documents (SDDs), technical blueprints, data mapping specifications, and ingestion patterns across batch and streaming sources.
- Provide hands-on technical leadership and guidance to data engineering squads building robust ingestion pipelines using GCP-native data services.
- Design secure ingestion interfaces connecting on-premises databases, SaaS platforms, third-party APIs, and streaming event hubs into BigQuery and Cloud Storage.
- Embed automated data quality validation, lineage tracking, encryption, and governance controls (IAM, Data Catalog, DLP) directly into the ingestion lifecycle.
- Evaluate system throughput, optimize data pipeline efficiency, reduce latency, and govern compute/storage costs across GCP data environments.
Requirements
- Extensive experience designing and building data pipelines using core GCP services such as BigQuery, Dataflow (Apache Beam), Pub/Sub, Dataproc, Cloud Storage, and Cloud Data Fusion / Composer (Airflow).
- Proven track record as a Solution Designer or Lead Data Architect crafting high-level and low-level designs for large-scale enterprise data platforms.
- Deep understanding of modern ingestion paradigms (batch, micro-batch, real-time event streaming, CDC/Change Data Capture, and API-driven ingestion).
- Advanced proficiency in SQL, schema design, data partitioning, and data modeling strategies optimized for analytical data warehouses (e.g., Star/Snowflake schemas, Data Vault).
- Strong coding capability in Python or Java/Scala, alongside Infrastructure as Code (Terraform) and modern CI/CD data deployment pipelines.
- Exceptional communication skills with the ability to articulate complex data architectural decisions to senior tech leads, product owners, and business stakeholders.
- Google Cloud Certifications (Professional Data Engineer or Professional Cloud Architect).
- Experience with orchestration tools like Apache Airflow or dbt.
- Knowledge of enterprise governance frameworks and regulatory compliance standards for data privacy.
- Valid work rights for Australia.
- Willingness to undergo a comprehensive background checking process, including probity and police checks.
Skills
- GCP Data Ecosystem
- BigQuery
- Dataflow (Apache Beam)
- Pub/Sub
- Dataproc
- Cloud Storage
- Cloud Data Fusion / Composer (Airflow)
- Solution Architecture
- Data Engineering
- Data Pipeline Architecture
- Batch Data Processing
- Streaming Data Processing
- Data Integration
- Data Governance
- SQL
- Schema Design
- Data Partitioning
- Data Modeling
- Python
- Java
- Scala
- Infrastructure as Code (Terraform)
- CI/CD
- Stakeholder Management
- Apache Airflow
- dbt
Location
- Australia
Work Type
- Full-time
Experience Level
- Experienced
Benefits
- Paid parental leave
- Well-being initiatives
- Discounted health insurance
- Discounts on various products and services
- Regular recognition and rewards for high performance
- Career development opportunities
- Capability Fingerprint
- Industry and partner training programs
- Special interest groups
- AI-driven learning platform
About the Company
- At NCS Australia, we believe in doing technology services better. Our commitment to quality, focus on people, and willingness to challenge traditional thinking set us apart.
- Our team brings this belief to life by partnering with our clients and communities to make tomorrow together.
- We are committed to creating an environment that prioritises innovation, collaboration, and purposeful work.
- Our diverse team is empowered to make a meaningful impact with curiosity, creativity and resilience to shape better outcomes.
- Join us and accept the challenge of creating a better tomorrow.
Equal Opportunity
- NCS Australia is an equal-opportunity employer, and we take pride in our commitment to valuing and supporting our people and the communities we serve.
- We are dedicated to attracting, retaining and developing our people regardless of gender identity, ethnicity, sexual orientation, disability and age.
- Applications are encouraged from all sectors of the community and we strongly encourage applications from the Veterans, Aboriginal and/or Torres Strait Islander community.
- At NCS Australia, we are committed to supporting adjustments throughout the recruitment and selection process, as well as during employment.
- We actively support and encourage people with disability to apply.
