Requirements
- Design scalable data solutions using native GCP tools.
- Build and maintain ETL/ELT pipelines.
- Develop real-time streaming and batch processing solutions.
- Design and optimize data warehouses (BigQuery).
- Understand data lineage, cataloging, and governance.
- Understand IAM roles, data security, and compliance in GCP.
Skills
- GCP Data Services (BigQuery, Dataflow, Pub/Sub, Cloud Storage)
- Data Pipeline Development (Batch & Streaming)
- Python
- SQL
- Data Modeling (star/snowflake schemas)
- Data Warehousing (BigQuery)
- Multi-Cloud Exposure (AWS, Azure)
- Streaming & Messaging Frameworks (Kafka, Pub/Sub)
- Containerization & Orchestration (Docker, Kubernetes, GKE)
- Data Governance & Security
