About the Role
We are seeking a Senior Data Engineer with a deep understanding of data engineering and a proven track record of leading data projects in a fast-paced environment.
Responsibilities
- Design, build, and maintain scalable and robust data pipelines using SQL and Python, leveraging tools like Databricks, Snowflake, Azure Data Factory, AWS Glue, Apache Airflow, and Pyspark.
- Lead the integration of complex data systems, ensuring data consistency and accuracy across multiple platforms.
- Implement CI/CD practices for data pipelines to improve efficiency and quality.
- Collaborate with data architects, analysts, and stakeholders to translate business requirements into technical solutions.
- Oversee and manage a team of data engineers, providing guidance and mentorship.
- Develop and enforce best practices in data governance, security, and compliance.
- Optimize data retrieval and develop dashboards and reports for business teams.
- Continuously evaluate new technologies and tools to enhance data engineering capabilities.
Requirements
- 3+ years of industry experience in data engineering.
- Strong technical proficiency in SQL, Python, and big data technologies.
- Expertise in building scalable data workflows using cloud-native orchestration tools and distributed data processing frameworks.
- Demonstrated experience with Infrastructure as Code tooling such as Terraform.
- Solid understanding of CI/CD principles and DevOps/DevSecOps practices.
- Proven leadership skills and experience managing data engineering teams.
- Excellent problem-solving skills and ability to work with ambiguity.
- Proficient in leveraging AI-assisted workflows to optimize task efficiency.
- Strong communication and interpersonal skills.
- Excellent understanding of data architecture involving data mesh, data lake, data warehouse, and data lakehouse.
Skills
- SQL
- Python
- Databricks
- Snowflake
- Azure Data Factory
- AWS Glue
- Apache Airflow
- Pyspark
- Infrastructure as Code (Terraform)
- CI/CD
- DevOps/DevSecOps
- AI-assisted workflows
Location
- Office
Work Type
- Hybrid
Experience Level
- Senior
Education Level
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
About the Company
- Artefact is a new generation data service provider specializing in data consulting and data-driven digital marketing.
- We transform data into business impact across the entire value chain of organizations.
- We have over 2000 employees across 26 offices focused on accelerating digital transformation.
- Our approach combines state-of-the-art data technologies, lean AI agile methodologies, and cohesive teams of experts.
