About the Role
As a Data Engineer II, you will build high-quality data pipelines on our Big Data Platform, maintain data infrastructure, and ensure smooth data flows across systems while balancing business context with technical execution.
Responsibilities
- Collaborate with data scientists, analysts, software engineers, product managers, and customers to craft effective solutions.
- Design, develop, deploy, and operate high-quality production ELT pipelines and data architectures.
- Integrate data from various sources and formats to ensure compatibility, consistency, and reliability.
- Establish and share best practices in performance, code quality, data validation, data governance, and discoverability.
- Mentor team members and participate in knowledge sharing initiatives.
- Ensure data accuracy, completeness, reliability, relevance, and timeliness.
- Implement testing, monitoring, and validation protocols for code and data using tools like Pytest.
- Identify and resolve performance bottlenecks in data pipelines and systems.
- Improve query performance and resource utilization using Spark optimizations to meet SLAs.
Requirements
- 3+ years of experience as a Data Engineer or in a similar role.
- Solid understanding of Software and Data Engineering practices.
- Ability to communicate complex data-related concepts to diverse stakeholders.
- Self-starter capable of identifying opportunities and handling projects independently.
- Experimental mindset with a launch fast and iterate mentality.
- Ability to promote a data-centric culture and advocate for continuous improvement.
Skills
- Python
- PySpark
- Airflow
- Hadoop
- Spark
- Kafka
- SQL
- Git
- Pytest
Location
- Amsterdam
Work Type
- Office-first
Experience Level
- 3+ years
About the Company
- Financial technology platform providing payments, data, and financial products.
- Serves customers including Meta, Uber, H&M, and Microsoft.
- Engineered for ambition with a focus on innovative and ethical solutions.
Equal Opportunity
- Adyen values diverse perspectives and backgrounds.
- We welcome you to be your true self regardless of who you are or where you are from.
- We encourage candidates from underrepresented communities to apply even if they do not meet 100% of the qualifications.
