About the Role
As a Data Engineer, you will promote data as a key differentiator for Nomia, driving innovation and building intelligent systems for internal use, customers, and suppliers globally. You will be a key member of the team focused on designing and implementing cutting-edge Agentic solutions.
Responsibilities
- Design and implement data pipelines for cleaning and enriching data
- Be responsible for the data lake
- Find and curate third-party datasets
- Prepare data for use in experiments
- Design and maintain notebooks to measure data quality and completeness
- Understand real-world use cases and translate them into actionable plans
- Conduct experiments to validate design choices or theories
- Create, manage, monitor, and maintain data models
- Design and implement ETL processes
- Document all aspects of your work
- Stay abreast of advancements in data engineering and research new software and techniques
- Participate in code reviews, technical discussions, and cross-functional meetings
- Ensure compliance with Nomia's data protection and information security policies
- Promote inclusivity, innovation, and ethical use of AI across the organisation
- Be adaptable and proactive in learning new tools, techniques, and methods as the AI landscape evolves
Requirements
- 3+ years' experience in data engineering
- Demonstrable experience with Microsoft Azure tools, such as Function Apps and services including Data Factory, Azure Synapse, and Azure Databricks
- Demonstrable experience designing and implementing ETL pipelines
- Proficient in PostgreSQL and T-SQL
- Proficient in Python, with a strong command of data processing libraries such as Pandas and PySpark
- Proficient in the use of Python notebooks
- Experience with event-driven architecture
- Familiarity with LLMs and prompt engineering
- Proficient in writing clean, maintainable code and well-documented data pipelines
- Wide knowledge of different database types and designs
- Familiarity with data modelling techniques
- Genuine enthusiasm for learning new ideas and techniques
Skills
- Data Engineering
- Microsoft Azure
- Data Factory
- Azure Synapse
- Azure Databricks
- ETL Pipelines
- PostgreSQL
- T-SQL
- Python
- Pandas
- PySpark
- Python notebooks
- Event-driven architecture
- LLMs
- Prompt engineering
- Data modelling
Location
- Hybrid
Work Type
- Hybrid
Experience Level
- 3+ years
About the Company
- Nomia
