About the Role
We are seeking a highly skilled Data Engineer with strong problem-solving expertise to join our dynamic data engineering team. Your primary focus will be to design, develop, and optimize data pipelines and workflows leveraging Databricks and AWS.
Responsibilities
- Support L2 and L3 functions within Data engineering to troubleshoot and rectify production pipelines.
- Develop and maintain high-performance data pipelines using Databricks.
- Collaborate with architects and analysts to build data models and transformations.
- Ensure data quality, security, and compliance within Databricks environments.
- Implement monitoring and logging strategies to ensure data pipeline reliability and performance.
- Deploy and manage code via CI/CD workflows.
- Troubleshoot and resolve complex data processing challenges efficiently.
Requirements
- Proficiency in Databricks, including PySpark, Spark SQL, and Delta Lake.
- Strong experience with data modelling, optimization, and performance tuning within Databricks.
- Hands-on experience with AWS infrastructure, specifically for Databricks deployments with AWS DMS and S3 based ingestion patterns.
- Solid understanding of data governance, security best practices, and compliance.
- Familiarity with CI/CD principles and practices.
- Excellent problem-solving skills and ability to collaborate effectively in agile teams.
- Hands-on experience supporting and troubleshooting data pipelines is a big plus.
- Databricks certification (Data Engineer Professional) is preferred.
- Prior experience working within financial services or highly regulated environments is preferred.
Skills
- Databricks
- PySpark
- Spark SQL
- Delta Lake
- AWS
- AWS DMS
- S3
- CI/CD
- Data Modelling
- Optimization
- Performance Tuning
- Data Governance
- Security Best Practices
- Compliance
Work Type
- Permanent Full Time
Experience Level
- Associate Director
Benefits
- Competitive compensation
- Significant professional growth opportunities
- Opportunities to directly impact and shape the strategic direction of our data platform.
About the Company
- MUFG Investor Services is a trusted partner to many of the world’s largest public and private funds, providing asset servicing and operational solutions built for alternatives.
- With over $1 trillion in client assets under administration, we offer fund administration, banking, payments, fund financing, foreign exchange overlay, corporate and regulatory services, custody, business consulting, and more.
- Operating from 17 locations worldwide, we help clients mitigate risk, enhance efficiency, and navigate the operational complexities of today’s investment management landscape.
- As a division of Mitsubishi UFJ Financial Group (MUFG), one of the world’s largest financial institutions with approximately $3 trillion in assets, we combine deep expertise with the strength and stability of a leading financial institution.
- Visit us at www.mufg-investorservices.com.
Equal Opportunity
- We are an equal opportunity employer.
