About the Role
Join the Total Fund Management Portfolio Management Technology team as a hands-on Data Engineer, focusing on building and optimizing large-scale cloud data systems with Spark/PySpark and modern storage formats.
Responsibilities
- Develop and optimize Spark workloads in cloud environments
- Work with large datasets using Parquet and Iceberg
- Translate requirements into robust engineering solutions
- Ensure performance, reliability, and maintainability
- Contribute to monitoring, documentation, and deployment
Requirements
- Strong Python and PySpark
- Hands-on Apache Spark, cloud preferred
- Databricks experience
- Large-scale data systems expertise
- Client-facing delivery background
- Independent problem-solving in ambiguous settings
Skills
- Python
- PySpark
- Apache Spark
- Databricks
- Parquet
- Iceberg
- AWS Glue
- Lake Formation
- Airflow
- Orchestration tools
- Distributed data architectures
- Capital markets
