Impress employers and recruiters.
Choose from hundreds of resume examples.
Impress employers and recruiters.
Choose from hundreds of resume examples.
Target Resume Now
About the Role
As a Software Engineer on the Data & AI Technology team, you will design, build, and scale enterprise data catalog and management solutions using the Databricks ecosystem. You will play a key role in enabling data discovery and governance by developing robust, scalable, and secure data services while mentoring team members and shaping the future of the data platform.
Responsibilities
- Design and build scalable components of an enterprise data catalog using automation.
- Integrate enterprise data catalog with Databricks and other data platforms.
- Design and develop data quality, profiling, and classification solutions.
- Lead technical design discussions and drive architectural decisions.
- Advocate for engineering and development best practices.
- Collaborate on priority projects to develop deep technical expertise.
- Evaluate trade-offs between correctness, robustness, performance, and customer impact.
- Identify technical risks and propose scalable, long-term solutions.
- Mentor and guide junior engineers.
- Communicate with stakeholders and product managers to align infrastructure with product goals.
Requirements
- Bachelor’s or master’s degree in computer science, Engineering, or a related field.
- Solid understanding of common design patterns and lakehouse architecture.
- Experience working with backend and frontend development frameworks.
- Strong programming skills in Python and/or Java.
- Proven experience with Databricks, Unity Catalog, Delta Lake, and Apache Spark.
- Experience building or integrating enterprise data catalog tools such as Atlan, Alation, Collibra, DataHub, or OpenMetadata.
- Experience designing and building reusable data quality, profiling, and classification frameworks.
- Experience implementing data security and access control models.
- Solid understanding of data governance, metadata management, and data lineage concepts.
- Experience with cloud platforms like Azure or GCP.
- Experience with infrastructure-as-code tools such as Terraform.
- Familiarity with RESTful APIs, microservice architecture, and distributed designs.
- Knowledge of streaming technologies like Kafka and structured streaming.
- Understanding of product development processes and data infrastructure requirements.
Skills
- Python
- Java
- Databricks
- Unity Catalog
- Delta Lake
- Apache Spark
- Data Governance
- Metadata Management
- Data Lineage
- Azure
- GCP
- Terraform
- RESTful APIs
- Microservices
- Kafka
- Structured Streaming
- Problem-solving
- Analytical skills
Location
- Toronto, Ontario, Canada
Education Level
- Bachelor’s degree
- Master’s degree
Benefits
- Upskilling through online courses
- Cross-functional development opportunities
- Tuition assistance
- Competitive rewards program including bonus
- Flexible vacation, personal, and sick days
- Benefits starting on day one
- Free tea and coffee
- Community engagement programs
About the Company
- Scotiabank is a leading bank in the Americas.
- Guided by the purpose: for every future.
- Provides personal, commercial, wealth, private, corporate, and investment banking services.
Equal Opportunity
- Scotiabank is committed to an inclusive culture with bias-free practices.
- Provides opportunities through Employee Resource Groups.
- Committed to creating and maintaining an inclusive and accessible environment by removing barriers.