Senior Lead Data & AI Engineer at Vanguard | CA | Rezi

Senior Lead Data & AI Engineer at Vanguard

Senior Lead Data & AI Engineer

Vanguard · CA

4 days ago

Senior Lead Data & AI Engineer

Vanguard · CA

5 days ago
Resume preview

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now
Resume preview

Tailor your resume to this Senior Lead Data & AI Engineer role.

Rezi rewrites your resume against Vanguard's job description. Free.

Resume score gauge reading 58 out of 100

Don't guess if your resume is good enough.

See how it scores against the Senior Lead Data & AI Engineer posting at Vanguard — free, in seconds.

About the Role

Lead the design and delivery of enterprise-scale Data & AI solutions that power analytics, operational decision-making, and AI innovation across the organization. This role is responsible for building scalable data foundations, reusable engineering frameworks, and AI-ready data products.

Responsibilities

  • Lead the architecture, design, and delivery of enterprise-scale data engineering solutions leveraging Databricks and AWS.
  • Design and implement scalable, resilient, and reusable data pipelines supporting batch, streaming, and event-driven workloads.
  • Drive engineering best practices across data ingestion, transformation, orchestration, testing, monitoring, and deployment.
  • Establish reusable frameworks, patterns, and standards to accelerate delivery and improve engineering quality across teams.
  • Architect and implement modern Lakehouse solutions utilizing Databricks, Delta Lake, Unity Catalog, and cloud-native services.
  • Develop metadata-driven and configuration-based frameworks that standardize ingestion, transformation, quality validation, and deployment processes.
  • Design and implement Delta Live Tables (DLT), Lakeflow Pipelines, and Databricks Workflows to automate enterprise data processing.
  • Build trusted, governed, and reusable data products that support analytics, reporting, data science, and AI initiatives.
  • Optimize platform performance, scalability, reliability, and cost efficiency across large-scale workloads.
  • Lead migration and modernization initiatives from legacy platforms to cloud-native data architectures.
  • Implement data observability, monitoring, lineage, metadata management, and quality controls throughout the data lifecycle.
  • Partner with architecture and platform teams to advance enterprise data platform capabilities and engineering standards.
  • Support implementation of CI/CD, Infrastructure-as-Code, automated testing, and DevSecOps practices.
  • Build AI-ready data foundations that support machine learning, Generative AI, and intelligent business applications.
  • Partner with Data Scientists, AI Engineers, and business teams to operationalize data products and AI solutions.
  • Support implementation of vector search, semantic models, retrieval-augmented generation (RAG), and knowledge-driven AI capabilities.
  • Contribute to AI orchestration and agent-based solutions where business value can be accelerated through intelligent automation.
  • Enable reliable integration between AI applications and enterprise data platforms.
  • Implement enterprise-grade governance using Unity Catalog, metadata repositories, and data quality frameworks.
  • Ensure compliance with enterprise security, privacy, and regulatory requirements.
  • Design automated controls for data validation, observability, lineage, and operational monitoring.
  • Partner with governance organizations to improve trust and accessibility of critical data assets.
  • Act as a trusted technical advisor to business, analytics, and technology stakeholders.
  • Mentor and provide technical leadership to Data Engineers and platform teams.
  • Lead architecture reviews, design workshops, and engineering governance activities.
  • Translate complex technical concepts into actionable business outcomes for leadership audiences.

Requirements

  • Bachelor's or Master's degree in Computer Science, Engineering, Information Systems, or related discipline.
  • 9-12+ years of experience in Data Engineering, Data Platform Engineering, or Analytics Engineering.
  • 5+ years of hands-on experience building enterprise solutions on Databricks.
  • Strong expertise in Lakehouse architecture, Delta Lake, Unity Catalog, and modern data engineering patterns.
  • Proven experience building large-scale data pipelines using Spark, PySpark, SQL, and Python.
  • Deep experience with AWS services supporting Data & AI platforms.
  • Experience implementing Delta Live Tables, Lakeflow, Databricks Workflows, and metadata-driven engineering approaches.
  • Strong understanding of data modeling, data products, data governance, metadata management, and data quality frameworks.
  • Experience with CI/CD, Infrastructure-as-Code, automated testing, and cloud-native engineering practices.
  • Demonstrated leadership experience mentoring engineers and leading complex technical initiatives.
  • Strong communication and stakeholder management skills.

Skills

  • Databricks
  • AWS
  • Lakehouse architecture
  • Delta Lake
  • Unity Catalog
  • Spark
  • PySpark
  • SQL
  • Python
  • Delta Live Tables (DLT)
  • Lakeflow Pipelines
  • Databricks Workflows
  • CI/CD
  • Infrastructure-as-Code
  • Automated testing
  • DevSecOps
  • Vector search
  • Semantic models
  • Retrieval-augmented generation (RAG)
  • Metadata-driven engineering

Location

  • Hybrid

Work Type

  • Hybrid
  • Full-time

Experience Level

  • 9-12+ years of experience
  • 5+ years of hands-on experience

Education Level

  • Bachelor's or Master's degree in Computer Science, Engineering, Information Systems, or related discipline

Salary/Compensations

  • 93,000 to 165,000

Benefits

  • Health insurance
  • Accident and life insurance
  • Retirement savings plans

About the Company

  • Vanguard has implemented a hybrid working model for the majority of our crew members, designed to capture the benefits of enhanced flexibility while enabling in-person learning, collaboration, and connection. We believe our mission-driven and highly collaborative culture is a critical enabler to support long-term client outcomes and enrich the employee experience.

Equal Opportunity

  • Vanguard does not use artificial intelligence (AI) or automated decision-making tools in its recruitment process. All application reviews and hiring decisions are made by our recruitment team.
  • Vanguard is committed to fostering an accessible and inclusive workplace. We are committed to providing barrier-free and accessible employment practices in compliance with the Accessibility for Ontarians with Disabilities Act (AODA) and the Ontario Human Rights Code. If you require accommodation at any stage of the recruitment process, please inform us. We will work with you to meet your needs and you can reach us at americas_crewcentral@vanguardhr.com, quoting the job ID and job title.