Senior Engineer | AI Assurance | Multiple Locations at Deloitte Services Pty Ltd | AU | Rezi

Senior Engineer | AI Assurance | Multiple Locations at Deloitte Services Pty Ltd

Senior Engineer | AI Assurance | Multiple Locations

Deloitte Services Pty Ltd · AU

4 days ago

Senior Engineer | AI Assurance | Multiple Locations

Deloitte Services Pty Ltd · AU

5 days ago
Resume preview

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now
Resume preview

Tailor your resume to this Senior Engineer | AI Assurance | Multiple Locations role.

Rezi rewrites your resume against Deloitte Services Pty Ltd's job description. Free.

Resume score gauge reading 58 out of 100

Don't guess if your resume is good enough.

See how it scores against the Senior Engineer | AI Assurance | Multiple Locations posting at Deloitte Services Pty Ltd — free, in seconds.

About the Role

We are seeking a Senior Engineer with a strong interest in independent evaluation, assurance, controls, and governance. This role involves applying deep technical expertise to assurance and evaluation challenges within a team that values high-quality work, strong relationships, and a sustainable work-life balance.

Responsibilities

  • Lead technical evaluation workstreams for complex AI systems, designing robust approaches across models, retrieval-augmented generation, agents, data, platforms, MLOps/LLMOps, and lifecycle controls.
  • Assess architecture, implementation, and operational evidence.
  • Design testing for risks such as hallucination, robustness, safety, reliability, and performance degradation.
  • Work with engagement leaders to bring technical, controls, and business evidence into a clear assurance position.
  • Lead technical workshops.
  • Challenge client engineers, data scientists, architects, and platform teams constructively.
  • Coach multidisciplinary teams.
  • Help strengthen methodology, technical quality practices, and market proposition.

Requirements

  • Deep experience in building, operating, or evaluating production AI systems, including complex GenAI implementations.
  • Experience in advanced AI or model evaluation, statistical evaluation, experimentation, quality engineering, reliability engineering, or model validation.
  • Demonstrated experience with leading cloud AI platforms and model ecosystems, as well as MLOps/LLMOps, context engineering, retrieval-augmented generation, and production monitoring.
  • Ability to lead technical discussions with experienced engineers, data scientists, architects, and risk stakeholders.
  • Ability to translate detailed technical analysis into concise, well-supported findings and assurance conclusions.
  • Experience coaching technical practitioners and reviewing complex technical work to ensure quality and reproducibility.
  • The preferred candidate will be subject to background screening by Deloitte or by their external third-party provider.

Skills

  • Advanced Python skills
  • Strong practical understanding of evaluation tooling
  • Data pipelines
  • APIs
  • Model behaviour
  • Production evidence

Location

  • Remote
  • Hybrid
  • Onsite

Work Type

  • Full-time

Experience Level

  • Senior

Education Level

  • Relevant IT or business qualifications will be viewed favourably.

Benefits

  • Retail discounts
  • Wellbeing leave
  • Paid volunteering days
  • Twelve flexible working options
  • Market-leading parental leave
  • Return to work support package

About the Company

  • We value in-person connection with our teams and clients, with flexibility to balance work and life.
  • Mentoring, coaching, and leadership programs to help make an impact that matters.
  • Unlock everyday savings through our MyBenefits platform on retail, tech, travel and more.
  • At Deloitte, we focus our energy on interesting and impactful work.
  • We’re always learning, innovating and setting the standard; making a positive difference to our clients and our society.
  • We put coaching at the heart of what we do, helping our people grow their careers in any direction – whether it be up, moving into something new, or even moving across the world.
  • We embrace diversity, equity and inclusion.
  • We have a diverse collection of people from different backgrounds, with different experiences, gender identities, abilities and thinking styles.
  • What binds us together is a shared commitment to value everyone’s perspective and to cultivate inclusion; so that our work environment is a safe space we can all belong.
  • We value in-person connection with our clients and our colleagues.
  • We offer several ways for you to work flexibly so that you can serve your clients, stay connected with your team, and manage your personal priorities.
  • We help you live and work well.
  • AI Assurance sits within our Digital Assurance team in Deloitte’s Audit & Assurance business.
  • We help organisations build confidence in AI systems through independent evaluation, internal audit, controls assessment, readiness reviews and technical assurance.
  • Our work combines assurance judgement, risk and controls expertise, data and analytics, and practical experience with production AI systems to help clients make well-supported decisions about whether their AI is reliable, controlled and fit for purpose.
  • We don’t treat AI assurance as standard IT controls testing, nor as AI implementation.
  • Instead, we translate business and risk questions into proportionate evaluation approaches, assess the strength and limitations of evidence, and communicate confidence clearly.

Equal Opportunity

  • We embrace diversity, equity and inclusion.
  • We have a diverse collection of people from different backgrounds, with different experiences, gender identities, abilities and thinking styles.
  • What binds us together is a shared commitment to value everyone’s perspective and to cultivate inclusion; so that our work environment is a safe space we can all belong.