Engineer | AI Assurance | Multiple Locations at Deloitte Services Pty Ltd | AU | Rezi

Engineer | AI Assurance | Multiple Locations at Deloitte Services Pty Ltd

Engineer | AI Assurance | Multiple Locations

Deloitte Services Pty Ltd · AU

4 days ago

Engineer | AI Assurance | Multiple Locations

Deloitte Services Pty Ltd · AU

5 days ago
Resume preview

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now
Resume preview

Tailor your resume to this Engineer | AI Assurance | Multiple Locations role.

Rezi rewrites your resume against Deloitte Services Pty Ltd's job description. Free.

Resume score gauge reading 58 out of 100

Don't guess if your resume is good enough.

See how it scores against the Engineer | AI Assurance | Multiple Locations posting at Deloitte Services Pty Ltd — free, in seconds.

About the Role

We’re looking for an Engineer with a strong interest in independent evaluation, assurance, controls and governance, and the ability to apply deep technical expertise to assurance and evaluation challenges. You’ll join a team that values high-quality work, strong relationships and a sustainable work-life balance.

Responsibilities

  • Independently evaluate AI systems by assessing architecture, implementation, controls and operational evidence to form clear, defensible conclusions on fitness for purpose, risk, reliability and control effectiveness.
  • Execute technical testing across models, prompts, retrieval-augmented generation, agents, data pipelines, platforms and lifecycle controls.
  • Assess behaviours such as accuracy, robustness, safety, hallucination and material failure modes.
  • Help build reusable evaluation and assurance infrastructure.
  • Develop high-quality assurance evidence.
  • Work closely with client engineers, data scientists, platform teams, risk teams and Internal Audit stakeholders through technical workshops and reviews.

Requirements

  • Experience building production AI systems or platforms.
  • Experience with Azure AI Foundry, AWS Bedrock, Vertex AI or similar AI platforms, as well as major model ecosystems such as OpenAI, Anthropic and Gemini.
  • Working knowledge of MLOps or LLMOps, context engineering, retrieval-augmented generation, model and prompt evaluation, and production monitoring.
  • Strong Python skills, with experience working with data, APIs, model outputs and technical evidence.
  • Ability to clearly communicate technical observations and contribute to high-quality workpapers, findings, and assurance conclusions.
  • Strong critical thinking, with the ability to assess fitness for purpose, risk, evidence quality, uncertainty and limitations.
  • Clear technical writing and communication skills, with the ability to explain methods and conclusions to multidisciplinary stakeholders.
  • Relevant IT or business qualifications will be viewed favourably.
  • The preferred candidate will be subject to background screening by Deloitte or by their external third-party provider.

Skills

  • AI Assurance
  • Independent evaluation
  • Assurance
  • Controls
  • Governance
  • Technical expertise
  • AI systems evaluation
  • Architecture assessment
  • Implementation assessment
  • Operational evidence assessment
  • Risk assessment
  • Reliability assessment
  • Control effectiveness assessment
  • Technical testing
  • Model testing
  • Prompt testing
  • Retrieval-augmented generation testing
  • Agent testing
  • Data pipeline testing
  • Platform testing
  • Lifecycle control testing
  • Accuracy assessment
  • Robustness assessment
  • Safety assessment
  • Hallucination assessment
  • Material failure mode assessment
  • Evaluation infrastructure development
  • Assurance infrastructure development
  • Assurance evidence development
  • Technical workshops
  • Technical reviews
  • MLOps
  • LLMOps
  • Context engineering
  • Model evaluation
  • Prompt evaluation
  • Production monitoring
  • Python
  • Data analysis
  • API integration
  • Technical evidence analysis
  • Critical thinking
  • Evidence quality assessment
  • Uncertainty assessment
  • Limitations assessment
  • Technical writing
  • Technical communication

Work Type

  • In-person connection
  • Flexible working options

Benefits

  • Mentoring programs
  • Coaching programs
  • Leadership programs
  • MyBenefits platform for everyday savings on retail, tech, travel and more
  • Retail discounts
  • Wellbeing leave
  • Paid volunteering days
  • Twelve flexible working options
  • Market-leading parental leave
  • Return to work support package

About the Company

  • We value in-person connection with our teams and clients, with flexibility to balance work and life.
  • At Deloitte, we focus our energy on interesting and impactful work.
  • We’re always learning, innovating and setting the standard; making a positive difference to our clients and our society.
  • We put coaching at the heart of what we do, helping our people grow their careers in any direction – whether it be up, moving into something new, or even moving across the world.
  • AI Assurance sits within our Digital Assurance team in Deloitte’s Audit & Assurance business.
  • We help organisations build confidence in AI systems through independent evaluation, internal audit, controls assessment, readiness reviews and technical assurance.
  • Our work combines assurance judgement, risk and controls expertise, data and analytics, and practical experience with production AI systems to help clients make well-supported decisions about whether their AI is reliable, controlled and fit for purpose.
  • We don’t treat AI assurance as standard IT controls testing, nor as AI implementation.
  • Instead, we translate business and risk questions into proportionate evaluation approaches, assess the strength and limitations of evidence, and communicate confidence clearly.

Equal Opportunity

  • We embrace diversity, equity and inclusion.
  • We have a diverse collection of people from different backgrounds, with different experiences, gender identities, abilities and thinking styles.
  • What binds us together is a shared commitment to value everyone’s perspective and to cultivate inclusion; so that our work environment is a safe space we can all belong.
  • By applying for this job, you’ll be assessed against the Deloitte Talent Standards.
  • We’ve designed these standards so that you can grow in your career, and we can provide our clients with a consistent and exceptional Deloitte employee experience globally.