Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now

About the Role

We are seeking an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform. This role is ideal for an engineer who is equally comfortable building automated delivery pipelines, operating high-performance inference, and building deep observability and cost visibility, understanding that in regulated contexts every AI workload must be delivered repeatably and every AI request must be economically bounded, attributable, and traceable end-to-end.

Responsibilities

Own DevOps and delivery for AI workloads, building and operating CI/CD/CV pipelines for AI services, agents, and runtime components.
Own governance and discovery for AI assets, including service catalog/registry, experiment tracking, model metadata, CVE/SBOM scanning, lineage contracts, and license management.
Own resource and cost management, including quotas, rate limits, cost attribution, and utilization.
Own the full observability stack, including metrics, logs, traces, dashboards, and LLM debugging and evaluation.
Own the OpenTelemetry collection layer, including multi-tenant receiver, exporters, queues, DCGM exporter for GPU telemetry, processor batching, and dynamic filtering.
Automate GitOps-based delivery and continuous verification, embedding quality, integrity, and cost gates into pipelines.
Close the loop between delivery and observability by using telemetry, evaluation, and cost signals to drive deployment decisions, progressive rollout, and automated rollback of AI workloads.
Ensure cost and telemetry are identity-stamped and per-tenant for end-to-end attribution.

Requirements

Bachelor’s or Master’s degree in Computer Science or related technical field.
8+ years in DevOps, MLOps, platform, or observability engineering, with hands-on production ownership of AI or high-throughput services.
Strong hands-on DevOps experience, including CI/CD/CV pipelines and GitOps tooling for automated build, test, release, and rollback.
Hands-on expertise operating inference/model-serving frameworks on GPU infrastructure.
Strong experience with observability stacks and OpenTelemetry.
Experience with API gateways and request routing, including streaming responses.
Experience with cost management / FinOps tooling and quota/rate-limit enforcement.
Familiarity with model/artifact registries and supply-chain scanning.
Proven track record operating AI or service infrastructure under compliance, security, or regulatory constraints.
Ability to define clean ownership boundaries and consumption contracts with platform, trust, and data teams.

Skills

Strong DevOps expertise: CI/CD/CV pipeline design, GitOps, continuous verification, and progressive/automated release and rollback for production workloads.
Deep expertise operating model-serving and inference systems on GPUs at production scale.
Deep observability skills: metrics, logs, traces, and OpenTelemetry.
FinOps mindset: able to attribute, bound, and optimize AI consumption cost per tenant and workload.
Familiarity with model/artifact governance, registries, CVE scanning, and license/lineage tracking.
Comfortable operating across cloud, on-prem, edge, and air-gapped environments with consistent runtime and telemetry semantics.
Strong communicator able to explain runtime, cost, and observability tradeoffs to engineers, architects, and leadership.

Location

Anywhere in Country

Work Type

Hybrid

Experience Level

8+ years

Education Level

Bachelor's or Master's degree in Computer Science or related technical field

Salary/Compensations

$125,500 to $230,200 (US)
$150,700 to $261,600 (New York City Metro Area, Washington State, California)

Benefits

Medical and dental coverage
Pension and 401(k) plans
Wide range of paid time off options
Flexible vacation policy
Time off for designated EY Paid Holidays, Winter/Summer breaks, Personal/Family Care, and other leaves of absence

About the Company

EY is building a better working world by creating new value for clients, people, society and the planet, while building trust in capital markets.
Enabled by data, AI and advanced technology, EY teams help clients shape the future with confidence and develop answers for the most pressing issues of today and tomorrow.
EY teams work across a full spectrum of services in assurance, consulting, tax, strategy and transactions.
Fueled by sector insights, a globally connected, multi-disciplinary network and diverse ecosystem partners, EY teams can provide services in more than 150 countries and territories.

Equal Opportunity

EY provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy, genetic information, national origin, protected veteran status, disability status, or any other legally protected basis, including arrest and conviction records, in accordance with applicable law.
EY is committed to providing reasonable accommodation to qualified individuals with disabilities including veterans with disabilities.