Senior ML Platform Lead Engineer, Training and Inference at Paramount | NY, US | Rezi

Senior ML Platform Lead Engineer, Training and Inference at Paramount

Senior ML Platform Lead Engineer, Training and Inference

Paramount · NY, US

4 days ago

Senior ML Platform Lead Engineer, Training and Inference

Paramount · NY, US

4 days ago
Resume preview

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now
Resume preview

Tailor your resume to this Senior ML Platform Lead Engineer, Training and Inference role.

Rezi rewrites your resume against Paramount's job description. Free.

Resume score gauge reading 58 out of 100

Don't guess if your resume is good enough.

See how it scores against the Senior ML Platform Lead Engineer, Training and Inference posting at Paramount — free, in seconds.

About the Role

We are seeking a Senior Lead / Lead ML Platform Engineer to architect and own the technical direction for our Training and Inference infrastructure. This is a high-leverage role designed for an expert who understands the deep technical stack required to shift ML models from research to global production. You will be responsible for the "engine room" of the AMLG, ensuring that our MLEs can train massive models efficiently and serve them with sub-millisecond reliability. This role requires a unique blend of expertise in distributed systems and hardware acceleration. You will lead the adoption and optimization of AnyScale (Ray) for distributed training and manage a high-performance Kubernetes-based inference environment. You aren't just managing clusters; you are building a seamless, scalable platform that abstracts the complexity of GPUs and distributed compute for the entire organization.

Responsibilities

  • Own the long-term architectural direction for the Training and Inference domains, ensuring the platform scales 10x over a 1–3 year horizon.
  • Lead the implementation and optimization of Ray/AnyScale, providing a unified compute layer for batch processing, model training, and reinforcement learning.
  • Design and maintain K8s-based inference servers (e.g., Triton, TorchServe, or vLLM) optimized for GPU memory management and high throughput.
  • Navigate the trade-offs between different GPU instances (A100s, H100s, T4s), optimizing for cost, availability, and performance.
  • Solve high-leverage problems that affect multiple pods (e.g., Entry, Session, Presentation), establishing reusable patterns for CI/CD, model versioning, and canary deployments.
  • Define and enforce SLIs/SLOs for the platform, ensuring that infrastructure failures never interrupt the user-facing personalization experience.
  • Act as a technical mentor to senior engineers across the ML Platform and Applied ML pods, raising the bar for system design and operational rigor.

Requirements

  • 6-8+ years of experience in ML Infrastructure, Platform Engineering, or high-scale Backend Engineering.
  • Extensive experience with Kubernetes (K8s) and serving frameworks for large-scale ML models.
  • Strong knowledge of GPU architecture, CUDA, and optimizing ML workloads for hardware acceleration.
  • Proven track record of owning the technical direction for a major domain and driving impact across multiple teams.

Skills

  • Kubernetes (K8s)
  • GPU architecture
  • CUDA
  • Infra-as-Code (Terraform/Pulumi)
  • MLOps pipelines
  • Ray (AnyScale)
  • Distributed compute frameworks
  • ML observability tools (Prometheus, Grafana, Weights & Biases, or MLFlow)
  • Multi-cloud or hybrid-cloud ML environments
  • Python
  • C++

Location

  • New York
  • California
  • Colorado
  • Washington state

Work Type

  • Full-time

Experience Level

  • Lead / Senior Lead (IC4–IC5)
  • 6-8+ years of experience

Salary/Compensations

  • $280,000.00 - $280,000.00

Benefits

  • Medical
  • Dental
  • Vision
  • 401(k) plan
  • Life insurance coverage
  • Disability benefits
  • Tuition assistance program
  • PTO
  • Bonus eligible
  • Attractive compensation and comprehensive benefits packages
  • Generous paid time off
  • Complimentary subscriptions to HBO Max, Paramount+, and other Skydance streaming services and digital news products
  • Robust employee engagement opportunities, including access to exclusive screenings and events, speaker series, volunteer activities and more.

About the Company

  • Storytelling is, and will always be, the heart of what we do at Skydance.Our vision is to build a thriving entertainment ecosystem where stories and worlds are imagined, brought to life and experienced. We create for every age and audience, anchored by the strength of our content and experiences and the depth of our connection with fans. We are creator-first, audience-focused, tech-forward, globally scaled.
  • Here, you’ll work with talented teams that move fast, think boldly and collaborate with purpose to deliver results. We aim high, champion the best ideas and win together, earning the trust of our employees, creators, partners and audiences every day.
  • If you’re energized by the opportunity to help build the next-generation global media and entertainment company powered by creativity and technology, we’d be thrilled to welcome you aboard. LET’S GO!
  • Paramount Streaming, a division within Paramount Global, is the home to the company's direct-to-consumer services spanning free and paid in the form of Pluto TV and Paramount+. Pluto TV is the global leader in free ad-supported TV, delivering more than 1,400 global channels and an extensive library of streaming content, including live and original channels. Paramount+, digital subscription video-on-demand and live streaming service, combines live sports, breaking news, and A Mountain of Entertainment™. Paramount+ features an expansive library of original series, hit shows and popular movies across every genre from world-renowned brands and production studios, including SHOWTIME®.

Equal Opportunity

  • Skydance is an equal opportunity employer (EOE)
  • We embrace the opportunity to build a workforce that reflects a wide array of perspectives, backgrounds and experiences. Being an equal opportunity employer means that we take seriously our responsibility to consider qualified candidates on the basis of merit. In line with the laws of the country or region in which the role is based, this includes consideration without regard to race, color, ethnicity, national origin, citizenship status, religion or belief, sex, gender, gender identity or expression, sexual orientation, age, marital status, pregnancy, parenthood, physical or mental disability, genetic information, military or protected veteran status, union status or any other category protected by applicable law.
  • If you are a qualified individual with a disability, you may request a reasonable accommodation during the job application and/or recruitment process. You can request reasonable accommodations by calling 212.846.5500 or by sending an email to paramountaccommodations@paramount.com. Only messages left for this purpose will be returned.