Senior System Software Engineer – Dynamo Tools at NVIDIA | California, United States | Rezi

Senior System Software Engineer – Dynamo Tools at NVIDIA

Senior System Software Engineer – Dynamo Tools

NVIDIA · California, United States

2 weeks ago

Senior System Software Engineer – Dynamo Tools

NVIDIA · California, United States

15 days ago
Resume preview

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now

About the Role

Own and advance AI-Perf, NVIDIA's flagship framework for benchmarking, experimentation, and analysis of LLMs, Generative AI, and deep learning inference workloads. Combine systems research, distributed systems engineering, and applied AI to enable reproducible performance evaluation, influence internal platforms, and provide global tooling for researchers and engineers.

Responsibilities

  • Lead the design, development, and roadmap of AI-Perf, defining benchmarking methodologies, performance metrics, and reproducible experimental workflows.
  • Build scalable and high-performance features to measure latency, throughput, and efficiency across AI models and distributed systems.
  • Partner with AI researchers, platform teams, and engineers to translate experimental challenges into robust, user-friendly performance tooling.
  • Integrate AI-Perf with the Dynamo Inference Stack, other NVIDIA inference stacks, and open-source inference frameworks, delivering end-to-end performance insights for researchers and production users.

Requirements

  • Bachelor's, Master's, or PhD in Computer Science, Computer Engineering, or related field—or equivalent experience.
  • 3+ years of experience in systems software, distributed performance engineering, or AI infrastructure research.
  • Expert-level Python skills, including profiling, optimization, automation, and debugging of complex systems.
  • Deep knowledge of distributed systems concepts, including scalability, concurrency, fault tolerance, and performance trade-offs.

Skills

  • Python
  • Distributed systems
  • Performance benchmarking
  • LLMs
  • Deep learning frameworks
  • PyTorch
  • TensorFlow
  • TensorRT
  • ONNX Runtime
  • Cloud environments
  • On-prem environments
  • AWS
  • Azure
  • GCP

Location

  • Remote
  • Hybrid
  • Onsite

Work Type

  • Full-time

Experience Level

  • Senior
  • 3+ years

Education Level

  • Bachelor's Degree
  • Master's Degree
  • PhD

Salary/Compensations

  • 152,000 USD - 241,500 USD for Level 3
  • 184,000 USD - 287,500 USD for Level 4

Benefits

  • Equity
  • Comprehensive benefits package

About the Company

  • NVIDIA is widely considered to be one of the technology world's most desirable employers.
  • We have some of the most forward-thinking and hardworking people in the world working for us and, due to outstanding growth, our special engineering teams are growing fast.
  • NVIDIA uses AI tools in its recruiting processes.

Equal Opportunity

  • NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer.
  • We do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.