Senior Software Engineer - Local AI at NVIDIA | United States | Rezi

Senior Software Engineer - Local AI at NVIDIA

Senior Software Engineer - Local AI

NVIDIA · United States

1 weeks ago

Senior Software Engineer - Local AI

NVIDIA · United States

7 days ago
Resume preview

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now

About the Role

NVIDIA is seeking a Senior Systems Software Engineer to address client-side AI challenges on Windows and Linux PCs with limited resources, focusing on running AI models locally for reduced latency, improved real-time processing, and enhanced privacy.

Responsibilities

  • Partner with NVIDIA software, research, architecture, and product teams to align strategies and technical needs for fostering the ecosystem of AI on RTX and DGX PCs.
  • Collaborate with industry partners to advance AI across critical domains—including graphics, web browsers, and edge devices—by driving innovation in both open and closed source technologies with emphasis on system level support.
  • Improve performance on current and next-generation GPU architectures by conducting in-depth analysis and end-to-end optimization of AI models, data processing pipelines, and inference runtime features.
  • Identify, evaluate, and implement compute and memory optimization techniques—such as quantization, distillation, and pruning—for large AI models; fine-tune and compress models to fit edge devices.

Requirements

  • Bachelor's, Master's, or PhD in Computer Science, Software Engineering, Mathematics, or a related field (or equivalent experience).
  • Excellent C++ programming and debugging skills with a strong understanding of data structures and algorithms.
  • 5+ years of experience with proficiency in AI inferencing pipelines and applications using ML/DL frameworks, including ONNX RT, PyTorch, Tensor RT, llama.cpp and vLLM.
  • Strong analytical and problem-solving abilities, with the ability to multitask effectively in a dynamic environment.
  • Outstanding written and oral communication skills enabling effective collaboration with management and engineering teams.

Skills

  • AI inferencing pipelines
  • ML/DL frameworks
  • ONNX RT
  • PyTorch
  • Tensor RT
  • llama.cpp
  • vLLM
  • C++ programming
  • Data structures
  • Algorithms
  • Machine Learning
  • Deep Neural Networks
  • Generative AI
  • CUDA
  • DirectX
  • Vulkan

Location

  • Remote

Work Type

  • Full-time

Experience Level

  • Senior
  • 5+ years

Education Level

  • Bachelor's Degree
  • Master's Degree
  • PhD

Salary/Compensations

  • 152,000 USD - 241,500 USD for Level 3
  • 184,000 USD - 287,500 USD for Level 4

Benefits

  • Equity
  • Benefits package

About the Company

  • NVIDIA has continuously reinvented itself for over two decades. Our invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI - the new era of computing, positioning GPUs as the driving force behind intelligent applications in productivity, gaming, and creative fields, solidifying NVIDIA's position as the leading "AI computing company."
  • We're a top employer known for innovation and growth.
  • We have some of the most forward-thinking and hardworking people in the world working for us and, due to unprecedented growth, our exclusive engineering teams are rapidly growing.

Equal Opportunity

  • NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer.
  • We highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.