Impress employers and recruiters.
Choose from hundreds of resume examples.
Impress employers and recruiters.
Choose from hundreds of resume examples.
Target Resume Now
About the Role
NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference to design, build, and optimize GPU-accelerated software for AI applications. You will contribute to high-performance open-source frameworks for efficient large-scale model serving and inference, focusing on improving platforms for groundbreaking language models and implementing the latest algorithms for public release.
Responsibilities
- Performance optimization, analysis, and tuning of DL models in domains like LLM, Multimodal and Generative AI.
- Scale performance of DL models across different architectures and types of NVIDIA accelerators.
- Contribute features and code to NVIDIA’s inference libraries, vLLM and SGLang, FlashInfer and LLM software solutions.
- Work with cross-collaborative teams across frameworks, NVIDIA libraries and inference optimization innovative solutions.
Requirements
- Masters or PhD or equivalent experience in relevant field (Computer Engineering, Computer Science, EECS, AI).
- 5+ years of relevant software development experience.
- Excellent C/C++ programming and software design skills.
- SW Agile skills are helpful.
- Python experience is a plus.
- Prior experience with training, deploying or optimizing the inference of DL models in production is a plus.
- Prior background with performance modeling, profiling, debug, and code optimization or architectural knowledge of CPU and GPU is a plus.
- GPU programming experience (CUDA, OAI TRITON or CUTLASS) is a plus.
Skills
- C/C++
- Software Design
- SW Agile
- Python
- Deep Learning Model Inference
- Performance Modeling
- Profiling
- Debug
- Code Optimization
- CPU Architecture
- GPU Architecture
- CUDA
- OAI TRITON
- CUTLASS
- Multi GPU Communications
- NCCL
- NVSHMEM
Location
- Remote
Work Type
- Full-time
Experience Level
- Senior
- 5+ years
Education Level
- Masters
- PhD
- Equivalent Experience
Salary/Compensations
- 152,000 USD - 241,500 USD for Level 3
- 184,000 USD - 287,500 USD for Level 4
Benefits
- Equity
- Comprehensive benefits package
About the Company
- NVIDIA pioneered accelerated computing. Today, our AI infrastructure powers global intelligence, transforming every industry.
- With highly competitive salaries and a comprehensive benefits package, NVIDIA is widely considered to be one of the technology world's most desirable employers.
- We have some of the most forward-thinking and hardworking people in the world working for us and, due to outstanding growth, our special engineering teams are growing fast.
Equal Opportunity
- NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer.
- As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.