Impress employers and recruiters.
Choose from hundreds of resume examples.
Impress employers and recruiters.
Choose from hundreds of resume examples.
Target Resume Now
About the Role
NVIDIA is seeking a Software Engineer specializing in Deep Learning Inference to design, build, and optimize GPU-accelerated software for AI applications. The role involves developing and maintaining high-performance open-source frameworks for large-scale model serving and inference, focusing on improving platforms for groundbreaking language models.
Responsibilities
- Performance optimization, analysis, and tuning of DL models in domains like LLM, Multimodal, and Generative AI.
- Scale performance of DL models across different architectures and types of NVIDIA accelerators.
- Contribute features and code to NVIDIA’s inference libraries, vLLM and SGLang, FlashInfer and LLM software solutions.
- Work with cross-collaborative teams across frameworks, NVIDIA libraries, and inference optimization innovative solutions.
Requirements
- Pursuing or recently completed a MS or PhD in Computer Engineering, Computer Science, EECS, AI, or related field, or equivalent experience.
- Software development experience.
- Excellent C/C++ programming and software design skills.
- SW Agile skills are helpful.
- Python experience is a plus.
- Prior experience with training, deploying, or optimizing the inference of DL models in production is a plus.
- Prior background with performance modeling, profiling, debug, and code optimization or architectural knowledge of CPU and GPU is a plus.
- GPU programming experience (CUDA, OAI TRITON, or CUTLASS) is a plus.
Skills
- Deep Learning Inference
- GPU acceleration
- Open-source frameworks
- Large-scale model serving
- LLM
- Generative AI
- C/C++
- Python
- Performance modeling
- Profiling
- Debugging
- Code optimization
- CPU and GPU architecture
- CUDA
- OAI Triton
- CUTLASS
- PyTorch
- vLLM
- SGLang
- FlashInfer
- Multi GPU Communications
- NCCL
- NVSHMEM
Location
- Remote
Work Type
- Full-time
Experience Level
- Level 2
- Level 3
Education Level
- MS or PhD in Computer Engineering, Computer Science, EECS, AI, or related field, or equivalent experience.
Salary/Compensations
- 124,000 USD - 195,500 USD for Level 2
- 152,000 USD - 241,500 USD for Level 3
Benefits
- Equity
- Benefits
About the Company
- NVIDIA is a technology company focused on AI and GPU technology.
- NVIDIA is considered a desirable employer.
- NVIDIA employs forward-thinking and hardworking individuals.
- NVIDIA values creativity and autonomy.
Equal Opportunity
- NVIDIA is committed to fostering an inclusive work environment and is an equal opportunity employer.
- NVIDIA values diversity and does not discriminate on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law.