Impress employers and recruiters.
Choose from hundreds of resume examples.

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now

About the Role

This Principal Software Engineer role focuses on developing and integrating the AI Virtualization Stack to provide hardware-agnostic acceleration for AI/ML workloads on Virtual Machines. The position is critical for enabling multi-vendor GPU and XPU support using ML compilation technologies.

Responsibilities

• Research, design, and develop the AI Virtualization Stack for ESXi server products.
• Implement and optimize PyTorch and JAX backends using OpenXLA for high-performance AI/ML workload execution across GPUs and XPUs.
• Analyze and re-architect performance-critical ML acceleration code, focusing on LLM inference optimization techniques like KV-caching and FlashAttention.
• Troubleshoot and resolve bugs related to AI/ML acceleration functionality.
• Deliver software adhering to VCF coding guidelines and quality standards.
• Develop and maintain technical documentation for delivered features.
• Collaborate with virtual driver and device teams, and external GPU/XPU vendors, to provide end-to-end support for ML frameworks.
• Stay updated on the latest GPU/XPU hardware architecture and AI/ML compiler technologies.

Requirements

• Bachelor's degree in Computer Science or related field with 12+ years of experience, or Master's degree with 10+ years of experience.
• 5+ years of experience in ML framework/runtime development, GPU/XPU backend engineering.
• Strong understanding and direct experience with ML frameworks (PyTorch, JAX) and graph/ML compiler technologies (e.g., OpenXLA).
• Proficiency in C++ and Python programming languages.
• Strong problem-solving skills and ability to troubleshoot complex issues.
• Excellent communication and collaboration skills.
• Experience with version control systems such as Git.
• Ability to thrive in a fast-paced and dynamic work environment.
• Familiarity with enterprise coding standards and best practices.
• Legal authorization to work in the US.

Skills

• ML framework development
• ML runtime development
• GPU backend engineering
• XPU backend engineering
• PyTorch
• JAX
• Graph compiler technologies
• ML compiler technologies
• OpenXLA
• C++
• Python
• Problem-solving
• Troubleshooting
• Communication
• Collaboration
• Git
• Enterprise coding standards
• ML compilation technologies
• LLM inference optimization
• KV-caching
• FlashAttention
• GPU/XPU hardware architecture
• AI/ML compiler technologies
• Inference servers (vLLM, Triton)
• Low-level GPU kernel development (CUDA, ROCm)

Experience Level

• 12+ years of related experience (with Bachelor's degree)
• 10+ years of related experience (with Master's degree)
• 5+ years in ML framework/runtime development, GPU/XPU backend engineering

Education Level

• Bachelor's degree in Computer Science or related field
• Master's degree

Salary/Compensations

• $127,100 - $226,000

Benefits

• Discretionary annual bonus
• Competitive new hire equity grant
• Annual equity awards
• Medical plans
• Dental plans
• Vision plans
• 401(K) participation including company matching
• Employee Stock Purchase Program (ESPP)
• Employee Assistance Program (EAP)
• Company paid holidays
• Paid sick leave
• Vacation time
• Paid Family Leave
• Other leaves of absence

About the Company

• Broadcom is a global leader in semiconductor and infrastructure software solutions.
• Its VMware subsidiary is dedicated to shaping the future of virtualization technology.
• The GPU Virtualization Team is part of the VMware Cloud Foundation (VCF) Division, enabling readily deployable, easily managed solutions with GPUs for modern applications.

Equal Opportunity

• Broadcom is an equal opportunity employer.
• Qualified applicants are considered without regard to race, color, creed, religion, sex, sexual orientation, national origin, citizenship, disability status, medical condition, pregnancy, protected veteran status, or any other characteristic protected by federal, state, or local law.
• Qualified applicants with arrest and conviction records are considered consistent with local law.