Impress employers and recruiters.
Choose from hundreds of resume examples.
Impress employers and recruiters.
Choose from hundreds of resume examples.
Tailor your resume to this Software Engineer, GPU Performance role.
Rezi rewrites your resume against HeyGen's job description. Free.
Tailor your resume to this Software Engineer, GPU Performance role.
Rezi rewrites your resume against HeyGen's job description. Free.
Don't guess if your resume is good enough.
See how it scores against the Software Engineer, GPU Performance posting at HeyGen — free, in seconds.
Don't guess if your resume is good enough.
See how it scores against the Software Engineer, GPU Performance posting at HeyGen — free, in seconds.
About the Role
HeyGen is seeking a Software Engineer focused on GPU performance to enhance the speed and efficiency of AI applications like Avatar IV, Photo Avatar, Interactive Avatar, and Video Translation. This role involves optimizing model execution and inference infrastructure by analyzing and improving latency, throughput, and GPU costs, appealing to engineers interested in the interplay between software and hardware.
Responsibilities
- Investigate GPU utilization, kernel execution, memory bandwidth, and CPU–GPU data movement using NVIDIA Nsight Systems, Nsight Compute, and PyTorch Profiler.
- Identify and measure the impact of bottlenecks across model execution, preprocessing, and inference serving.
- Enhance performance through batching, scheduling, memory management, and improved GPU utilization.
- Develop or integrate high-performance GPU kernels when existing implementations are performance-limiting.
- Build benchmarks and automated checks to detect performance regressions in video workloads.
- Collaborate with AI researchers and infrastructure engineers to implement optimizations in production.
- Measure the impact of changes on latency, throughput, cost, and output quality.
Requirements
- Experience optimizing GPU-based AI workloads or high-performance computing systems.
- Proficiency in Python and experience with PyTorch or a similar machine learning framework.
- Strong understanding of GPU hardware, including memory bandwidth, cache behavior, tensor cores, and CPU-GPU data movement.
- Experience using profiling tools to link hardware behavior to application bottlenecks and validate improvements.
- Ability to implement performance changes reliably in production and articulate tradeoffs.
- Experience with CUDA, Triton, or C++ GPU programming.
- Experience optimizing video, image, audio, diffusion, or Transformer models.
- Familiarity with multi-GPU inference, GPU interconnects, quantization, or large-scale model serving.
- Experience building performance benchmarks or regression testing infrastructure.
- Prior experience in a fast-paced technology environment.
Skills
- Python
- PyTorch
- GPU performance optimization
- Profiling tools
- CUDA
- Triton
- C++ GPU programming
- Video model optimization
- Image model optimization
- Audio model optimization
- Diffusion model optimization
- Transformer model optimization
- Multi-GPU inference
- GPU interconnects
- Quantization
- Large-scale model serving
- Performance benchmarking
- Regression testing
Location
- Remote
Work Type
- Full-time
Experience Level
- Mid-level
- Senior
Benefits
- Competitive salary and benefits package
- Dynamic and inclusive work environment
- Opportunities for professional growth and advancement
- Collaborative culture that values innovation and creativity
- Access to the latest technologies and tools
About the Company
- HeyGen's mission is to make visual storytelling accessible to all by building technology that empowers more people to reach, captivate, and inspire audiences.
- Learn more at www.heygen.com.
- Visit our Mission and Culture doc here.
Equal Opportunity
- HeyGen is an Equal Opportunity Employer.
- We celebrate diversity and are committed to creating an inclusive environment for all employees.