Impress employers and recruiters.
Choose from hundreds of resume examples.
Impress employers and recruiters.
Choose from hundreds of resume examples.
Tailor your resume to this Training / AI Infrastructure role.
Rezi rewrites your resume against Genesis's job description. Free.
Tailor your resume to this Training / AI Infrastructure role.
Rezi rewrites your resume against Genesis's job description. Free.
Don't guess if your resume is good enough.
See how it scores against the Training / AI Infrastructure posting at Genesis — free, in seconds.
Don't guess if your resume is good enough.
See how it scores against the Training / AI Infrastructure posting at Genesis — free, in seconds.
About the Role
Drive down wall-clock time to convergence by profiling and eliminating bottlenecks across the foundation model training stack, from data pipelines to GPU kernels. Design, build, and optimize distributed training systems (PyTorch) for multi-node GPU clusters, ensuring scalability, robustness, and high utilization. Implement efficient low-level code (CUDA, cuDNN, Triton, custom kernels) and integrate it seamlessly into high-level training frameworks. Optimize workloads for hardware efficiency: CPU/GPU compute balance, memory management, data throughput, and networking. Develop monitoring and debugging tools for large-scale runs, enabling rapid diagnosis of performance regressions and failures.
Responsibilities
- Drive down wall-clock time to convergence by profiling and eliminating bottlenecks across the foundation model training stack, from data pipelines to GPU kernels.
- Design, build, and optimize distributed training systems (PyTorch) for multi-node GPU clusters, ensuring scalability, robustness, and high utilization.
- Implement efficient low-level code (CUDA, cuDNN, Triton, custom kernels) and integrate it seamlessly into high-level training frameworks.
- Optimize workloads for hardware efficiency: CPU/GPU compute balance, memory management, data throughput, and networking.
- Develop monitoring and debugging tools for large-scale runs, enabling rapid diagnosis of performance regressions and failures.
Requirements
- Deep experience in distributed systems, ML infrastructure, or high-performance computing (8+ years)
- Production-grade expertise in Python
- Low-level performance mastery: CUDA/cuDNN/Triton, CPU–GPU interactions, data movement, and kernel optimization
- Scaling at the frontier: experience with PyTorch and training jobs using data, context, pipeline, and model parallelism
- System-level mindset with a track record of tuning hardware–software interactions for maximum utilization
Skills
- Python
- CUDA
- cuDNN
- Triton
- PyTorch
- distributed systems
- ML infrastructure
- high-performance computing
- kernel optimization
- data parallelism
- context parallelism
- pipeline parallelism
- model parallelism
Experience Level
- 8+ years