Performance Engineer at CuspAI | GB | Rezi

Performance Engineer at CuspAI

Performance Engineer

CuspAI · GB

2 weeks ago

Performance Engineer

CuspAI · GB

15 days ago
Resume preview

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now
Resume preview

Tailor your resume to this Performance Engineer role.

Rezi rewrites your resume against CuspAI's job description. Free.

Resume score gauge reading 58 out of 100

Don't guess if your resume is good enough.

See how it scores against the Performance Engineer posting at CuspAI — free, in seconds.

About the Role

CuspAI is seeking a Performance Engineer to optimize the efficiency of their frontier AI models and high-performance computing infrastructure, accelerating materials discovery.

Responsibilities

  • Analyze model architectures to optimize mathematical operations on hardware, focusing on NVIDIA GPU kernels and collective communication layers (NCCL).
  • Implement state-of-the-art efficiency techniques like quantization, model pruning, and distillation to reduce latency for materials "search engine" APIs.
  • Streamline data pipelines to ensure high-performance accelerators are never starved for data during massive training runs.
  • Use advanced observability tools to trace end-to-end execution of training jobs, pinpointing processing clogs or interconnect contention.
  • Build and maintain real-time dashboards tracking vital system metrics, including MFU, memory bandwidth utilization, and cluster uptime.
  • Monitor and justify the utilization of AI accelerators (e.g., H100 clusters), preventing idle time and memory leaks.
  • Develop scaling laws and internal tools to predict system behavior across compute, memory, and networking as models grow.
  • Work closely with AI Researchers to adapt model architectures for better hardware compatibility without sacrificing scientific accuracy.
  • Partner with the Infrastructure team to influence the design of future compute clusters based on performance data and profiling results.

Requirements

  • Excitement about enabling scientists to work on world-changing challenges.
  • Personal interest in the potential applications of CuspAI's technology.
  • 3+ years of experience in performance engineering, site reliability engineering, or low-level software development, specifically focused on high-performance computing (HPC) or AI workloads.
  • Expert-level knowledge of GPU architecture.
  • Experience optimizing CUDA kernels or using libraries like Triton.
  • Deep understanding of distributed training frameworks (e.g., PyTorch Distributed, DeepSpeed, or Megatron-LM) and networking protocols.
  • Proficiency in profiling tools such as Nsight Systems, Nsight Compute, or Weights & Biases for performance tracking.
  • A "builder" mindset with the ability to work autonomously in an early-stage, fast-paced startup environment.

Skills

  • GPU architecture
  • CUDA kernels optimization
  • Triton
  • Distributed training frameworks (PyTorch Distributed, DeepSpeed, Megatron-LM)
  • Networking protocols
  • Profiling tools (Nsight Systems, Nsight Compute, Weights & Biases)
  • Quantization
  • Model pruning
  • Distillation
  • NVIDIA GPU kernels
  • Collective communication layers (NCCL)

Location

  • Cambridge
  • London
  • Amsterdam
  • Berlin

Work Type

  • Hybrid (three days per week in office)
  • Travel required

Experience Level

  • 3+ years of experience

Salary/Compensations

  • Competitive salary

Benefits

  • Equity in CuspAI
  • 28 days holiday (DE, NL, UK) or 21 days holiday (JP, SG, US), in addition to local public holidays
  • 26 weeks (primary caregiver) and 12 weeks (secondary caregiver) parental leave at full pay
  • Professional development budget

About the Company

  • CuspAI is a frontier AI company focused on solving breakthrough materials needed for human progress.
  • The company aims to unlock trillion-dollar materials breakthroughs using AI.
  • The founding team consists of world-class researchers in AI, chemistry, and engineering.
  • CuspAI is working on challenges in energy, clean water, future of compute, and carbon capture.
  • The company is building a 'search engine' for next-generation materials.
  • CuspAI invites individuals to join a diverse, innovative team at the intersection of AI and materials science.
  • The company aims to create impactful partnerships that drive innovation, scalability, and industry collaboration.
  • CuspAI is on the cusp of the on-demand materials era.

Equal Opportunity

  • CuspAI is an equal opportunities employer committed to building a diverse and inclusive workplace.
  • The company does not discriminate on the basis of sex, race, religion or belief, ethnic or national origin, disability, age, citizenship, marital, domestic or civil partnership status, sexual orientation, gender identity, pregnancy or related condition (including breastfeeding), veteran status, or any other basis protected by applicable law.
  • CuspAI actively encourages applications from all backgrounds and values the unique perspectives and contributions that diversity brings to the team.
  • The company will provide reasonable adjustments during or after the interview process if required.