Impress employers and recruiters.
Choose from hundreds of resume examples.

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now

About the Role

DigitalOcean is seeking a Senior Engineer 2 to play a key technical role in our AI Inference Optimization team. You will be responsible for architectural decisions that maximize throughput and minimize latency for large models, acting as an IC leader to solve complex bottlenecks and guide the technical roadmap for our high-performance inference fleet.

Responsibilities

• Lead the technical strategy for benchmarking and performance optimizations at the inference engine and GPU kernel layers.
• Engineer solutions for complex performance issues, including attention layer optimizations, memory and precision management, and advanced parallelization across multi-node GPU clusters.
• Proactively implement cutting-edge optimization techniques to keep DigitalOcean at the forefront of the Gen AI landscape.
• Act as the subject matter expert on modern GPU families and their software stacks, advising on hardware procurement and software integration.
• Develop and deploy state-of-the-art quantization techniques to double throughput without losing accuracy.
• Lead by example through high-quality code and design reviews, elevating the technical bar for the team.
• Partner with Product Management and TPMs to translate theoretical hardware limits into shippable product features.
• Maintain a strong presence in the GPU infrastructure and model performance optimization communities, contributing to and integrating the best of open-source AI.

Requirements

• 5+ years of experience in high-performance computing or AI infrastructure, with a proven track record of solving compute utilization and memory bandwidth bottlenecks.
• Deep familiarity with the Gen AI landscape, including the specific quirks and architectural requirements of major model families.
• Hands-on experience with attention-layer optimizations and parallelization strategies across distributed GPU environments.
• Comprehensive understanding of NVIDIA and AMD GPU architectures and their respective software ecosystems.
• Extensive experience integrating, building with, and contributing to open-source software projects.
• Excellent system design skills, particularly related to low-level GPU programming - optimization, memory access patterns, and parallel execution.
• Experience acting as a technical lead, driving design and delivery through cross-functional alignment and expert-level delegation.
• Deep understanding of GPU architectures (SMs, Warp scheduling, Tensor Cores).
• Expert-level Triton or CUDA.
• Experience contributing to the Triton compiler or writing custom CUDA kernels for a major LLM.

Skills

• Performance Architecture
• Deep-Dive Optimization
• Technological Innovation
• Hardware & Ecosystem Mastery
• Precision Optimization
• Technical Mentorship
• Strategic Collaboration
• Community Leadership
• Gen AI Literacy
• Optimization Expert
• Hardware Fluency
• Open Source Mastery
• Systems Design
• Leadership through Influence
• Low-Level Mastery
• Triton
• CUDA

Location

• Remote

Work Type

• Remote
• Full-time

Experience Level

• Senior

Salary/Compensations

• $191,200 - $239,000

Benefits

• Employee Assistance Program
• Local Employee Meetups
• Flexible time off policy
• Reimbursement for relevant conferences, training, and education
• Access to LinkedIn Learning's 10,000+ courses
• Bonus eligibility
• Equity compensation
• Equity grants upon hire
• Option to participate in Employee Stock Purchase Program

About the Company

• DigitalOcean aims to be the Inference Cloud of choice for digitally native companies.
• We innovate with purpose. You’ll be a part of a cutting-edge technology company with an upward trajectory, who are proud to simplify cloud and AI so builders can spend more time creating software that changes the world.
• We are a high-performance organization that will always challenge you to think big.

Equal Opportunity

• DigitalOcean is an equal-opportunity employer. We do not discriminate on the basis of race, religion, color, ancestry, national origin, caste, sex, sexual orientation, gender, gender identity or expression, age, disability, medical condition, pregnancy, genetic makeup, marital status, or military service.