Impress employers and recruiters.
Choose from hundreds of resume examples.
Impress employers and recruiters.
Choose from hundreds of resume examples.
Tailor your resume to this Member of Technical Staff - GPU Performance role.
Rezi rewrites your resume against Gimlet Labs's job description. Free.
Tailor your resume to this Member of Technical Staff - GPU Performance role.
Rezi rewrites your resume against Gimlet Labs's job description. Free.
Don't guess if your resume is good enough.
See how it scores against the Member of Technical Staff - GPU Performance posting at Gimlet Labs — free, in seconds.
Don't guess if your resume is good enough.
See how it scores against the Member of Technical Staff - GPU Performance posting at Gimlet Labs — free, in seconds.
About the Role
As a Member of Technical Staff, you will characterize and improve the performance of production AI inference across Gimlet's heterogeneous accelerator fleet. You will work across kernel execution, compiler output, runtime behavior, memory movement, synchronization, scheduling, and multi-device execution. You will connect hardware-level evidence to end-to-end latency, throughput, utilization, and cost. You will build the measurement systems and performance methodology that let Gimlet understand new hardware quickly, identify the limiting resource in real workloads, and turn that understanding into changes across kernels, compilers, runtimes, and distributed execution.
Responsibilities
- Establish trustworthy performance baselines for production inference workloads across established and emerging accelerator architectures
- Isolate bottlenecks across compute, memory bandwidth, cache behavior, kernel launch, synchronization, host-device interaction, communication, and runtime scheduling
- Use profiling, hardware counters, controlled experiments, and performance models to explain why a workload behaves as it does and identify the highest-leverage optimization
- Improve execution through changes such as launch reduction, graph capture, stream and event coordination, compute-communication overlap, memory reuse, batching, and scheduling
- Build automated benchmarks and regression detection that preserve performance across models, tensor shapes, data types, software releases, and hardware targets
- Translate performance findings into production improvements, partnering with kernel, compiler, ML systems, and distributed systems engineers when necessary
- Develop a repeatable methodology for evaluating and bringing up new accelerators within Gimlet's execution platform
Requirements
- Strong software engineering fundamentals and experience working on performance-critical systems
- Experience profiling GPU or accelerator workloads and turning measurements into production improvements
- A strong understanding of GPU execution, memory hierarchies, asynchronous execution, synchronization, and performance tradeoffs
- The ability to design controlled experiments, distinguish symptoms from root causes, and communicate performance findings precisely
Skills
- Nsight Systems
- Nsight Compute
- rocprof
- Omniperf
- VTune
- Perfetto
- hardware performance counters
- CUDA
- HIP
- Triton
- accelerator programming model
- roofline analysis
- queueing behavior
- occupancy
- latency hiding
- instruction throughput
- memory-bandwidth analysis
- inference runtimes
- execution graphs
- memory allocators
- kernel dispatch
- batching
- model-serving systems
- collective communication
- topology-aware execution
- compute-communication overlap
- performance laboratories
- benchmark suites
- regression infrastructure
- hardware bring-up methodology
Education Level
- Bachelor's degree in a relevant field, or an equivalent combination of education, training, and professional experience
About the Company
- Gimlet is building the first multi-silicon neocloud designed for fast, efficient AI inference.
- We combine large-scale compute infrastructure with an execution platform that partitions AI workloads and maps each stage to the hardware best suited to run it.
- We work with foundation labs, hyperscalers, and AI-native companies, giving our team access to technical problems spanning frontier models, production infrastructure, and emerging hardware.
- Gimlet is expanding from its core technology into a production neocloud spanning new hardware, customers, and data centers.
Equal Opportunity
- Gimlet Labs does not accept unsolicited resumes from recruitment agencies or search firms. Any unsolicited resumes submitted without a signed agreement will be considered the property of Gimlet Labs, and no fees will be paid.