Impress employers and recruiters.
Choose from hundreds of resume examples.
Impress employers and recruiters.
Choose from hundreds of resume examples.
Tailor your resume to this Member of Technical Staff role.
Rezi rewrites your resume against True Talent Solutions Partners's job description. Free.
Tailor your resume to this Member of Technical Staff role.
Rezi rewrites your resume against True Talent Solutions Partners's job description. Free.
Don't guess if your resume is good enough.
See how it scores against the Member of Technical Staff posting at True Talent Solutions Partners — free, in seconds.
Don't guess if your resume is good enough.
See how it scores against the Member of Technical Staff posting at True Talent Solutions Partners — free, in seconds.
About the Role
Join a small AI infrastructure team focused on enhancing the speed, energy efficiency, and cost-effectiveness of model inference. You will optimize systems serving open-source language models across diverse hardware, with responsibilities ranging from kernel performance to production operations.
Responsibilities
- Ship support for new open-source models, tuning them for latency and throughput.
- Optimize inference serving using techniques like batching, KV caching, speculative decoding, and quantization.
- Write and tune GPU kernels using CUDA, HIP, and Triton for various accelerator platforms.
- Design, deploy, and operate heterogeneous clusters across hardware vendors.
- Run production inference systems, improving reliability, observability, and cost per token.
- Collaborate directly with customers to resolve infrastructure and performance issues.
Requirements
- 1 to 6 years of experience in backend, infrastructure, systems, or low-level engineering, with experience at scale or in a fast-moving startup.
- Strong understanding of computer architecture, memory hierarchies, and operating system internals.
- Experience with production infrastructure such as data centers, clusters, or large GPU fleets.
- Familiarity with machine learning inference optimization, including quantization, batching, KV caching, or speculative decoding.
- Experience with CUDA, Triton, or other GPU programming.
- Familiarity with Python, HIP, or accelerator platforms like TPU or AWS Trainium.
- Demonstrated technical ownership, rapid learning, or exceptional performance in demanding engineering roles.
- Strong computer science fundamentals.
- Comfort using AI agents and coding tools to enhance engineering workflows.
- Ability to communicate effectively with customers.
Skills
- CUDA
- HIP
- Triton
- Python
- GPU programming
- Machine learning inference optimization
- Quantization
- Batching
- KV caching
- Speculative decoding
- Computer architecture
- Memory hierarchies
- Operating system internals
- Production infrastructure management
- AI agents
- Coding tools
Location
- San Francisco, California
Work Type
- On-site
Experience Level
- 1 to 6 years
Salary/Compensations
- $200,000 to $300,000
Benefits
- Visa sponsorship available