Impress employers and recruiters.
Choose from hundreds of resume examples.
Impress employers and recruiters.
Choose from hundreds of resume examples.
Target Resume Now
Tailor your resume to this Engineering Manager role.
Rezi rewrites your resume against Inferact's job description. Free.
Tailor your resume to this Engineering Manager role.
Rezi rewrites your resume against Inferact's job description. Free.
Don't guess if your resume is good enough.
See how it scores against the Engineering Manager posting at Inferact — free, in seconds.
Don't guess if your resume is good enough.
See how it scores against the Engineering Manager posting at Inferact — free, in seconds.
About the Role
We are seeking an Engineering Manager to scale a world-class, senior-heavy engineering organization focused on AI inference. You will lead a team of exceptional engineers, own team execution, hiring, coaching, prioritization, and operating rhythm, while staying technically engaged. Partner with leadership to translate company priorities into technical direction and foster engineer growth.
Responsibilities
- Lead a team of exceptional engineers across inference systems, performance, kernels, accelerators, and cloud infrastructure.
- Create the management capacity required for rapid growth without sacrificing technical quality or execution speed.
- Own team execution, hiring, coaching, prioritization, and operating rhythm.
- Stay close enough to the work to earn the trust of engineers solving hard systems problems.
- Partner closely with engineering and company leadership to turn company priorities into clear technical direction.
- Remove blockers and improve team processes.
- Help every engineer do the highest-leverage work of their career.
- Translate ambiguous company priorities into clear team goals, sequencing, ownership, and execution plans.
- Maintain urgency in a fast-changing startup environment.
- Build effective engineering operating rhythms around planning, decision-making, technical reviews, cross-team coordination, and accountability without creating unnecessary process.
- Exercise strong judgment about when to dive into a technical problem, when to delegate, and how to create leverage for senior engineers.
- Manage the full people-management lifecycle, including hiring, onboarding, 1:1s, feedback, performance management, career development, team health, and retention.
- Scale an engineering team through rapid hiring, including interviewer calibration, hiring decisions, onboarding systems, and thoughtful team design.
- Partner closely with founders or engineering executives in an early-stage company.
- Manage teams spanning multiple technical specialties, geographies, or time zones while preserving strong ownership and communication.
- Help establish engineering management practices from an early stage.
Requirements
- Bachelor's degree or equivalent experience in computer science, engineering, or similar.
- Demonstrated experience managing strong software engineers in technically demanding systems, infrastructure, ML systems, distributed systems, or performance-oriented environments.
- Strong technical credibility with the ability to understand architecture, ask useful questions, challenge assumptions, and help unblock senior engineers without becoming a bottleneck or overriding domain experts.
- 2+ years of management experience with 10+ reports.
- Experience leading teams working on AI / ML infrastructure, model serving, distributed systems, GPU infrastructure, compilers, performance engineering, cloud infrastructure, or developer platforms.
- Experience managing senior, staff, principal, research-adjacent, or PhD engineers in an environment where technical credibility and autonomy are especially important.
- Familiarity with inference systems and adjacent technologies such as vLLM, SGLang, PyTorch, CUDA / Triton, Kubernetes, distributed serving, or accelerator infrastructure.
- Built or scaled a small, unusually high-talent engineering team where the technical surface area was specialized and the quality bar was extremely high.
- Previously remained hands-on as an engineer or technical lead before moving into management and can still reason credibly about complex production systems.
- Contributed to open-source infrastructure, AI systems, developer tools, or technically ambitious products used by external engineers.
Skills
- Inference systems
- Performance engineering
- Kernel development
- Accelerator technology
- Cloud infrastructure
- AI/ML infrastructure
- Model serving
- Distributed systems
- GPU infrastructure
- Compilers
- Developer platforms
- vLLM
- SGLang
- PyTorch
- CUDA/Triton
- Kubernetes
- Technical leadership
- People management
- Hiring
- Coaching
- Prioritization
- Execution planning
- Cross-team coordination
- Open-source contribution
Location
- San Francisco, California
Work Type
- In-office
- Full-time
Experience Level
- 2+ years of management experience
- 10+ reports
Education Level
- Bachelor's degree or equivalent experience in computer science, engineering, or similar.
Salary/Compensations
- $200,000 - $400,000 USD + equity
Benefits
- Generous health, dental, and vision benefits
- 401(k) company match
- Visa sponsorship on a case-by-case basis
About the Company
- Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster.
- Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware, a position that took years to build.