Impress employers and recruiters.
Choose from hundreds of resume examples.
Impress employers and recruiters.
Choose from hundreds of resume examples.
Tailor your resume to this Director of Product Management role.
Rezi rewrites your resume against FriendliAI's job description. Free.
Tailor your resume to this Director of Product Management role.
Rezi rewrites your resume against FriendliAI's job description. Free.
Don't guess if your resume is good enough.
See how it scores against the Director of Product Management posting at FriendliAI — free, in seconds.
Don't guess if your resume is good enough.
See how it scores against the Director of Product Management posting at FriendliAI — free, in seconds.
About the Role
FriendliAI is seeking a Director of Product Management to lead the product strategy and development of their AI inference platform. This role involves defining how the platform serves models, scales under heavy workloads, and improves performance, reliability, and cost-efficiency. It requires a technically adept leader who understands AI infrastructure and can translate complex systems into user-friendly products, while also building and leading the product organization.
Responsibilities
- Own the product vision, strategy, and roadmap for FriendliAI’s AI inference platform, including model serving, deployment, orchestration, APIs, and developer capabilities.
- Define product direction for the inference stack, balancing performance, scalability, reliability, usability, and cost.
- Identify and prioritize high-impact product opportunities across evolving AI workloads like LLMs, multimodal models, and agentic applications.
- Translate complex technical capabilities into clear product value and differentiated customer experiences.
- Develop a deep understanding of AI inference workloads and challenges faced by ML engineers, AI platform teams, and infrastructure organizations.
- Collaborate with engineering and research to shape capabilities in routing, batching, scheduling, resource allocation, model optimization, and inference performance.
- Drive product strategy around key inference metrics such as latency, time-to-first-token, throughput, GPU utilization, cost per inference, and availability.
- Engage directly with enterprise customers and technical users to understand production workloads, validate product direction, and identify opportunities.
- Partner with Sales, Solutions, Customer Success, and Marketing to align customer needs with product priorities and enhance market position.
- Lead product initiatives from discovery and problem definition through prioritization, execution, launch, and iteration.
- Lead and mentor Product Managers and Product Designers, setting high standards for product thinking and execution.
- Establish product planning, prioritization, and measurement practices for rapid progress and strong product judgment.
- Define and track product KPIs, using customer feedback, product usage, and performance data to guide investment and prioritization.
- Clearly communicate product vision, priorities, and tradeoffs to engineering, research, GTM, and executive leadership.
Requirements
- 10+ years of product management experience, with significant experience owning technically complex platforms or infrastructure products.
- Proven experience leading product strategy for AI/ML infrastructure, cloud platforms, distributed systems, developer platforms, or related technical products.
- Deep understanding of AI inference and LLM serving architectures, including concepts such as prefill vs. decode, KV cache, token streaming, batching, routing, and GPU utilization.
- Strong technical fluency and the ability to work directly with senior engineering and research teams on complex distributed systems.
- Proven track record taking technically complex products from strategy through execution and customer adoption.
- Experience leading and developing Product Managers and/or coordinating multiple product workstreams.
- Strong customer orientation, with experience working directly with enterprise customers and technical users.
- Strong written and verbal communication skills, with the ability to explain complex technical systems and make clear product tradeoffs.
- Strong product judgment and the ability to operate effectively in a fast-moving environment with significant ambiguity.
Skills
- AI inference
- LLM serving
- GPU infrastructure
- Model deployment
- vLLM
- TensorRT-LLM
- SGLang
- Developer platforms
- APIs
- SDKs
- Cloud-native infrastructure
- Multi-tenant SaaS
- Enterprise AI platforms
- ML engineers
- AI platform teams
- Infrastructure organizations
Location
- Remote
Work Type
- Full-time
Experience Level
- Director
- 10+ years of product management experience
Education Level
- Background in Computer Science, Engineering, or a closely related technical field.
Benefits
- Flexible working hours
- Daily lunch and dinner provided
- Unlimited snacks and beverages
- Supportive and highly collaborative work environment
- Health check-up support
- Top-tier equipment/hardware support
- A front-row seat to the generative AI infrastructure revolution
- Competitive compensation
- Startup equity
- Health insurance
About the Company
- FriendliAI is the fastest inference cloud for agents, built to run frontier open-weight models in production at scale.
- It delivers up to 7x faster output token speed, up to 90% lower inference costs, and 99.99% uptime across the most demanding agent workloads — long-context inference, real-time streaming, and accurate tool calling.
- We are a small, fast-moving team doing work that matters at one of the most exciting moments in technology history.
- With our world-class inference stack, we are building the platform teams can actually rely on.