Product Manager, AI Infrastructure at Together AI | San Francisco, CA | Rezi

Product Manager, AI Infrastructure at Together AI

Product Manager, AI Infrastructure

Together AI · San Francisco, CA

1 months ago

Product Manager, AI Infrastructure

Together AI · San Francisco, CA

a month ago
Resume preview

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now

About the Role

This role focuses on the day-to-day product work for Together Cloud's expanding AI infrastructure products, including GPU clusters, managed storage, and observability. The Product Manager will initially focus on observability and GPU clusters, collaborating closely with engineering to deliver customer-facing features. The role requires identifying and resolving issues proactively, using data and experimentation to guide product decisions, and offers significant autonomy and broad exposure to compute, storage, and observability. There is a clear growth path to full ownership of a product area within approximately nine months, reporting to a Staff Product Manager with close product leadership involvement.

Responsibilities

  • Own the day-to-day product and feature work across Together's AI infrastructure products - GPU Clusters, Managed Storage, and observability - with an early focus on observability and storage.
  • Find and drive problems to resolution with minimal guidance, including issues that aren't yet on anyone's radar.
  • Run structured, hypothesis-driven experiments - reading the data yourself and driving the data collection and instrumentation needed to answer open questions.
  • Partner across engineering, product, and partner teams to ship improvements and unblock work without waiting for permission.
  • Translate a deep understanding of customers operating in fast-moving, high-ambiguity markets into product decisions.
  • Juggle multiple priorities and workstreams across a broad infrastructure surface.
  • Grow into end-to-end ownership of a complete product area (observability or storage) as you ramp.

Requirements

  • Deep empathy for customers operating in high-ambiguity, fast-evolving markets; we work with AI Native startups and model labs that move at high pace.
  • Strong, hands-on data and analytics skills with a hypothesis-driven approach - you design experiments, read the data yourself, and can drive the data collection needed to get answers.
  • High agency: you find problems, push through resistance, and drive resolution without waiting to be told what to do.
  • A real technical foundation -whether from an AI/infrastructure background, hands-on software development, or strong working knowledge of cloud and infrastructure.
  • A track record of collaborating across orgs and product lines to get things done.
  • Comfortable managing multiple priorities and workstreams at once.
  • Familiarity with the AI stack, especially at the infrastructure layer, is a strong plus.
  • Cloud platform experience (AWS, Azure, GCP, or similar) - with extra weight if you've helped build such products.
  • Bonus: working knowledge of the Nvidia/AMD GPU stack (InfiniBand, NCCL, GPU operator, etc.), or experience with AI training or inference workloads.

Skills

  • Data and analytics
  • Hypothesis-driven approach
  • Experiment design
  • Data collection and instrumentation
  • Collaboration
  • Managing multiple priorities
  • AI stack familiarity
  • Cloud platform experience
  • Nvidia/AMD GPU stack knowledge
  • AI training or inference workloads experience

Salary/Compensations

  • $175,000 - $220,000

Benefits

  • Startup equity
  • Health insurance
  • Other competitive benefits

About the Company

  • Together AI is a research-driven artificial intelligence company.
  • We believe open and transparent AI systems will drive innovation and create the best outcomes for society.
  • Our mission is to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models.
  • We have contributed to leading open-source research, models, and datasets to advance the frontier of AI.
  • Our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama.
  • We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.

Equal Opportunity

  • Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.