Engineering Manager, Runtime Fabric at Baseten | San Francisco | Rezi

Engineering Manager, Runtime Fabric at Baseten

Engineering Manager, Runtime Fabric

Baseten · San Francisco

1 months ago

Engineering Manager, Runtime Fabric

Baseten · San Francisco

2 months ago
Resume preview

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now

About the Role

As Engineering Manager of the Runtime Fabrics team, you will lead the development of a purpose-built container runtime and storage layers for AI inference workloads. You will set technical direction, grow a world-class team of systems engineers, and shape the open-source container ecosystem.

Responsibilities

  • Recruit, hire, and develop a high-performing team of systems engineers with deep container and Linux expertise.
  • Foster a culture of technical rigor, open-source contribution, and continuous improvement.
  • Provide regular coaching, feedback, and career development support to your direct reports.
  • Partner with engineering leadership to define the long-term vision and roadmap for container runtime and storage infrastructure.
  • Guide the team in extending and hardening containerd, runc, and related OCI ecosystem projects to meet the GPU-specific requirements of production AI inference.
  • Oversee the architecture and evolution of the Baseten Delivery Network: the tiered caching and weight delivery system.
  • Drive the expansion of BDN's architecture to container images, training checkpoints, and deployment artifacts.
  • Provide technical oversight on GPU-aware isolation mechanisms for multi-tenant inference.
  • Ensure the team maintains end-to-end ownership of the container startup performance path.
  • Champion the team's contributions back to the open-source containerd ecosystem.
  • Act as the primary advocate for Runtime Fabrics across the organization.
  • Collaborate with product and engineering stakeholders to prioritize investments.
  • Communicate team progress, technical trade-offs, and architectural decisions clearly to leadership.

Requirements

  • Proven experience managing and growing engineering teams in a systems, infrastructure, or low-level runtime context.
  • Deep familiarity with the Linux container ecosystem: containerd, runc, OCI Runtime Spec, Linux namespaces, and cgroups.
  • Contributions to containerd/containerd, opencontainers/runc, google/gvisor, kata-containers/kata-containers, or closely related open-source projects.
  • Strong systems programming background in Go and/or C/C++.
  • Experience with distributed storage systems, content-addressable storage, or large-scale caching infrastructure.
  • Understanding of how container images are structured, stored, and delivered at scale.
  • Strong written and verbal communication skills, with the ability to influence without authority across teams.

Skills

  • containerd
  • runc
  • OCI Runtime Spec
  • Linux namespaces
  • cgroups
  • Go
  • C/C++
  • distributed storage systems
  • content-addressable storage
  • large-scale caching infrastructure
  • GPU device access
  • NVIDIA Container Toolkit
  • CDI (Container Device Interface)
  • lazy-loading snapshotters
  • stargz
  • soci
  • EROFS/Nydus
  • peer-to-peer image distribution
  • secure container runtimes
  • gVisor
  • Sysbox
  • micro-VM technologies
  • Firecracker
  • Cloud Hypervisor
  • containerd's shim API (v2)
  • multi-tenant infrastructure
  • security-sensitive serving environments

Experience Level

  • Management experience

Benefits

  • Competitive compensation, including meaningful equity.
  • 100% coverage of medical, dental, and vision insurance for employee and dependents
  • Flexible PTO policy including company wide Winter Break
  • Paid parental leave
  • Fertility and family-building stipend through Carrot
  • Company-facilitated 401(k)

About the Company

  • Baseten powers mission-critical inference for the world's most dynamic AI companies.
  • By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production.
  • We're growing quickly and recently raised our $300M Series E, backed by investors including BOND, IVP, Spark Capital, Greylock, and Conviction.
  • Join us and help build the platform engineers turn to to ship AI products.

Equal Opportunity

  • At Baseten, we are committed to fostering a diverse and inclusive workplace.
  • We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
  • We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law.