About the Role
Baseten is building its own GPU infrastructure for large-scale inference and is hiring a Lead Software Engineer to build a first-class observability and root-cause analysis system for GPU fabrics. This role sits at the boundary between networking and inference software, aiming to quickly and accurately diagnose incidents.
Responsibilities
- Own Baseten’s GPU fabric observability and root-cause analysis architecture.
- Build telemetry pipelines across switches, NICs, hosts, GPUs, Kubernetes, and inference services.
- Model topology, flow paths, service ownership, and failure domains.
- Separate true fabric faults from host, NIC, GPU, kernel, driver, RDMA, scheduler, and workload failures.
- Create clear operator workflows for triage, remediation, and post-incident learning.
Requirements
- Staff-level or senior staff-level experience building production infrastructure software.
- Strong distributed systems background, especially streaming systems, telemetry pipelines, diagnostics, or control-plane software.
- Experience building systems that process high-volume, high-cardinality, noisy operational data.
- Understanding of networking fundamentals and high-performance networks.
- Ability to work with low-level infrastructure signals and build practical correlation, anomaly detection, or root-cause analysis systems.
Experience Level
- Staff-level
- Senior staff-level
Benefits
- Competitive compensation, including meaningful equity.
- 100% coverage of medical, dental, and vision insurance for employee and dependents.
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!).
- Paid parental leave.
- Fertility and family-building stipend through Carrot.
- Company-facilitated 401(k).
About the Company
- Baseten powers mission-critical inference for the world's most dynamic AI companies.
- By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production.
- We're growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital.
- Join us and help build the platform engineers turn to to ship AI products.
Equal Opportunity
- At Baseten, we are committed to fostering a diverse and inclusive workplace.
- We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
- We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
