Senior Software Engineer - Managed Kubernetes at Lambda | CA, US | Rezi

Senior Software Engineer - Managed Kubernetes at Lambda

Senior Software Engineer - Managed Kubernetes

Lambda · CA, US

1 months ago

Senior Software Engineer - Managed Kubernetes

Lambda · CA, US

a month ago
Resume preview

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now
Resume preview

Tailor your resume to this Senior Software Engineer - Managed Kubernetes role.

Rezi rewrites your resume against Lambda's job description. Free.

Resume score gauge reading 58 out of 100

Don't guess if your resume is good enough.

See how it scores against the Senior Software Engineer - Managed Kubernetes posting at Lambda — free, in seconds.

About the Role

We are seeking a Senior Software Engineer to join our Managed Kubernetes (Mk8s) team. You will play a crucial role in shaping the architecture, reliability, and automation of our Kubernetes-based infrastructure, which powers mission-critical workloads across our global platform. Lambda is building the AI Cloud of the future, and this role will help build the infrastructure that powers the next generation of AI training and inference at scale. You'll work at the intersection of distributed systems, GPU-accelerated computing, and Cloud Native infrastructure to build systems that are reliable, performant, and elegantly simple for our customers.

Responsibilities

  • Design, build, and maintain scalable control plane services, operators, and custom Kubernetes controllers
  • Develop automation in Go/Python for end-to-end cluster lifecycle management — provisioning, upgrades, patching, and deletion
  • Build GPU-aware orchestration systems, working within the platform architecture to support GPU scheduling and resource allocation
  • Partner with the Network team on networking solutions for AI workloads: CNI integration (Cilium, Multus), high-performance fabrics (InfiniBand, RoCE), RDMA, and GPUDirect
  • Write resilient systems that handle failure gracefully — timeouts, retries, backoff, and degraded-mode operation — across large-scale distributed environments
  • Develop platform services for inference: model serving infrastructure, autoscaling based on inference load, and multi-model deployment patterns
  • Build internal tools and CLIs that let ML/AI teams deploy and monitor their own inference services
  • Support and debug production issues through on-call rotation

Requirements

  • 6+ years of experience in software engineering, with a track record of owning significant technical scope within a team
  • Deep understanding of Kubernetes internals: controllers, schedulers, operators, CRDs, CSI, CNI, and the extension patterns that make Kubernetes powerful
  • Solid grasp of distributed systems fundamentals — fault tolerance, graceful degradation, and failure handling in large-scale environments
  • Experience operating the control plane and low-level pieces of large-scale Kubernetes clusters
  • Experience with observability at scale: Prometheus, Grafana, distributed tracing, and building actionable alerting systems
  • Strong programming skills in Go and Python; ability to collaborate effectively on shared codebases
  • Solid knowledge of Linux systems, networking, containers, and cloud infrastructure
  • Take pride in owning and delivering core components of products and platforms
  • Experience building and operating managed Kubernetes services (GKE, EKS, AKS, or similar) or working on Kubernetes control plane components
  • Hands-on experience with NVIDIA's GPU and networking ecosystem: GPU Operator, device plugins, DCGM, MIG, Network Operator, NCCL tuning, or similar
  • Familiarity with HPC and traditional job schedulers (Slurm) and Kubernetes-native batch scheduling (KAI, Volcano, Kueue)
  • Familiarity with GPU, InfiniBand, RDMA, or high-performance computing on Kubernetes
  • Exposure to storage architecture for AI/ML workloads
  • Past contributions to CNCF projects or Kubernetes SIGs a plus

Skills

  • Go
  • Python
  • Kubernetes
  • Prometheus
  • Grafana
  • Linux
  • Networking
  • Containers
  • Cloud Infrastructure
  • CNI integration
  • RDMA
  • GPUDirect
  • HPC
  • Slurm
  • NVIDIA GPU ecosystem

Location

  • San Francisco
  • San Jose
  • Bellevue

Work Type

  • Hybrid

Experience Level

  • Senior

Benefits

  • Generous cash & equity compensation
  • Health, dental, and vision coverage for you and your dependents
  • Wellness and commuter stipends for select roles
  • 401k Plan with 2% company match (USA employees)
  • Flexible paid time off plan

About the Company

  • Lambda, The Superintelligence Cloud, is a leader in AI cloud infrastructure serving tens of thousands of customers.
  • Our customers range from AI researchers to enterprises and hyperscalers.
  • Lambda's mission is to make compute as ubiquitous as electricity and give everyone the power of superintelligence.
  • Lambda is building the essential infrastructure for the AI era.
  • We're not just another cloud provider: we're a company founded by ML practitioners, for ML practitioners.
  • Our customers include leading AI research labs and enterprises pushing the boundaries of what's possible with artificial intelligence.
  • Founded in 2012, with 500+ employees, and growing fast.
  • Our investors notably include TWG Global, US Innovative Technology Fund (USIT), Andra Capital, SGW, Andrej Karpathy, ARK Invest, Fincadia Advisors, G Squared, In-Q-Tel (IQT), KHK & Partners, NVIDIA, Pegatron, Supermicro, Wistron, Wiwynn, Gradient Ventures, Mercato Partners, SVB, 1517, and Crescent Cove.
  • We have research papers accepted at top machine learning and graphics conferences, including NeurIPS, ICCV, SIGGRAPH, and TOG.
  • Our values are publicly available: https://lambda.ai/careers

Equal Opportunity

  • Lambda is an Equal Opportunity employer.
  • Applicants are considered without regard to race, color, religion, creed, national origin, age, sex, gender, marital status, sexual orientation and identity, genetic information, veteran status, citizenship, or any other factors prohibited by local, state, or federal law.