About the Role
We are looking for a Senior Software Engineer to help build Nebius Serverless AI, a GPU-native platform for deploying inference endpoints, batch jobs, and AI workloads without managing infrastructure. This is a senior, high-ownership position where you will set the technical bar, own architecture, drive design decisions, and raise the standard of the team through code and design reviews. The work is end-to-end, from cold-start latency to the API contract.
Responsibilities
- Design and build core components of the Serverless platform, including the control plane, scheduler, runtime, autoscaler, and customer-facing APIs.
- Own and solve complex engineering challenges such as cold-start latency, GPU scheduling under contention, multi-tenant isolation, fair-share quotas, and edge request routing.
- Set technical direction for owned areas by driving architecture decisions, creating design documents, and aligning the team.
- Elevate the team's engineering standards through code reviews, design reviews, and by example.
- Operate the service with an SRE mindset, defining SLOs, building observability, leading incident response, and ensuring platform improvements based on postmortems.
- Collaborate directly with customers on architecture reviews, performance escalations, and production issues.
- Partner with Product, GTM, and infrastructure teams to translate customer needs into a technical roadmap.
Requirements
- 7+ years of professional software engineering experience, with a proven track record of shipping production distributed systems at scale.
- Excellent knowledge of Golang, or the ability to quickly switch to it.
- Deep experience operating Kubernetes and container orchestration in production environments.
- Strong distributed-systems understanding, including trade-offs between consistency and availability, queueing, backpressure, retries, idempotency, and multi-tenancy.
- Experience designing and operating high-throughput, low-latency services.
- Demonstrated ability to tackle complex problems, drive design discussions, unblock teammates, and ship challenging features.
- Ability to write reliable code and troubleshoot complex issues.
- Teamwork-oriented approach.
Skills
- Golang
- Kubernetes
- Container orchestration
- Distributed systems
- High-throughput, low-latency services
- Serverless platforms (Knative, AWS Lambda, GCP Cloud Run, Cloudflare Workers, Modal, Replicate, Together, Fireworks, Anyscale, or similar)
- GPU scheduling (Kubernetes device plugins, MIG, MPS, time-slicing, NVIDIA GPU Operator)
- ML inference (vLLM, TensorRT-LLM, Triton Inference Server, SGLang, model loading and warm-pool strategies)
- Cold-start optimization (FireCracker, gVisor, checkpoint/restore, image streaming)
- Kubernetes operators (Go + controller-runtime / kubebuilder)
- Open-source contributions in serverless, scheduling, or inference ecosystems
Location
- Amsterdam
- London
Work Type
- Hybrid
Experience Level
- Senior
- 7+ years
Salary/Compensations
- Competitive compensation
Benefits
- Career growth and learning opportunities
- Flexibility and ownership
- Collaborative and innovative culture
- Opportunity to work on impactful AI projects
- International environment and talented teams
About the Company
- Nebius is leading a new era in cloud infrastructure for the global AI economy, building a full-stack AI cloud platform that supports developers and enterprises from data and model training through to production deployment.
- Built by engineers, for engineers, Nebius addresses complex challenges in compute, storage, networking, and applied AI.
- Listed on Nasdaq (NBIS) and headquartered in Amsterdam, Nebius has a global footprint with R&D hubs across Europe, the UK, North America, and Israel.
- The team of 1,500+ includes hundreds of engineers with deep expertise across hardware, software, and AI R&D.
Equal Opportunity
- Nebius is an equal opportunity employer committed to fostering an inclusive and diverse workplace.
- We provide equal employment opportunities in all aspects of employment and do not discriminate on the basis of race, color, religion, sex (including pregnancy), national origin, ancestry, age, disability, genetic information, marital status, veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by applicable law.
- Applicants must be authorized to work in the country in which they apply and will be required to provide proof of employment eligibility.
- Accommodations are available during the application process upon request.
