Impress employers and recruiters.
Choose from hundreds of resume examples.
Impress employers and recruiters.
Choose from hundreds of resume examples.
Tailor your resume to this Software Engineer, Inference role.
Rezi rewrites your resume against Luma's job description. Free.
Tailor your resume to this Software Engineer, Inference role.
Rezi rewrites your resume against Luma's job description. Free.
Don't guess if your resume is good enough.
See how it scores against the Software Engineer, Inference posting at Luma — free, in seconds.
Don't guess if your resume is good enough.
See how it scores against the Software Engineer, Inference posting at Luma — free, in seconds.
About the Role
You'll own how Luma's models get served, integrating new architectures into the inference engine, scaling deployments, and keeping GPU fleets busy while meeting internal SLOs. This role focuses on large-scale inference systems, including scheduling, fleet management, deployment pipelines, and reliability across clusters and hardware providers. It is ideal for a strong systems engineer comfortable with model serving and Kubernetes at scale.
Responsibilities
- Ship new model architectures by integrating them into the inference engine.
- Collaborate across research, engineering, and infrastructure to optimize model efficiency and deployments.
- Build internal tooling to measure, profile, and track the lifetime of inference jobs and workflows.
- Automate, test, and maintain inference services for maximum uptime and reliability.
- Manage and optimize inference workloads across clusters and hardware providers, and scale deployments across thousands of machines.
- Build scheduling systems that use expensive GPU resources optimally while meeting SLOs.
- Maintain CI/CD for model checkpoints and SDKs.
Requirements
- Strong Python and system-architecture skills.
- Experience deploying models with PyTorch, Hugging Face, vLLM, SGLang, TensorRT-LLM, or similar.
- Experience with queues, scheduling, traffic control, and fleet management at scale.
- Experience with Linux, Docker, and Kubernetes, and with orchestration, deployment, and scheduling.
- Familiarity with Redis and S3-compatible storage.
Skills
- Python
- System architecture
- Model deployment
- PyTorch
- Hugging Face
- vLLM
- SGLang
- TensorRT-LLM
- Queues
- Scheduling
- Traffic control
- Fleet management
- Linux
- Docker
- Kubernetes
- Orchestration
- Deployment
- Redis
- S3-compatible storage
- Modern networking stacks
- RDMA
- RoCE
- InfiniBand
- NVLink
- High-performance large-scale ML systems
- CUDA
- FFmpeg
- Multimedia processing
Experience Level
- Systems engineer comfortable with model serving and Kubernetes at scale
- High-performance large-scale ML systems (100+ GPUs)
About the Company
- Luma's mission is to build unified general intelligence that can generate, understand, and operate in the physical world.
- We believe multimodality is critical for intelligence — the next step beyond language models comes from vision.
Equal Opportunity
- Luma is an equal opportunity employer.