Impress employers and recruiters.
Choose from hundreds of resume examples.
Impress employers and recruiters.
Choose from hundreds of resume examples.
Tailor your resume to this Senior Systems Engineer, Workers AI role.
Rezi rewrites your resume against Cloudflare's job description. Free.
Tailor your resume to this Senior Systems Engineer, Workers AI role.
Rezi rewrites your resume against Cloudflare's job description. Free.
Don't guess if your resume is good enough.
See how it scores against the Senior Systems Engineer, Workers AI posting at Cloudflare — free, in seconds.
Don't guess if your resume is good enough.
See how it scores against the Senior Systems Engineer, Workers AI posting at Cloudflare — free, in seconds.
About the Role
Design and build the core infrastructure powering AI inference across Cloudflare's global network, including real-time voice, open LLMs, and customer-deployed models on a heterogeneous fleet of GPUs and accelerators. Solve challenges in distributed systems and high-performance computing like sub-second model cold starts and multi-accelerator workload scheduling. This role is central to building a novel AI inference platform embedded in the internet's fabric, focusing on foundational infrastructure problems at the network edge.
Responsibilities
- Develop and maintain core components of the serverless inference platform for high availability and scalability.
- Optimize the model scheduling system for increased efficiency and resource utilization.
- Implement improvements to request routing logic to reduce latency.
- Drive measurable improvements in platform reliability and resilience.
- Expand and refine the observability stack (metrics, logging, tracing) and fine-tune alerts.
- Lead complex, cross-functional technical projects from concept to deployment.
- Mentor junior engineers and contribute to a collaborative engineering culture.
Requirements
- Proven experience in systems engineering, with a primary focus on distributed, high-performance systems.
- Expert proficiency in Rust programming, particularly in an asynchronous environment.
- Deep understanding and hands-on experience with relevant networking and application protocols (e.g., TCP, HTTP, WebSocket).
- Solid experience with scaling and performance optimization techniques, including load balancing and caching in a distributed environment.
- Demonstrable experience with container orchestration platforms, specifically Kubernetes and/or Nomad.
- Familiarity with the unique architectural challenges involved in large-scale inference serving (e.g., LLMs and diffusion models).
Skills
- Rust
- Asynchronous programming
- Networking protocols
- Application protocols
- TCP
- HTTP
- WebSocket
- Scaling
- Performance optimization
- Load balancing
- Caching
- Distributed systems
- High-performance computing
- Kubernetes
- Nomad
- LLMs
- Diffusion models
Location
- Austin, TX (Hybrid)
Work Type
- Hybrid
Experience Level
- Systems engineering
- Distributed systems
- High-performance systems
About the Company
- Cloudflare runs one of the world’s largest networks, powering millions of websites and Internet properties for diverse customers.
- The company protects and accelerates online applications without requiring hardware or software changes.
- Cloudflare's network gets smarter with every request, improving performance and security.
- Cloudflare was recognized on Entrepreneur Magazine’s Top Company Cultures list and Fast Company’s World’s Most Innovative Companies.
- The company culture values builders who identify and solve problems with AI, prioritizing curiosity and iteration.
- Cloudflare is committed to helping build a better and free, open Internet.
- Project Galileo provides tools to journalism and civil society organizations to defend against censorship.
- The Athenian Project offers protection and reliability to state and local governments for election information.
- Cloudflare released 1.1.1.1, a faster, more secure, and privacy-centric public DNS resolver, with a commitment to not storing client IP addresses or selling user data.
Equal Opportunity
- Cloudflare is proud to be an equal opportunity employer, committed to providing equal employment opportunity for all people and valuing diversity and inclusiveness.
- All qualified applicants will be considered for employment without regard to race, color, religion, sex, gender, gender identity, gender expression, sexual orientation, national origin, ancestry, citizenship, age, physical or mental disability, medical condition, family care status, or any other basis protected by law.
- Cloudflare is an AA/Veterans/Disabled Employer.
- Cloudflare provides reasonable accommodations to qualified individuals with disabilities during the application process.