Model Operations Lead, AI Gateway at Cloudflare | Austin, TX, US | Rezi

Model Operations Lead, AI Gateway at Cloudflare

Model Operations Lead, AI Gateway

Cloudflare · Austin, TX, US

1 weeks ago

Model Operations Lead, AI Gateway

Cloudflare · Austin, TX, US

13 days ago
Resume preview

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now
Resume preview

Tailor your resume to this Model Operations Lead, AI Gateway role.

Rezi rewrites your resume against Cloudflare's job description. Free.

Resume score gauge reading 58 out of 100

Don't guess if your resume is good enough.

See how it scores against the Model Operations Lead, AI Gateway posting at Cloudflare — free, in seconds.

About the Role

Cloudflare's AI Gateway is building the essential layer for AI inference, ensuring reliability, observability, security, cost control, and routing for applications accessing multiple AI models. This role leads the models team responsible for integrating providers, testing capabilities, managing pricing and metering, and ensuring the reliability and accuracy of AI models. The team will also develop model intelligence to guide customers in selecting the best models for their needs.

Responsibilities

  • Ensure new models launch on day zero with tested capabilities, accurate pricing, docs, and a clear call on routing eligibility.
  • Ensure the catalog reflects reality, and proactively identify when a model or provider is underperforming before customers notice.
  • Deliver auto-routing that measurably beats a fixed model choice on cost or quality for users.
  • Build and maintain trusted rankings and recommendations grounded in solid methodology.
  • Set clear expectations for providers, while keeping Engineering, Product, Partnerships, and other stakeholders aligned.
  • Provide clear ownership and direction so the team knows what's next, who owns it, and how to grow into bigger roles.
  • Continually drive down the human effort required for each launch, eval, and routing update through tools and automation.

Requirements

  • Experience hiring, managing, and growing engineers or operators, giving direct feedback, delegating real ownership, and expanding scope without becoming a bottleneck.
  • Proven track record of taking technical launches or integrations from ambiguity to production across teams and partners.
  • Hands-on ability to write TypeScript, Python, or Rust, read API docs, inspect endpoints, and debug using terminal tools (logs, cURL).
  • Deep familiarity with new models, labs, and inference providers.
  • Hands-on understanding of streaming, tool calling, structured outputs, rate limits, token pricing, and provider-specific model behavior variations.
  • Data-driven product instincts to advocate for adding, modifying, or retiring catalog items.
  • SRE approach to defining, measuring, and alerting on service health, managing incidents calmly, and fixing root causes.
  • Daily experience building with agents—scoping work, verifying outputs, and integrating deterministic checks or human judgment appropriately.
  • Meticulous attention to detail regarding model IDs, context limits, per-token prices, and response fields.

Skills

  • TypeScript
  • Python
  • Rust
  • Agent Workflows

Location

  • Austin, TX
  • New York City, NY
  • San Francisco, CA
  • Bay Area
  • New York City
  • New Jersey
  • Washington
  • Washington DC
  • California (excluding Bay Area)

Work Type

  • Onsite
  • In-person interview

Experience Level

  • People Leadership
  • Technical & Shipping Capabilities
  • Model Ecosystem Expertise
  • Product & SRE Mindset
  • Agent Workflows & Detail-Oriented Execution

Salary/Compensations

  • For Bay Area based hires: Estimated annual salary of $230,000 - $317,000
  • For New York City, New Jersey, Washington, Washington DC, and California (excluding Bay Area) based hires: Estimated annual salary of $275,000 - $303,000

Benefits

  • Equity
  • Medical/Rx Insurance
  • Dental Insurance
  • Vision Insurance
  • Flexible Spending Accounts
  • Commuter Spending Accounts
  • Fertility & Family Forming Benefits
  • On-demand mental health support and Employee Assistance Program
  • Global Travel Medical Insurance
  • Short and Long Term Disability Insurance
  • Life & Accident Insurance
  • 401(k) Retirement Savings Plan
  • Employee Stock Participation Plan
  • Flexible paid time off covering vacation and sick leave
  • Leave programs, including parental, pregnancy health, medical, and bereavement leave

About the Company

  • At Cloudflare, we are on a mission to help build a better Internet.
  • The company runs one of the world’s largest networks that powers millions of websites and other Internet properties for customers ranging from individual bloggers to SMBs to Fortune 500 companies.
  • Cloudflare protects and accelerates any Internet application online without adding hardware, installing software, or changing a line of code.
  • Internet properties powered by Cloudflare all have web traffic routed through its intelligent global network, which gets smarter with every request.
  • As a result, they see significant improvement in performance and a decrease in spam and other attacks.
  • Cloudflare was named to Entrepreneur Magazine’s Top Company Cultures list and ranked among the World’s Most Innovative Companies by Fast Company.
  • At Cloudflare, we’re not looking for people who wait for a polished roadmap; we’re looking for the builders who see the cracks in the Internet that everyone else has simply learned to live with.
  • We value candidates who have the instinct to spot a "normalized" problem and the AI-native curiosity to create a solution using the latest tools.
  • Our culture is built on iteration, leveraging AI to ship faster today to make it better tomorrow, while ensuring that every improvement, no matter how small, is shared across the team to lift everyone up.
  • If you’re the type of person who values curiosity over bureaucracy, and that AI is a partner in solving tough problems to keep the Internet moving forward, you’ll fit right in.
  • We’re not just a highly ambitious, large-scale technology company. We’re a highly ambitious, large-scale technology company with a soul.
  • Fundamental to our mission to help build a better Internet is protecting the free and open Internet.
  • Project Galileo: Since 2014, we've equipped more than 2,400 journalism and civil society organizations in 111 countries with powerful tools to defend themselves against attacks that would otherwise censor their work, technology already used by Cloudflare’s enterprise customers--at no cost.
  • Athenian Project: In 2017, we created the Athenian Project to ensure that state and local governments have the highest level of protection and reliability for free, so that their constituents have access to election information and voter registration. Since the project, we've provided services to more than 425 local government election websites in 33 states.
  • 1.1.1.1: We released 1.1.1.1 to help fix the foundation of the Internet by building a faster, more secure and privacy-centric public DNS resolver. This is available publicly for everyone to use - it is the first consumer-focused service Cloudflare has ever released. Here’s the deal - we don’t store client IP addresses never, ever. We will continue to abide by our privacy commitment and ensure that no user data is sold to advertisers or used to target consumers.

Equal Opportunity

  • Cloudflare is proud to be an equal opportunity employer.
  • We are committed to providing equal employment opportunity for all people and place great value in both diversity and inclusiveness.
  • All qualified applicants will be considered for employment without regard to their, or any other person's, perceived or actual race, color, religion, sex, gender, gender identity, gender expression, sexual orientation, national origin, ancestry, citizenship, age, physical or mental disability, medical condition, family care status, or any other basis protected by law.
  • We are an AA/Veterans/Disabled Employer.
  • Cloudflare provides reasonable accommodations to qualified individuals with disabilities.
  • Please tell us if you require a reasonable accommodation to apply for a job.
  • Examples of reasonable accommodations include, but are not limited to, changing the application process, providing documents in an alternate format, using a sign language interpreter, or using specialized equipment.
  • If you require a reasonable accommodation to apply for a job, please contact us via e-mail at hr@cloudflare.com or via mail at 101 Townsend St. San Francisco, CA 94107.