About the Role
You'll build the evaluation systems that tell us whether Firecrawl actually works. Our core promise, convert any URL into clean, structured, LLM-ready data reliably, is hard to measure rigorously across millions of different websites, formats, and edge cases. This role involves designing metrics, building pipelines, generating datasets, and owning the feedback loop from output quality back to model and product decisions.
Responsibilities
- Design the metrics that define what "good output" actually means across millions of sites, formats, and edge cases
- Build the pipelines and harnesses that measure quality rigorously and at scale
- Generate and curate the datasets that make evaluation trustworthy
- Own the feedback loop from output quality back to model and product decisions
- Turn "did that work?" into an answer the whole team can act on
Requirements
- Must be legally authorized to work in the United States. We're not able to sponsor visas right now, though that may change down the line.
- You have the engineering depth to build real evaluation systems, not just run existing ones
- You care deeply about what "good" means and how to measure it rigorously
- You're comfortable owning ambiguous problems where the metric itself has to be invented
- You move fast and close the loop - you'd rather ship, measure, and iterate than perfect on paper
Location
- San Francisco, CA
Work Type
- Hybrid
- On-site required
- Full-Time
Experience Level
- 4+ years in ML, research engineering, or data-heavy backend, with real evaluation work
Salary/Compensations
- $210,000–$275,000/year
Benefits
- Competitive equity
- Generous PTO — 15 days mandatory, anything after 24 days, just ask (holidays excluded)
- 12 weeks fully paid parental leave, for all parents
- $100/month wellness stipend
- Expense up to $1,000/year toward learning and development
- Team offsites
- 3 paid months off after 4 years sabbatical
- Full medical, dental, and vision coverage (100% for employees, 50% for spouse/kids) for US-based full-time employees
- Employer-paid short-term disability, long-term disability, and life insurance
- Optional accident, critical illness, hospital indemnity, and voluntary life insurance
- Doctegrity telehealth
- 401(k) plan
- Pre-tax benefits — FSAs and commuter benefits
- Pet insurance
- SF HQ perks — Snacks, drinks, team lunches, intense ping pong, and peak startup energy
- E-Bike transportation — A loaner electric bike
About the Company
- Firecrawl is the easiest way to turn the web into data AI agents can use. One API call converts any URL into clean, LLM-ready markdown or structured data - the boring-hard problem everyone building with LLMs eventually hits, solved.
- We hit 8 figures in ARR in year one and more than doubled it in year two. We have 147k+ GitHub stars, and developers, agents, and category-defining AI companies build on us every day. Growth like this is rare, and we're just getting started.
- We're a small team punching far above our weight. Everyone here owns a real piece of the product and company, end to end, and runs it themselves - no hiding behind process or headcount.
- This is a place for people who want to work at the frontier: an AI company building the infrastructure other AI companies run on, not one bolting AI onto an existing product. We move fast, go deep, and are building the tools superintelligence will rely on to gather data from the web.
