Engineering Manager, AI Platform at Harvey | CA, US | Rezi

Engineering Manager, AI Platform at Harvey

Engineering Manager, AI Platform

Harvey · CA, US

2 weeks ago

Engineering Manager, AI Platform

Harvey · CA, US

18 days ago
Resume preview

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now
Resume preview

Tailor your resume to this Engineering Manager, AI Platform role.

Rezi rewrites your resume against Harvey's job description. Free.

Resume score gauge reading 58 out of 100

Don't guess if your resume is good enough.

See how it scores against the Engineering Manager, AI Platform posting at Harvey — free, in seconds.

About the Role

Harvey is redefining legal work with AI and intuitive product experiences. As we scale, we're expanding our engineering team to accelerate development and build scalable infrastructure. As an Engineering Manager for AI Platform, you will lead a team building foundational AI systems, including model access, agent orchestration, evaluation frameworks, and observability. You will partner with Product, Research, and product engineering teams to translate AI advances into durable platform capabilities and set technical direction for AI features. This role requires technical depth, product intuition, and the ability to make fast, high-quality decisions at the cutting edge of applied AI.

Responsibilities

  • Lead and grow a team of engineers building the core AI platform
  • Define the roadmap for shared AI infrastructure, including model gateways and routing, agent orchestration, tool calling, prompt and context management, and long-running job execution
  • Partner with Product, Research, and product engineering teams to understand their needs and turn recurring patterns into reusable, well-documented platform primitives
  • Build and scale evaluation, testing, and monitoring systems
  • Drive reliability, latency, cost efficiency, and security across LLM-powered systems
  • Evaluate and rapidly adopt new models, frameworks, and techniques
  • Contribute to code and architecture reviews, unblock teams, and lead by example
  • Hire, grow, and retain exceptional engineers

Requirements

  • 2+ years of experience in a software engineering management role leading platform, infrastructure, or full stack product engineering teams, preferably in high-growth environments
  • 5+ years of experience as a backend, infrastructure, or full stack engineer
  • A track record of leading high-performing, engaged engineering teams
  • Experience building and operating production systems powered by LLMs (e.g., agents, retrieval, tool use, or evaluation pipelines)
  • Experience building internal platforms or shared services that other engineering teams depend on
  • Partnering with cross-functional stakeholders to prioritize internal platforms
  • Strong backend engineering skills in modern languages and frameworks (e.g. Python, Go, Node)
  • Familiarity with distributed systems concepts
  • Sound judgment on tradeoffs among quality, latency, cost, and speed of delivery in AI systems
  • Experience with durable job execution frameworks, MCP or other tool and context protocols, LLM observability and eval tooling, or working directly with model providers is a plus

Skills

  • Python
  • Go
  • Node
  • LLM
  • AI
  • Platform Engineering
  • Infrastructure Engineering
  • Backend Engineering
  • Full Stack Engineering
  • Distributed Systems
  • Agent Orchestration
  • Tool Calling
  • Prompt Management
  • Context Management
  • Job Execution
  • Evaluation Frameworks
  • Observability
  • Model Routing

Location

  • Remote

Work Type

  • Full-time

Experience Level

  • Management
  • Senior

Salary/Compensations

  • $272,000 - $355,000 USD

About the Company

  • Harvey is transforming how legal and professional services operate by combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise.
  • The company is reshaping how critical knowledge work gets done.
  • Harvey has strong product-market fit and world-class investor support.
  • The team moves fast, takes ownership, and is deeply committed to the mission.
  • Harvey operates with intensity, stays close to customers, and pushes for excellence.
  • Harvey values Decisiveness, Simplicity, and Job's Not Finished.
  • The future of professional services is being written at Harvey.

Equal Opportunity

  • Harvey is an equal opportunity employer and does not discriminate on the basis of race, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition, or any other basis protected by law.
  • We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made by emailing accommodations@harvey.ai