About the Role
The Agent Studio team is building the foundational platform for creating, deploying, and evaluating AI agents. This role involves architecting and shipping robust platform capabilities while collaborating with product teams to ensure their success in production. You will also translate learnings into a scalable, self-serve platform.
Responsibilities
- Partner directly with product teams to unblock agent use cases, co-build initial agents, and drive adoption via office hours, integration guides, and reference implementations.
- Leverage knowledge of the built environment and ConTech platforms (Procore, Autodesk CC, Buildertrend, OpenSpace) to address key friction points for GCs, Subcontractors, Owners, PMs, and Field Engineers.
- Translate fragmented, team-specific requirements into generalized platform capabilities and concrete roadmap proposals.
- Collaborate with the AI Architect and engineering leads to evaluate, benchmark, and adopt emerging agent frameworks and tools.
- Design and build the agent runtime, tool registry, and execution security controls, including process isolation, egress restrictions, and credential scoping.
- Build automated testing harnesses, LLM-as-a-judge pipelines, regression tracking, and quality dashboards for agents.
- Own end-to-end tracing using OpenTelemetry, session replay, cost attribution, and latency profiling across multi-step agent runs.
- Maintain Model Context Protocol (MCP) servers, third-party tool integrations, and stable, well-versioned platform API schemas for cross-org consumption.
Requirements
- 5+ years of software engineering experience, with at least 2 years focused on developer platforms, internal tooling, or infrastructure.
- Hands-on experience building and deploying production LLM applications or agentic systems.
- Deep proficiency in Python and/or TypeScript; comfortable reading and navigating Go codebases.
- Proven track record designing and maintaining developer-facing REST or GraphQL APIs.
- Strong grasp of agent architecture: tool usage, multi-step reasoning, memory management, structured output, and error handling.
- Pragmatic "bias for action"—capable of shipping rapidly without compromising long-term platform integrity.
- Familiarity with the ConTech landscape (Procore, Autodesk Construction Cloud, Buildertrend, OpenSpace).
- Clear understanding of core customer personas in the built environment and their operational pain points.
- Background in ConTech support, specifically troubleshooting AI features, LLM interfaces, or automated toolsets.
- Hands-on experience with Model Context Protocol (MCP) or modern tool-calling frameworks.
- Familiarity with LLM evaluation methodologies (automated judging, red-teaming, eval-driven development).
- Experience with workflow orchestration engines (e.g., Temporal, Prefect, Airflow) for long-running agent tasks.
- Experience implementing AI/ML observability tools (e.g., OpenTelemetry, Langfuse, Datadog).
- Prior experience in forward-deployed, solutions engineering, or developer advocacy roles.
Skills
- Python
- TypeScript
- Go
- REST APIs
- GraphQL APIs
- Agent architecture
- Tool usage
- Multi-step reasoning
- Memory management
- Structured output
- Error handling
- ConTech landscape
- OpenTelemetry
- Model Context Protocol (MCP)
- Workflow orchestration engines
- AI/ML observability tools
Experience Level
- 5+ years of software engineering experience
- 2+ years focused on developer platforms, internal tooling, or infrastructure
Salary/Compensations
- 168,560.00 - 231,770.00 USD Annual
- This role may also be eligible for Equity Compensation and/or Bonus Incentive Compensation.
About the Company
- Procore is committed to offering competitive, fair, and commensurate compensation.
Equal Opportunity
- For Los Angeles County (unincorporated) Candidates:
- Procore will consider for employment all qualified applicants, including those with arrest or conviction records, in accordance with the requirements of applicable federal, state, and local laws, including the City of Los Angeles’ Fair Chance Initiative for Hiring Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act.
- A criminal history may have a direct, adverse, and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment: 1. appropriately managing, accessing, and handling confidential information including proprietary and trade secret information, as well as accessing Procore's information technology systems and platforms; 2. interacting with and occasionally having unsupervised contact with internal/external customers, stakeholders, and/or colleagues; and 3. exercising sound judgment.
