About the Role
Build the core infrastructure that powers the next generation of AI agents, focusing on ingesting, enriching, and vectorizing massive, multi-modal datasets from over 100 customer sources. The role addresses the challenge of achieving radical cost-efficiency while enabling agents to deliver thorough responses in seconds.
Responsibilities
- Implement and optimize a highly scalable, multi-tenant data ingestion and vectorization pipeline, focusing on cost and performance improvements.
- Create and maintain dashboards, alerts, and logging to ensure system health and visibility into production issues.
- Contribute to performance tuning across the stack to eliminate bottlenecks in data retrieval, model inference, and agent response times.
- Design and implement scalable, secure, and cost-effective multi-tenant infrastructures for SaaS-based AI products, ensuring tenant isolation and fair resource allocation.
Requirements
- 5+ years of hands-on experience with cloud platforms.
- Strong expertise in Google Cloud Platform (GCP) and Infrastructure as Code (e.g., Terraform).
- Demonstrated history of performance analysis, tuning, and infrastructure cost optimization.
- Experience building or working on multi-tenant SaaS platforms.
- Experience setting up end-to-end observability, including logging, metrics, and alerting using tools like Prometheus, Grafana, Datadog, or GCP Operations suite.
Skills
- Google Cloud Platform (GCP)
- Infrastructure as Code (Terraform)
- Performance analysis
- Infrastructure cost optimization
- Multi-tenant SaaS platforms
- Observability tools (Prometheus, Grafana, Datadog, GCP Operations suite)
- VectorDBs
- LLMs
- Agentic Observability tools
- Gemini API
- LLM serving frameworks
- Quantization
- Tensor parallelism
- FlashAttention
Location
- Austin
Work Type
- Hybrid
Experience Level
- Senior
- 5+ years
Salary/Compensations
- 140,960.00 - 193,820.00 USD Annual
Benefits
- Equity Compensation
- Bonus Incentive Compensation
About the Company
- Procore is committed to offering competitive, fair, and commensurate compensation.
Equal Opportunity
- Procore will consider for employment all qualified applicants, including those with arrest or conviction records, in accordance with the requirements of applicable federal, state, and local laws, including the City of Los Angeles’ Fair Chance Initiative for Hiring Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act.
- A criminal history may have a direct, adverse, and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment: 1. appropriately managing, accessing, and handling confidential information including proprietary and trade secret information, as well as accessing Procore's information technology systems and platforms; 2. interacting with and occasionally having unsupervised contact with internal/external customers, stakeholders, and/or colleagues; and 3. exercising sound judgment.
