Impress employers and recruiters.
Choose from hundreds of resume examples.
Impress employers and recruiters.
Choose from hundreds of resume examples.
Target Resume Now
Tailor your resume to this Agentic AI Analyst role.
Rezi rewrites your resume against Invoca's job description. Free.
Tailor your resume to this Agentic AI Analyst role.
Rezi rewrites your resume against Invoca's job description. Free.
Don't guess if your resume is good enough.
See how it scores against the Agentic AI Analyst posting at Invoca — free, in seconds.
Don't guess if your resume is good enough.
See how it scores against the Agentic AI Analyst posting at Invoca — free, in seconds.
About the Role
As an Agentic AI Analyst at Invoca, you will play a pivotal role in shaping and refining the emerging category of agentic AI applications. Within our Product organization, you'll collaborate closely with a cross-functional team to identify, evaluate, and operationalize agentic use cases that directly improve customer outcomes and advance Invoca's strategic AI vision. A core focus of this role is the integration layer that makes agents useful in the real world: designing and validating the tools agents call, authoring the skills that shape agent behavior, building the evaluation harnesses that measure whether agents actually work, and running simulations that stress-test agents before customers ever touch them. This is an opportunity to grow your product skillset at the intersection of customer needs, agentic AI system design, and real-world AI performance.
Responsibilities
- Design and Validate Agentic Integrations (MCP Tools): Define the tools our agents use to read and act on customer data. Author tool specifications, prototype MCP servers and tool integrations, and validate that agents select and invoke tools correctly across realistic scenarios. Partner with Engineering on tool ergonomics that reduce hallucinated calls and improve task completion.
- Author and Maintain Agent Skills: Design, write, and maintain reusable skills: structured instructions, workflows, and domain knowledge that govern how agents approach specific jobs. Test skill triggering accuracy, iterate on instructions based on eval results, and manage a versioned library of skills for reuse across products and customers.
- Build and Run Agent Evals: Design evaluation frameworks for agentic behaviors, including golden datasets, task-level success criteria, grading rubrics, and LLM-as-judge pipelines. Run evals across model, prompt, tool, and skill changes to catch regressions, quantify improvements, and inform release decisions. Report results in a way that both Engineering and GTM can act on.
- Simulate Agent Behavior Before Production: Build and operate simulation environments to exercise multi-step agent workflows at scale. Use simulation results to uncover failure modes, calibrate human-in-the-loop handoff points, and establish confidence thresholds before beta and GA.
- Design End-to-End Agent Behavior: Own how an agent reasons through a task from start to finish, including planning logic, state management across steps, escalation and human-in-the-loop decision points, and fallback behavior when tools or data are unavailable.
- Validate Use Cases with Customers and GTM: Work with Sales Engineering, Customer Success, and customers to surface high-value problems, and mine call transcripts, usage data, and tool-call traces to identify where agents can deliver measurable outcomes. Translate those findings into scoped, experiment-ready proposals.
- Monitor Agent Performance in Production: Track and interpret key metrics to assess agent efficacy and prioritize improvements.
- Optimize Retrieval and Model Behavior: Partner with Engineering and ML teams to tune the components behind agent quality, using eval and production data to guide changes.
- Triage Production Issues and Regressions: Own the process for capturing, reproducing, and documenting unintended agent behaviors reported from production. Work cross-functionally to root-cause issues, land fixes, and add coverage to evals and simulations so they don't recur.
- Document Agent Designs and Best Practices: Own internal documentation for agent designs, tool specifications, skill libraries, eval methodology, and troubleshooting guides so that patterns can be reused and scaled across teams.
- Enable Cross-Functional Teams and Customers: Support Product Marketing and Enablement by developing clear collateral and training on agentic AI features. Represent Product in customer meetings, agile ceremonies, and internal demos.
- Design Multi-Agent and Long-Running Workflows: Architect how agents hand off tasks to other agents and how they maintain context and state across long-running or multi-session buyer interactions.
Requirements
- 3+ years of experience in product, analytics, or technical customer-facing roles within SaaS or enterprise software.
- Hands-on experience with agentic AI systems in production environments, including multi-step reasoning, tool use, conversational agents and human-in-the-loop agents.
- Experience designing or integrating tools for AI agents, such as building or configuring MCP servers, defining function/tool schemas, or connecting agents to APIs and enterprise systems.
- Experience with agent design and architecture, authoring prompts, skills, or agent instructions and iterating on them based on measured results.
- Experience designing and running evals for Agentic systems, including building golden data sets, defining success criteria, and building scorers.
- Experience with simulation or synthetic testing approaches for agents.
- Experience with AI orchestration frameworks (e.g., LangChain, LangGraph).
- Demonstrated ability to work independently on medium-scope initiatives and balance tradeoffs across requirements, user value, and implementation effort.
- Skilled at breaking down ambiguous problems, gathering data, and proposing thoughtful, data-driven solutions.
- Strong communicator who can lead and coordinate messaging across technical and non-technical stakeholders.
- Highly collaborative and comfortable working across Engineering, GTM, and Design partners.
- Familiarity with agent-to-agent (A2A) protocols or multi-agent orchestration patterns.
- Experience designing for long-running or stateful agent sessions (context persistence, session resumption, drift over time).
- Working comfort with Python, JSON/JSON Schema, and reading API documentation, enough to prototype and inspect tool calls and traces.
- Prior experience building or managing integrations between SaaS platforms via APIs, webhooks, or iPaaS tools.
- Experience in marketing or advertising technology, such as paid media, call tracking, attribution, marketing analytics, or ad platforms.
Skills
- Agentic AI
- Product Management
- Data Analysis
- Technical Customer Support
- SaaS
- Enterprise Software
- Multi-step Reasoning
- Tool Use
- Conversational Agents
- Human-in-the-loop Agents
- MCP Servers
- Function/Tool Schemas
- API Integration
- Prompt Authoring
- Skill Authoring
- Agent Instruction Authoring
- Evaluation Frameworks
- Golden Datasets
- Success Criteria Definition
- Scoring
- Simulation
- Synthetic Testing
- AI Orchestration Frameworks
- LangChain
- LangGraph
- Problem Solving
- Data Gathering
- Data-Driven Solutions
- Communication
- Collaboration
- Agent-to-Agent (A2A) Protocols
- Multi-agent Orchestration
- Long-running Agent Sessions
- Stateful Agent Sessions
- Context Persistence
- Session Resumption
- Python
- JSON
- JSON Schema
- API Documentation
- SaaS Platform Integration
- CRM Integration
- Marketing Automation Integration
- Contact Center Integration
- Data Platform Integration
- Webhooks
- iPaaS
- Marketing Technology
- Advertising Technology
- Paid Media
- Call Tracking
- Attribution
- Marketing Analytics
- Ad Platforms
Location
- Remote-first
- United States: Greater Los Angeles Area
- United States: SF Bay Area
- United States: Denver Metro
- United States: Austin Metro
- United States: Chicago Metro
- United States: Greater NYC Area
- United States: Seattle Metro
Work Type
- Remote
Experience Level
- 3+ years of experience
Salary/Compensations
- $94,000–$134,000
Benefits
- Day-One Health Benefits – Medical, dental, and vision coverage begins on your first day of employment for U.S.-based teammates.
- Mental Wellbeing – Access to mental wellbeing support and an Employee Assistance Program (EAP).
- Wellness Subsidy – Reimbursement that can be applied toward gym memberships, fitness classes, and more.
- Flexible Time Off – Encourages a healthy work-life balance.
- Paid Holidays – Invoca provides 20 U.S. paid holidays, including a winter break.
- Paid Family Leave – Up to 12 weeks of 100% paid leave for baby bonding, adoption, and caring for family members.
- Paid Medical Leave – Up to 12 weeks of 100% paid leave for childbirth and medical needs.
- Enterprise-Grade AI Tools – Access to industry-leading enterprise AI tools.
- Professional Development – Annual reimbursement of up to $1,000 per fiscal year to support learning, certifications, conferences, and other professional development opportunities.
- 401(k) – Invoca offers a 401(k) plan through Fidelity with a company match of up to 4%.
- Recognition Programs – Celebrate great work through company-wide and team recognition programs.
- InVacation (Sabbatical) – Offer a sabbatical after seven years of service.
About the Company
- Invoca is the revenue infrastructure connecting marketing, commerce, and contact center teams — turning every buyer conversation into revenue, and attributing it all the way back to the media spend that drove it. Our multimodal AI agents operate at the moment of decision: engaging buyers across the journey with personalized interactions at scale for life's most considered purchases — without losing the empathy, explainability, and trust those decisions demand. Every engagement is transparent and attributable — brands see not just what converted, but why, and what marketing dollar earned it. Come work on the layer where AI agents and real revenue meet.