About the Role
Zeta Global is seeking a leader to drive the architecture and development of agentic systems, focusing on LLM agents, context management, and observability to enhance marketer efficiency.
Responsibilities
- Develop and manage the architecture for chaining LLM agents, tools, models, and workflows.
- Ensure seamless orchestration, handoffs, state management, and integration across the platform.
- Lead the development of a shared Context Graph for persistent agent awareness.
- Define how context is captured, structured, retrieved, governed, and made available.
- Implement and manage context streaming services for real-time agent awareness.
- Define the telemetry framework for understanding agent operations in production.
- Instrument and analyze agent performance metrics and build feedback loops for improvement.
- Build robust evaluation frameworks for testing agent quality, reliability, and workflow completion.
- Lead the creation of a Model Workbench for non-technical users to leverage LLMs and ML.
- Oversee the registration, documentation, governance, and discoverability of Model Context Protocol servers, tools, and agents.
- Drive alignment across Product, Engineering, Data Science, Design, Analytics, Security, and business stakeholders.
- Establish clear accountability and operating models for cross-team capabilities.
- Define standards for building and integrating agents, tools, context sources, telemetry, and workflows.
- Balance local team autonomy with the consistency required for a coherent platform experience.
- Actively participate in troubleshooting and debugging using tools like LangSmith.
- Rapidly build proof-of-concepts to validate technical approaches and identify architectural constraints.
- Promote a culture of rapid prototyping, experimentation, and evidence-based iteration.
- Use lightweight development and “vibe coding” to quickly turn ideas into working experiences.
Requirements
- Demonstrated experience leading complex technical products, particularly those involving LLMs, AI agents, workflow systems, developer platforms, ML infrastructure, or AI-driven applications.
- Strong understanding of LLM agents, tool use, orchestration, multi-agent workflows, state management, context management, and architectural patterns for reliable operation at scale.
- Experience designing or working with context graphs, knowledge graphs, semantic systems, memory architectures, metadata platforms, or similar systems.
- Strong understanding of instrumentation, telemetry, evaluation, and observability for complex software or AI systems.
- Ability to define signals to distinguish between various system failure types.
- Exceptional ability to align senior stakeholders and cross-functional teams around shared technical architecture, product priorities, ownership boundaries, and operating standards.
- Comfortable leading initiatives where no single team controls the entire outcome.
- Ability to reason across product experience, model behavior, data, infrastructure, APIs, organizational ownership, and operational processes.
- Strong technical background with hands-on familiarity with tools such as LangSmith.
- Experience working with APIs, workflow orchestration, LLM agent chaining, MCP, evaluation frameworks, and modern AI development environments.
- Demonstrated ability to troubleshoot ambiguous technical problems, rapidly prototype potential solutions, and translate experimentation into scalable product and architectural decisions.
- Excellent communication skills with the ability to translate highly technical concepts for both technical and non-technical audiences.
Skills
- LLMs
- AI agents
- Workflow systems
- Developer platforms
- ML infrastructure
- AI-driven applications
- Agent chaining
- Orchestration
- Multi-agent workflows
- State management
- Context management
- Context graphs
- Knowledge graphs
- Semantic systems
- Memory architectures
- Metadata platforms
- Instrumentation
- Telemetry
- Evaluation
- Observability
- Systems thinking
- LangSmith
- APIs
- Workflow orchestration
- MCP
- Evaluation frameworks
- AI development environments
- Prototyping
Location
- New York City
- Global
Work Type
- Full-time
Experience Level
- Senior
- Lead
Salary/Compensations
- $185,000 - $205,000
Benefits
- Unlimited PTO
- Excellent medical, dental, and vision coverage
- Employee Equity
- Employee Discounts
- Virtual Wellness Classes
- Pet Insurance
About the Company
- Zeta Global (NYSE: ZETA) is the AI-Powered Marketing Cloud that leverages advanced artificial intelligence (AI) and trillions of consumer signals to make it easier for marketers to acquire, grow, and retain customers more efficiently.
- Through the Zeta Marketing Platform (ZMP), our vision is to make sophisticated marketing simple by unifying identity, intelligence, and omnichannel activation into a single platform – powered by one of the industry’s largest proprietary databases and AI.
- Our enterprise customers across multiple verticals are empowered to personalize experiences with consumers at an individual level across every channel, delivering better results for marketing programs.
- Zeta was founded in 2007 by David A. Steinberg and John Sculley and is headquartered in New York City with offices around the world.
Equal Opportunity
- Zeta considers applicants for employment without regard to, and does not discriminate on the basis of an individual’s sex, race, color, religion, age, disability, status as a veteran, or national or ethnic origin; nor does Zeta discriminate on the basis of sexual orientation, gender identity or expression.
- We’re committed to building a workplace culture of trust and belonging, so everyone feels invited to bring their whole selves to work.
- We provide a forum for employees to celebrate, support and advocate for one another.
- Learn more about our commitment to diversity, equity and inclusion here: https://zetaglobal.com/blog/a-look-into-zetas-ergs/
