About the Role
The Agent Control Plane is a new extension of Signal 1's AI Management System, designed to help health systems manage, evaluate, and govern their AI agents. This is a zero-to-one build co-developed with leading health systems, offering significant ownership and the chance to shape the product's architecture and codebase.
Responsibilities
- Own features end to end, from ambiguous idea to production, including data modeling, pipeline and backend service construction, and frontend collaboration.
- Build the AI core of the product, designing and implementing systems for grounding agents, evaluating behavior, and extracting insights for continuous improvement.
- Work with messy, real-world data, ingesting and normalizing telemetry, healthcare data standards (FHIR), and clinician feedback into reliable datasets.
- Prototype with design partners, building demos and pilots with health systems and incorporating feedback rapidly.
- Invent solutions for novel problems in agent observability and evaluation within healthcare.
- Raise the bar for agent management practices, keeping patterns for testing, evaluation, logging, and reliability ahead of the state-of-the-art.
- Keep engineering, product, and customers aligned through clear and succinct communication.
- Translate fluently between technical and clinical audiences.
Requirements
- 3+ years of industry experience shipping software, with a substantial portion focused on applied machine learning.
- Proven track record of building and operating production AI systems, including LLM-powered or ML-powered features at scale.
- Depth in AI and backend engineering, including strong Python for services and ML pipelines, cloud infrastructure, CI/CD, and a working understanding of frontend development (TypeScript, React, or equivalent).
- Deep hands-on data experience, including building data pipelines, cleaning datasets, designing schemas, and understanding data quality impacts.
- Experience taking at least one product or major product area from an empty repository to real users.
- History of creating novel solutions for problems without established approaches.
- Strong product mindset, prioritizing user needs and outcomes.
- Comfort making decisions with incomplete information and adapting quickly.
- High agency and resourcefulness in unblocking oneself and seeking help when needed.
- AI-native approach, utilizing AI tools daily for coding, research, and prototyping.
- High bar for craft, focusing on both functionality and user experience.
Skills
- Python
- Cloud infrastructure
- CI/CD
- TypeScript
- React
- Data pipelines
- Data cleaning
- Schema design
- Machine learning
- AI systems
- LLM-powered features
- Agentic systems
Location
- Toronto
Work Type
- Hybrid
Experience Level
- 3+ years
Benefits
- Comprehensive health benefits
- 4 weeks PTO
About the Company
- Signal 1's AI Management System helps health systems operate scalable and valuable AI programs, ensuring solutions perform as expected and enabling data-driven investment decisions.
- The company was founded by Tomi Poutanen and Mara Lederman, with early backing from Geoffrey Hinton.
- Signal 1 is purpose-built for healthcare and informed by experience managing AI at scale.
