About the Role
Seeking an AI Developer to design, build, and maintain scalable backend services and APIs in Python, with a strong focus on Flask and FastAPI, including both synchronous and asynchronous patterns. The position also involves developing production-grade AI and LLM capabilities such as REST and WebSocket APIs, RAG pipelines, agent/tool-calling workflows, and model evaluation and optimization across GPT and open-source solutions.
Responsibilities
- Designing, building, and maintaining robust, scalable backend services and APIs in Python (focus on Flask and FastAPI, synchronous and asynchronous patterns).
- Writing clean, efficient, and scalable Python code with strong attention to performance, reliability, and security.
- Developing and exposing AI/LLM capabilities as production-grade APIs (REST / WebSocket streaming responses, authentication).
- Implementing Large Language Model (LLM) solutions (GPT family and open-source models) including prompt design, evaluation, versioning, and cost/performance optimization.
- Build and maintain RAG pipelines (ingestion, embeddings, vector search e.g., pgvector) and agent/tool-calling (MCP / function calling) workflows.
- Integrating external/internal tools and data sources for LLM-based agents (databases, APIs, file systems, messaging platforms).
- Integrate data sources (SQL Server, PostgreSQL) and implement efficient schemas, queries, and transaction handling. ORM usage e.g., SQLAlchemy).
- Applying classical machine learning (scikit-learn) and statistical techniques when they provide simpler or more cost‑effective solutions.
- Performing systematic evaluation and monitoring of AI/LLM outputs (quality, hallucination mitigation, latency, cost KPIs) and implementing guardrails/content filtering.
Requirements
- 3+ years of experience in a corporate IT environment
- 1+ year of experience in Artificial Intelligence, Machine Learning, Python, Flask, and FastAPI; sound software design, debugging, and performance profiling skills.
- Solid SQL Server & PostgreSQL knowledge (schema design, indexing, optimization; ORM experience).
- Maintaining adherence to security, privacy, and compliance best practices (secret management, data handling, access control).
- Strong commitment to secure, reliable, well-documented code ensuring adherence with quality standards.
Skills
- Python
- Flask
- FastAPI
- AI
- Machine Learning
- SQL Server
- PostgreSQL
- ORM
- scikit-learn
- Docker
- Kubernetes
- CI/CD
- JavaScript
Location
- Toronto
Work Type
- Hybrid
- Full-time
Experience Level
- 3+ years of experience in a corporate IT environment
- 1+ year of experience in Artificial Intelligence, Machine Learning, Python, Flask, and FastAPI
Benefits
- Professional development opportunities
- Interesting work
- Supportive leaders
- Vibrant and inclusive culture
- Range of career opportunities
- Benefits and rewards to enhance well-being
About the Company
- Marsh (NYSE: MRSH) is a global leader in risk, reinsurance and capital, people and investments, and management consulting, advising clients in 130 countries.
- With annual revenue of over $27 billion and more than 95,000 colleagues, Marsh helps build the confidence to thrive through the power of perspective.
- For more information, visit corporate.marsh.com, or follow us on LinkedIn and X.
Equal Opportunity
- Marsh is committed to embracing a diverse, inclusive and flexible work environment.
- We aim to attract and retain the best people and embrace diversity of age background, disability, ethnic origin, family duties, gender orientation or expression, marital status, nationality, parental status, personal or social status, political affiliation, race, religion and beliefs, sex/gender, sexual orientation or expression, skin color, or any other characteristic protected by applicable law.
- In accordance with the Accessibility for Ontarians with Disabilities Act, 2005, Marsh will provide a reasonable accommodation to employees and prospective employees to the point of undue hardship upon request and as required in respect of the individual’s particular restrictions and limitations.
- If you require a specific accommodation because of a disability or medical need, please contact reasonableaccommodations@marsh.com.
- Marsh is committed to hybrid work, which includes the flexibility of working remotely and the collaboration, connections and professional development benefits of working together in the office.
- All Marsh colleagues are expected to be in their local office or working onsite with clients at least three days per week.
- Office-based teams will identify at least one “anchor day” per week on which their full team will be together in person.
