About the Role
Seeking an experienced AI/ML Model Validation and Governance professional to independently evaluate predictive, machine learning, Generative AI, and other advanced analytical models. The ideal candidate combines strong quantitative skills, hands-on Python and SQL experience, and a thorough understanding of model risk management within a regulated environment.
Responsibilities
- Perform independent validation of predictive, statistical, AI/ML, and Generative AI models.
- Evaluate model methodology, assumptions, data quality, implementation, performance, limitations, and intended use.
- Conduct benchmarking, sensitivity analysis, stress testing, and performance testing.
- Assess model explainability, bias, fairness, robustness, and regulatory compliance.
- Review models using structured and unstructured data, including NLP, LLM, and RAG-based solutions.
- Evaluate model monitoring frameworks, performance thresholds, and governance controls.
- Document findings clearly and communicate recommendations to model developers, business stakeholders, risk teams, and senior management.
- Support the continued development of AI governance and model risk standards.
Requirements
- At least 4 years of direct experience in model validation, model risk management, or AI/ML governance.
- Hands-on experience independently validating predictive or AI/ML models.
- Strong Python and SQL skills.
- Experience with benchmarking, explainability, bias and fairness testing, sensitivity analysis, and ongoing model monitoring.
- Understanding of model risk management principles and regulatory expectations.
- Experience working in financial services, insurance, banking, or another regulated industry.
- Strong written and verbal communication skills.
- Ability to work onsite in New York City three days per week.
Skills
- Python
- SQL
- NLP
- LLM
- RAG-based solutions
- Benchmarking
- Explainability
- Bias and fairness testing
- Sensitivity analysis
- Model monitoring
- Model risk management
- AI governance
- Responsible AI frameworks
Location
- New York City, NY
Work Type
- Full-time
- Hybrid
Experience Level
- Experienced
- 4+ years
Education Level
- Advanced degree in mathematics, statistics, computer science, data science, engineering, economics, or another quantitative discipline.
Salary/Compensations
- Up to $210,000 base salary
- 10% annual bonus
- Sign-on bonus
About the Company
- Highly established financial services organization.
