Applied AI Analyst at Metropolitan Commercial Bank | NY, US | Rezi

Applied AI Analyst at Metropolitan Commercial Bank

Applied AI Analyst

Metropolitan Commercial Bank · NY, US

1 months ago

Applied AI Analyst

Metropolitan Commercial Bank · NY, US

a month ago
Resume preview

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now
Resume preview

Tailor your resume to this Applied AI Analyst role.

Rezi rewrites your resume against Metropolitan Commercial Bank's job description. Free.

Resume score gauge reading 58 out of 100

Don't guess if your resume is good enough.

See how it scores against the Applied AI Analyst posting at Metropolitan Commercial Bank — free, in seconds.

About the Role

Metropolitan Commercial Bank is seeking an Applied AI Analyst to support the design, configuration, testing, and monitoring of applied AI, Generative AI, machine learning, and agentic workflow solutions within a regulated banking environment. This role involves working with AI Scientists and cross-functional teams on internal use cases like AI-assisted documentation, fraud detection, and workflow automation, with a strong emphasis on documentation, oversight, privacy, and security controls.

Responsibilities

  • Support AI Scientists in building, configuring, and testing applied AI/GenAI solutions for banking use cases.
  • Develop and refine prompts, grounding instructions, structured outputs, evaluation datasets, and RAG pipelines.
  • Prepare and transform data; assist with API integrations, notebooks, and repeatable workflows.
  • Assist in designing and testing agentic workflows using approved enterprise platforms.
  • Work with emerging interoperability patterns such as Model Context Protocol (MCP), tool/skill/plugin integration, and Agent-to-Agent (A2A) connectivity.
  • Document workflow steps, tool schemas, fallback logic, escalation paths, and safe disablement/rollback procedures.
  • Support prototyping and evaluation in Microsoft Foundry / Foundry Agent Service and related Microsoft ecosystems.
  • Assist with prompt and agent configuration, retrieval integration, logging, model/tool versioning, and operational runbooks.
  • Create and execute test cases for AI outputs, evaluating accuracy, groundedness, hallucination, task completion, retrieval quality, bias/fairness, and security scenarios.
  • Track KPIs/KRIs, output quality, drift indicators, and user feedback; maintain evidence for reviews and monitoring.
  • Support AI use-case intake and governance processes by preparing required documentation.
  • Learn domain and process context for new use cases by speaking with business owners and control partners.
  • Support third-party/AI vendor due diligence by collecting and organizing evidence and reviewing vendor documentation.
  • Apply privacy-by-design, data minimization, access-control, and secure prompt/data handling practices.
  • Communicate findings, limitations, and recommendations clearly to stakeholders.
  • Contribute to playbooks, standard operating procedures, and reusable templates.
  • Stay current on practical applied-AI methods and recommend fit-for-purpose uses.
  • Promote responsible AI, reproducibility, and disciplined execution.

Requirements

  • 2+ years of work experience.
  • Working knowledge of Python, SQL, notebooks, REST APIs, JSON/YAML, and version control (e.g., Git).
  • Understanding of traditional machine learning model development and lifecycle concepts.
  • Familiarity with LLM application patterns, including prompt engineering, structured outputs, function/tool calling, RAG, embeddings, and vector search.
  • Familiarity with Microsoft Foundry (including Foundry Agent Service), Microsoft 365 Copilot / Copilot Studio concepts, and approved enterprise data/AI platforms such as Snowflake.
  • Understanding of agentic workflow concepts such as MCP servers/tools, skills/plugins, subagents or agents-as-tools, handoffs, human-in-the-loop controls, and A2A integration patterns.
  • Ability to test and evaluate AI outputs for accuracy, groundedness, hallucination, retrieval quality, bias/fairness, and basic security misuse scenarios.
  • Working knowledge of model and data governance concepts, including documentation, monitoring, change control, inventories, audit trails, and three-lines-of-defense oversight in a regulated environment.
  • Strong written and verbal communication skills.
  • Analytical, organized, and adaptable mindset; ability to learn quickly, manage multiple workstreams, and balance innovation with risk discipline.
  • Excellent written and verbal communication skills.
  • Demonstrate analytical, troubleshooting, and problem-solving skills.
  • The ability to learn new technologies quickly.
  • Self-directed individual with strong organizational and communication skills.
  • Ability to synthesize multiple sources of information with an understanding of the bigger picture needs and operations of the Bank.
  • Collaborative team player who can find practical solutions in a dynamic work environment.
  • Ability to handle ambiguity, manage multiple tasks at once, and shift effectively between priorities.

Skills

  • Applied AI
  • Generative AI
  • Machine Learning
  • Agentic Workflow Solutions
  • Prompt Engineering
  • Retrieval-Augmented Generation (RAG)
  • Embeddings
  • Vector Search
  • Document Chunking
  • Metadata-driven Retrieval
  • API Integrations
  • Notebooks
  • Repeatable Workflows
  • Microsoft Foundry
  • Foundry Agent Service
  • Microsoft 365 Copilot
  • Copilot Studio
  • Snowflake
  • Model Context Protocol (MCP)
  • Tool/Skill/Plugin Integration
  • Agent-to-Agent (A2A) Connectivity
  • Python
  • SQL
  • REST APIs
  • JSON/YAML
  • Git
  • Model Training
  • Data Leakage Prevention
  • Model Testing/Validation
  • Model Monitoring
  • Performance Metrics
  • Classification
  • Regression
  • Structured Outputs
  • Function/Tool Calling
  • Agentic Workflow Design
  • Human-in-the-Loop Controls
  • Model Governance
  • Data Governance
  • Documentation
  • Change Control
  • Inventories
  • Audit Trails
  • Three-Lines-of-Defense Oversight
  • Financial Services Exposure (Fraud, AML/KYC/CDD/EDD, Underwriting, Commercial Banking, Treasury, Policy Governance, Contact Center Analytics)
  • Azure AI Search
  • Vector Databases
  • Document Understanding
  • LangChain
  • Semantic Kernel
  • LangGraph
  • Microsoft Agent Framework
  • Orchestration Libraries/Frameworks
  • SR 11-7
  • SR 23-4
  • AI Use-Case Intake
  • AI Inventory Processes
  • Privacy
  • Cybersecurity
  • Third-Party Risk Management

Location

  • New York City

Work Type

  • Hybrid
  • 4-day in-office
  • 1-day remote

Experience Level

  • 2+ years of work experience

Education Level

  • Bachelor’s degree in Computer Science, Data Science, Statistics, Engineering, Information Systems, Mathematics, or a related field is preferred.
  • Relevant internships, apprenticeships, or comparable hands-on AI, analytics, or automation project experience will be considered.

Salary/Compensations

  • $120,000 - $150,000 annually

About the Company

  • Metropolitan Commercial Bank (the “Bank”) is a full-service commercial bank based in New York City.
  • The Bank provides a broad range of business, commercial, and personal banking products and services.
  • Metropolitan Commercial Bank was named one of Newsweek’s Best Regional Banks and Credit Unions 2024.
  • Ranked by Independent Community Bankers of America among the top ten successful loan producers for 2023.
  • Kroll affirmed a BBB+ (investment grade) deposit rating on January 25, 2024.
  • MCB has earned a place in the Piper Sandler Bank Sm-All Stars Class of 2024.
  • Metropolitan Commercial Bank operates banking centers and private client offices in Manhattan, Boro Park, Brooklyn and Great Neck on Long Island in New York State.
  • The Bank is a New York State chartered commercial bank, a member of the Federal Reserve System and the Federal Deposit Insurance Corporation, and an equal housing lender.
  • The parent company of Metropolitan Commercial Bank is Metropolitan Bank Holding Corp. (NYSE: MCB).

Equal Opportunity

  • Metropolitan Commercial Bank provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws.
  • This applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.
  • MCB maintains a drug free workplace.