GenAI Engineer at BDIPlus | NY | Rezi

GenAI Engineer at BDIPlus

GenAI Engineer

BDIPlus · NY

1 months ago

GenAI Engineer

BDIPlus · NY

2 months ago
Resume preview

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now

About the Role

As a Generative AI Engineer at BDIPlus, you will design, develop, and deploy Generative AI solutions to enhance core product platforms and client implementations. You will collaborate with engineering, data science, and infrastructure teams to build scalable AI-driven applications using LLMs, RAG, model fine-tuning, and reinforcement learning.

Responsibilities

  • Deliver GenAI solutions end-to-end, owning technical design and implementation from discovery through production.
  • Build APIs/services that integrate with enterprise systems and analytics platforms.
  • Implement enterprise-grade RAG, including designing ingestion pipelines for various content types.
  • Build retrieval systems with hybrid search, filtering, re-ranking, query rewriting, and context optimization.
  • Implement permission-aware retrieval aligned to entitlements and data access policies.
  • Establish evaluation and quality controls by defining metrics for retrieval quality and answer grounding.
  • Create golden datasets, regression tests, and automated evaluation harnesses.
  • Operationalize GenAI (LLMOps), instrumenting observability and implementing safe rollout patterns.
  • Implement caching, rate limiting, fallbacks, and incident-ready operational practices.
  • Partner across teams to land solutions by collaborating with business owners and translating requirements.
  • Work with Security/Compliance to embed guardrails, auditability, and privacy controls.
  • Provide clear documentation and implementation playbooks to enable internal teams post-engagement.

Requirements

  • Master's degree or equivalent experience required; PhD a plus.
  • 3+ years in software engineering, data engineering, ML engineering, or applied AI, including recent GenAI delivery in production.
  • Demonstrated expertise in RAG system design and optimization, including chunking + metadata enrichment, hybrid search, re-ranking, retrieval evaluation, grounding/citations, and hallucination mitigation patterns.
  • Strong Python and backend engineering skills (FastAPI/Flask), plus strong SQL.
  • Experience working in regulated or security-conscious environments, with knowledge of access controls/entitlements, data privacy, logging/audit trails, and secure SDLC practices.
  • Proven ability to work effectively as an IC consultant, communicate architecture decisions clearly, influence cross-functional stakeholders without direct authority, and produce high-quality documentation and handoff materials.

Skills

  • Generative AI
  • Large Language Models (LLMs)
  • Retrieval-Augmented Generation (RAG)
  • Model fine-tuning
  • Reinforcement learning
  • Python
  • FastAPI
  • Flask
  • SQL
  • Access controls
  • Entitlements
  • Data privacy
  • Logging
  • Audit trails
  • Secure SDLC practices
  • Fine-tuning (SFT, LoRA/QLoRA)
  • Preference optimization concepts (DPO/RLHF)
  • Vector/hybrid search platforms (Elasticsearch/OpenSearch vector, FAISS, Pinecone, Weaviate, Milvus)
  • LLMOps tooling (MLflow/W&B, OpenTelemetry, prompt registries, evaluation frameworks)
  • Cloud (AWS/Azure/GCP)
  • Docker
  • Kubernetes
  • Terraform
  • Finance domain familiarity
  • LangChain
  • LlamaIndex
  • Semantic Kernel
  • Snowflake/Databricks
  • Event pipelines
  • Document stores

Location

  • New York, NY

Work Type

  • Full-time

Experience Level

  • 3+ years

Education Level

  • Master's degree or equivalent experience
  • PhD

Salary/Compensations

  • Competitive salary

Benefits

  • Full health and commuter benefits
  • Paid time off
  • Sick leave
  • Most national holidays
  • Visa sponsorship

About the Company

  • BDIPlus is a US-based consulting and Customer Data Platform (CDP) company specializing in technology transformation for the Financial Services and Insurance sectors.
  • We help enterprises turn complex data into actionable insights, enabling smarter decisions, greater efficiency and accelerated growth.
  • Our mission is to help enterprises utilize their resources more efficiently, implement effective information management and empower them with richer insights and intelligence.
  • We are driven by a single purpose: empower technology transformation.
  • We are passionate about creating foundational technology platforms for enterprise data and information management.
  • Our employees are at the heart of the work we do at BDIPlus, and we are committed to encouraging and celebrating innovation, creativity and hard work among our team members.