Associate LLM Engineer (Forward Deployment) at ZS | CA | Rezi

Associate LLM Engineer (Forward Deployment) at ZS

Associate LLM Engineer (Forward Deployment)

ZS · CA

4 weeks ago

Associate LLM Engineer (Forward Deployment)

ZS · CA

a month ago
Resume preview

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now
Resume preview

Tailor your resume to this Associate LLM Engineer (Forward Deployment) role.

Rezi rewrites your resume against ZS's job description. Free.

Resume score gauge reading 58 out of 100

Don't guess if your resume is good enough.

See how it scores against the Associate LLM Engineer (Forward Deployment) posting at ZS — free, in seconds.

About the Role

We are seeking a highly skilled LLM Engineer with 1-4 years of experience in software development and 1-2 years in LLM solution development. The ideal candidate will have strong experience working with Python, LLM solution patterns and tools (RAG, Vector DB, Agentic workflows, LoRA, etc.) cloud platforms (AWS, Databricks and Azure), and DevOps tools. They will be responsible for designing and developing scalable software solutions, leading architecture design, and ensuring the performance and reliability of our systems.

Responsibilities

  • Take ownership of architecture design and development of scalable and distributed software systems
  • Translate business to technical requirements
  • Own technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocation
  • Data driven decision making skills with focus on achieving product goals
  • Design, develop and deploy LLM based pipelines involving patterns like RAG, Agentic workflows, PEFT (e.g. LORA, QLORA, etc.)
  • Responsible for the complete software development lifecycle, including requirements analysis, design, coding, testing, and deployment.
  • Utilize AWS services/ Azure services like IAM, Monitoring, Load Balancing, Autoscaling, Database, Networking, storage, ECR, AKS, ACR etc.
  • Utilize Databricks capabilities, esp. Unity Catalog and be able to architect the governance layer from data all-the-way to the AI model output
  • Design, develop and deploy prompt and response guardrails to enable responsible AI requirements
  • Implement DevOps practices using tools like Docker, Kubernetes to ensure continuous integration and delivery. Develop DevOps scripts for automation and monitoring.
  • Collaborate with cross-functional teams, conduct code reviews, and provide guidance on software design and best practices.

Requirements

  • Bachelor’s degree in computer science, Information Technology, or a related field (or equivalent work experience).
  • 1-5 years of experience in software development, with relevant work experience in LLM app development.
  • Strong coding skills with proficiency in Python and Javascript
  • Experience with API frameworks both stateless and stateful such as Fast API, Django
  • Proficient in cloud platforms, specifically AWS, Databricks and Azure
  • Proficient in Infra-as-Code, esp. focused on developing Terraform scripts and Cloudformation
  • Knowledge and hands-on experience with front-end development (React JS, Next JS, Tailwind CSS) preferred
  • Strong experience in LLM patterns like RAG, Vector DB, Hybrid Search, Agent development, Agentic workflows, prompt engineering, etc.
  • Strong experience with LLM APIs (Open AI, Anthropic, AWS Bedrock), SDKs (Langchain, DSPy)
  • Hands-on experience with DevOps tools including Docker, Kubernetes, and AWS services (Redshift, RDS, S3).
  • Hands-on experience with Databricks solutions including Unity Catalog.
  • Experience in production deployments involving thousands of users, esp with capabilities like Redis, Vector Search, etc.
  • Strong understanding of scalable application design principles and experience with security best practices and compliance with privacy regulations.
  • Good knowledge of software engineering practices like version control (GIT), DevOps (Azure DevOps preferred) and Agile or Scrum.
  • Strong communication skills, with the ability to effectively convey complex technical concepts to a diverse audience.
  • Experience of SDLC and best practices while development
  • Experience with Agile methodology for continuous product development and delivery
  • Fluency in English
  • Client-first mentality
  • Intense work ethic
  • Collaborative spirit and problem-solving approach
  • Candidates must possess or be able to obtain work authorization for their intended country of employment.
  • An on-line application, including a full set of transcripts (official or unofficial), is required to be considered.

Skills

  • Python
  • LLM solution patterns
  • RAG
  • Vector DB
  • Agentic workflows
  • LoRA
  • AWS
  • Databricks
  • Azure
  • DevOps tools
  • Javascript
  • Fast API
  • Django
  • Terraform
  • Cloudformation
  • React JS
  • Next JS
  • Tailwind CSS
  • Open AI
  • Anthropic
  • AWS Bedrock
  • Langchain
  • DSPy
  • Docker
  • Kubernetes
  • Redshift
  • RDS
  • S3
  • Unity Catalog
  • Redis
  • GIT
  • Azure DevOps
  • Agile
  • Scrum

Location

  • On-site at clients or ZS offices
  • Remote

Work Type

  • Hybrid
  • Full-time

Experience Level

  • 1-4 years of experience in software development
  • 1-2 years in LLM solution development
  • 1-5 years of experience in software development
  • Relevant work experience in LLM app development

Education Level

  • Bachelor’s degree in computer science, Information Technology, or a related field (or equivalent work experience).

Benefits

  • Comprehensive total rewards package that supports your health and well‑being, financial future, time away, and professional development.
  • Robust skills‑building programs
  • Multiple career progression paths
  • Internal mobility
  • Deeply collaborative culture

About the Company

  • ZS is a management consulting and technology firm focused on improving life and how we live it.
  • We transform ideas into impact by bringing together data, science, technology and human ingenuity to deliver better outcomes for all.
  • Here you’ll work side-by-side with a powerful collective of thinkers and experts shaping life-changing solutions for patients, caregivers and consumers, worldwide.
  • ZSers drive impact by bringing a client-first mentality to each and every engagement.
  • We partner collaboratively with our clients to develop custom solutions and technology products that create value and deliver company results across critical areas of their business.
  • Bring your curiosity for learning, bold ideas, courage and passion to drive life-changing impact to ZS.

Equal Opportunity

  • ZS is an equal opportunity employer and is committed to providing equal employment and advancement opportunities without regard to any class protected by applicable law.