Staff Research Engineer (LLM Pre-Training) at JetBrains | CZ | Rezi

Staff Research Engineer (LLM Pre-Training) at JetBrains

Staff Research Engineer (LLM Pre-Training)

JetBrains · CZ

1 months ago

Staff Research Engineer (LLM Pre-Training)

JetBrains · CZ

a month ago
Resume preview

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now

About the Role

We are looking for a Research Engineer to contribute to training foundation models for coding tasks. You will develop Large Language Models from scratch and deploy them into production environments, making them accessible to end users globally.

Responsibilities

  • Work with stakeholders to convert business requirements into technical specifications.
  • Train LLMs from scratch on a large GPU cluster.
  • Collect and process pre-training and fine-tuning datasets.
  • Support and improve existing subsystems.

Requirements

  • Experience in design, deployment, and support of production ML systems.
  • A strong theoretical background in NLP and transformer-based approaches.
  • Proficiency with modern deep learning frameworks such as PyTorch and common libraries for NLP.
  • Experience in distributed training of multi-billion parameter models.
  • Attention to detail in everything you do and great communication skills.

Skills

  • PyTorch
  • NLP
  • Transformer-based approaches
  • LLM inference frameworks
  • vLLM
  • DeepSpeed
  • TensorRT
  • LLM alignment techniques
  • RLHF/RLAIF
  • MLOps tools and practices
  • CI/CD for ML
  • K8s
  • Kubeflow
  • Python
  • HuggingFace
  • Weights & Biases
  • TeamCity

Location

  • Remote

Work Type

  • Full-time

Experience Level

  • Mid-level
  • Senior

Education Level

  • Scientific publications in the NLP field

About the Company

  • At JetBrains, code is our passion. We strive to make the world’s most robust and effective developer tools by automating routine checks and corrections, speeding up production and freeing developers to grow, discover, and create.
  • We are working on an ambitious new platform that provides AI capabilities to all JetBrains products, based on in-house models and integrations with strategic partners.

Equal Opportunity

  • We are an equal opportunity employer.
  • We know great ideas can come from anyone, anywhere. That’s why we do our best to create an open and inclusive workplace – one that welcomes everyone regardless of their background, identity, religion, age, accessibility needs, or orientation.
  • We process the data provided in your job application in accordance with the Recruitment Privacy Policy.