Research Intern, Frontier Speculative Decoding (Winter 2027) at Together AI | CA, US | Rezi

Research Intern, Frontier Speculative Decoding (Winter 2027) at Together AI

Research Intern, Frontier Speculative Decoding (Winter 2027)

Together AI · CA, US

3 weeks ago

Research Intern, Frontier Speculative Decoding (Winter 2027)

Together AI · CA, US

22 days ago
Resume preview

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now
Resume preview

Tailor your resume to this Research Intern, Frontier Speculative Decoding (Winter 2027) role.

Rezi rewrites your resume against Together AI's job description. Free.

Resume score gauge reading 58 out of 100

Don't guess if your resume is good enough.

See how it scores against the Research Intern, Frontier Speculative Decoding (Winter 2027) posting at Together AI — free, in seconds.

About the Role

Together AI is building the Inference Platform for advanced generative AI models, focusing on the transition from research to production. This role involves fine-tuning models using internal and customer-specific data to create specialized, high-performance tools for business problems, utilizing dedicated GPU clusters.

Responsibilities

  • Research and prototype new speculator algorithms, experimenting with architectural ideas and data curation to improve accuracy–efficiency tradeoffs in speculative decoding.
  • Own a well-scoped project end to end, from data preparation through training and evaluation, with a real path to production.
  • Learn how frontier inference systems work in practice, in a fast-paced environment at the cutting edge of generative AI.
  • Collaborate directly with customers to understand their needs, and work closely with core inference and Applied ML research teams to integrate work into the production platform.
  • Present results to the broader team at the end of the internship, with the chance to influence the direction of speculator work.
  • Take on and solve challenging problems with deep technical ownership.

Requirements

  • Currently pursuing a degree in Computer Science, Electrical Engineering, Information Science, or a related field.
  • Genuine love for data curation and processing, with meticulous attention to detail.
  • Demonstrated ability to perform effective hyperparameter searches and understand tuning trade-offs.
  • Strong attention-to-detail in evaluating model checkpoints for quality, performance, and reliability.
  • Experience with Python and PyTorch.
  • Familiarity with SLURM and/or Kubernetes clusters and experience submitting and managing jobs in a high-performance computing environment.
  • Familiarity with modern LLMs and generative models.
  • Basic understanding of distributed training frameworks (e.g., FSDP, DeepSpeed).
  • Publications at leading research conferences or journals (such as NeurIPS, ICML, ICLR, *ACL, EMNLP, Interspeech).

Skills

  • Python
  • PyTorch
  • SLURM
  • Kubernetes
  • LLMs
  • Generative Models
  • FSDP
  • DeepSpeed

Work Type

  • Internship

Experience Level

  • Intern

Education Level

  • Pursuing a degree in Computer Science, Electrical Engineering, Information Science, or a related field

Salary/Compensations

  • $58 - $70 per hour

Benefits

  • Housing stipends
  • Competitive benefits

About the Company

  • Together AI, the AI Native Cloud, is purpose-built for AI engineers, offering high-performance inference, fine-tuning, reinforcement learning, and pre-training.
  • Features a marketplace of leading open models.
  • Trusted by Cursor, Decagon, ElevenLabs, Salesforce, and Zoom.
  • Serves over 400+ trillion tokens per month.

Equal Opportunity

  • Together AI is an Equal Opportunity Employer and offers equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.