Software Engineer, ML Infrastructure at Ideogram | CAN | Rezi

Software Engineer, ML Infrastructure at Ideogram

Software Engineer, ML Infrastructure

Ideogram · CAN

3 weeks ago

Software Engineer, ML Infrastructure

Ideogram · CAN

a month ago
Resume preview

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now

About the Role

As a Software Engineer, ML Infrastructure at Ideogram, you'll build the systems that power training and serving for our generative AI models at scale. You'll work across the stack, from designing distributed training infrastructure to optimizing inference pipelines that serve millions of users, with a relentless focus on reliability, speed, and efficiency. We're looking for someone who combines deep systems expertise with a builder's mindset, strong technical ownership, and the ability to move fast in an evolving AI landscape.

Responsibilities

  • Build systems that power training and serving for generative AI models at scale.
  • Design distributed training infrastructure.
  • Optimize inference pipelines that serve millions of users.
  • Focus on reliability, speed, and efficiency.
  • Combine deep systems expertise with a builder's mindset.
  • Demonstrate strong technical ownership.
  • Move fast in an evolving AI landscape.

Requirements

  • 1-4 years developing and shipping large-scale production infrastructure.
  • Experience designing large, highly available distributed systems with Kubernetes/GCP.
  • Experience with GPU/TPU workloads on Kubernetes/GCP clusters.
  • Experience in deploying, supporting, and troubleshooting in complex Linux-based computing environments.
  • Experience in worker scaling for training or inference workloads.
  • Fundamental knowledge in ML models and how they run on GPUs.
  • Deep sense of ownership - proactively identifies opportunities, suggests improvements, and acts on them.
  • Grit and adaptability to solve complex technical challenges that evolve day to day.
  • Ability to explain technical concepts to both engineers and non-technical stakeholders.
  • Pushes for quality through constructive code review and collaboration.

Skills

  • Kubernetes
  • GCP
  • GPU
  • TPU
  • Linux
  • ML models

Location

  • Toronto
  • NYC

Work Type

  • Full-time

Experience Level

  • 1-4 years

Education Level

  • Bachelor's degree in Computer Science, Engineering, related field, or equivalent practical experience

Salary/Compensations

  • Competitive compensation and equity

Benefits

  • 4 weeks of vacation
  • Comprehensive health, vision, and dental coverage
  • RRSP/401(k) with employer match up to 4%
  • Top-of-the-line tools and tech
  • Autonomy to explore and experiment
  • Access to compute/resources
  • Culture of learning and growth
  • Mentorship

About the Company

  • Ideogram’s mission is to make world-class design accessible to everyone, multiplying human creativity.
  • We build proprietary generative media models and AI native creative workflows, tackling unsolved challenges in graphic design.
  • Our team includes builders with a track record of technology breakthroughs including early research in Diffusion Models, Google’s Imagen, and Imagen Video.
  • We care about design, taste, and craft as much as research and engineering – shipping experiences that creatives actually love.
  • We’ve raised nearly $100M, led by Andreessen Horowitz and Index Ventures.
  • Headquartered in Toronto with a growing team in NYC, we're scaling fast, aiming to triple over the next year.
  • We're a flat team with a culture of high ownership, collaboration, and mentorship.
  • We’re a team of exceptionally talented, curious builders who love solving tough problems and turning bold ideas into reality.
  • We move fast, collaborate deeply, and operate without unnecessary hierarchy, because we believe the best ideas can come from anyone.
  • Everyone at Ideogram rolls up their sleeves to make our products and our customers successful.
  • We thrive on curiosity, creativity, and shared ownership.
  • We believe that small, dedicated teams working together with trust and purpose can move faster, think bigger, and create amazing things.

Equal Opportunity

  • Ideogram is committed to welcoming everyone — regardless of gender identity, orientation, or expression.
  • Our mission is to create belonging and remove barriers so everyone can create boldly.