About the Role
Unity Vector builds an offline ML platform that powers insight, experimentation, attribution, and AI-driven decision-making. This role focuses on building reliable infrastructure for generating training datasets, orchestrating ML workflows, and enabling efficient, distributed model training at scale. You will play a key role in shaping how model datasets are prepared, trained, validated, and delivered to distributed training systems.
Responsibilities
- Design and operate large-scale data pipelines that generate training datasets used for machine learning training and experimentation.
- Develop infrastructure that supports distributed training workflows using technologies such as Pytorch, Ray Data, and Ray Train.
- Integrate ML pipelines with workflow orchestration systems (e.g., Flyte, Airflow, or similar) to enable reliable multi-stage training workflows.
- Improve reproducibility and observability of ML pipelines through dataset validation, monitoring, and automated testing.
- Optimize performance and resource utilization across distributed compute systems used for data processing and model training.
- Partner closely with ML engineers to enable efficient large-scale experimentation and model iteration.
- Lead architectural improvements to ensure our offline ML pipelines remain scalable, reliable, and cost-efficient.
Requirements
- Strong experience building large-scale ML pipelines.
- Experience working with distributed computing frameworks such as Ray, Spark, Flink and familiarity in the Ray ecosystem (Ray Data, Ray Train) for distributed data processing and model training.
- Experience building infrastructure for training data generation, dataset preparation, or ML feature pipelines.
- Deep experience designing and operating production-grade data pipelines.
- Strong programming skills in Python and experience working with large-scale distributed workloads.
- Experience with modern data infrastructure (data lakes, warehouses, orchestration systems, streaming platforms).
- Strong systems thinking, with the ability to reason about performance, scalability, reliability, and cost tradeoffs in distributed systems.
- Proven ability to lead technical direction and influence architectural decisions across teams without formal authority.
- Sufficient knowledge of English for professional verbal and written exchanges.
Skills
- Pytorch
- Ray Data
- Ray Train
- Flyte
- Airflow
- Python
Experience Level
- Staff
Salary/Compensations
- $244,500.00 - $366,700.00
Benefits
- Comprehensive health, life, and disability insurance
- Commute subsidy
- Employee stock ownership
- Competitive retirement/pension plans
- Generous vacation and personal days
- Support for new parents through leave and family-care programs
- Office food snacks
- Mental Health and Wellbeing programs and support
- Employee Resource Groups
- Global Employee Assistance Program
- Training and development programs
- Volunteering and donation matching program
About the Company
- Unity [NYSE: U] is the world’s leading game engine, powering play for more than 3 billion consumers each month. The top mobile games in the world, the most played PC indie titles, the most innovative console games, and virtually all of the top XR and Web Games are developed, deployed, and grown in Unity. Unity also enables teams across industries like automotive, manufacturing, and healthcare to design, simulate, and collaborate in 3D — closing the gap between ideas and reality.
- At Unity, we're committed to creating a workplace that fosters collaboration and teamwork that allows you to harness your unique skills. Join us in creating industry tools to help creators of all levels bring their projects to reality.
Equal Opportunity
- Unity is a proud equal opportunity employer. We are committed to fostering an inclusive, innovative environment and celebrate our employees across age, race, color, ancestry, national origin, religion, disability, sex, gender identity or expression, sexual orientation, or any other protected status in accordance with applicable law. Our differences are strengths that enable us to support the growing and evolving needs of our customers, partners, and collaborators.
- If you have a disability that means there are preparations or accommodations we can make to help ensure you have a comfortable and positive interview experience, please fill out this form to let us know.
- Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
