About the Role
This role on the Xet Storage team is responsible for the storage system behind Hugging Face, storing over 200PB of ML & AI assets. You will contribute to the open-source project xet-core (Rust) and the Python library hf-xet, and design, build, and operate features in the Xet Storage backend. This is a high-trust, low-process, async, and remote environment.
Responsibilities
- Contribute to xet-core, an open-source project written in Rust.
- Power hf-xet, the Python library underpinning the Hugging Face Hub client.
- Design, build, and operate features in the Xet Storage backend.
- Contribute to the broader Infrastructure organization at Hugging Face.
- Build and operate production systems software.
Requirements
- 8+ years building and scaling distributed systems, storage, or networking infrastructure.
- Proficiency in a low-level systems language, with Rust strongly preferred.
- A track record of working independently in a high-trust, low-process environment.
- Comfort operating in a fast-moving, async, and fully remote environment.
- Passion for building simple, robust, and scalable systems.
Skills
- Rust
- Python
- Typescript
- Go
- C++
- Git internals
- Cloud infrastructure (AWS, Azure, GCP, Kubernetes)
- Databases (relational and non-relational)
- Networking
- Designing efficient, high-performance, fault-tolerant data storage and retrieval systems
- Operating production systems (monitoring, alerting, distributed debugging and recovery)
Location
- Remote
Work Type
- Remote
- Full-time
Experience Level
- 8+ years
Benefits
- Reimbursement for relevant conferences, training, and education.
- Flexible working hours.
- Remote options.
- Health, dental, and vision benefits for employees and their dependents.
- Parental leave.
- Flexible paid time off.
- Company equity.
- Opportunity to visit office spaces.
About the Company
- Hugging Face is building the fastest growing platform for AI builders with over 11 million users.
- Our open-source libraries have more than 700,000 stars on Github.
- We are actively working to build a culture that values diversity, equity, and inclusivity.
- We believe great AI shouldn't require a massive cluster; we build for everyone, especially the GPU-poor.
- We value development and have a bias for impact.
- We care about employee well-being.
- We support our employees wherever they are.
- We want our teammates to be shareholders.
- We support the community and believe major scientific advancements are the result of collaboration.
Equal Opportunity
- Hugging Face is an equal opportunity employer and we do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.
