About the Role
We are seeking a Software Engineer to optimize data transfer from AI models to actuators. This role involves working closely with hardware, kernel, firmware, controls, and perception layers to develop real-time pipelines with low latency. The objective is to enhance the visibility and determinism of the end-to-end inference pipeline, ensuring the ML model is the primary source of stochasticity. The fast-paced iteration cycle means code shipped will be deployed on physical systems rapidly.
Responsibilities
- Ship performance-critical code to real robots daily.
- Understand the complete data flow from input (camera frames) to output (control commands and actuator feedback), including the systems involved.
- Contribute to the real-time control loop, ensuring deterministic operation alongside vision inference.
- Develop components of the perception data path to minimize latency and data loss for high-bandwidth camera streams.
- Reduce latency and optimize the system stack for improved speed, determinism, and reliability.
- Create tooling and instrumentation for observing and debugging real-time behavior across controls and vision.
Requirements
- 1+ years of software engineering experience in systems development close to hardware (exceptional new graduates with relevant project or internship experience will be considered).
- Proficiency in Rust, C++, or Python, with a strong understanding of operating systems and multithreading.
- Demonstrated experience in building systems such as production systems, internal tools, or personal projects.
- Experience debugging timing, concurrency, or hardware-related issues.
- Comfort with ambiguity and a proactive, hands-on learning approach.
- Ability to work on-site in San Francisco 5 days a week, with potential for 6 days during peak periods.
Skills
- Rust
- C++
- Python
- Operating Systems
- Multithreading
- Linux kernel
- Embedded systems
- Bazel
- Nix
- HIL testing
- CI/CD
- Real-time control systems
- Motor control
- High-rate control loops
- Robot controllers
- Computer vision pipelines
- Camera drivers
- Image transport
- GPU inference
- Sensor synchronization
- ftrace
- flamegraphs
- eBPF
- AI tools
Location
- San Francisco
Work Type
- On-site
Experience Level
- 1+ years
- New Grads considered
