About the Role
The AI Infrastructure team builds and operates production systems that power intelligent agents at scale, ensuring reliable, observable, and performant model inference, orchestration, and execution layers. This role involves designing and building the infrastructure layer for AI agent systems, developing high-performance Rust services, and architecting scalable systems.
Responsibilities
- Design and build the infrastructure layer powering AI agent systems in production
- Develop high-performance Rust services that handle model inference, orchestration, and execution
- Architect scalable systems capable of supporting millions of users and high request throughput
- Build reliable ML infrastructure and MLOps patterns for model deployment, evaluation, and monitoring
- Define guardrails, observability, and failure handling for agent-driven workflows
- Optimize latency, throughput, and cost across inference and orchestration layers
- Partner closely with the Agent Systems team to translate experimental prototypes into hardened production systems
- Contribute to foundational infrastructure decisions in a high-scale, high-impact environment
Requirements
- 5+ years of experience building and operating high-scale production systems
- Strong proficiency in Rust and systems-level programming
- Deep understanding of distributed systems, reliability engineering, and performance optimization
- Experience operating services serving millions of users or high-throughput workloads
- Familiarity with ML infrastructure, model serving, or MLOps in production environments
- Experience designing observability, monitoring, and failure recovery systems
- Strong collaboration skills working across infrastructure and applied engineering teams
- High ownership mindset in high-stakes production environment
- Experience building infrastructure for agent-based or LLM-powered systems (Nice to have)
- Background in high-performance networking, async systems, or low-latency architectures (Nice to have)
- Experience with container orchestration and cloud-native infrastructure (Nice to have)
- Familiarity with evaluation frameworks and model performance monitoring at scale (Nice to have)
- Experience working in fast-moving 0→1 or platform-building teams (Nice to have)
Skills
- Rust
- Systems-level programming
- Distributed systems
- Reliability engineering
- Performance optimization
- ML infrastructure
- Model serving
- MLOps
- Observability
- Monitoring
- Failure recovery systems
- Collaboration
- Ownership mindset
- Agent-based systems infrastructure
- LLM-powered systems infrastructure
- High-performance networking
- Async systems
- Low-latency architectures
- Container orchestration
- Cloud-native infrastructure
- Evaluation frameworks
- Model performance monitoring
Location
- Remote (70+ countries)
Work Type
- Fully remote
- Full-time
Experience Level
- 5+ years of experience
About the Company
- Kraken is a mission-focused company rooted in crypto values, aiming to accelerate the global adoption of crypto for financial freedom and inclusion.
- Krakenites are industry pioneers who develop premium crypto products for experienced traders, institutions, and newcomers.
- The company focuses on industry-leading security, crypto education, and world-class client support through products like Kraken Pro, Desktop, Wallet, and Kraken Futures.
Equal Opportunity
- Kraken hires strictly based on merit, seeking candidates with the right abilities, knowledge, and skills.
- Encourages applications from candidates who may not fully meet all listed requirements but are passionate or knowledgeable about crypto.
- May ask candidates to complete job-related skills or work-style assessments.
- Considers qualified applicants with criminal histories in accordance with the San Francisco Fair Chance Ordinance.
- Celebrates diverse talents, backgrounds, contributions, and unique perspectives.
- As an equal opportunity employer, Kraken does not tolerate discrimination or harassment based on race, ethnicity, age, gender identity, citizenship, religion, sexual orientation, disability, pregnancy, veteran status, or any other protected characteristic.
