Impress employers and recruiters.
Choose from hundreds of resume examples.
Impress employers and recruiters.
Choose from hundreds of resume examples.
Tailor your resume to this Senior Software Engineer — Infra Agent Systems role.
Rezi rewrites your resume against Together AI's job description. Free.
Tailor your resume to this Senior Software Engineer — Infra Agent Systems role.
Rezi rewrites your resume against Together AI's job description. Free.
Don't guess if your resume is good enough.
See how it scores against the Senior Software Engineer — Infra Agent Systems posting at Together AI — free, in seconds.
Don't guess if your resume is good enough.
See how it scores against the Senior Software Engineer — Infra Agent Systems posting at Together AI — free, in seconds.
About the Role
Together AI runs one of the largest GPU fleets globally, and the Infra Agent Systems team develops the software that powers and automates this infrastructure. We build production AI agents for diagnosing hardware failures, investigating incidents, correlating signals, and automating operational workflows, alongside the platform they run on, including knowledge graphs, retrieval systems, orchestration frameworks, and developer tooling. This role offers the chance to work at the intersection of AI agents, distributed systems, infrastructure, and automation, solving complex engineering problems with significant production impact and shaping the future of autonomous infrastructure.
Responsibilities
- Design and build production AI agent systems for diagnosing, investigating, and remediating infrastructure issues across a large GPU fleet.
- Build distributed services, orchestration frameworks, knowledge graphs, and retrieval systems to power infrastructure agents.
- Develop fleet intelligence systems that integrate telemetry, infrastructure state, operational knowledge, and historical incidents to enhance agent decision-making.
- Integrate with observability, incident management, ticketing, fleet inventory, source control, chat, and internal infrastructure systems via APIs.
- Own services end-to-end, including architecture, implementation, testing, deployment, observability, and production operations.
- Improve agent performance through evaluations, retrieval enhancements, better tools, and production feedback loops.
- Translate learnings from agents in production into reliable, reviewed software and automation.
Requirements
- 5+ years of experience building production backend systems, distributed systems, or infrastructure platforms.
- Strong systems design skills and experience owning significant systems from design through production.
- Depth in AI agent systems, orchestration, tool use, evaluation, or grounding.
- Depth in knowledge graphs or graph data modeling.
- Depth in search, retrieval, ranking, RAG, or semantic search systems.
- Strong backend engineering experience, including API design, service boundaries, data modeling, and integrations across complex systems.
- Experience with Kubernetes, GitOps such as ArgoCD, infrastructure-as-code, and cloud platforms.
- Comfortable working across languages such as Go, TypeScript, Python, or Rust.
Skills
- AI agent systems
- Orchestration
- Tool use
- Evaluation
- Grounding
- Knowledge graphs
- Graph data modeling
- Search
- Retrieval
- Ranking
- RAG
- Semantic search
- API design
- Service boundaries
- Data modeling
- Kubernetes
- GitOps
- ArgoCD
- Infrastructure-as-code
- Cloud platforms
- Go
- TypeScript
- Python
- Rust
- GPU infrastructure
- Datacenters
- Bare-metal systems
- Hardware failure modes
- BMC/IPMI
- Cluster schedulers
- Graph databases
- Event-driven systems
- Messaging platforms
- NATS
- Kafka
- Observability platforms
- Prometheus
- Grafana
- Evaluation frameworks
- LLM-powered systems
Location
- Remote
Work Type
- Full-time
- Remote
Experience Level
- 5+ years of experience
Salary/Compensations
- $250,000 - $300,000
Benefits
- Competitive compensation
- Startup equity
- Health insurance
- Other benefits
- Flexibility in terms of remote work
About the Company
- Together AI, the AI Native Cloud, is purpose-built for AI engineers, offering high-performance inference, scaling, fine-tuning, reinforcement learning, and pre-training.
- AI application developers can access a marketplace of leading open models to run, adapt, and own.
- Trusted by Cursor, Decagon, ElevenLabs, Salesforce, and Zoom, Together processes over 400+ trillion tokens monthly.
Equal Opportunity
- Together AI is an Equal Opportunity Employer and offers equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.
- Privacy policy available at https://www.together.ai/privacy.