About the Role
NVIDIA is seeking an experienced Software Engineer to develop core libraries for Agentic Applications. This role involves building foundational technology to power the next generation of agents and elevating engineering practices for safe, scalable deployment of autonomous systems. As a leader in AI and deep learning, NVIDIA is redefining industries, and this position is crucial for building scalable agentic capabilities, reusable building blocks, and high-quality libraries. The goal is to accelerate developer productivity, ensure agent quality, and provide critical acceleration and optimization for highly performant and efficient agents, collaborating with creative engineers to push the boundaries of autonomous agents.
Responsibilities
- Track evolving agent development patterns across NVIDIA and the broader ecosystem, staying current with research and commercial products.
- Develop open-source libraries and tools to accelerate and optimize agent harnesses and frameworks, ensuring top-tier performance, accuracy, quality, and stability.
- Benchmark agents to identify bottlenecks and create solutions to increase performance, reduce cost, and improve latency.
- Collaborate with teams building high-performance data pipelines, RAG systems, vector databases, and GPU-optimized training and inference workflows to deliver best-in-class agentic applications.
- Identify architectural gaps and friction in agents, translating insights into tools that boost developer velocity and agent quality, supported by evaluations, benchmarking, and feedback loops.
Requirements
- Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Applied Math, or a related field, or equivalent experience.
- 8+ years experience in at least one of Rust, Python, Go, or Node.js, with working familiarity in at least one more.
- Solid understanding of asynchronous programming, callbacks, request lifecycles, and event-driven systems.
- Hands-on experience with evolving agent architectures, multiple agent frameworks, and agent harnesses.
- Proficiency in LLM applications, agent workflows, tool calls, and model-provider APIs.
- Ability to design or extend cross-language APIs, focusing on consistency, usability, stability, and backwards compatibility.
- Systems-level debugging and performance intuition to trace execution from high-level API calls through runtime internals, language bindings, callbacks, serialization, and event emission to understand overhead and optimize hot paths.
- Strong interpersonal skills for effective collaboration with the open-source community.
Skills
- Rust
- Python
- Go
- Node.js
- Asynchronous programming
- Callbacks
- Request lifecycles
- Event-driven systems
- Agent architectures
- Agent frameworks
- Agent harnesses
- LLM applications
- Agent workflows
- Tool calls
- Model-provider APIs
- Cross-language API design
- Systems-level debugging
- Performance intuition
- Experience building evaluation/benchmarking systems for agent workflows (metrics, regression, feedback loops)
- Rust systems work (async Rust, Tokio, serde, API design, runtime state management)
- Python native extension experience (PyO3, maturin, Python/Rust bindings)
- Instrumenting third-party frameworks without changing user-visible behavior
- Knowledge of OpenTelemetry, tracing, structured events, exporters, or observability pipelines
- Middleware, plugin systems, guardrails, policy engines, or request/response interception
- Maintaining open-source libraries, SDKs, or internal developer platforms
- Profiling or optimizing runtime/library overhead across language boundaries, async execution, native bindings, serialization, tracing, or middleware pipelines
Experience Level
- 8+ years experience
- Level 4
- Level 5
Education Level
- Bachelor’s degree in Computer Science, Artificial Intelligence, Applied Math, or a related field
- Master’s degree in Computer Science, Artificial Intelligence, Applied Math, or a related field
- Equivalent experience
Salary/Compensations
- 184,000 USD - 287,500 USD for Level 4
- 224,000 USD - 356,500 USD for Level 5
- Eligible for equity
Benefits
- Equity
- Benefits
About the Company
- NVIDIA has transformed computer graphics, PC gaming, and accelerated computing for over 25 years.
- The company leverages AI to define the next era of computing, with GPUs acting as the brains for computers, robots, and self-driving cars.
- NVIDIA fosters a diverse, supportive environment where employees are inspired to do their best work.
- NVIDIA pioneered accelerated computing and its AI infrastructure powers global intelligence, transforming every industry.
Equal Opportunity
- NVIDIA is committed to fostering an inclusive work environment and is an equal opportunity employer.
- The company values diversity and does not discriminate in hiring or promotion practices based on race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law.
