Distinguished Architect, AI at Datadog | California, United States | Rezi

Distinguished Architect, AI at Datadog

Distinguished Architect, AI

Datadog · California, United States

2 months ago

Distinguished Architect, AI

Datadog · California, United States

2 months ago
Resume preview

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now

About the Role

Datadog is expanding the Technical Solutions (TS) organization by seeking a customer-focused, deeply technical Distinguished Architect to join our Product Solutions Architecture (PSA) team. In this role, you will act as a technical multiplier for the world's leading AI labs and AI-native companies. You will bridge the gap between their bleeding-edge infrastructure aspirations and Datadog’s technology roadmap, ensuring our platform natively solves the unique observability challenges of training and deploying foundational models at scale. At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them.

Responsibilities

  • Demonstrate thought leadership in the AI/LLM space, influencing decision-makers by linking technical capabilities to business impact.
  • Strategically partner with technical leaders, guiding them on AI/LLM best practices and emerging trends.
  • Lead high-level technical and architectural conversations on AI adoption.
  • Lead deep-dive architecture reviews and design engagements with customer teams.
  • Share industry trends, best practices, and demonstrate Datadog's support for high-throughput AI workloads.
  • Identify emerging AI-native technology shifts and provide feedback to Product Management.
  • Co-create custom observability integrations and solutions with Product SAs.
  • Collaborate with PSA, Sales, Sales Engineering, and Marketing to provide high-quality technical resources.
  • Assist leadership in recruiting and hiring top talent for PSA and Field CTO teams.

Requirements

  • 10+ years of experience with at-scale distributed systems architecture, high-performance computing, or large-scale infrastructure.
  • Deep familiarity with the AI/LLM ecosystem, accelerator hardware (GPUs/TPUs), and modern orchestration frameworks.
  • Ability to think long-term and creatively about technical and business challenges.
  • Proven experience interacting with and influencing elite individual contributors, research scientists, and technical founders.
  • Deep hands-on credibility and ability to whiteboard architectural solutions with senior engineers.
  • Strong understanding of best practices and real-world challenges in AI/LLM Ops and LLM Observability (LLMO).
  • Excellent customer-facing presentation skills for large audiences.
  • Comfortable discussing complex technical details and briefing executives or non-technical personas.
  • Excellent verbal and written communication skills.
  • Ability to link product functionality to business objectives, value realization, and ROI.
  • Ability to travel up to 50%.

Skills

  • Thought leadership in AI/LLM
  • Strategic thinking
  • Stakeholder management
  • Technical credibility
  • Architectural solution design
  • AI/LLM Ops
  • LLM Observability (LLMO)
  • Customer-facing presentation
  • Verbal communication
  • Written communication

Location

  • Hybrid

Work Type

  • Hybrid

Experience Level

  • 10+ years of experience

Education Level

  • Bachelor’s degree in engineering or related field
  • Master’s degree preferred

Salary/Compensations

  • $300,000 - $484,000 USD

Benefits

  • Best-in-breed onboarding
  • Generous global benefits
  • Intra-departmental mentor and buddy program
  • New hire stock equity (RSUs)
  • Employee stock purchase plan (ESPP)
  • Continuous professional development
  • Product training
  • Career pathing
  • Inclusive company culture
  • Community Guilds
  • Inclusion Talks
  • Healthcare benefits
  • Dental benefits
  • Parental planning benefits
  • Mental health benefits
  • 401(k) plan and match
  • Paid time off
  • Fitness reimbursements

About the Company

  • Datadog is the leading observability and security platform for the AI era, providing businesses with unified visibility across the technology stack to manage complexity at scale.
  • It brings applications, infrastructure, data, models, and security into one place, using AI to detect and resolve issues before they impact customers.
  • Trusted globally by Fortune 500 companies and high-growth AI leaders, Datadog enables businesses to move faster with clarity and confidence.

Equal Opportunity

  • Datadog offers equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and other characteristics protected by law.
  • Qualified applicants are considered regardless of criminal histories, consistent with legal requirements.
  • Datadog endeavors to make its Careers Page accessible to all users and provides a form for accommodation requests.