Impress employers and recruiters.
Choose from hundreds of resume examples.
Impress employers and recruiters.
Choose from hundreds of resume examples.
Target Resume Now
Tailor your resume to this AI Architect role.
Rezi rewrites your resume against The Information's job description. Free.
Tailor your resume to this AI Architect role.
Rezi rewrites your resume against The Information's job description. Free.
Don't guess if your resume is good enough.
See how it scores against the AI Architect posting at The Information — free, in seconds.
Don't guess if your resume is good enough.
See how it scores against the AI Architect posting at The Information — free, in seconds.
About the Role
Lead the design, evolution, and scaling of our AI pipeline infrastructure. Take ownership of a backend platform built to orchestrate AI workflows at scale and extend it to support a growing set of high-fan-out AI features central to our product strategy.
Responsibilities
- Maintain and operate all existing AI pipelines running on the platform.
- Complete the migration of remaining workflows from the legacy orchestration framework to the primary platform.
- Own on-call response for AI pipeline failures, including failed-job triage and retries.
- Manage LLM provider relationships, API key rotation, cost tracking, and model upgrades.
- Design and implement new high-fan-out AI pipelines on the existing platform.
- Establish patterns and conventions for onboarding new pipelines.
- Drive architectural decisions around data storage strategy, queue partitioning, concurrency throttling, and cost controls.
- Evaluate and integrate new LLM providers and embedding models.
- Build observability and operational tooling.
- Partner with product, editorial/content, and growth teams to translate product requirements into pipeline designs.
- Work across the engineering organization to integrate AI pipelines with the broader technical stack.
- Mentor engineers on AI pipeline patterns, prompt engineering, and platform architecture.
- Own the technical proposal process for new pipelines and major infrastructure changes.
Requirements
- 5+ years of backend framework expertise building production applications in a modern web framework (e.g., Rails, Django, or similar).
- Strong experience in ORM usage, API-only application design, and background job processing.
- Proven experience designing idempotent, retryable, fan-out job pipelines (batching, concurrency controls, dead-letter handling, queue partitioning).
- Hands-on work with multiple LLM providers, structured output, embeddings, prompt engineering, and cost tracking.
- Experience with a vector database for similarity matching at scale (batched queries, namespace management, embedding model migration).
- Experience running internal services on a cloud PaaS or equivalent, with relational databases, caching/queueing infrastructure, and observability tooling.
- Track record of authoring technical design documents, making build-vs-buy decisions, and designing platforms meant to be extended by others.
- 5+ Years of Ruby/Ruby on Rails experience.
- Experience migrating workflows from a Python-based orchestration framework to Ruby-based framework.
- Familiarity with agent orchestration and LLM tracing/observability ecosystems.
- Experience with AI alerting or notification systems.
- Background in media/publishing AI applications.
- Experience with state machine libraries for managing job lifecycles.
- Experience building retrieval-augmented generation (RAG) pipelines.
Skills
- AI pipeline infrastructure
- Backend platform development
- AI workflow orchestration
- High-fan-out AI features
- API-only backend service
- Background job processing
- Relational database management
- Idempotent job design
- Observable job design
- Authenticated API access
- Secure credential management
- LLM integration
- Vector database management
- Similarity search
- Prompt engineering
- Cost tracking
- Model upgrades
- Observability tooling
- Technical proposal writing
- Ruby/Ruby on Rails
- Python-based orchestration framework migration
- Agent orchestration
- LLM tracing
- AI alerting
- Media/publishing AI applications
- State machine libraries
- Retrieval-augmented generation (RAG)
Location
- United States
Work Type
- Full-time
Experience Level
- 5+ years
Salary/Compensations
- $155,000 - $175,000 USD Annually + Bonus + Benefits
Benefits
- Company-paid medical, dental, and vision coverage for employees and their dependents
- Medical coverage includes fertility care and $0 copays for in-office mental health visits with in-network providers
- Paid parental leave
- Generous paid time off (PTO) that increases with tenure
- 401(k) plan with employer matching contributions
- Flexible Spending Accounts (FSAs) for healthcare and dependent care expenses
- Fitness and wellness stipend
- Monthly cell phone reimbursement
- Company-sponsored lunches in the office every Monday
- Commuter benefits
About the Company
- We offer a comprehensive and competitive benefits package designed to support the well-being of our employees and their families.
- A supportive, inclusive, and diverse work environment with a zero-tolerance policy for harassment.
- We can only accept applications from those eligible to live and work in the United States.
Equal Opportunity
- We are an equal opportunity employer.
- We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.
- We are committed to diversity and to building an inclusive environment for people of all backgrounds and ages.