About the Role
Town is building the most personalized AI assistant, which requires a robust retrieval and data infrastructure. You will build the foundational search and data infrastructure, including a shared retrieval layer combining lexical and semantic search, real-time and batch pipelines, and a durable data model. This is a greenfield opportunity as the first person building this critical layer.
Responsibilities
- Build the search and retrieval layer for the AI assistant.
- Combine lexical and semantic search, managing tradeoffs between different approaches.
- Design the durable data model for context relevance, speed, and cost-effectiveness.
- Build and operate real-time/streaming and batch pipelines to maintain index freshness and accuracy.
- Establish and maintain a fast, reliable indexing and storage layer at scale.
- Develop the foundation for relating content by meaning, creating a knowledge graph.
Requirements
- Significant hands-on experience with lexical and semantic search components and approaches (BM25, embeddings, ANN/vector indexes, hybrid retrieval, ranking).
- Experience running large-scale data infrastructure, including real-time/streaming and batch pipelines, indexing, and storage.
- Ability to make retrieval fast and cost-effective at scale, with a strong understanding of latency, cost, and freshness tradeoffs.
- Systems thinking and comfort working in a greenfield environment.
- Experience taking systems from rapid prototype to production scale.
- Experience with ranking/relevance, knowledge graphs, or retrieval for LLM or agentic systems is a plus.
Skills
- Lexical search
- Semantic search
- BM25
- Embeddings
- ANN/vector indexes
- Hybrid retrieval
- Ranking
- Data infrastructure
- Real-time/streaming pipelines
- Batch pipelines
- Indexing
- Storage
- Systems thinking
- Knowledge graphs
- LLM retrieval
- Agentic systems retrieval
Location
- San Francisco, CA
Work Type
- Onsite
Experience Level
- Senior
About the Company
- Town is building an AI that starts from who you are, creating a persistent model of identity, voice, judgment, relationships, and priorities to perform work across various tools.
- The company was founded by Jean-Denis Greze (CEO), former CTO of Plaid, and Tony Vincent (CPO), former Director of Applied AI Product at Google.
- Town is a small, talent-dense team backed by prominent investors including Andreessen Horowitz, Forerunner Ventures, First Round Capital, and Conviction, having raised over $73M.
