Billion-Scale Vector Search on Object Storage
[2025 - Day 1 - Data Eng & Infra] Simon Hørup Eskildsen and Mickey Liu share insights from powering one of the world's largest vector search use cases, exploring the database and pipeline engineering behind Notion's semantic search across billions of vectors. This collaboration between turbopuffer and Notion offers valuable guidance on managing massive vector workloads and object-storage native indexing, essential for teams connecting LLMs to data or building RAG systems at scale.
ABOUT THE SPEAKERS:
Simon Hørup Eskildsen, Co-Founder, turbopuffer
Mickey Liu, Software Engineer, Notion
👉 Sign up for our "No BS" Newsletter to get the latest technical data & AI content: https://datacouncil.ai/newsletter
ABOUT DATA COUNCIL:
Data Council brings together the brightest minds in data to share industry knowledge, technical architectures and best practices in building cutting edge data & AI systems and tools.
FIND US:
Twitter: https://twitter.com/datacouncilai
LinkedIn: https://www.linkedin.com/company/datacouncil-ai/
Website: https://www.datacouncil.ai/