Augmented Language Models (LLM Bootcamp)

New course announcement ✨ We're teaching an in-person LLM bootcamp in the SF Bay Area on November 14, 2023. Come join us if you want to see the most up-to-date materials building LLM-powered products and learn in a hands-on environment. https://www.scale.bythebay.io/llm-workshop Hope to see some of you there! --------------------------------------------------------------------------------------------- In this video, Josh walks through the patterns for augmenting language models with external context: retrieval augmentation, chaining, and tool use. Download slides from the bootcamp website here: https://fullstackdeeplearning.com/llm-bootcamp/spring-2023/augmented-language-models/ Intro and outro music made with Riffusion: https://github.com/riffusion/riffusion Watch the rest of the LLM Bootcamp videos here: https://www.youtube.com/playlist?list=PL1T8fO7ArWleyIqOy37OVXsP4hFXymdOZ 0:00:00 Why augmented LMs? 0:06:40 Why retrieval augmentation? 0:08:25 Traditional information retrieval 0:13:05 Embeddings for retrieval 0:22:15 Embedding relevance and indexes 0:28:42 Embedding databases 0:38:50 Beyond naive embeddings 0:41:10 Patterns & case studies 0:46:16 What are chains and why do we need them? 0:52:50 LangChain 0:54:55 Tool use 0:59:17 Plugins 1:02:38 Recommendations for tool use 1:04:07 Recap & conclusions