In this video, I walk through a collab notebook in order to fine tune an open source LLM locally using QLoRA.
Here is my Twitter: https://twitter.com/lukemoningtonAI
Here is the Hugging Face collab notebook for QLoRA: https://colab.research.google.com/drive/1VoYNfYDKcKRQRor98Zbf2-9VQTtGJ24k?usp=sharing
Feel free to post questions in the comments section!
0:00 Introduction
0:24 Explanation of Python Libraries
2:46 Loading the Model
5:18 Preparing the Model for Training
6:51 Preparing the Lora Configuration
8:45 Preparing the Dataset
9:24 Fine-Tuning the LLM
11:42 Saving the Model and Inferencing