Fine tuning Whisper for Speech Transcription

➡️ Get access to the ADVANCED Transcription Repo: https://trelis.com/advanced-transcription/ KEY TRELIS LINKS: 🛠 Tools (Fine-tuning, Vision, Audio, Inference): https://Trelis.com 💡 Consulting (Technical Assistance OR Market Insights): https://forms.gle/2VXzrBzpvm1BmG6e7 🤝 Work for Trelis: https://trelis.com/jobs/ 💸 Grants Program: https://trelis.com/trelis-ai-grants/ 📧 Newsletter: https://trelis.substack.com Video Resources: - Dataset: https://huggingface.co/datasets/Trelis/llm-lingo - Slides: https://docs.google.com/presentation/d/1_vxojbAwSzjB4L4NlNfQq0tudpyQ4ptSQtQSXE8GstM/edit?usp=sharing - Simple Whisper Transcription Notebook: https://colab.research.google.com/drive/1tM1U2fAH30niw23l5Qz0gjWZs1AuDXlt?usp=sharing - Basic fine-tuning notebook: https://colab.research.google.com/github/sanchit-gandhi/notebooks/blob/main/fine_tune_whisper.ipynb#scrollTo=BRdrdFIeU78w - PEFT Example: https://colab.research.google.com/drive/1DOkD_5OUjFa0r5Ik3SgywJLJtEo2qLxO?usp=sharing#scrollTo=8d230e6d-624c-400a-bbf5-fa660881df25 Chapters 0:00 Fine-tuning speech-to-text models 0:17 Video Overview 1:39 How to transcribe YouTube videos with Whisper 7:39 How do transcription models work? 20:08 Fine-tuning Whisper with LoRA 43:32 Performance evaluation of fine-tuned Whisper 48:32 Final Tips