In this video, we are going to cover how decision tree pruning works. Hereby, we are first going to answer the question why we even need to prune trees. Then, we will go over two pre-pruning techniques. And finally, we will see how post-pruning works.
Links:
- Corresponding blog post: https://www.sebastian-mantey.com/theory-blog/decision-tree-algorithm-explained-p4-decision-tree-pruning
- Post-Pruning from Scratch:
https://youtu.be/a1jVzX8J-YA
- Decision Tree Algorithm explained: Intuition
https://youtu.be/WlGuizdVaiY
- Decision Tree Algorithm explained: Entropy
https://youtu.be/ObLQcpuLAlI
- Decision Tree Algorithm explained: Regression
https://youtu.be/hTlpia36Znc
Timestamps:
00:00 - Why do we need to prune trees?
01:57 - Overfitting example
04:44 - Pre-Pruning: Min-Samples approach
07:08 - Pre-Pruning: Max-Depth approach
10:18 - Post-Pruning