an explanation of the source coding theorem, arithmetic coding, and asymmetric numeral systems
this was my entry into #SoMEpi. this video can get pretty confusing, so don't worry if it takes some rewatches to understand. if i had more time i would've made it better....but anyway i hadn't seen many videos on this so i hope it is a helpful introduction
Reducible's huffman codes video:
https://www.youtube.com/watch?v=B3y0RsVCyrw
arithmetic coding implementation: https://marknelson.us/posts/2014/10/19/data-compression-with-arithmetic-coding.html
tabled asymmetric numeral system implementation: https://github.com/JentGent/tANS/blob/main/ans.ipynb
00:00 intro
01:07 what's wrong with huffman
02:46 prove the source coding theorem
05:35 entropy and information theory
06:59 everything is a number
07:50 arithmetic coding
11:38 asymmetric numeral systems
the music is debussy, satie, and schumann