In this video I go over Vector Quantised Variational Auto Encoder(VQVAE).
Specifically I talk over how its different from VAE, its theory and implementation.
I also train a VQVAE model and show how the generation process looks like after we have trained a VQVAE model.
Timestamps
--------------------
00:00 Intro
00:27 Need and difference from VAE
02:43 VQVAE Components
04:31 Argmin and Straight Through Gradient Estimation
07:11 Codebook and Commitment Loss
08:45 KL Divergence Loss
09:30 Implementation
12:35 Visualization
14:29 Generating Images
16:37 Outro
*Paper Link* - https://tinyurl.com/exai-vqvae-paper
*Subscribe* - https://tinyurl.com/exai-channel-link
Inspiration of visualization of embedding taken from -
https://www.youtube.com/watch?v=GgX_6Ce41-c&pp=ygUFdnF2YWU%3D
Github Repo Link - https://tinyurl.com/exai-vqvae-repo (Will be updated soon)
Background Track Fruits of Life by Jimena Contreras
Email -
[email protected]