Word Embedding and Word2Vec, Clearly Explained!!!

Word Embedding and Word2Vec, Clearly Explained!!!

444.734 Lượt nghe
Word Embedding and Word2Vec, Clearly Explained!!!
Words are great, but if we want to use them as input to a neural network, we have to convert them to numbers. One of the most popular methods for assigning numbers to words is to use a Neural Network to create Word Embeddings. In this StatQuest, we go through the steps required to create Word Embeddings, and show how we can visualize and validate them. We then talk about one of the most popular Word Embedding tools, word2vec. BAM!!! Note, this StatQuest assumes that you are already familiar with... The Basics of how Neural Networks Work: https://youtu.be/CqOfi41LfDw The Basics of how Backpropagation Works: https://youtu.be/IN2XmBhILt4 How the Softmax function works: https://youtu.be/KpKog-L9veg How Cross Entropy works: https://youtu.be/6ArSys5qHAU For a complete index of all the StatQuest videos, check out: https://statquest.org/video-index/ If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying one of my books, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! https://www.paypal.me/statquest Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 4:25 Building a Neural Network to do Word Embedding 8:18 Visualizing and Validating the Word Embedding 10:42 Summary of Main Ideas 11:44 word2vec 13:36 Speeding up training with Negative Sampling #StatQuest #word2vec