Introduction to GloVe Embeddings

In the previous articles, we have discussed what word embeddings are and how to train them from scratch or using word2vec models. This article is an intuitive guide to understanding Glove Embeddings which is a powerful word vector learning technique. We focus on why GloVe is better than word2vec in some ways and arrive at the cost function of GloVe used for training word vectors. To recap, word embeddings transform words into a vector space where similar words are placed together and different words wide off. Word2Vec models only consider the local (context, target) words for training word vectors, unlike GloVe which does not rely on local statistics or local context of words but includes global statistics to train word vectors.