Introduction to NLP Deep Learning Theories

Deep learning models rely on numerical vectors to'understand' the input words. We can think of the numerical vectors as high dimensional features representing the input words. In this high dimensional space, words are located close together or far away from each other. Word representation is built by finding the proper numerical vector representations for all the words in a given corpus. The quality of word representation relies on the corpus. This can be easily understood in the way that two human beings can have a different understanding of the same word, depending on whether he likes to spend time reading the modern newspaper or Shakespeare's literature. Besides, the quality of word representation heavily relies on the methods to find numerical vector representations for all the words. There are several methods to generate word representation by learning from the words' context.