Deep Learning Research Review Week 3: Natural Language Processing

This is the 3rd installment of a new series called Deep Learning Research Review. Every couple weeks or so, I'll be summarizing and explaining research papers in specific subfields of deep learning. This week focuses on applying deep learning to Natural Language Processing. Natural language processing (NLP) is all about creating systems that process or "understand" language in order to perform certain tasks. The traditional approach to NLP involved a lot of domain knowledge of linguistics itself. Understanding terms such as phonemes and morphemes were pretty standard as there are whole linguistic classes dedicated to their study. Let's look at how traditional NLP would try to understand the following word. Let's say our goal is to gather some information about this word (characterize its sentiment, find its definition, etc).