Why neural networks aren't fit for natural language understanding

Welcome to AI book reviews, a series of posts that explore the latest literature on artificial intelligence. One of the dominant trends of artificial intelligence in the past decade has been to solve problems by creating ever-larger deep learning models. And nowhere is this trend more evident than in natural language processing, one of the most challenging areas of AI. In recent years, researchers have shown that adding parameters to neural networks improves their performance on language tasks. However, the fundamental problem of understanding language--the iceberg lying under words and sentences--remains unsolved.