Paper Walkthrough: The Three Giants' Survey

The "Three Giants' Survey", published as "Deep Learning", is a review paper authored by Yann LeCun, Yoshua Bengio, and Geoffrey Hinton and published in the journal "Nature". It introduces deep learning, distinguishes it from classical machine learning, and discusses various important techniques and architectures such as back propagation and convolutional neural networks. Machine learning technologies have proliferated modern society, from search engines to recommender systems, from language translation to autonomous vehicles. And over the past years, interest in and utilization of a subset of machine learning techniques, labelled as deep learning, has drastically increased. One major reason for this is the ability of deep learning models to automatically discover suitable data representations when fed with raw data (methods that are able to do that are called representation-learning methods).