A Brief History of Deep Learning (Part One) - Bulletproof

In this article and the next, we'll discuss some of the history and basics of Deep Learning to serve as a kind of primer for the coverage of the International Conference on Machine Learning recently held in Sydney. Much of the discussion centres around recent advances in Deep Learning and the purpose here is to give some background, basic terminology and provide some context. Deep Learning is part of Machine Learning which is itself a sub-field of the field of Artificial Intelligence. It's generally accepted that there are three broad categories or types of Machine Learning: Supervised, Unsupervised and Reinforcement (these are fuzzy boundaries, other categories exist and definitions vary but we'll stick with these for now). In Unsupervised Learning we don't make any assumptions about the data we have, the processes that generated it nor any underlying structure/constraints.