GPU for Deep Learning

The buzz around Deep Learning often misleads layman people to think that it is a newly invented technology, but it comes as a shock for them when they know that foundations of Deep Learning were laid down as early as in the 1940–1950s. There is a long history of deep learning where most of the popular deep neural network architectures and theories were already proposed throughout the latter half of the 20th century. If it was such the case, then you may ask why the Deep Learning revolution is taking place in the current times and why not a few decades back. The short answer is that the right hardware and compute power, required to train the large neural networks efficiently, did not exist during those times; thus all the theories were mostly on papers without practical support. There was a time when if you were researching on neural networks, you would not have been taken seriously by the machine learning research community.