Must Know Tips/Tricks in Deep Neural Networks

This article was posted by Xiu-Shen Wei. Xiu-Shen Wei is a 2nd-year Ph.D. candidate of Department of Computer Science and Technology in Nanjing University and a member of LAMDA Group. Deep Neural Networks, especially Convolutional Neural Networks (CNN), allows computational models that are composed of multiple processing layers to learn representations of data with multiple levels of abstraction. These methods have dramatically improved the state-of-the-arts in visual object recognition, object detection, text recognition and many other domains such as drug discovery and genomics. In addition, many solid papers have been published in this topic, and some high quality open source CNN software packages have been made available.