Although Deep Learning has been around for several years now, that's still an unanswered question. Much of the difficulty in designing a good neural net stems from the fact that they're still black boxes. We have some high-level idea of how they work, but we don't really know how they achieve the results that they do. There are a few clues we can start with. From an intuitive perspective, all of these additions to the state-of-the-art of Deep Learning make sense.

Although Deep Learning has been around for several years now, that's still an unanswered question. Much of the difficulty in designing a good neural net stems from the fact that they're still black boxes. We have some high-level idea of how they work, but we don't really know how they achieve the results that they do. There are a few clues we can start with. From an intuitive perspective, all of these additions to the state-of-the-art of Deep Learning make sense.