The Power and Limits Of Deep Learning -- Yann LeCun

We need a lot of data thas a huge drawback. We are learning the representation directly and this is why it works so well. Even in RL, we need a lot of data and this can really be a drawback in every turn. And all supervised learning is backpropagation gradient descent derivative. Even 2005 some good progress were made.