Goto

Collaborating Authors

 Oceania










Embedding Principle of Loss Landscape of Deep Neural Networks

Neural Information Processing Systems

Understanding the structure of loss landscape of deep neural networks (DNNs) is obviously important. In this work, we prove an embedding principle that the loss landscape of a DNN "contains" all the critical points of all the narrower DNNs.