Embedding Principle of Loss Landscape of Deep Neural Networks

Neural Information Processing Systems 

Understanding the structure of loss landscape of deep neural networks (DNNs) is obviously important. In this work, we prove an embedding principle that the loss landscape of a DNN "contains" all the critical points of all the narrower DNNs.

Similar Docs  Excel Report  more

TitleSimilaritySource
None found