Towards Understanding the Importance of Shortcut Connections in Residual Networks

Tianyi Liu, Minshuo Chen, Mo Zhou, Simon S. Du, Enlu Zhou, Tuo Zhao

Neural Information Processing Systems 

Residual Network (ResNet) is undoubtedly a milestone in deep learning.