Rank Diminishing in Deep Neural Networks

Neural Information Processing Systems 

By virtue of our numerical tools, we provide the first empirical analysis of the per-layer behavior of network rank in practical settings, i .