On the spectral bias of two-layer linear networks

The most forceful driver of advancements in the field of Machine Learning over the past decades has been the success of deep neural networks.