Reviews: The Spectrum of the Fisher Information Matrix of a Single-Hidden-Layer Neural Network

Some further work is dedicated to a conditioning measure of this matrix. It is argued that neural networks with linear activation function suffer worse conditioning than those with non-linearities.