ReLU soothes the NTK condition number and accelerates optimization for wide neural networks

Open in new window