An Empirical Study of the Occurrence of Heavy-Tails in Training a ReLU Gate

Open in new window