Goto

Collaborating Authors

 Deep Learning






invariantton 1 5 10 15 20 101 105 109 1013 1017

Neural Information Processing Systems

The rectified linear unit (ReLU) [Fukushima, 1980, Nair and Hinton, 2010] activation has been by far the most widely used nonlinearity and successful building block in deep neural networks (DNNs).