A Probabilistic Framework for Nonlinearities in Stochastic Neural Networks

Qinliang Su, xuejun Liao, Lawrence Carin

Neural Information Processing Systems 

We present a probabilistic framework for nonlinearities, based on doubly truncated Gaussian distributions.