Stochastic Adaptive Activation Function

Neural Information Processing Systems 

Therefore, this study proposes a simple yet effective activation function that facilitates different thresholds and adaptive activations according to the positions of units and the contexts of inputs.