Diffusion Approximations for the Constant Learning Rate Backpropagation Algorithm and Resistence to Local Minima

Finnoff, William

Dec-31-1993–Neural Information Processing Systems 

TJ of the gradient updates is held constant (simple backpropagation).