Goto

Collaborating Authors

 theano implementation


Theano Implementation of LambProp? • /r/MachineLearning

#artificialintelligence

In my own experiments I've found ShakeWeight to really help generalization when using LambProp. You can train neural nets with trillions of layers on MNIST and not over fit. Plus you get your heart rate up and work the forearms.


Theano Implementation of LambProp? • /r/MachineLearning

#artificialintelligence

Does anyone have an implementation of LambProp, preferably in Theano? The arxiv paper isn't out yet but I think that enough details have been leaked that a strong PhD student should be able to reproduce it. I incorporated gradient noise in my implementation since it seems to help.