[R] Cyclical Learning Rates for Training Neural Networks • r/MachineLearning
Submission statement: Finding the correct learning rate is a pain. But this paper shows how to find reasonable learning rate bounds. Then you can cyclically vary your learning rate to getting better accuracy and often a decreasing training time. P.S There is a PR for this in keras-contrib.
Sep-24-2017, 02:35:09 GMT
- Technology: