Understanding Learning Rates and How It Improves Performance in Deep Learning

One only needs to type in the following command to start finding the most optimal learning rate to use before training a neural network. At this juncture we've covered what learning rate is all about, it's importance, and how can we systematically come to an optimal value to use when we start training our model. Next we would go through how learning rates can still be used to improve our model's performance.