Gradient Descent Algorithm : Understanding the Logic - Analytics Vidhya

Gradient Descent algorithm is an iterative algorithm used for the optimization of parameters used in an equation and to decrease the Loss (often called a Cost function). But before diving deep, we first need to have a basic idea of what a gradient means? Why are we calculating the gradient of a function and what is our final goal to achieve by using this algorithm? The gradient of a function refers to the slope of the function at some point. We are calculating the gradient of a function to achieve the global minima of the function.