A Beginners Guide to the Gradient Descent Algorithm

The gradient descent algorithm is an approach to find the minimum point or optimal solution for a given dataset. It follows the steepest descent approach. That is it moves in the negative gradient direction to find the local or global minima, starting out from a random point. We use gradient descent to reach the lowest point of the cost function. In Machine Learning, it is used to update the coefficients of our model.