Understanding Gradient Descent with simple mathematical intuition

In simple language, the gradient descent is an ML optimization strategy which facilitates the ML model to find the minimum loss (cost) function which relates to the optimal variable parameters. Let's understand the concept in detail by applying it on one of the most regression algorithms that ML engineers and Data scientists use, that is Linear Regression. For ease of understanding Gradient descent, we will use simple or univariate linear regression. Here, we are focusing on determining the relationship between one independent variable and one dependent variable(target variable). A univariate linear regression is mathematically represented by y mx c, where'y' is the dependent variable and'x' is the independent or target variable.