Gradient Descent Simplified. An optimization algorithm behind the…

Batch gradient descent is a type of gradient descent that update the parameters after forward and backward pass through the entire dataset. It is called "batch" gradient descent because it uses the entire dataset to compute the gradient of the loss function at each iteration. Where n is the number of samples in the entire dataset. One of the main disadvantages of batch gradient descent is that it can be computationally expensive when the dataset is very large, as it requires a forward and backward pass through the entire dataset at each iteration. In addition, if the dataset is noisy or has a lot of outliers, the loss function can oscillate and never converge to a minimum. In this case, a more sophisticated optimization algorithm such as stochastic gradient descent or mini-batch gradient descent may be more appropriate.