ABC of Deep Learning (Part 3 of 5)

As referred previously, the gradient descent algorithm is an optimization technique used to find the weights and bias values that minimize a cost function. The backpropagation algorithm is a method of training neural networks that uses gradient descent to minimize the cost function. Backpropagation is a fast and efficient method of training a neural network. Before explaining the backpropagation algorithm, it's crucial to describe the equation behind any artificial neural network. A neural network can be represented by a composition of multivariate functions.