The Insider's Guide to Adam Optimization Algorithm for Deep Learning

Adam is the super star optimization algorithm of Deep Learning. Optimization algorithms aim to find optimum weights, minimize error and maximize accuracy. We find partial derivative of total error with respect to each weight and use this calculation to update weights. This is common because it works slowly but surely. In 2015, Adam optimization algorithm is raised. The name of the algorithm refers to adaptive moment estimation.