Understanding Gradient Descent And Its Variants

Machine learning models are fantastic; they can recognize objects in videos; they can automatically generate captions for images and accurately classify pictures of cats and dogs (sometimes). This article will provide a surface level understanding of what happens underneath the hood of Machine learning models. More specifically, we will be exploring the'backbone algorithms' that enable these machine learning models to learn. The'backbone algorithms' are called Optimization algorithms. Below are some definitions of keywords you will encounter within this article, and optimization algorithm is amongst the provided descriptions.