#003B Gradient Descent Master Data Science

A term "Deep learning" refers to training neural networks and sometimes very large neural networks. They are massively used for problems of classification and regression. The main goal is to optimize parameters \( w \) and \( b \) ( both in logistic regression and in neural networks). Gradient Descent achieved amazing results in solving these optimization tasks. Not so new, developed in the 1940s, 1950s and 1960s.