ML Basics (Part-1): REGRESSION -- A Gateway Method to Machine Learning

There has been growing interest in the introductory posts on the elementary topics in Machine Learning. So, I am writing on such topics in the coming posts starting from this one. This article is mostly self-contained however, it requires basic understanding of linear algebra, and calculus. Regression is the process of estimating the relationship of a dependent variable (Y) with one or more independent variables (Xi). It is used primarily for finding patterns in a given set of data samples and forecasting the value of a variable while given a set of values of other variables.