Feature Engineering vs Feature Selection

All machine learning workflows depend on feature engineering and feature selection. However, they are often erroneously equated by the data science and machine learning communities. Although they share some overlap, these two ideas have different objectives. Knowing these distinct goals can tremendously improve your data science workflow and pipelines. This post is intended for those who have done some machine learning before but want to improve their models. First, we'll cover what features and feature matrices are, then we'll walk through the differences between feature engineering and feature selection.