CS 229 - Machine Learning Tips and Tricks Cheatsheet

In a context of a binary classification, here are the main metrics that are important to track in order to assess the performance of the model. Confusion matrix The confusion matrix is used to have a more complete picture when assessing the performance of a model. ROC The receiver operating curve, also noted ROC, is the plot of TPR versus FPR by varying the threshold. Once the model has been chosen, it is trained on the entire dataset and tested on the unseen test set. Cross-validation Cross-validation, also noted CV, is a method that is used to select a model that does not rely too much on the initial training set.