PCA, LDA, and SVD: Model Tuning Through Feature Reduction for Transportation POI Classification

PCA is a dimension reduction method that takes datasets with a large number of features and reduces them to a few underlying features. The sklearn PCA package performs this process for us. In the snippet of code below we are reducing the 75 features that the initial dataset has into 8 features. This snippet serves to show the optimal number of features for the feature reduction algorithm to fit into. The below snippets will show how to use the Gaussian Naive Bayes, Decision Tree, and the K-Nearest Neighbors Classifiers with the reduced features.