A Comprehensive Guide to Decision trees - Analytics Vidhya

In this series, we will start by discussing how to train, visualize, and make predictions with Decision trees. After that, we will go through a training algorithm known as CART which is used by Scikit-learn, and lastly, we would discuss how to regularize the trees and use them for regression tasks. Decision trees are versatile machine learning algorithm capable of performing both regression and classification task and even work in case of tasks which has multiple outputs. They are powerful algorithms, capable of fitting even complex datasets. They are also the fundamental components of Random Forests, which is one of the most powerful machine learning algorithms available today.