Decision Trees for Classification

The last post in the Machine Learning algorithm frenzy that I'm currently on was based on Support Vector Machines. This post is going to look at another classification algorithm called a Decision Tree and again see if this can improve on our classification problem of predicting whether lines from Simpson's episodes are said by Bart or Homer. Again, a Decision Tree is a supervised learning algorithm that can be used to classify data based on a model it has built on training data. Like the other models, it tries to split data into two or more sets but the most significant variable that creates the best split is calculated by the algorithm. To distinguish between Homer and Bart from a set of images the decision tree would split the data on each of them and choose which performs best.