Decision Trees Explained -- Entropy, Information Gain, Gini Index, CCP Pruning

Note, average Entropy is the weighted average of all the sub nodes that a parent node splits into. Thus, in our example this would be 2 sub nodes for Working Status and 3 sub nodes for Student Background.