Learning Machine Learning Part 1: Introduction and Revoke-Obfuscation

The more a feature decreases the impurity, the more important the feature is. In random forests, the impurity decrease from each feature can be averaged across trees to determine the final importance of the variable.