How to explain gradient boosting

As Ben Gorman points out in A Kaggle Master Explains Gradient Boosting, "This is the part that gets butchered by a lot of gradient boosting explanations." His blog post does a good job of explaining it, but we give our own perspective here.