A Gentle Introduction to the Gradient Boosting Algorithm for Machine Learning - Machine Learning Mastery

XGBoost is the high performance implementation of gradient boosting that you can now access directly in Python. The idea of boosting came out of the idea of whether a weak learner can be modified to become better.