Gradient Boosting from scratch

Gradient Boosting (most often seen in its 'extreme' variant, XGBoost) arguably is the most successful algorithm in kaggle competitions. This blog post provides a nice introduction to the algorithm.