September 25th, 2013

Gradient Boosting Machine in III Acts: Trevor Hastie, Netflix & 0xdata

RSS icon RSS Category: Uncategorized
Fallback Featured Image

Gradient Boosting Machine in III Acts: Dr. Trevor Hastie, Netflix & 0xdata. Triple Header on Boosting & GBM:
Act I: Trevor Hastie, Of Stanford Mathematical Sciences, the mathematician behind Lasso & GBM speaks of the nuances of the Algorithm.
Act II: Cliff Click, CTO of 0xdata, the implementor of parallel and distributed GBM.
Act III: Antonio Molins, Data Scientist at Netflix, who uses GBM in his practice of data science for Marketing Algorithmic Models.
Boosting is a simple strategy that produces dramatic improvement in prediction performance. It works by sequentially applying a Classification Algorithm to reweighted versions of training data and taking the weighted majority vote of the sequence of classifiers produced.

“In the last 10 years my colleagues and I have been drawn into the machine learning domain, probably after the lure of neural networks. This has led us to offer a statistical perspective on novel and popular techniques arising outside of statistics, such as boosting and support-vector machines. This culminated in our 2001 book “Elements of Statistical Learning”, but the interest continues.”
-Trevor Hastie, http://www.stanford.edu/~hastie

GBM Implementation:

H2O https://github.com/0xdata/h2o/tree/master/src/main/java/hex/gbm
R: http://cran.r-project.org/web/packages/gbm/gbm.pdf<

References:

http://www.stanford.edu/~hastie/Papers/AdditiveLogisticRegression/alr.pdf

Leave a Reply

What Are Feature Stores and Why Are They Important?

Machine learning (ML) models are only as good as the data fed into them. In

January 18, 2022 - by Adam Murphy
A Beginner’s View of H2O MLOps

Note: this is a community blog post by Shamil Dilshan Prematunga. It was first published

January 15, 2022 - by Jo-Fai Chow
Shapley Values – A Gentle Introduction

If you can't explain it to a six-year-old, you don't understand it yourself. - Albert

January 11, 2022 - by Adam Murphy
The Bond Market & AI: How MarketAxess Brings it All Together

The vast majority of the equities market trades electronically while the bond market is still

January 11, 2022 - by Ian Gomez
H2O Release 3.36 (Zorn)

There’s a new major release of H2O, and it’s packed with new features and fixes! Among

January 7, 2022 - by Michal Kurka
1st Place Winner’s Blog – Kaggle 2021 Data Science and Machine Learning Survey

Kaggle, the largest global community of data scientists, conducted the 5th annual industry-wide survey that

January 4, 2022 - by Shivam Bansal and KunHao Yeh

Start your 14-day free trial today