undefined | Better HN

0 pointsdavidsrosenberg7y ago0 comments

I imagine Breiman was just talking about bagging-style parallel ensembles, when he was talking about variance reduction, not boosting-style sequential ensembles. Not long before he died, he was still actively trying to figure out why AdaBoost “works”. Don’t think he claimed to really understand that. He had experimental results that disputed the “it’s just maximizing the margin” explanation.

Saw the comments above — are you from a stats or ML background, or neither?

0 comments

srean7y ago

I am more ML than stats. BTW Brieman believed the same for Boosting. Later he got a little unsure. You will find this in his writings on Boosting

davidsrosenbergOP7y ago

Interesting -- if you've got a link, please post it.

srean7y ago

You can take a look at his technical reports from 2001 onwards, lot of very interesting material, lot of back forth between Freund, Schapire and Brieman in those. The reports continue to be hosted on Brieman's home page.

j / k navigate · click thread line to collapse

0 pointsdavidsrosenberg7y ago0 comments

Saw the comments above — are you from a stats or ML background, or neither?

0 comments

srean7y ago

I am more ML than stats. BTW Brieman believed the same for Boosting. Later he got a little unsure. You will find this in his writings on Boosting

davidsrosenbergOP7y ago

Interesting -- if you've got a link, please post it.

srean7y ago

j / k navigate · click thread line to collapse