Hyperparameter Tuning Is a Resource Scheduling Problem (opens in new tab)

(jchandra.com)

2 pointsjchandra10mo ago3 comments

3 comments

I dont think its just a resource scheduling problem, there are more to it as well. The goal is Model Performance, not just efficient resource use.

Nice article but I can see your point.

jchandraOP10mo ago

Totally fair point — at the end of the day, it's all about getting the best model performance. I was mostly trying to highlight how, under the hood, a lot of modern HPO algos really boil down to smart scheduling decisions.

vivahir21510mo ago

Total Computational Budget in Hyperband need to be elaborated. There are more things to it.

j / k navigate · click thread line to collapse

3 comments

vivahir21510mo ago

I dont think its just a resource scheduling problem, there are more to it as well. The goal is Model Performance, not just efficient resource use.

Nice article but I can see your point.

jchandraOP10mo ago

vivahir21510mo ago

Total Computational Budget in Hyperband need to be elaborated. There are more things to it.

j / k navigate · click thread line to collapse