undefined | Better HN

0 pointssimonw5mo ago0 comments

"With what is called AI today, only the largest corporations can afford to train the models"

I take it you're very positive about Andrej's new project which allows anyone to train a model for a few hundred dollars which is comparable to the state-of-the-art from just 5 years ago then.

0 comments

hn_acc15mo ago

For a few hundred dollars, given heavily-VC-subsidized hardware that is probably partially funded by nvidia and various AI companies, etc.

Can I run it on my local hardware (nvidia consumer card, AMD cpu)? No. When could that corporation cut off my access to that hardware if I did anything it didn't like? Anytime.

Lots of things have started off cheap / subsidized to put competitors out of business, and then the prices go up, up and up..

simonwOP5mo ago

> Can I run it on my local hardware?

Yes. The training process requires big expensive GPUs. The model it produces has 561M parameters, which should run on even a high end mobile phone (I run 4B models on my iPhone).

j / k navigate · click thread line to collapse