undefined | Better HN

0 pointstintor1y ago0 comments

> they have brought the cost of pretraining a frontier 400B+ parameter model to ZERO

It is still far from zero.

0 comments

cs7021y ago

If the model is already pretrained, there's no need to pretrain it, so the cost of pretraining is zero.

Yeah but you only have the one model, and so far it seems to be only good on paper.

j / k navigate · click thread line to collapse

0 pointstintor1y ago0 comments

> they have brought the cost of pretraining a frontier 400B+ parameter model to ZERO

It is still far from zero.

cs7021y ago

If the model is already pretrained, there's no need to pretrain it, so the cost of pretraining is zero.

Yeah but you only have the one model, and so far it seems to be only good on paper.

j / k navigate · click thread line to collapse