undefined | Better HN

0 pointsbinary1321y ago0 comments

Quantized Llama 3.1 can run on an Amazon GPU instance for $32/hr now

0 comments

That's still prohibitively expensive for anyone that doesn't intend to make their money back. For training it's even more outrageous.

$64K isn’t even one developer’s salary.

And how many people can afford to pay a developer's salary after utilities and mortgage?

j / k navigate · click thread line to collapse

0 pointsbinary1321y ago0 comments

Quantized Llama 3.1 can run on an Amazon GPU instance for $32/hr now

That's still prohibitively expensive for anyone that doesn't intend to make their money back. For training it's even more outrageous.

$64K isn’t even one developer’s salary.

And how many people can afford to pay a developer's salary after utilities and mortgage?

j / k navigate · click thread line to collapse