undefined | Better HN

0 pointsInsimwytim1d ago0 comments

  > Model training is similar to the creation of the cgi for the movie. Both happen before anyone consumes the output

I did not say anything about consumption of the output. Maybe you misread what I wrote, it is about energy consumption.

  > Both a movie and a language model can cost

But we weren't comparing cost of the movie to cost of a language model

  > can cost tens or hundreds of dollars

But we weren't talking about dollars, we were talking about energy.

We're clearly exploring different questions.

0 comments

And that energy costs money, both at the training/cgi stage and at the inference/consumption stage. It's not even an externality.

CGI renders do use a lot of electricity relative to playing back the movie for individual viewers. It's perfectly analogous.

  > CGI renders do use a lot of electricity relative to playing back the movie for individual viewers. It's perfectly analogous.

I've literally laughed at loud after reading this.

I can't believe you're stretching this in a good faith.

But if you are - well, you're certainly have a unique perspective.

j / k navigate · click thread line to collapse