This is massively overstated. We ought to be more careful in performing such calculations.
Not only that, both keep getting less expensive in various ways. small models, though still not cheap to train, are making inference vanishingly cheap.
> Alex de Vries is a Ph.D. candidate at VU Amsterdam and founder of the digital-sustainability blog Digiconomist. In a report published earlier this month in Joule, de Vries has analyzed trends in AI energy use. He predicted that current AI technology could be on track to annually consume as much electricity as the entire country of Ireland (29.3 terawatt-hours per year).
That's a lot of power, and the availability of electricity is already seen as a bottleneck in the development of AI models [2].
[1] https://spectrum.ieee.org/ai-energy-consumption
[2] https://www.tomshardware.com/tech-industry/artificial-intell...
He didn’t though, did he? If you click through and read the report, it is quite clear in saying that this is a worst case scenario if you ignore things like it being unrealistic for Nvidia to even produce the requisite number of chips. It’s also based on the efficiency of 2023 models; he assumes 3 Wh per prompt when today it is 0.34 Wh.
It also completely ignores the fact that AI use can displace greater energy use:
The carbon emissions of writing and illustrating are lower for AI than for humans
> Our findings reveal that AI systems emit between 130 and 1500 times less CO2e per page of text generated compared to human writers, while AI illustration systems emit between 310 and 2900 times less CO2e per image than their human counterparts. […] the use of AI holds the potential to carry out several major activities at much lower emission levels than can humans.
— https://www.nature.com/articles/s41598-024-54271-x
It isn’t a bad thing if AI uses x Wh if not using AI uses 1500x Wh. Looking at the absolute usage without considering displacement only gives you half the picture.
Great so all we have to do to save the world is cull illustrators, writers and anyone else who can be replaced by AI.
Population of Ireland is .06% of world's population btw.
