undefined | Better HN

0 pointslostmsu1y ago0 comments

Impossible. Power costs for H100-like cards are dwarfed by the cost of the cards themselves. H100 at full load will consume ~$3500 (rough estimate) of power in 5 years at $0.12/kWh.

0 comments

yencabulator1y ago

Data centers are more constrained by availability of power, and the matching cooling, than the actual bulk cost of it.

For example, I've been in situations where we had to deploy fewer hard drives per server unit than we otherwise would have, just because we knew we couldn't power & cool the racks if we fully stocked them.

lostmsuOP1y ago

How much do you think it would cost to install cooling for 5kW power output (1 8xH100 node)?

yencabulator1y ago

It's more that a room/wing/building/whatever is built with a certain capacity, while power and heat density keeps increasing. Most buildings can't "just add cooling for 5kW". Newer data centers should already be built with that lesson in mind, for example with a lot of extra air moving capacity etc planned in, but that's been the struggle for a while now.

j / k navigate · click thread line to collapse

0 comments

yencabulator1y ago

Data centers are more constrained by availability of power, and the matching cooling, than the actual bulk cost of it.

lostmsuOP1y ago

How much do you think it would cost to install cooling for 5kW power output (1 8xH100 node)?

yencabulator1y ago

j / k navigate · click thread line to collapse