undefined | Better HN

0 pointsdylan6043d ago0 comments

I know it's one of those "if you have to ask" situations, but curiosity got the better part of me. Here's the search assist response:

"The DGX GB200 NVL72 AI server costs approximately $3 million per unit. This system includes 72 Blackwell GPUs and 36 Grace CPUs, making it one of the most powerful AI servers available."

The search assist actually credited a source used with: https://www.tweaktown.com/news/98292/nvidias-new-gb200-super...

That $25k spend by GGGP seems like nothing in comparison. That's ~1/3 of one chip in that cabinet. God gawd I'm old and out of touch with modern AI data centers.

0 comments

nl3d ago

By comparison, the Colossus 1 data center had 32,000 GB200s (as well as 150,000 H100 GPUs, 50,000 H200 GPUs), and they are bringing another 110,000 GB200s online (although this might be Colossus 2?)

There are bigger data centers than Colossus 1 around too.

There is a reason NVidia is the most valuable company on the planet.

https://en.wikipedia.org/wiki/Colossus_(supercomputer)#Curre...

TheOtherHobbes3d ago

It's The Circle of Computing Life. The pendulum swings between centralised mainframe timesharing-for-hire and desktop individuality.

We've been in a centralised phase for longer than usual - first cloud everything, then AI - but at some point in the next decade prices will crash and a market will appear for personal, local intelligence.

brianwawok2d ago

Depends how local models keep up

j / k navigate · click thread line to collapse