undefined | Better HN

0 pointsechelon1y ago0 comments

> you're not going to get these results with a 14B video model

Foundation models are starting to outstrip any consumer hardware we have.

If Nvidia wants to stay ahead of Google's data center TPUs for running all of these advanced workloads, they should make edge GPU compute a priority.

There's a future where everything is a thin client to Google's data centers. Nvidia should do everything in its power to prevent that from happening.

0 comments

sigmaisaletter1y ago

Your post strangely sounds like Nvidia primarily makes graphic cards for consumers.

Last time I checked, they couldn't produce enough H100s/GB100s to satisfy demand from everyone and their mother running a data center. And their most recent consumer hardware offerings have been repeatedly called a "paper launch" - probably because consumer hardware isn't a priority, given the price (and profit) delta.

sofixa1y ago

I read their comment as meaning that Nvidia should prioritise a specific kind of consumer/prosumer hardware.

Nobody is running H100s at home, nor are most video companies running ones. So the choice for them is to "rent" them from Google, or... invest a lot in almost impossible to obtain Nvidia hardware? One has lower initial cost, and is available now.

sigmaisaletter1y ago

Thanks for the (possible) clarification.

But as long as Google isn't their _only_ customer, why would Nvidia care?

larodi1y ago

>There's a future where everything is a thin client to Google's data centers. Nvidia should do everything in its power to prevent that from happening.

there has always been, the mainframe concept is not new. but it goes in and out of fashion.

>>>> mainframe

<<<< personalpc

>>>> web pages/social media

<<<< personal phones/edge

>>>> cloud ai

<<<< ???? personal robotics, chips and ai ???

>>>> ???? rented swarms ???

j / k navigate · click thread line to collapse

0 comments

sigmaisaletter1y ago

Your post strangely sounds like Nvidia primarily makes graphic cards for consumers.

sofixa1y ago

I read their comment as meaning that Nvidia should prioritise a specific kind of consumer/prosumer hardware.

sigmaisaletter1y ago

Thanks for the (possible) clarification.

But as long as Google isn't their _only_ customer, why would Nvidia care?

larodi1y ago

>There's a future where everything is a thin client to Google's data centers. Nvidia should do everything in its power to prevent that from happening.

there has always been, the mainframe concept is not new. but it goes in and out of fashion.

>>>> mainframe

<<<< personalpc

>>>> web pages/social media

<<<< personal phones/edge

>>>> cloud ai

<<<< ???? personal robotics, chips and ai ???

>>>> ???? rented swarms ???

j / k navigate · click thread line to collapse