DeepSeek-V3 runs at 20 tokens/s on Mac Studio, and that's a nightmare for OpenAI (opens in new tab)

(venturebeat.com)

8 pointsbenocodes1y ago2 comments

2 comments

NVIDIA came out with its AI desktops just in time I feel. $4k vs $9k for a Mac Studio. Looks like Nvidia was correct in wanting to buy ARM as the home pc will be taken over by ARM soon.

Its great for western countries but the rest of the world needs China to get to parity on node size and crash the market.

arresin1y ago

…at half the weight precision.

j / k navigate · click thread line to collapse

2 comments

xbmcuser1y ago

NVIDIA came out with its AI desktops just in time I feel. $4k vs $9k for a Mac Studio. Looks like Nvidia was correct in wanting to buy ARM as the home pc will be taken over by ARM soon.

Its great for western countries but the rest of the world needs China to get to parity on node size and crash the market.

arresin1y ago

…at half the weight precision.

j / k navigate · click thread line to collapse