undefined | Better HN

0 pointselashri1y ago0 comments

At the price of $5,000 before taxes. There would be better and most cost effective options to run models that will require that much memory.

0 comments

csomar1y ago

It is a laptop. The memory is also shared which means if you are looking for a non-gaming workload, you can use it. If you have laptop equivalents in the same memory range, feel free to share.

rfoo1y ago

I have laptop equivalents in the same memory range and is at least $2,500 cheaper.

Unfortunately, it does not have "unified memory", a somewhat "powerful GPU", and of course no local LLM hype behind it.

Instead, I've decided to purchase a laptop with 128GB RAM with $2,500 and then another $2,160 for 10 years Claude subscription, so I can actually use my 128GB RAM at the same time as using a LLM.

csomar1y ago

That's not the same thing. Also, can you share this 128GB $2500 laptop?

kridsdale11y ago

Ok, but that means you’re not getting full privacy. It’s a trade off.

kergonath1y ago

I see this comment all the time. But realistically if you want more than 1 token/s you’re going to need geforces, and that would cost quite a lot as well, for 100 GB.

nenaoki1y ago

https://nvidianews.nvidia.com/news/nvidia-puts-grace-blackwe...

GB10, or DIGITS, is $3,000 for 1 PFLOP (@4-bit) and 128GB unified memory. Storage configurable up to 4TB.

Can be paired to run 405B (4-bit), probably not very fast though (memory bandwidth is slower than a typical GPU's, and is the main bottleneck for LLM inference).

kergonath1y ago

That’s not something I can get, so it’s not really relevant. There is always a better device around the corner.

justincormack1y ago

Not shipping until May or so.

j / k navigate · click thread line to collapse

0 comments

csomar1y ago

It is a laptop. The memory is also shared which means if you are looking for a non-gaming workload, you can use it. If you have laptop equivalents in the same memory range, feel free to share.

rfoo1y ago

I have laptop equivalents in the same memory range and is at least $2,500 cheaper.

Unfortunately, it does not have "unified memory", a somewhat "powerful GPU", and of course no local LLM hype behind it.

Instead, I've decided to purchase a laptop with 128GB RAM with $2,500 and then another $2,160 for 10 years Claude subscription, so I can actually use my 128GB RAM at the same time as using a LLM.

csomar1y ago

That's not the same thing. Also, can you share this 128GB $2500 laptop?

kridsdale11y ago

Ok, but that means you’re not getting full privacy. It’s a trade off.

kergonath1y ago

I see this comment all the time. But realistically if you want more than 1 token/s you’re going to need geforces, and that would cost quite a lot as well, for 100 GB.

nenaoki1y ago

https://nvidianews.nvidia.com/news/nvidia-puts-grace-blackwe...

GB10, or DIGITS, is $3,000 for 1 PFLOP (@4-bit) and 128GB unified memory. Storage configurable up to 4TB.

Can be paired to run 405B (4-bit), probably not very fast though (memory bandwidth is slower than a typical GPU's, and is the main bottleneck for LLM inference).

kergonath1y ago

That’s not something I can get, so it’s not really relevant. There is always a better device around the corner.

justincormack1y ago

Not shipping until May or so.

j / k navigate · click thread line to collapse