undefined | Better HN

0 pointsmordae1mo ago0 comments

They have released mixed fp8/fp4 for efficiency. It's still hundreds of gigabytes, though. Give up on local for these.

0 comments

That's right, need a lot of GPUs + memory, anybody experimented with Mac Studio M3 Ultra for this?

j / k navigate · click thread line to collapse

That's right, need a lot of GPUs + memory, anybody experimented with Mac Studio M3 Ultra for this?

j / k navigate · click thread line to collapse