Skip to content
Better HN
Top
New
Best
Ask
Show
Jobs
Search
⌘K
undefined | Better HN
0 points
sroussey
1y ago
0 comments
Share
How much can you quantize that down to run on a Mac Studio with 192GB? Is it possible? Feels like it would have to be 2bit…
0 comments
default
newest
oldest
Davidzheng
1y ago
Less than 2bit i think. There's this IQ2 quant that fits
j
/
k
navigate · click thread line to collapse
