Skip to content
Better HN
Top
New
Best
Ask
Show
Jobs
Search
⌘K
0 points
refulgentis
4mo ago
0 comments
Share
Unlikely to see more VRAM in the short term, memory prices are thru the roof :/ like, not subtly, 2-4x.
undefined | Better HN
0 comments
default
newest
oldest
embedding-shape
4mo ago
Well, GPUs are getting more VRAM, although it's pricey. But we didn't used to have 96GB VRAM GPUs at all, now they do exist :) But for the ones who can afford it, it is at least possible today. Slowly it increases.
refulgentis
OP
4mo ago
Agreed, in the limit, RAM go up. As billg knows, 128KB
definitely
wasn't enough for everyone :)
embedding-shape
4mo ago
I'm already thinking 96GB might not be enough, and I've only had this GPU for 6 months or so :|
1 more reply
j
/
k
navigate · click thread line to collapse