undefined | Better HN

0 pointsbillconan1y ago0 comments

Can their system attach memory? from what I read, it doesn't seem to be able to: https://www.reddit.com/r/mlscaling/comments/1csquky/with_waf...

0 comments

wmf1y ago

I think they do have external memory that they use for training.

anon2911y ago

Former Cerebras engineer. At the time I was there, it could not.

winwang1y ago

Surprising. DRAM (and more importantly high-bandwidth DRAM) seems to be scaling significantly better than SRAM -- and I'm not sure if that could be seriously expected to shift.

j / k navigate · click thread line to collapse