undefined | Better HN

0 pointsAurornis7mo ago0 comments

> Yes all this has been known since the M4 came out. The memory bandwidth is too low.

The M4 Max with 128GB of RAM (the part used in the comment) has over 500GB/sec of memory bandwidth.

0 comments

Which is incredibly slow when you’re over 20k context

j / k navigate · click thread line to collapse

0 pointsAurornis7mo ago0 comments

> Yes all this has been known since the M4 came out. The memory bandwidth is too low.

The M4 Max with 128GB of RAM (the part used in the comment) has over 500GB/sec of memory bandwidth.

Which is incredibly slow when you’re over 20k context

j / k navigate · click thread line to collapse