undefined | Better HN

0 pointsgiantrobot7mo ago0 comments

A 1B model at 2-bit quantization is about the size of the average web page anymore. With some WebGPU support you could run such a model in a browser.

I'm half joking. Web pages are ludicrously fat these days.

0 comments

That was the exact thing I was thinking of but couldn't remember the project name. Thanks!

j / k navigate · click thread line to collapse

0 pointsgiantrobot7mo ago0 comments

A 1B model at 2-bit quantization is about the size of the average web page anymore. With some WebGPU support you could run such a model in a browser.

I'm half joking. Web pages are ludicrously fat these days.

That was the exact thing I was thinking of but couldn't remember the project name. Thanks!

j / k navigate · click thread line to collapse