undefined | Better HN

0 pointskergonath5mo ago0 comments

Hang on, starting benchmarks on my Raspberry Pi.

0 comments

By the year 2035, toasters will run LLMs.

On a lark a friend setup Ollama on a 8GB Raspberry Pi with one of the smaller models. It worked by it was very slow. IIRC it did 1 token/second.

j / k navigate · click thread line to collapse

By the year 2035, toasters will run LLMs.

On a lark a friend setup Ollama on a 8GB Raspberry Pi with one of the smaller models. It worked by it was very slow. IIRC it did 1 token/second.

j / k navigate · click thread line to collapse