How to run LLMs locally on mobile devices (with Gemma and On-Device AI tools) (opens in new tab)

(annjose.com)

1 pointsannjose9mo ago1 comments

1 comments

Any models that can run on a mobile device will likely be 8B or smaller, will have very noticable hallucination problems.

j / k navigate · click thread line to collapse

(annjose.com)

1 pointsannjose9mo ago1 comments

Any models that can run on a mobile device will likely be 8B or smaller, will have very noticable hallucination problems.

j / k navigate · click thread line to collapse