undefined | Better HN

0 pointsMuffinFlavored2y ago0 comments

> But mid term, having a locally run LLM and integrated into the OS that scans my files and can summarize folders for me

But don't most LLMs have about a max 32k token context?

0 comments

lukan2y ago

The idea is to have a personal AI, that is trained with my content, my files. My emails, my pictures, projects, notes, etc. How that can be implemented in the best way, is not my expertize, but I believe is subject of heavy research.

j / k navigate · click thread line to collapse

0 pointsMuffinFlavored2y ago0 comments

> But mid term, having a locally run LLM and integrated into the OS that scans my files and can summarize folders for me

But don't most LLMs have about a max 32k token context?

0 comments

lukan2y ago

j / k navigate · click thread line to collapse