undefined | Better HN

0 pointslayer81y ago0 comments

Same. And the next step is that it must feed back into training, to form long-term memory and to continually learn.

0 comments

I analogize this with sleep. Perhaps that is what is needed, 6 hours offline per day to LoRa the base model on some accumulated context from the day.

dev0p1y ago

LLMs need to sleep too. Do they dream of electric sheep?

j / k navigate · click thread line to collapse

0 pointslayer81y ago0 comments

Same. And the next step is that it must feed back into training, to form long-term memory and to continually learn.

I analogize this with sleep. Perhaps that is what is needed, 6 hours offline per day to LoRa the base model on some accumulated context from the day.

dev0p1y ago

LLMs need to sleep too. Do they dream of electric sheep?

j / k navigate · click thread line to collapse