undefined | Better HN

0 pointsnaasking1y ago0 comments

State is a function of accumulated past information.

0 comments

State is a function of accumulated past. That does not mean that having some past written down makes you stateful. A stateful thing has to incorporate the ongoing changes.

naaskingOP1y ago

Which is what I described: some successful prompt-replies are fed back into subsequent training runs.

jncfhnb1y ago

No… that implies the model never has active state and is being replaced with a different, stateless model. This is similar to the difference between

Actor.happy = True

And

Actor = happier(Actor)

1 more reply

j / k navigate · click thread line to collapse

0 comments

jncfhnb1y ago

State is a function of accumulated past. That does not mean that having some past written down makes you stateful. A stateful thing has to incorporate the ongoing changes.

naaskingOP1y ago

Which is what I described: some successful prompt-replies are fed back into subsequent training runs.

jncfhnb1y ago

No… that implies the model never has active state and is being replaced with a different, stateless model. This is similar to the difference between

Actor.happy = True

And

Actor = happier(Actor)

1 more reply

j / k navigate · click thread line to collapse