undefined | Better HN

0 pointsdavekeck1y ago0 comments

> then some lower probability tokens may be chosen

Can you explain how it chooses one of the lower-probability tokens? Is it just random?

0 comments

Reducing temperature reduces the impact of differences between raw output values giving a higher probability to pick other tokens.

Oops backwards. Increasing temperature...

j / k navigate · click thread line to collapse

0 pointsdavekeck1y ago0 comments

> then some lower probability tokens may be chosen

Can you explain how it chooses one of the lower-probability tokens? Is it just random?

Reducing temperature reduces the impact of differences between raw output values giving a higher probability to pick other tokens.

Oops backwards. Increasing temperature...

j / k navigate · click thread line to collapse