undefined | Better HN

0 pointswoojoo6663y ago0 comments

The string is there but it hasn't been trained/taught how to use it and what it actually means

0 comments

In what sense has it been trained how to use any other string that is not also true for the string "I don't know"? Surely that string is perfectly common in the corpus of internet text used to train these models.

Obviously it hasn't been given some explicit model of "you have low confidence on this question therefore you should say you don't know", but neither has it been given any explicit model for any of its other capabilities.

woojoo666OP3y ago

I don't have the training data so I can't say for sure, but I'm assuming here that the training data is a lot of "valid question" => "valid answer", without many examples of "nonsense question" => "i don't understand"/"that's nonsense"

Edit: I want to add that expressing confidence is not the same as answering the prompt. If I ask somebody "give me a drawing depicting Obama's son", and they said "Obama doesn't have a son", I explicitly asked for a drawing and they are giving a speech response. I believe this kind of indirect response has to be taught, and can't be expected to come out naturally from a model that has only been trained on giving out direct responses.

j / k navigate · click thread line to collapse

0 comments

Imnimo3y ago

woojoo666OP3y ago

j / k navigate · click thread line to collapse