undefined | Better HN

0 pointsWiSaGaN2y ago0 comments

I am wondering why it would price them in characters but not tokens? Are they processing characters directly as tokens without tokenizer?

0 comments

abeshkek9192y ago

Maybe because it's easier this way to estimate the data size before you send it to the API.

WiSaGaNOP2y ago

I am not sure about that. You are already using API, should be trivial to use a tokenizer to get the number. Also prompt is just minor part of the cost. You have much less control in the completion part, which is the majority of the cost.

j / k navigate · click thread line to collapse

0 pointsWiSaGaN2y ago0 comments

I am wondering why it would price them in characters but not tokens? Are they processing characters directly as tokens without tokenizer?

0 comments

abeshkek9192y ago

Maybe because it's easier this way to estimate the data size before you send it to the API.

WiSaGaNOP2y ago

j / k navigate · click thread line to collapse