undefined | Better HN

0 pointsAurornis5d ago0 comments

> especially when token costs aren't a concern. Not every problem requires SOTA

If token costs aren’t a concern I’m using SOTA for everything.

Even SOTA gets it wrong and hallucinates, but at a lower rate. I don’t want to waste my time.

0 comments

I believe they mean token costs aren't a concern when you're not paying for a SOTA model via API, and are instead running local models.

Infinite monkeys on infinite typewriters, and all that.

Correct, I have local hardware, not infinite money.

j / k navigate · click thread line to collapse

I believe they mean token costs aren't a concern when you're not paying for a SOTA model via API, and are instead running local models.

Infinite monkeys on infinite typewriters, and all that.

Correct, I have local hardware, not infinite money.

j / k navigate · click thread line to collapse