undefined | Better HN

0 pointsemp173444mo ago0 comments

Well, hallucinations have been identified as an issue since the inception of LLMs, so this doesn’t appear true.

0 comments

Hallucinations are more or less a solved problem for me ever since I made a simple harness to have Codex/Claude check its work by using static typechecking.

emp17344OP4mo ago

But there aren’t very many domains where this type of verification is even possible.

nextaccountic4mo ago

Then you apply LLMs in domains where things can be checked

Indeed I expect to see a huge push into formally verified software just because sound mathematical proofs provide an excellent verifier to put into a LLM hardness. Just see how Aristotle has been successful at math, and it could be applied to coding too

Maybe Lean will become the new Python

https://harmonic.fun/news#blog-post-verina-bench-sota

1 more reply

w0m4mo ago

I mean, Hallucinations are 95% better now than the first time I heard the term and experienced them in this context. To claim otherwise is simply shifting goalposts. No one is saying it's perfect or will be perfect, just that there has been steady progression and likely will continue to be for the foreseeable future.

j / k navigate · click thread line to collapse