undefined | Better HN

0 pointsmindwok9mo ago0 comments

Not necessarily. If the RL objective is passing tests then in the context of LLMs it means "correct", or at least "correct based on the tests".

0 comments

Unfortunately that doesn't solve the problem in any way. We don't have an Oracle machine for testing software.

If we did, we could autogenerate code even without an LLM.

j / k navigate · click thread line to collapse

0 pointsmindwok9mo ago0 comments

Not necessarily. If the RL objective is passing tests then in the context of LLMs it means "correct", or at least "correct based on the tests".

Unfortunately that doesn't solve the problem in any way. We don't have an Oracle machine for testing software.

If we did, we could autogenerate code even without an LLM.

j / k navigate · click thread line to collapse