XentGame: Help Minimize LLM Surprise (opens in new tab)

(xentlabs.ai)

17 pointsupperhalfplane1y ago5 comments

5 comments

Interesting I'm wondering if it is possible to cheat using LLMs!

It looks like you can (there are some LLM responses out there, e.g. Sonnet 3.5). Not clear if they can be super good at this, though.

tianlong1y ago

Quite impressed by the entries of Claude

frotaur1y ago

pretty cool, managed to get some reasonable score. I wonder if the high scores are close to the 'theoretical maximum', or if we are an order of magnitude below.

upperhalfplaneOP1y ago

I don't think it's an order of magnitude below... though it's a bit hard to know for sure

j / k navigate · click thread line to collapse

5 comments

tianlong1y ago

Interesting I'm wondering if it is possible to cheat using LLMs!

upperhalfplaneOP1y ago

It looks like you can (there are some LLM responses out there, e.g. Sonnet 3.5). Not clear if they can be super good at this, though.

tianlong1y ago

Quite impressed by the entries of Claude

frotaur1y ago

pretty cool, managed to get some reasonable score. I wonder if the high scores are close to the 'theoretical maximum', or if we are an order of magnitude below.

upperhalfplaneOP1y ago

I don't think it's an order of magnitude below... though it's a bit hard to know for sure

j / k navigate · click thread line to collapse