undefined | Better HN

0 pointsbloppe3y ago0 comments

This. The author is very generous with their interpretation:

> I decided to interpret that as ChatGPT flipping the table and saying “this game is impossible, I literally cannot conceive of how to win without breaking the rules of chess.”

Kind of sounds like anthropomorphization, but more likely the author just papering over the glaring shortcomings to produce a compelling blog post.

It also sounds like the illegal moves were rather frequent. The 61-legal-move game sounded like an impressive outlier.

0 comments

rightbyte3y ago

I think the authors rule is fair. If we interpret illegal moves as getting stuck in an online game, the resulting Elo rating is what it would get.

But ye, he is anthropomorphizing alot ...

bloppeOP3y ago

There's no indication that GPT-3.5 was stuck when it tried to make illegal moves. GPT-4 clearly was making illegal moves when it was very much not stuck. It just doesn't know how to play, but the author decided to interpret it as frustration.

rightbyte3y ago

I meant stuck as "it can't make the move" and would timeout the game if playing online.

j / k navigate · click thread line to collapse

0 comments

rightbyte3y ago

I think the authors rule is fair. If we interpret illegal moves as getting stuck in an online game, the resulting Elo rating is what it would get.

But ye, he is anthropomorphizing alot ...

bloppeOP3y ago

rightbyte3y ago

I meant stuck as "it can't make the move" and would timeout the game if playing online.

j / k navigate · click thread line to collapse