undefined | Better HN

0 pointsnmca1y ago0 comments

It is allowed exactly two guesses, per the ARC rules.

0 comments

How many guesses is the human comparison based on? I’d hope two as well but haven’t seen this anywhere so now I’m curious.

nmcaOP1y ago

The real turker studies, resulting in the ~70% number, are scored correctly I believe. Higher numbers are just speculated human performance as far as I’m aware.

j / k navigate · click thread line to collapse

0 comments

trescenzi1y ago

How many guesses is the human comparison based on? I’d hope two as well but haven’t seen this anywhere so now I’m curious.

nmcaOP1y ago

The real turker studies, resulting in the ~70% number, are scored correctly I believe. Higher numbers are just speculated human performance as far as I’m aware.

j / k navigate · click thread line to collapse