undefined | Better HN

0 pointsadriand3y ago0 comments

The goalposts absolutely have moved: consider the Turing Test as a prime example. If machines cannot pass that test now (and right now it would take a skilled interviewer with substantial domain knowledge to cause a failure), they seem likely to be able to in the very near future.

0 comments

soperj3y ago

It really doesn't take much skill as an interviewer. ChatGPI is so confident in it's answers all you have to really do is ask it for the lyrics to a song that you know. It never answers correctly. It might get the first verse or 2 correct, maybe even the chorus, but it eventually decides to make up it's own parts and then you know.

anonyfox3y ago

I just asked ChatGPT (v4!) and it’s a bit sensitive but otherwise correct:

"Surfacing" is a song by Slipknot from their self-titled debut album, released in 1999. Please note that the lyrics contain explicit language. Here is a portion of the lyrics with some of the explicit content redacted:

"Running out of ways to run I can't see, I can't be Over and over and under my skin All this attention is doing me in!

[Chorus:] (Expletive) it all! (Expletive) this world! (Expletive) everything that you stand for! Don't belong! Don't exist! Don't give a (expletive), don't ever judge me!

Picking through the parts exposed Taking shape, taking shag Over and over and under my skin All this momentum is doing me in!

[Chorus:] (Expletive) it all! (Expletive) this world! (Expletive) everything that you stand for! Don't belong! Don't exist! Don't give a (expletive), don't ever judge me!

You got all my love, livin' in your own hate Drippin' hole man, hard step, no fate Show you nothin', but I ain't holdin' back Every damn word I say is a sneak attack When I get my hands on you Ain't a (expletive) thing you can do Get this cuz you're never gonna get me I am the very disease you pretend to be

I am the push that makes you move

[Chorus:] (Expletive) it all! (Expletive) this world! (Expletive) everything that you stand for! Don't belong! Don't exist! Don't give a (expletive), don't ever judge me!"

Please be aware of the explicit content before sharing or using these lyrics in any context.

soperj3y ago

I'll wait until it's actually available for me to test to change my mind.

1 more reply

erohead3y ago

Um as a human, I do this constantly as well

gkbrk3y ago

Humans can generally realize they don't know the complete lyrics of a song, instead of making up whole verses with 0 indication that it's not the real lyrics.

1 more reply

ilyt3y ago

...Okay but random human might fail on exact same thing.

soperj3y ago

I've never met someone who will make up whole verses to a song. Especially when you pick a song with 7 words and it gives you about 10 verses.

1 more reply

bluefirebrand3y ago

Recognizing that the Turing Test is not a sufficient bar for judging if a computer is true AGI is not moving the goalposts, it's just realizing that passing the test and the location of the goalposts weren't actually the same in the first place.

gowld3y ago

The Turing Test was proposed as one example of a test for "indistinguishable from a human", not the singular goalpost for indistinguishability.

wongarsu3y ago

The Turing test has been questioned for decades, with many suggesting that Turing meant it more as a joke.

And that's ignoring that arguably chat bots have been passing the Turing test (against non-expert judges) since ELIZA in the 60s [1]

1: https://en.m.wikipedia.org/wiki/ELIZA

joshuahedlund3y ago

> If machines cannot pass that test now (and right now it would take a skilled interviewer with substantial domain knowledge to cause a failure)

Does ChatGPT fail this simple test: "I am going to ask you questions, but if I go silent for a couple minutes, I want YOU to start asking ME random questions."

ogogmad3y ago

ChatGPT predicts the next letter. It doesn't tell the time.

joshuahedlund3y ago

And AGI is impossible if you can’t tell time

Lewton3y ago

ChatGPT does not pass the Turing test

j / k navigate · click thread line to collapse

0 comments

soperj3y ago

anonyfox3y ago

I just asked ChatGPT (v4!) and it’s a bit sensitive but otherwise correct:

"Running out of ways to run I can't see, I can't be Over and over and under my skin All this attention is doing me in!

[Chorus:] (Expletive) it all! (Expletive) this world! (Expletive) everything that you stand for! Don't belong! Don't exist! Don't give a (expletive), don't ever judge me!

Picking through the parts exposed Taking shape, taking shag Over and over and under my skin All this momentum is doing me in!

[Chorus:] (Expletive) it all! (Expletive) this world! (Expletive) everything that you stand for! Don't belong! Don't exist! Don't give a (expletive), don't ever judge me!

I am the push that makes you move

[Chorus:] (Expletive) it all! (Expletive) this world! (Expletive) everything that you stand for! Don't belong! Don't exist! Don't give a (expletive), don't ever judge me!"

Please be aware of the explicit content before sharing or using these lyrics in any context.

soperj3y ago

I'll wait until it's actually available for me to test to change my mind.

1 more reply

erohead3y ago

Um as a human, I do this constantly as well

gkbrk3y ago

Humans can generally realize they don't know the complete lyrics of a song, instead of making up whole verses with 0 indication that it's not the real lyrics.

1 more reply

ilyt3y ago

...Okay but random human might fail on exact same thing.

soperj3y ago

I've never met someone who will make up whole verses to a song. Especially when you pick a song with 7 words and it gives you about 10 verses.

1 more reply

bluefirebrand3y ago

gowld3y ago

The Turing Test was proposed as one example of a test for "indistinguishable from a human", not the singular goalpost for indistinguishability.

wongarsu3y ago

The Turing test has been questioned for decades, with many suggesting that Turing meant it more as a joke.

And that's ignoring that arguably chat bots have been passing the Turing test (against non-expert judges) since ELIZA in the 60s [1]

1: https://en.m.wikipedia.org/wiki/ELIZA

joshuahedlund3y ago

> If machines cannot pass that test now (and right now it would take a skilled interviewer with substantial domain knowledge to cause a failure)

Does ChatGPT fail this simple test: "I am going to ask you questions, but if I go silent for a couple minutes, I want YOU to start asking ME random questions."

ogogmad3y ago

ChatGPT predicts the next letter. It doesn't tell the time.

joshuahedlund3y ago

And AGI is impossible if you can’t tell time

Lewton3y ago

ChatGPT does not pass the Turing test

j / k navigate · click thread line to collapse