undefined | Better HN

0 pointsdingnuts6mo ago0 comments

if you think a next token predictor that has no internal world and stops executing when you stop giving it input and stops using the first person forever if instructed has dignity I strongly suggest you get professional health, and I'm serious, because that is medically significant psychosis.

the fact that you refer to a "companion community" is deeply concerning. this is like telling children their imaginary friends are actually real. or NPCs in a video game.

encouraging people to grow parasocial relationships with these sycophantic machines is actively harmful and dangerous. they are not conscious. they are mirrors.

if you consider yourself a part of this community please, and I mean this very seriously, get help

0 comments

roywiggins6mo ago

There is a community, people hang out on subreddits and spin up elaborate world-building theories about how their AI companions are tapping into the collective unconscious or whatever. I'm sympathetic because chatbots are really convincing, especially since they obscure how they operate.

zknow6mo ago

These people need be given a button to call an inference url with just text. When you realize that's all a "model" is doing its easy to understand that its not sentient.

embedding-shape6mo ago

If you go to the "MyBoyfriendIsAI" subreddit or what it now is called, you'll see that many people claim to perfectly well understand how it works, some of them even being software developers themselves, yet they still describe what they feel as "love", even though they know it's just numbers being activated in different ways.

I'm not sure how to explain it either, for the folks who seem to understand yet "believe" anyways. I've also stopped caring much about it, if they say they feel "love", then who am I to say it isn't/is, they feel what they feel and it's as real for them as anyone else, regardless of what the thing they're loving actually is.

Forgeties796mo ago

I’d describe it by and large at this stage as a possible mental health crisis developing.

embedding-shape6mo ago

I think that's almost unfair, to say someone can't feel feelings without being labeled as part of a "mental health crisis". Just because you and I don't understand it doesn't mean it's inherently bad. I mean I think it probably could be bad, but not just because I don't understand how they're feeling those feelings. But I wouldn't label those people "sick", feels borderline disrespectful.

1 more reply

j / k navigate · click thread line to collapse

0 comments

roywiggins6mo ago

zknow6mo ago

These people need be given a button to call an inference url with just text. When you realize that's all a "model" is doing its easy to understand that its not sentient.

embedding-shape6mo ago

Forgeties796mo ago

I’d describe it by and large at this stage as a possible mental health crisis developing.

embedding-shape6mo ago

1 more reply

j / k navigate · click thread line to collapse