undefined | Better HN

0 pointsRecycledEle1y ago0 comments

> The bad thing is that people still think LLMs can be trusted at all.

LLMs are as trustworthy as humans.

Humans have been being wrong for about as long as we have been lying.

Whether you get information from a human or an LLM, check it.

I worry about the people who insist on credible sources rather than checking information for themselves. I think 80% or more of them are trolling me, but there are some who genuinely do not apply the Scientific Method to check facts in their everyday life. I truly feel sorry for them.

0 comments

MajimasEyepatch1y ago

This is not true. Sure, humans can lie or get things wrong. But normal people will also admit when they don't know something. LLMs tend not to admit when they don't know something, and they use an authoritative voice that sounds like they know what they're talking about. To an untrained person, this can easily be misleading.

dylan6041y ago

> But normal people will also admit when they don't know something.

You'd like to think so, right? However, this isn't really a solid thesis. Decent people will admit when they don't know. Is that normal? I've worked with so many people that just do not fit that definition at all, to the point it just seems like that's the normal way to behave. Maybe I'm jaded grossly overweighting it, but it just seems I have been in way too many meets with too many arguments over something because someone refused to back down and admit their ignorance/arrogance wasted valuable time because of refusal to accept input from others.

threeseed1y ago

> However, this isn't really a solid thesis

Let's get 1000 random people in a surgery room and ask them to perform brain surgery.

You actually think that most of them will say "sure I know exactly how to do this".

Be serious.

lazide1y ago

Some people can admit when they’re wrong.

When was the last time Trump admitted he was wrong?

MajimasEyepatch1y ago

Nothing about Trump is normal.

lxgr1y ago

Even if that were true (I don't think it is): The more important distinction between humans and LLMs is accountability.

If a customer support agent gives you incorrect information, you can often hold the company liable for it (assuming you can prove it; I suppose there's a reason for why companies prefer certain support channels over others).

If an AI "lies" to you, you're largely on your own right now.

Majromax1y ago

Not necessarily. In Canada, a case in February (https://www.mccarthy.ca/en/insights/blogs/techlex/moffatt-v-...) held that Air Canada could be held responsible for incorrect information about a refund given to a customer by its chatbot.

Notwithstanding differences in jurisdiction, applying that idea to this case would rely on finding that Meta owed Gaudreau a duty of care that extended to the Meta AI chatbot.

It would be more difficult to make this claim if Gaudreau had asked the question of Google, since Google itself is not usually responsible for false information uncovered by its searches.

lxgr1y ago

That's going to be indeed an interesting question (also discussed in this sibling thread: https://news.ycombinator.com/item?id=40536860).

My gut feeling is that it should be possible for companies to distinguish an AI product (i.e. as something provided to customers like a search engine, as you say) from an AI "working for them", but I can see a lot more disclaimers showing up in Meta's various AI chat channels soon.

markhahn1y ago

did Meta present the AI as an official customer-service chatbot?

1 more reply

layer81y ago

Look at the screenshot in the article. If a human Facebook representative would give that response, would you not trust them? And if not, how would you apply the Scientific Method to fact-check it?

TuringTourist1y ago

It would be nice to have a confidence level for pieces of information, like humans have

Mawr1y ago

In theory. In practice, every piece of information you can get from a human has mountains of context around it which lets you gauge the reliability of the information.

A skilled motorcycle rider explaining how to take corners in a widely watched youtube video, with hundreds of comments confirming the advice and several recommended videos from other riders that basically say the same thing is an extremely strong positive signal.

The same answer gotten from a magic AI answer box is just as likely to be right as wrong, 50/50.

idle_zealot1y ago

Good luck checking every fact you encounter with the scientific method (and making sure to repeat your experiments to ensure reliability, oh and don't forget peer review to evaluate your methodology). What is your proposed scientific experiment to test... what Facebook's support number is?

My point is just that credible sources are absolutely necessary for information to disperse. Nobody can afford to figure out the modern world from first principles.

josephcsible1y ago

It's not about intentional deception. LLMs are very confidently incorrect way more often than humans are.

lxgr1y ago

Eh, I've had the questionable pleasure of talking to first level support call centers a couple of times recently, and I wouldn't be so sure about that.

The number of times I've been told that yes, resetting my iPhone's network settings and reinstalling an app will resolve my billing issue or similar...

j / k navigate · click thread line to collapse

0 comments

MajimasEyepatch1y ago

dylan6041y ago

> But normal people will also admit when they don't know something.

threeseed1y ago

> However, this isn't really a solid thesis

Let's get 1000 random people in a surgery room and ask them to perform brain surgery.

You actually think that most of them will say "sure I know exactly how to do this".

Be serious.

lazide1y ago

Some people can admit when they’re wrong.

When was the last time Trump admitted he was wrong?

MajimasEyepatch1y ago

Nothing about Trump is normal.

lxgr1y ago

Even if that were true (I don't think it is): The more important distinction between humans and LLMs is accountability.

If an AI "lies" to you, you're largely on your own right now.

Majromax1y ago

Notwithstanding differences in jurisdiction, applying that idea to this case would rely on finding that Meta owed Gaudreau a duty of care that extended to the Meta AI chatbot.

It would be more difficult to make this claim if Gaudreau had asked the question of Google, since Google itself is not usually responsible for false information uncovered by its searches.

lxgr1y ago

That's going to be indeed an interesting question (also discussed in this sibling thread: https://news.ycombinator.com/item?id=40536860).

markhahn1y ago

did Meta present the AI as an official customer-service chatbot?

1 more reply

layer81y ago

Look at the screenshot in the article. If a human Facebook representative would give that response, would you not trust them? And if not, how would you apply the Scientific Method to fact-check it?

TuringTourist1y ago

It would be nice to have a confidence level for pieces of information, like humans have

Mawr1y ago

In theory. In practice, every piece of information you can get from a human has mountains of context around it which lets you gauge the reliability of the information.

The same answer gotten from a magic AI answer box is just as likely to be right as wrong, 50/50.

idle_zealot1y ago

My point is just that credible sources are absolutely necessary for information to disperse. Nobody can afford to figure out the modern world from first principles.

josephcsible1y ago

It's not about intentional deception. LLMs are very confidently incorrect way more often than humans are.

lxgr1y ago

Eh, I've had the questionable pleasure of talking to first level support call centers a couple of times recently, and I wouldn't be so sure about that.

The number of times I've been told that yes, resetting my iPhone's network settings and reinstalling an app will resolve my billing issue or similar...

j / k navigate · click thread line to collapse