Gmail AI hallucinates, distorts email contents (opens in new tab)

(t-online.de)

31 pointsdisentanglement10mo ago8 comments

8 comments

ggm10mo ago

I smell class action. The first time smart mail hallucinates something like an appointment cancellation or flight changes which leads to a real world loss, across a big enough surface of users, lawyers are going to be circling.

If this causes corporate loss, it's even more likely. GSuite is behind a lot of things.

croes10mo ago

I bet they have disclaimer in the ToS

maxbond10mo ago

I didn't find one about generative AI, but I suppose this is it:

    To the extent allowed by applicable law:
    - Google is liable only for its breaches of these terms or applicable service-specific additional terms
    - Google isn’t liable for:
      - loss of profits, revenues, business opportunities, goodwill, or anticipated savings
      - indirect or consequential losses
      - punitive damages

https://policies.google.com/terms (this is titled "Google Terms of Service" & is presumably broader but is what I got by going to Gmail and clicking "Terms".)

The terms may be different for corporate users.

ggm10mo ago

Disclaimers are only as strong as the bank balance behind or defending the assault. Loss of custom typically follows a breakdown in trust as well. I suspect anyone seeking to fall back on ToS would find reasons to discuss matters round a table rather than test the strength at the bar.

I'm not a lawyer.

Incipient10mo ago

I don't expect these hallucinations would impact enough people to cause a material loss of custom,such that google would even notice, let alone care. If you're the person affected, you'll be on your own.

If it was widespread enough to cause loss of custom, they'd 'simply' fix the issue before it got to that point.

Eddy_Viscosity210mo ago

> Disclaimers are only as strong as the bank balance behind or defending the assault.

Googles bank balance is, ummmm, pretty good I think.

pixelbash10mo ago

Wouldn't that turn out to be a candle in a hurricane situation given the level of risk involved?

rvz10mo ago

So does "AI overviews".

I guarrantee you that you're now having to waste more time double checking even the sources hallucinated from these AI systems.

j / k navigate · click thread line to collapse

8 comments

ggm10mo ago

If this causes corporate loss, it's even more likely. GSuite is behind a lot of things.

croes10mo ago

I bet they have disclaimer in the ToS

maxbond10mo ago

I didn't find one about generative AI, but I suppose this is it:

    To the extent allowed by applicable law:
    - Google is liable only for its breaches of these terms or applicable service-specific additional terms
    - Google isn’t liable for:
      - loss of profits, revenues, business opportunities, goodwill, or anticipated savings
      - indirect or consequential losses
      - punitive damages

https://policies.google.com/terms (this is titled "Google Terms of Service" & is presumably broader but is what I got by going to Gmail and clicking "Terms".)

The terms may be different for corporate users.

ggm10mo ago

I'm not a lawyer.

Incipient10mo ago

If it was widespread enough to cause loss of custom, they'd 'simply' fix the issue before it got to that point.

Eddy_Viscosity210mo ago

> Disclaimers are only as strong as the bank balance behind or defending the assault.

Googles bank balance is, ummmm, pretty good I think.

pixelbash10mo ago

Wouldn't that turn out to be a candle in a hurricane situation given the level of risk involved?

rvz10mo ago

So does "AI overviews".

I guarrantee you that you're now having to waste more time double checking even the sources hallucinated from these AI systems.

j / k navigate · click thread line to collapse