undefined | Better HN

0 pointsflangola72y ago0 comments

Unnecessary risk to everything and everyone else on the internet eventually.

AI will create perfect Sybil attacks. The reality dictates our need of a signal for humanness. To know an interaction is a real human and not an indistinguishable simulation of one. Picture if the internet was flooded with 100 trillion malign actors and trolls, each tireless, merciless, skilled at both social manipulation and cyber attacks, with no way to tell if they are real people or not. Even a live video call with them cannot be trusted, not even if they look and sound like someone you know.

We're not there yet, but how far out do you feel confidant in saying that will still be the case? Two years? Five?

0 comments

randmeerkat2y ago

> Unnecessary risk to everything and everyone else on the internet eventually. AI will create perfect Sybil attacks. The reality dictates our need of a signal for humanness. To know an interaction is a real human and not an indistinguishable simulation of one. Picture if the internet was flooded with 100 trillion malign actors and trolls, each tireless, merciless, skilled at both social manipulation and cyber attacks, with no way to tell if they are real people or not. Even a live video call with them cannot be trusted, not even if they look and sound like someone you know.

And secure boot on ESP32s is what will save us from this dystopian vision of the future..?

theamk2y ago

We are talking about things like light bulbs and weather sensors.

They do not pretend to be humans, and will never run AI on the device itself, so there is no concerns about social manipulation.

But there are concerns (and many, many examples) of devices that rely on vendor's cloud.. and the vendor goes out of business, making devices useless. If there is no secure boot, people can flash alternative firmware and make devices usable again. If everything is signed, the device has to go to landfill instead.

ianlevesque2y ago

It's unclear to me how locking down devices with signed firmware fits into that dystopia you are imagining, other than by making it impossible to fight back since you're not allowed to modify anything.

j / k navigate · click thread line to collapse