undefined | Better HN

0 pointshnfong1y ago0 comments

I really want to say you're right, but I'm afraid it's not necessarily true.

Before we had computers and machines, humans did all the work.

And you can't really reliably "code" humans. They misunderstand instructions. They disobey rules and regulations. They make mistakes.

But society still strived with these unreliable humans that have no "proof" whatsoever that they'll do the job properly.

In fact, these days we still often trust humans more than code, at least in areas where the stakes are high. For example, we trust human surgeons over programs that perform surgery. We trust humans to run the government rather than programs.

It's entirely plausible that future generations growing up with AI don't see the point of requiring "proof" of correctness when deploying automation. If an AI model does the job correctly for 99.99% the cases, isn't that sufficient "proof"? That's better than a human for sure.

Yeah that sounds dystopian but I don't see why it can't happen.

0 comments

andyferris1y ago

Interesting.

I think we’ll always have code that will need to be “formal” and deterministic. Banks, voting machines, cryptography, pacemakers, rockets, etc may all need the kind of “precise” software we have today. Precise software for precise machines.

I’m now wondering if there may be a new category of programs, that are more wishy-washy yet useful in the kind of way an LLM can be today. Computer games aren’t really mission critical, for example, and I imagine we’ll see deep learning models and LLMs embedded one day. I could imagine a kid generating game logic, maps, content, etc through a more intuitive and less formal interface. I already get ChatGPT to help me cook dinner or any other number of less precise tasks. Who knows what other new kinds of automation may be this way - to produce something “good enough” like a person would.

j / k navigate · click thread line to collapse