Nobody is telling an experienced heart surgeon to step aside and let a child plan an open heart surgery. And yet, AI and LLMs in particular are being sold as the tools that can do complex tasks like that. But let's leave complex tasks and have a look at marketing behind one of the tools that's aimed at business. The messaging of one of the ads I'm seeing promises that the tools in question can summarise a 150-page long document into a 5-slide presentation. Now, that sounds amazing, if we ignore the fact that a person who wrote a 150-page document has already prepared an outline and is perfectly capable of summarising each section of the document. Writing a 150-page document without a plan and not being able to organise would mean that people have evolved into content generators that need machines to help them write tables of contents and reformat them into a presentation. Coming back to your child analogy, why would a child be better at summarising content it knows nothing about that the person who wrote it?
we do get consultants coming into companies and telling the experienced professionals how to screw up stuff all the time though. i think there are laws with teeth and of course the immediate body to get rid of that helps surgeons maintain the integrity of their profession. when the outcome is far removed from the decision, you do get people like ministers meddling in things they don't understand and leave the consequences for the next administration.