There is a lot of fraud that goes unpunished because the victims feel hopeless and embarrassed. As a result, it's a lot more attractive to defraud people.
A dumb investment might be dumb, it might be likely to be fraud. But if it turns out to actually be fraud, the victims should still be able to seek restitution or otherwise you are giving a free pass to commit fraud and creating a huge economic advantage for people willing to do it over people who aren't.