The perception does not matter in as much as it is actually aligned with reality. Which I suspect it actually is if you're not one of the initially rich.
Few can produce ground-breaking ideas or are lucky enough to actually earn a million dollars quickly (as opposed to stealing it).