Those people who bought his products, invested in his company or otherwise increased his wealth, thought that he deserves the money, as they got something valuable in exchange. I don't think the opinion of an unrelated party matters that much.