Am I to believe that the poor all sowed the clothes on their backs from sheep that they raised themselves?

At some point even if that is true, they have some responsibility. Unless they were born on a desert island.