How do you make that transition though? You don't just fire a bunch of people, cast them to the wind with some sort of hand-wavy explanation about how the "invisible hand" will sort everything out in magical fashion.
If you just cut all of those people loose, then you will have to deal with the fallout of a bunch of angry unemployed people, and their friends/family/etc. In addition to <opposing political party> using it as a "you don't love America" field day.
Honestly, screw those people. They profiteered off of human misery and enslavement and their actions directly and indirectly wrought chaos on communities worldwide.
I know it's a pipe dream, but personally I think anyone involved with imprisoning drug users / dealers should see the inside of a jail cell themselves.