I agree completely. This is, in fact, the difference that I am pointing out. In the case of paid parking, most people would agree that the trade of money for a parking space on land which someone else ones and maintains at cost is a fair trade. Similarly, most people would agree that debt collection as a whole is a fair industry in that it seeks to make sure that those who owe money for value received pay that money owed.

My point is that–especially in the world of software–this general consensus does not exist for the patent industry, (that a large majority of everybody else is already convinced that it is time to change the rules,) and that this general dislike for the rules is the real source of the anger directed at patent trolls. This aligns with your earlier point about there being no difference between outsourced and in-house torture, in that I would say that people are just as upset about Microsoft's, Oracle's, and even Google's patent portfolios as they are about Intellectual ventures. The only difference between IV and those others is that they manage to win people over (or at least mollify) with the rest of their work.

Edit: I would say that seven_stones cutting straight to the morality of software patents in general pretty well illustrates my point here.