Littering and running red lights causes problems for everyone in society. Copyright infringement... doesn't. It's mostly just a small dip in the expected profits of a monopolist.
If you litter on a street I'm not on, then it doesn't affect me.
If nobody will ever get paid for intellectual property again, then it will absolutely affect me. It's the end of a whole category of creation, and a huge net reduction.