Sure, I would prefer that you not do that, or indeed that you not physically trespass in any way. A more interesting hypothetical would be for thousands of homeowners to install a bunch of IP cameras in their homes, and for you to hack those without the benefit of physical trespass. I don't think you'd have much of a leg to stand on if you were to publish John and Jane Doe's humdrum bedroom activities. However, you might also witness some truly awful shit, which I'd have no problem with your bringing to the attention of society.
The bank example is another aspect of our bending all rational rules and expectations in the banks' "favor". They shouldn't build such brittle systems, and the more we coddle them the worse they get. It would be possible to prosecute fraud without criminalizing security research.
Libel laws are most often used for the benefit of the already powerful, so yeah getting rid of those would be an improvement.