Edit: Here we go[1]. So a patent holder can lose their ability to collect damages if they notify an infringer of their infringement but then fail to take action against that particular infringer within a certain period. There's no damage to the patent merely because of selective (or absence of) enforcement.
[1] http://www.lawabel.com/patent-damages-laches-and-equitable-e...