The problem isn't you choosing to engage with everybody. It's
everybody else choosing to engage with you and those you want to engage with.
If every discussion on HN was derailed by bad actors, you'd go somewhere else. If there was nowhere else moderated to go to, you'd probably just stop engaging altogether.