Yes and no. I’m working hard to keep people who act horribly out of my corner of the fediverse. I’ve never blocked someone for having different political opinions from my own, for example, but I’ve blocked plenty of people, even those who mostly share my opinions, because they were behaving like jerks. I’m doing nothing whatsoever to keep you from talking to them.
Hang out with anyone you want to, and I’ll do the same. And yes, my users are specifically OK with it. Our moderation actions are public, we put them to a vote when there’s some question about the right thing to do, and I’ve blogged a lot about the details of it all. Users tend to join and stay with my instance because they agree with my moderation actions, not in spite of them.