Why do you hate chatting? I can understand if one of your neighbors is annoying, but my point is that if you weren't driving, you'd certainly know more than just the annoying one next door, and you almost certainly get a kick out of dogging him with the person on the other side of his house.
If not, hey, there's always one or two annoying neighbors, and if you can't find them, it's probably you.