I take it personally which I know I shouldn't. I think others are the same. You can tell when people say "Why was I downvoted?!".

Everyone wants peer approval. Also you get the same feeling you get when you are being denigrated by someone who doesn't have the backbone to come out and say who they are. I say you get the feeling, not that it is true.