Everybody hates dorks who insist on talking about music labels or shoe brands to people who don't want to, but those types are pretty rare. Tech and gaming geeks are massively overrepresented here, and sports geeks to a lesser extent. When one guy goes on and on about his special interest to one or more people who are obviously not interested, but he doesn't get it, it's usually about technology, computer games, or sports.
Despite the massive popular appeal of celebrities and fashion, I've never been stuck in a one-on-one conversation with somebody who couldn't figure out that those topics bored me. I've been stranded in group conversations as the lone person who wasn't interested, but that's entirely different. People even figure out pretty quickly that I don't know anything about "Lost" despite how improbably that is. You have to give "normal" people credit for being much, much better than the average computer nerd when it comes to talking your ear off about stuff you don't care about.
(I guess there's another stereotypical dork: the middle-aged businessman who only know how to talk to other middle-aged businessmen, and who talks obsessively about cars, golf, or politics. I only encounter him at weddings, but you entrepreneurial types might run into him more often.)