It's called dog-whistle politics. It's subtle, so you have to listen hard, but here it is: "To the people who are used to influencing our choice of leaders, ..." and he goes on to describe "wealthy" and "successful" types of people. Basically he's talking "to" and "about" people like himself, namely, white men. The man is a bigot, and like all modern bigots, he hides (and shows) his bigotry in coded language like this.

edit: just to clarify, "people who are used to influencing our choice of leaders", I am interpreting in the context of voting rights in the United States, which of course were originally denied to everyone but white men. So those are the ones who are "used to it."