First I ever heard of his political views was when he ran for President.
If he'd been open and up-front about those views, I'm sure they would have been opposed, had anyone bothered to take him seriously. Though more likely he would have just been written off as some rich crank, much as he was at the start of his campaign.
The serious political opposition to him really mounted as his chances at getting political power increased. That, combined with people starting to realize what he and his biggest fans (Neo-Nazis and other white nationalists) stood for was why he's been called a racist now as opposed to when he was just another business man with his politics in the closet.