No.
I am not advocating violence against him. I am not trying to get him thrown out of his home.
The thing is, DHH can really easily stop being racist. Then people won't complain when he's invited to speak.
But the people he is complaining about cannot change their skin colour. They cannot change their nationality (according to him).
The people DHH support are advocating violence. They aren't asking politely for people to leave - they are threatening.
DHH is welcome to tell people not to come to my conferences. People can make up their own mind whether to listen to his opinion (or mine).