I wonder if it's not in fact that he only has as much power as you yourself give him. Then pretending that he has no power, actually makes it so that he does not have any power over you.
"They can tell you what to do, and how to do it. And if you don't, they can fire you. And when you have no job, you have problems eating, a place to stay, and a much harder time getting jobs."