Congress is one power structure. States and cities are others. 19 states have recall procedures. The fed is much less powerful domestically without state-level support. And pulling down even a couple state reps would send a chilling message to the fed.

https://www.ncsl.org/elections-and-campaigns/recall-of-state...