Most of his actions are, to the majority of the population, merely transient actions. A few letters on an arts center are trivial to remove, a cancelled wind turbine farm easy to forget. The CECOT stuff deeply impacts only a small part of the population, so it'll at most be a few lines in a history book.
But demolishing a third of the White House? That'll be clearly visible in every single aerial shot of the building during every single political event for years. It is, quite literally, a scar on the political face of the country.
It's like turning the Pentagon into a Square, or blowing Washington's face off Mount Rushmore, or selling Alaska back to Russia: you're not going to forget when you are constantly being reminded of it.