You could make a very good case that drone strikes on American citizens in foreign lands that are a part of jihadist groups without due process are unconstitutional. And yet, it happens. According to the standard Roberts puts in place, things that are on the extreme periphery of the duties of the Presidency are exempt from criminal prosecution. Does this mean drone strikes? Almost certainly. The President has an enumerated power to command the armed forces.
I fail to see why throwing all of the living Presidents in prison is a problem, particularly if they receive a day in court before getting thrown in prison. What this ruling does is create a class of American that can do some genuinely awful things and not be subject to legal process at all. There is no process, due or otherwise. The person gets to live their life as before.
Trump's being tried because the things he did weren't small potatoes. Trying to overthrow the electoral process unilaterally is a state fair record-setting potato. It's a far more immediate and widespread risk to American life and liberty than the drone strikes on foreign land that I mentioned earlier. One impacts a few dozen Americans globally at most; the other impacts literally all of them.