... if and only if it is off. Which is probably not a great assumption with a phone.
A DIY mitigation might be to convert a phone to having only an external battery on a long cable, which stays in your other pocket.
Philosophically I do agree with where you're coming from with contemporary devices insisting on baking in privileged keys. It's unfortunate that we're forced to choose between the two models.