I've been using Brodit/ProClip USA mounts to solve this. They sell holders designed specifically for your model of phone which attaches to a custom-fit mount for your car's make and model. It's pricy, at about $75 for a holder-mount combo, when cheap Amazon alternatives are closer to $10, but it overcomes a lot of the problems you list. I use it regularly for navigation, since my car doesn't support CarPlay or Android Auto.