If you want to avoid infrastructure complexity, I'd go for dedicated hosting most of the time. Most of my past clients have ended up paying for more hours on operations for AWS setups than for dedicated. AWS and similar tends to force a lot of ceremony, some of which is good, but a lot of which is unnecessary on dedicated setups or on premises setups.

But yes, if your costs per unit are that low, I've typically told clients it largely depends on what they're most comfortable with. Some then pick AWS and it's a perfectly good choice.

What I'm seeing though, is that a lot of people pick AWS without first pricing out the options, and then later end up with expensive migrations to get off it.