> and then only people using shitty ISPs that don't respect the TTL will ever see extra latency.
In my experience running large websites, that's about 10% of the internet, if not more.
When I made a DNS change, only about 70% of the traffic dropped off in the TTL. The rest took anywhere between a few hours and a few weeks (and some never dropped off, we had to just let them fail after a while).