I totally used to think that too, but whenever I've asked people about our process they say - "sure when you're making an offer, make it contingent on references and do a bunch of them."
I never revoke an offer unless we find out something truly bad at reference stage. Everyone has their foibles, and it's just useful to have more information about how to work with them.