References are stupid to rely on. Opinions are just... Opinions. If a shop was asking around for what is essentially gossip about me I would run for the hills.
Some real problems relying on references that aren't really fixable too:
#1 good luck getting references from anyone they weren't friends with. If you "find your own" you're a special kind of evil if they're still employed. You could make someone lose their job without even making an offer. It's lose-lose
#2 It's so easy to fake references that the people you don't want will have you talking to "the king of timbuktu". The best references will come from the biggest liars