Most credit unions participate in the credit union shared branching network, so I recommend joining your local credit union of choice. You can then go into the branches of several other credit unions to do most banking needs.

The caveat is if there's a major problem, like here, then you'd need to deal directly with your home credit union.