A couple years ago, a quick charger (CHAdeMO, not Tesla's) cost about 50k. Not sure what kind of permits were required.
Can you build a gas station with 50k? How much is just the labor to bury the underground tank?
And that's a quick charger, which you would use mostly for trips. For most purposes you only need easily accessible power outlets (although the level 2 stations are far more convenient). Most cars are sitting in parking lots most of the time anyway.