Why? Because utility monopoly. Why? Because lawyers and lobbyists and clueless and corrupt politicians.
Any question?
Companies don't give you what you want because: 1) its expensive; 2) they can make higher returns with that money elsewhere. You can blame lawyers and lobbyists all you want, but the bare fact is that what Facebook paid for WhatsApp would pay for all the lobbying capacity of the top 10 DC lobbying firms for 60 years. That's a really weak argument to lean on when the interested tech players have so much money and lobbying is so cheap.
Just look at what Google is doing with Google Fiber. They're demanding massive regulatory concessions, and still don't seem to be positioning it as a money-making business. If building fiber was a good use of capital, why would internet companies sit on the sidelines and demand someone else do it?
The reason why is because companies have to work with local governments to get construction permits to build out the access network. There are huge barriers here that prevent individuals and small companies from actually getting that work done. One of those barriers is the fact that even local governments have problems with bribery and corruption (you don't say!).
Google Fiber is demanding those massive regulatory concessions because they must! They're asking governments to bend over backwards for them because they recognize how hard it is go get through the bureaucracy. That's why they put on this big campaign to get the people to talk to their local representatives and essentially beg to be saved from the monopolies.
Take for example, Google Fiber versus Sonic.net. Sonic's been trying to build out their fiber network for a long time. However, since they're small it's much more difficult for them to work with the local governments and as a result their fiber rollout has been slower despite consumer demands.
The regulatory hurdles that Google is demanding relief from are (largely) not the result of lobbying. They're the result of the dysfunction of municipal politics. Right now, NYC's mayor is attacking Verizon because poor people can't afford FIOS (at $75/month). He's hired a civil rights lawyer to get into the issue. Is it any wonder companies aren't interested in building fiber? Is this the result of lobbying (or corruption and bribes) or predictable political forces?
At bottom, none of the screeds on this subject address the simple fact: the internet companies aren't rushing to build fiber, or lobbying to get permission to build fiber, or publicly demanding deregulation so they can build fiber. They're trying to get Comcast, Verizon, etc, to build fiber. To this day, Google positions Google Fiber as an effort to shame the ISPs, not a worthwhile business venture standing alone. What does that tell you about the monetary incentives at play?
