The government almost never does the work on an infrastructure project, but the high price of infrastructure have much less to with the fact that the government is paying the bill than with the regulations that any project public or private has to work within.
If we stopped eminent domain though, property purchase prices probably would become a significant portion of the total expense.