As much of a fan of SpaceX's vision as I am, the only ballistic point to point passengers I can envisage any time soon would be military operatives in a dire emergency.
I just can't see the likelihood of ballistic weapo..er.. projecti..er.. vehicles being allowed anywhere near major population centres, by tens of decamiles, therefore mooting the purpose of such extreme point to point passenger journeys.
Never mind the sonic booms and general noise. Even having regular scheduled passenger landings on water seems ... not entirely environmentally friendly.