No, it doesn't. Legislative jurisdiction over the territory itself includes the ability to build the city.
> You're comparing a power that's mentioned twice in the Constitution
The phrase is mentioned twice, but neither is a grant of power (one is a statement of the overall purpose of the Constitution, the other is expressly a limitation on the scope of another grant of power.)
There is no mention of "common defense" as a power anywhere in the Constitution.