Property tax has a known problem of taxing improvement in addition to land, which constrict urban development. Plus, imposing additional property tax means improvements are further penalized, which means efficient land ownership are penalized.

You should look up Georgism and read up on what they have to say. It's a reaction to the 19th century economic condition but it very much apply to our 21st century situation and even more relevant today.