The "as long as you don't hit anyone" part is going to be hard to guarantee, particularly if this is not just a one-shot event but a repetitive pattern of behavior.

Also, the fact that, if you are lucky enough not to hit anyone, and only cause property damage, and agree to pay for it, the government can't send you to jail in a sane society, does not mean the apartment owner can't take other actions. As, for example, telling everybody they know about your reckless behavior. In a sane society, people who act recklessly like this quickly find that they can't survive because no one will associate with them due to their widespread reputation for reckless behavior.

Unfortunately, we don't live in a sane society.

> What if I kidnap a sleeping baby, but they catch me before the baby awakens or the parents find out. No harm, no foul?

No, because kidnapping the baby is a crime because the baby is not yours, not because some government official thought that doing so "might harm" the baby. I thought we weren't discussing that category of crimes, but only the category where the government's justification for calling it a crime is that it "might harm" someone, even if there is no actual harm.