I think that's a bit of cultural bias there. Imagine a society without personal property, like some small tribe. Wouldn't they see our property rights as artificial? Maybe their "true" property would be something we don't even recognize like their honor or wife or other things they don't want to share with each other.
I have a wheelbarrow in my yard that I'm not using. Why can't anyone else use it? There's no natural reason why they couldn't. It's just there, they can take it and wheel dirt around in it. I might no even know it's happening, but my property rights say they're not allowed to.
I think the main feature of property is to disallow others from using it in a way that restricts your own use. For IP, others selling copies would restrict your ability to sell copies as they undercut you.
I wonder how you feel about medical information being free to copy? That's not property either, is it? Are you happy with no moral rights for subjects of photographs and no rights to privacy of medical information? Should patients "own" their medical records or should hospitals be free to use them however they like?