You're taking a much more narrow view of this discussion than I am. When I say IP rights I'm not talking about copyright specifically (which does not just cover creating copies, but also performances, adaptations, and distribution) but rather about the broad class of property rights to intangible "ideas". Trademarks, patents and the like are usually, and in my argument specifically, also included under that umbrella.

Even if we limit our area of consideration to just Copyright, you're just wrong. As the world currently stands, you probably get your music from a streaming service. That streaming service doesn't grant you the right to copy, perform, or adapt the music you listen to, they extend you a limited license. If you are in violation of that license, they likely reserve the right to terminate your access to the music. If that license said you weren't allowed to be upside down then standing on your head would allow them to prevent you listening. It does not matter that Copyright doesn't explicitly mention "listening to music while upside down" because your use is not mediated by copyright, but by the contract you signed.

Copyright does not govern how those individual contracts are formulated. We have Freedom of Contract in most of the western world. It provides a framework by which that contract even makes sense (they have property you even care to license with a contract), and a remedies should you violate it.