If you never intend to sue over IP, then the contract should be an no-issue. All it does is to write down that specific aspect into an enforceable contract. Contract don't need to use men with guns if everyone choose to honor it, which was the historically method used back when people lived in tribes and villages made out of a handful houses. No one would dare to break their word, risking that others would start to do the same.