There is no assumption that you can’t trade on knowledge unavailable to the rest of the market just not information that should be available to other shareholders but isn’t.
It’s not about a working market it’s about preventing you from stealing from other people.
Lots of economists think insider trading should be legal, precisely because it would make the market more transparent, not less.