If you remove things from the instruction set, any code that uses them will either crash or run very slowly in emulation.
Most uses of special instructions will check feature bits or CPU version, but not all will do so correctly.
(I'd say that the additional area cost of something like this is small, and the big cost of special instructions is reserving opcodes and feature bits)