Completely agree. I even had that situation myself - I misremembered how the mode switch/bluetooth pairing mode worked and was not able to connect my controller to a switch, thinking it was broken, until I realized what had happened. A small toggle switch really would be much easier.

Still think it's worth it, also to not destroy an original one. On the other hand, better to modify it like this than to throw it away of course...