You could at least disable Active Desktop to dethrottle your PC. Meanwhile, my work W11 PC has a second+ delay for explorer right click and there's nothing I can do about it.
You can actually restore the old right-click menu on W11 with some regedit.
Not ideal in any way, and a setting would have been a much better way to toggle this, but it is an option.
I've found that ( at least for me ) that was caused by some entries doing some checks before showing up. Getting a context menu editor and removing some of them can help.