Yeah, it used to be possible, but hasn't been for a long time. There are some old stackoverflow posts with `defaults write` commands in them, but they don't work anymore.
I used to be a fairly heavy spaces user with 60Hz macbooks; the delay was too high, but just low enough to not drive me completely insane. But after I got one of the new 120Hz ones, I've almost entirely stopped using spaces, since I just can't stand the extremely long wait where my keyboard inputs still go to the application I'm coming from.