Because most modeset protocols/implementations aren't atomic, so some frames are drawn halfway through setting the mode.
Turning off the screen can take a long time, but it is possible that putting up a "hot black" screen would be better than flicker if you had to do it.