What's made this a bit more tolerable for me is to set the source's (Apple TV, but it does the same thing) frame rate, HDR mode etc. to the one most likely to be used by the majority of the content you're planning to watch.
But I'd take a few seconds of renegotiation over frame rate juddering any day, at least for film content (maybe not so much for shorter Youtube clips).