In my opinion, the art in these games is the beautiful intersection of a set of puzzle rules with the world they inhabit. In The Witness, the world is additionally constructed to be thematically interesting, and I think that the set pieces on the island are intrinsically connected to the puzzles next to them. The island by itself would not make for very interesting art: it’s the game element that brings the art to life.
Also, “pressing a button to reverse time” feels very reductive. By playing the game, the player learns, and this learning leads to understanding. Usually, this understanding is tied solely to the game world and is used to tackle new and more complex challenges in later areas, but maybe it can also lead to extra-game insight. Even a tiny game like Passage makes powerful gestures in this direction.