The pattern still needs to be different at each sampling, yes. Moving the grating is one way to do it, or it can be done with a micromirror array, for example.
Gotcha cheers! A while ago I saw a single mirror MEMS device, could be useful for something like this, I believe you could control the horizontal/vertical angle.
