Currently, in video, we're chasing higher and higher output resolutions, and a 10x drop in pixel count isn't feasible. Once the sensors reach 10x the pixel count we need for output, then we can take the resolution hit for the focal effects.
1080p-capable light field capture seems possible now, but 4k light field capture might need a 300 MP sensor.