I came to the conclusion that this was THE issue holding VR productivity (and gaming) back, after a few weeks of using the Quest 2. The passthrough feature they have is like a v0.1 of what's that's really needed for this tech to excel. Haptic gloves look like they might nudge things along a little bit more, but ultimately being able to see your actual keyboard and mouse projected into the environment is essential if you're going to come off the controllers and start using high-productivity inputs.
What would really be needed for this is a digital twin of your input devices, and some kind of simple tracker you can physically attach to them so that the VR headset can overlay into VR like it does with the handsets.