I always thought it was the loss of perceived control
A little bit idiotic, if you ask me, as people can and do little in the office too if they are so inclined but there you go