I never switch modes unless I am switching tasks.
Desktop tasks (writing code, workign with office apps) all mouse/keyboard/trackpad
Consumption tasks (news, video) all use touch with keyboard folded out of the way
Drawing and taking notes I use the stylus.
I see this as having the right input mode available for each of my tasks, not some sort of "nightmare".