Edit: any downvoters care to elaborate?
The normal orientation is fine for most people who want things to be as simple as possible (ie, most Mac users). There is very little reason to ever turn it off. If you still do that frequently for some reason, just leave it in a locatino where the button is still easy to access.