And then there's the passport and any other important documentation. That stuff is pretty much always in either my carry-on or a jacket pocket (which is usually also in the overhead).

Yeah, keeping my cell on my person probably avoids 80%-90% of the annoyance, but you aren't getting through customs or security without a physical ID in most places.