Obviously you use your device, and you can lock it with a password. You can use two factor authentication.
It's straightforward, really. You sound like identity has never been solved electronically.
If anything, holding a physical paper id document is far less secure than a personal device with your private keys in the Secure Enclave.