Scanning a QR code or creating a secure connection between the clients to exchange the keys isn't that hard.
You're trading convenience for increased security.