Passwordless is MFA -- something you are and something you have.
I'm not a yubikey expert, but I don't believe that losing your Yubikey will open up your company to a breach.
For a typical passwordless solution, losing your phone isn't a risk, given that no one can reproduce your face or thumbprint.