You just need the recipient's public key to encrypt. Are you thinking about the sender adding a cryptographic signature, too?
> The recipient decrypts the message with the the sender's pub key and the recipient's priv key.
You don't need the sender's public key, just the recipient's private key to decrypt. Though, if there's also a cryptographic signature from the sender, then you would need the sender's public key to verify the signature.