Typically invites are used by people who are inviting people they know, in which case it's advantageous for them to be able to find each other.
But you're right that there's an argument that it could work differently. We're planning to get rid of invites shortly, otherwise we might consider enhancements to the invite system to e.g. make this optional.
