You're overlooking the fact that even if easily breedable pool of foreign species existed along H. sapiens, given enough time they would either be purged or become common ancestors to everyone by now.
Since they were purged and exist as remnants in individuals' DNA.
