It’s more complex than that- initial drafts of the declaration of independence were more explicit about literally covering all people, and even had a rant about how slavery was unethical, and they compromised by cutting these in order to get enough consensus to make it happen at all. Thomas Jefferson himself was a hypocrite- he wrote a lot about how slavery was wrong and should be ended, all the while owning slaves himself.
Anyways, I think it’s perfectly reasonable to nowadays take that philosophy and apply it universally. Just because it was done unfairly and hypocritically in the past is no excuse for us to also be hypocrites nowadays.
