The caste system has been enforced strictly enough to even have an imprint on the DNA:
https://www.thehindu.com/sci-tech/science/Caste-system-has-l...
In other words, casts differ from each other in ways that are similar to how Jews differ from other Europeans. And I would definitely label anti-Semitism as racism, even if it is usually difficult to identify a Jew by appearance.