I don't think so, but life will be harder. Life is harder if you are born poor. I graduated from an unknown university (in the US) overseas, so I started in lower places and climbed my way up through hard work, study, luck and skill development (which include social skills). You are not destined to be inferior, but if the cards are not stacked in your favor, you will just have to make up for it somehow.
It's not sarcasm. I'm told that I'm lesser because I didn't get into any top schools or "deserve" the respect they get - clearly I'm doing worse than Ivy+ folks.