It's unlcear to me which of the two is considered "higher class".
I think Astoria is slightly wealthier than Harlem in recent history, but neither is known for for having a particularly moneyed population.
Today, I know more wealthy people in Harlem than in Astoria.