Population size is usually included in those calculations. It’s typically GDP per capita.
But I couldn’t agree more that the inequality and social safety net (or lack thereof) make the numbers deeply disconnected from QoL. Which I believe is the whole point.