The issue with the word is that implies something that if left unchecked will cause disaster. So 100k people per year have left, and yet "California’s population still grew by about 2 million over this period". I really don't see the problem.
But in areas that do have negative growth, more people leave the tax base gets lower, the government has less funding to address issues that cause people to leave, move people leave, etc.
