Setting aside empathy, giving some thought about how we can slow the rate of change and/or cushion the fall for those affected is also in our self-interest.

As the number of people who have little left to lose grows, it destabilizes society and sets the stage for populism and revolution. Are cheap goods really so important that we're willing to leave our children to deal with another round of communism vs fascism?

Nevermind that there does not have to be any cross purposes in those two sides! We don't have to get our clogs out and beat up the AI machines, we just have to "take care of" the people who's jobs the AI machines made redundant!

Adequate social welfare and safety nets, significant opportunities to retrain in new (and otherwise expensive) fields, funding for re-homing people and entire towns that have been made redundant.

And also a willingness to agree that "tech advancement" isn't morally neutral by default.