Many rights that everybody enjoys were won by unions and applied to everybody.
You are generalising to all unions some hypothetical case.
Better job opportunities for a part of the population means that all employers need to improve conditions to compete for employees.