I also agree with this, but I think there is a need to slow the replacement, by a bit, to reduce the short term societal harm and allow society to catch up. Robots can’t do the jobs if society collapses due to unrest.
Progress is great obviously, but progress as fast as possible with no care about the consequences is more motivated by money, not the common good.