Answering the phone is often not the person's primary job; it may even be a distraction.
Even if a person's job is entirely replaced by a machine, the historical economic impact of automation has not been a reduction in employment nor an increase in inequality as the luddites feared.