I think people should be able to live without internet, if that's what they choose. Just as people can live without a TV. There's tons of reasons why someone might not have internet (permanently or temporarily) ranging from financials to personal choice.
And it's not about "illiteracy" as far as I'm concerned, it's about wanting to talk to an actual human being, which is becoming harder and harder. My bank card doesn't work. No idea why. I went to the office: they told me they can't help me and to ring a number. I've rung that number a bunch of times: no one answers. I guess they're busy... I have a workaround by being able to transfer money to a friend's bank account (at the in-store kiosk, because internet banking also doesn't work) and withdrawing it from that, but pff...
And yes, I'll change banks when I can, but I'm not sure it really better anywhere else. Overall, adding more tech to these kind of things tends to make it worse once you're outside of the standard happy path. I also wasn't able to get one of those "COVID passport" thingies a few years ago: I moved back to my home country to get the vaccine, but then I wasn't registered correctly, so couldn't use the app, in spite of having the proof that I got when I got the shot. I was a teeny bit outside the "happy path" and ... sucks to be you.
There's tons of exceptional situations; someone might lose their phone and lose access to their bank account that way, and they may not have the money to buy a new phone right that minute. Simple fool-proof backup solutions are needed unless you're okay with excluding a lot of people (often people already in less-than-ideal circumstances – i.e. not the people typically posting here).