If your tax issue isn't resolved and the AI has the final say, the problem is that the AI is the final authority, not that the AI isn't good for the (presumably vast majority of) people that it can help.

Same with the cancer diagnosis:

Both of these arguments are along the lines of the "seatbelts are bad because in 0.2% of accidents people get trapped in cars because of them."

This AI will dramatically improve outcomes for an overwhelming majority of people. Sure, we'll all think it sucks, just like we think phone queues suck now -- even though they are vastly superior to the previous system of sending paperwork back and forth, or scheduling a phone meeting for next Tuesday.