If critical decisions affecting human life—such as hiring, lending, crime prediction, and welfare—are processed in an opaque black box, people will lose their fundamental right to explain their context or appeal against the machine's algorithmic verdicts
This is very on-point: capitalism-driven AI development as we have it today will always turn against the common good due to it's singular profit-motive.
What a time: the pope having a much clearer picture of the risks & dangers of 'AI' than most people, many 'tech leaders' and certainly most politicians.
Occam's Razor says this is Anthropic trying to build a regulatory moat by leveraging some halo effect.
Maybe Leo should focus on finding a way to disconnect western society from their current cult-of-progress delusions? Could be a better use of the infallible man's pulpit?
> 12: Today, the human desire for fullness of life is at risk of being misled by deceitful goals, such as the prospect of a technology that promises to free us from all weakness, and models of wellbeing that leave behind entire populations. All too often, we place our hope in unlimited 'upgrades,' in forms of progress that exacerbate inequalities, and in immediate solutions incapable of healing people's wounds.
> 94: The danger of humanity becoming a victim of its own achievements was already clearly recognized by Saint Paul VI, who warned that 'the most extraordinary scientific progress, the most astounding technical feats and the most amazing economic growth, unless accompanied by authentic moral and social progress, will in the long run go against man.' For this reason, technological progress — valuable in itself — requires careful discernment of the anthropological vision that guides it and the ends it pursues. If technological development advances without a corresponding ethical and social progress, the result may be an increase in means without a growth in humanity: 'having more' without 'being more.' In such a scenario, there is a risk that individuals will be evaluated principally according to the outcomes they produce.
> 112: More gravely, the pervasive technocratic paradigm in which we are immersed, and that is amplified by the digital revolution and AI, threatens to normalize an anti-human vision. In that vision, the fullness of life is equated with having more, reducing weakness, eliminating uncertainty and exerting total control. When efficiency becomes the ultimate measure of value, human beings are tempted to see themselves as a project to be optimized rather than as persons called to relationship and communion.
There's much more along these and related lines.
> Maybe Leo should focus on finding a way to disconnect western society from their current cult-of-progress delusions?
It's too weak of a rhetoric from the highest representative of the Catholic church to call for regulations, but the alternative is to call for a transition from capitalism itself. Nothing that grows inside economic doctrines that only value constant growth at all costs can be safely regulated, regulation being only a makeshift solution.
