The level of confidence both sides give here is not warranted. We have no idea about what internal structures emerged within LLMs. We only know outer behavior.

From a humanist / secular perspective, humans evolved to make babies. Emotions are an emergent behavior to maximize the number of babies made, and their survival. Nothing less, and nothing more.

What analogues emerge when we train machines not to survive but to complete text?

We have no idea.

There's the "ghost in the machine" crowd, the sentient machine crowd, and the mechanical machine crowd. None have presented any compelling evidence, but all speak with complete confidence in their hypotheses.