Oh I know, I know. The problem comes from imbuing text with qualia. A printer that prints out text that says its in pain isn't actually in pain.

If we buy panpsychism, the best we could aim for is destruction of the printer counts as pain, not the arrangement of ink on a page.

When it comes to LLMs, you're actually trying to argue something different, something more like dualism or idealism, because the computing substrate doesn't matter to the output.

But once you go there, you have to argue that doing arithmetic may cause pain.

Hence my post.