Super interesting point that struck a chord with me. Without the risk of rejection, the ai will come off as a sycophantic ass kissing yes-man. It might be seductive at first but will get old fast for most people, I would imagine.
What would be really interesting is how much longer the relationship would last if it were formed on a social media site or forum where there is still some risk of rejection, and validation from others still has the feel of being earned.
Today there are LLM roleplay models than can behave like some character with a specific personality (e.g. a tsundere). So if you want a electronic partner that sometimes puts you in your place you can have it.
And this is with the current roleplay models, sincerely I'm a little scared with what would be available in 5 years.
Yes, but if you know the model is instructed to behave a certain way you are still not actually earning its regard. It is just trying to make you feel less lonely via some convoluted pathway.
