Such cases are the ones where I agree with age verification. In this case, he was already 19, so he had reached the age of maturity, but he's still a teen who needs some protection. Every AI should keep this in consideration.
Once there was a discussion here on HN where a user commented that everyone needed access to frontier models because they need them to be able to make important life decisions. In isolation that comment was just another facepalm moment in the life of online forums. When contrasted with this news piece, I dread to think what will become of us as a society where a segment takes instructions from an app as a way to guide them through life.
