We learn by example. What this tool teaches is that self-confidence is more important than content. And maybe it is! in life in general. But not in the pursuit of knowledge.
Instead of patronizing users by adding a stupid sentence at the end of each answer reminding them to be careful, it could say every time "I'm just a machine and what I say is random; if it's true it's by accident; it's mostly probably wrong and only sounds like the truth".
Here's an example I posted in another thread, where the machine is repeatedly mistaken but affirms it absolutely, positively can't make a mistake:
https://news.ycombinator.com/item?id=33852236
