Just last week I was looking up how much of some chemical was required for toxic effects, and Google's AI response, sitting right at the top, gave me a number that was off by magnitudes. I ignored it and found a factual answer by corroborating multiple sources. That is the difference between life and death.

> DeepSeek recommended us to visit a place that was actually privately owned and couldn't be visited at all.

One time some friends of mine got the wrong address for a party. When they showed up, a man was sitting on his porch with a shotgun, and he shot at their car multiple times while they hurriedly backed out of his driveway. A wrong address can be deadly, especially in unknown territory.

And please understand, I have personally created prototype agentic booking systems with route planning, concierge integrations and more. I am very excited about this space but also extremely cautious knowing exactly where cutting LLMs are and aren't useful enough not only for trusting your business logic with them, but trusting the safety of your customers.