That's a best case scenario. My experience is that it's more common for an LLM to confidently predict incorrect solutions to the problem, and then you wind up wasting time chasing down wild geese. At those times, it winds up being more of a hindrance than a help.
