The idea that LLMs like GPT-4 are glorified stochastic parrots who are merely predicting the next word has been thoroughly debunked, almost no one in the field believes that anymore. Whats been proven so far is they actually understand your questions and their responses. Its also proven that they have some level of reasoning capabilities.

I highly recommend using it. Think of it as a Google replacement. Every engineer out there uses Google. Instead of spending hours on Google, you can spend a minute or two doing something new with the help of an LLM. They can be wrong, which is why they are better used in the hands of Senior Engineers.