I usually run the image(s) through more than one converter then compare the results. They all have problems, but the parts they agree on are usually correct.

rarely happens to me using LLMs to transcribe pdfs

This must be some older/smaller model.