It comes across as more egocentric than "I had difficulty understanding them," but it is often the case that away from the more international areas it can become really difficult to understand the locals, whether that is rural Eire, Picardy or West Virginia.
Sorry If I sounded that way. As it's clear I am not native and meant "I can unfortunately hear gibberish with my untrained ears", not "they don't know how to speak proper". It's my dumbness.