Upping the listening speed is the only cure I know of. Quite a few podcasters can be listened to exclusively at up to 2x the normal speed without significant impairment to their content.
Of course, some others talk so quickly that 1x is the best you can do.