Some people like myself are very sensitive to some some vocal/audio oddities, while others seem insensitive to it.
The issue is for those sensitive, it literally creates the feeling sick and/or needing to escape or fight the situation (rage) despite rationally knowing there’s nothing wrong. See: misophonia
While sometimes the cause is unavoidable, reducing the avoidable ones is worthwhile, though I would agree that getting paranoid about it isn’t needed.
For those that encounter this in video/audio, a useful trick I’ve found is watching at a higher playback speed, which seems to mask many of the things that would drive me mad.