People knee-jerk upvote just as much as they knee-jerk downvote and eliminating one half of the knee-jerks has nasty side effects.
Frequently downvoted reasons could be added to a blacklist that requires additional elucidation before being able to submit the downvote.
This has been an interesting thought experiment. I'd expect the results might besimilar to Robot9000: https://blog.xkcd.com/2008/01/14/robot9000-and-xkcd-signal-a...
Don't remember how well it worked.