I would even say that if you're not frequently getting downvoted with no comments, then your comments are harmfully not enough contrarian.
If only there could be a webextension that would act as a meta recommender-system for HN comments that would highlight such sufficiently contrarian authors then I could quickly, heuristically read those more than average, valuable comments.
Being on the bottom is an aggregate that factor in the recency of the comment, isn't it? Moreover ideally only a subset of comments would be highlighted (e.g not the ones downvoted too much) and would benefit from making stats from the user comments history in order to increase the signal to noise ratio
