The longer this website is around, the more people there will be with enough karma to be able to downvote in the first place. Perhaps that explains the shift you've seen?
If so then perhaps the weighing of upvotes/downvotes should be adjusted to reflect that change in voting power?
