Why can't you just have a generic face and a series of mutations for each of the reactions, and then average among the mutations?

It wouldn't really work, but it might be one of those features that drives more engagement because it's "unintentionally" funny.