I'll be the naysayer here. I very much disagree with this. A Visa is a Visa is a Visa. If you don't like it then don't take visa.
Charging me as the end user more money because I have a "Premium" card would be a very fast way for me to not shop with you.