I work on this type of stuff thing at a major payments company and I can say this is _not_ true. For refunds, almost all of the interchange fee is returned. Sometimes even more than the original interchange fee is returned (don't ask why).
Caveat here is that the card networks' rules are ridiculously byzantine and making blanket statements is usually a bad idea.