Because market data suggests that most people won't switch. They will buy book from "the new, hip writer X" or they won't buy at all.
Someone who intends to buy something by Malcolm Gladwell is unlikely to buy something from somebody else just because it's a little cheaper.
Amazon wants to maximize sales volume whereas the distributors and authors want to maximize profit. The two are often correlated, but not always.