How do you feel about allowing the import of goods from nations using slavery to create those goods? Would you be okay with a foreign nation undercutting domestic production as a strategy to destroy your industry to control a market?
That's aside from my position that most taxes should be at a point of trade/exchange.