Look up shipworm, which historically took out many ships. Plenty of stuff eats wood quickly enough to cause issues. We have just evolved countermeasures. And trees are the product of a billion years of anti-predator evolution. Plastic is different than wood. It is homogenous and dead. Something like a plastic-eating bacteria might move through it exponentially.