A few simple examples of nations who have went through rather devastating wars and civil wars including Islamists who's main ideology is that anything pre-Islamic is to be destroyed as it might lead to heresy, and who go out of their way to destroy historical places and artifacts. And if not war, then the fact that the cultures of those areas traditionally dont value historical artifacts the same way the developped European, or Chinese influenced countries did in their times.
I am sorry but it is not defending colonization, it is a legitimate issue given that the middle east is stuck on an unresolved powder keg of issues, keeping the Pregammom in Britain instead of where it came from is a good thing.
Even during WW2 the UK, Germany and France set out programs to saveguard historical cultural treasures in protected areas.