You seem to assume that the temperature will slowly increase, giving us time to adapt, without descending into another global war due to all the shufling of agricultural areas and mass migrations.
But there's a scarier scenario, where temperatures change much more rapidly due to a positive feedback loop: https://en.wikipedia.org/wiki/Runaway_climate_change