The logic of it is that the pursuant might shortly commit further crime and not-pursuing endangers others more than pursuing. Additionally, it might serve as a deterrent to crime if criminals know they will be pursued strenuously.
It's not a universally accepted line of reasoning, even in communities across the US. But it's also not one just made up of whole cloth, 'for nothing'.