Many thousands of people do it every year, and just a few experience pick pocketing or a vehicle smash and grab.
If you're smart, don't drive at night and don't go looking for trouble, there's no reason to think you'll have problems.
After driving the Pan-Am I drove right around Africa through 35 countries. Never had a single "bad" moment, never heard a single gunshot. I was in LA a couple of months ago, heard gunshots.