I imagine my mom (who isn't super familiar with uber/etc.) getting really concerned that what the app says doesn't match what's happening in real life.
Imagine you're sitting outside, looking confused and waiting for your food to be delivered. Someone from a car asks you to approach their car, without providing any context of delivery/my name/etc. I've had this exact interaction many times, and I could imagine someone feeling unsafe in that kind of situation.