If you want to go out with friend A but don't want friend B to see it for whatever reason (maybe B has a feud with A), then that is a thing between B and A, but not you.
I think the whole point of the OP comment is to just go with it. If you don't flauntingly advertise it, it is not your fault.
But in a very social media centric world, even if you are just a participant in a picture can feel like "flaunting it" to 3rd parties.