IDK about shouldn't. Public photography not being a crime comes from a time where one could still be generally expected to remain anonymous despite being photographed. Just like how you can be seen by strangers in the street while walking and still remain anonymous. Yet stalking is a crime, and facial recognition seems to be the digital equivalent. Facial recognition is something that can be done at any point by someone with your picture in their hand.
This feels kind of like the way you could avoid having extensive traffic laws & control systems in 1905 when only a few people had cars.
It would also completely kill any form of street photography, even if you don't appreciate the art it would kill documenting times and places for posterity, for what benefit exactly?
In this case, I think it would be interesting to think about the most concerning area: linking a person in a photo to their real-world identity. It seems like there could be restrictions on how face-recognition databases are built and accessed, possibly incorporating intent to harass or intimidate as an aggravating factor, and possibly linking across time and place. If I take a picture of some guys playing basketball or chess as I walk around town, I don’t need to identify them in my art exhibit entry and I certainly don’t need to link one of them to a different time and place without their permission.
The laws regardless this almost always make a distinction between intentionally surveillance and by chance background noise. Taking a picture of the street with people on it doesn't matter, recording the street 24/7 probably does, and purposefully singling someone out and photographing them definitely matters.
We already kind of have this. Think about it - stalking is illegal, but you've walked behind people right? You've glanced into someone's window before, right? You've taken a picture of a random person before, right?
So why aren't you in jail? Because laws aren't algorithms
I actually don't find it hard to sacrifice the recreational photography of strangers, but I do have a hard time balancing it with the need to photograph crime and government entities overstepping their authorities.
I don't have a good answer for it all.
We would not only lose an art form but also the recording of the past, a candid photo of today has a lot more value in 50-100 years, rather absurd to lose this. It wouldn't even guarantee anything, bad actors would continue to do so covertly.
I find it pretty hard to sacrifice it, it's a freedom, making society at large less free to fight tyranny doesn't seem the way to solve anything, e.g.: EU Chat Control bullshit.
I don't have a good answer either but I lean on the camp of seeking solutions that are smarter than a sledgehammer.