The short of it is that lots of physical observables in nature are derivatives of things. So if the underlying thing contains a constant term, it goes away. Because it goes away, you are free to choose it however you like and still get the same observable result.

So the question then becomes how real you believe those underlying objects are. The linked article constructs a set up to challenge that.