And many do. The right is enshrined in several of the amendments to the U.S. Constitution, as well as the Universal Declaration of Human Rights:
No one shall be subjected to arbitrary interference with his privacy, family, home or correspondence, nor to attacks upon his honor and reputation. Everyone has the right to the protection of the law against such interference or attacks.
https://www.un.org/en/universal-declaration-human-rights/
There is Warren and Brandeis, "The Right to Privacy", 1890, which specifically addresses the publication of private aspects of citizens' (and residents') lives:
* Recent inventions and business methods call attention to the next step which must be taken for the protection of the person, and for securing to the individual what Judge Cooley calls the right "to be let alone" [10] Instantaneous photographs and newspaper enterprise have invaded the sacred precincts of private and domestic life; and numerous mechanical devices threaten to make good the prediction that "what is whispered in the closet shall be proclaimed from the house-tops." For years there has been a feeling that the law must afford some remedy for the unauthorized circulation of portraits of private persons;[11] and the evil of invasion of privacy by the newspapers, long keenly felt, has been but recently discussed by an able writer.[12] The alleged facts of a somewhat notorious case brought before an inferior tribunal in New York a few months ago,[13] directly involved the consideration of the right of circulating portraits; and the question whether our law will recognize and protect the right to privacy in this and in other respects must soon come before our courts for consideration.*
https://en.m.wikipedia.org/wiki/The_Right_to_Privacy_(articl...
https://groups.csail.mit.edu/mac/classes/6.805/articles/priv...
The only possibly validity to your nit is that it might be applied to any subject of human discernment: some will differ.
Those differences are quite frequently exceedingly poorly founded.