Ideological minorities don't get to make up "rights" and then demand the government defend them. The government has the obligation to defend free speech rights, even against the wishes of the majority, because there is ancient recognition of that right along with explicit adoption of a broad statement of that right in the Constitution.
But, there is no such thing when it comes to "privacy". See: http://law2.umkc.edu/faculty/projects/ftrials/conlaw/rightof... ("The U. S. Constitution contains no express right to privacy. The Bill of Rights, however, reflects the concern of James Madison and other framers for protecting specific aspects of privacy, such as the privacy of beliefs (1st Amendment), privacy of the home against demands that it be used to house soldiers (3rd Amendment), privacy of the person and possessions as against unreasonable searches (4th Amendment), and the 5th Amendment's privilege against self-incrimination, which provides protection for the privacy of personal information.")
There is nothing in the Constitution that says "you have a right to privacy", and it's really very difficult to extend one of the explicit provisions to get you to something that would prohibit the government's collection of information that you voluntarily put "out in the world" by giving it to entities like Google or Facebook, or information (like call records) that aren't even yours but rather information about you gathered by a private company. You have to resort to something worse than Griswald's "penumbras" to get from the 4th amendment, which concerns the sanctity of one's house and physical person, to such a broad privacy "right."
There's not even intellectual consensus on the issue. Academics disagree vigorously about the appropriate level of "privacy rights" and foreign liberal democracies often collect as much or more information than the U.S. does.