You wrote:
> A few things that's happened to me as a citizen after invoking right to remain silent to CBP
What happened that caused you to “invoke your right to remain silent”? When you enter a country, including the US, you are asked some pretty standard questions that would be weird to refuse to answer.
What question did you not want to answer?