Constitutionally, no, the right referenced by that phrase in, e.g., the Miranda warnings is the 5th Amendment right against self-incrimination (“No person... shall be compelled in any criminal case to be a witness against himself”).
The belief that a more general “right to remain silent” exists may be a moral belief of some people, but, it is not a legal right, and judges can and will conduct questioning to assess if the legal right applies.
You can’t just say you are invoking the 5th and refuse to testify. If pressed, you actually have to get up there and invoke it — possibly to every question if needed.
The fear of perjury is an interesting twist, though. And the removal of immunity may affect things too.
(Although in your own trial you have the right to not testify, that doesn’t apply here).
Its a nice try, but the right not to testify against yourself is not a right not to testify in a situation in which you might be tempted to choose (perjury not being a crime you can connit accidentally) to commit a crime.
They might as well abolish this right anyway. As if every device we ever touch won't testify against us in the first place.