As the help text explains, you can tap to select or unselect any permissions beyond the basics. (Which are admittedly still quite broad.)

You can also use a PAT but that's already too much friction for me for something like this.