Historically, browser vendors maintain per site settings of some sort. Whether that be Opera's Site Specific Patching or Brave.
Basically have to keep giant lists of what js actually enhances the people experience vs just being useful to the publisher.