The way that browsers typically handle this though is that your interaction isn't blocked by the prompt. There's a default state ('disallow'), the website can ask you for permission, and you can choose to either:

  1. Allow  
  2. Deny  
  3. Do nothing at all

The website then must take all three into consideration so your experience isn't ruined as a result of a blocking-state.

I agree that the permissions system isn't ideal, and I would hope that the way we handle this interchange in the future can improve to a point where it's less invasive in terms of screen space. But at least for now, it shouldn't invade your ability to continue using the site.