This one has always confused me as well. Tapping the screen, as the other commenter suggested, dismisses the whole thing too, so I have to fish for the stop button in the notifications every time.
Maybe there’s “the Apple way” that we’ve yet to discover.