The number of hospitalizations is somewhere around 10k a year. For ~1500 of those it's at least life threatening. ~100ish end up with organ failure or permanent neurological problems. ~10 of them die. That's every year.
That might be mildly dangerous compared to other hobbies, but if you isolate for actual practitioners of the hobby, suddenly those numbers look extremely dangerous.
Foraging for mushrooms is not dangerous if you know what you're doing and stick to easily identified mushrooms that aren't easily confused with poisonous varieties.
Also I said plants and mushrooms. Not specifically mushrooms. AAPCC doesn't track mushrooms separately and I would consider the CDC to not be the authority on poisoning -- their specialty is diseases.