There were apparently 454 non-traffic bicycle deaths in 2020[1], compared to 38,824 traffic deaths reported by NHTSA in 2020 [2]. I don't feel like bicycles are doing 1% of the trips in the US, even though they're more than 1% of the deaths. I feel like non-traffic death eliminates car vs bike deaths, but captures the basic idea that bicycles are more immediately risky.
All sorts of terrain issues that are minor for a car are dangerous for a bicycle, especially at higher speeds. Where I live, it's very hilly, so it's hard to go anywhere on a bike without hitting speeds of at least 25 mph at some point on the journey. Mechanical issues, unexpected objects in the road, or errors in piloting at that speed will result in an injury for sure.
[1] https://injuryfacts.nsc.org/home-and-community/safety-topics...
[2] https://www.nhtsa.gov/press-releases/2020-traffic-crash-data...