Exactly. Yes, cave diving is extremely dangerous. Deep diving also is dangerous. But there are dives, amazingly beautiful dives, that, while not devoid of risk, are very safe. Simple, shallow dives in the Caribbean, for example, where the benefit of the tank over snorkeling is just that you can stay down longer.
Diving is wonderful. Get certified (but you don't have to be for some dives).
I also sail. Also wonderful. Can be dangerous if you push the edge, but more likely embarrassing if you stay within your limits.