The best argument I have been able to come up with is that whilst it could be the perfect energy source humans are fundamentally incapable of designing or operating nuclear plants perfectly. You end up with designs that are tightly coupled and massively complicated, which is always risky from an engineering perspective. To make them safe you have to spend huge amounts of money on staff to maintain and operate.
Fukushima was designed and run by highly trained people but it still went wrong. Several stations in the UK were designed by brilliant scientists and still needed flood defenses built in response to Fukushima. There is a real threat and it is entirely due to the normal fallibility of humans. I personally think that nuclear is a necessary choice, but it is hardly a good choice. We need a new generation of generators that are very small, needs minimal maintenance, and have negligible risk even if they are completely destroyed.