“they are either on or off”
This is not true about neither nuclear nor coal.
Nuclear reaction can be slowed down, coal furnace can be used with lower amount of coal at lower temperature.
Nuclear does not need to be turned on or off spontaneously. Nuclear power plant can increase or decrease power smoothly, and that’s practically enough because consumption patterns are easily predicted.
The inflexibility you are describing is nonissue.
High capital cost is. But the largest issue is irrational fears of voters.
Edit: nuclear or coal are not on or off