Giant radiators?
edit: fixed typo, derp. fusion=fission
Yup, that's the thing on top [1].
I also meant to write fission in my original question, not fusion.
Radiators though, are constantly used in spacecraft, and seem to work well. Low gravity, no motion might let the thing be mostly the radiator, with not much support structure. Except it might need to be in shade, in the shadow of a building? hill? solar panels?
I wonder if recycling human liquid waste through evaporation could be of some use for that purpose.
Are you thinking of radioisotope generators? Those aren't reactors. They use thermocouples and need to get rid of the waste heat. The Voyager RTGs have radiator fins.