No. But the source is useful for other purposes than compiling , especially with original comments.
For rarer games, and those shipped on DRMed/copy protected media, it's certainly possible to get into a situation at risk of losing all known copies of the binaries!
