You can use something like a shared binary repo such as maven or you could just check in dependencies and not worry about an external server being available for builds.
>Surely source control is for source code?
This is just pedantry. Checking in binaries is a pragmatic solution that solves a lot of problems.