>> I think mainly the ease of having security dealt with around who can access etc really. Ofc you can just upload files and serve them over http,
This is where S3 really shines. You can give developers access through group membership while servers using instance profiles. We have implemented a fine grained access control for the S3 repos that works really well. Of course you access the content via HTTPS.