I agree that Nginx would be sufficient.
However, configuring S3 + CloudFront really isn't that much effort (I'd argue it's even simpler than Nginx).
It's not that expensive either! : ) It would probably even be within the free tier if I'm not mistaken.