This is a good point. I've been very impressed with how well Nuxt works for static builds:
https://nuxtjs.org/blog/going-full-static.
I think for a startup with the liberty to choose a new tech stack, Nuxt.js is a great choice. It allows you to start with simple S3 bucket hosting, and move up to Vercel/Docker on ECS/etc. as you grow.
Hugo is a fantastic choice for blogs, but not for much else.