As I always say, "If you are building a startup, over-engineering is a far bigger sin than creating technical debt."
Of course, each of those pieces is at risk of becoming over engineered. But hopefully the team has a leader that knows when to move forward and when to pull back.
And CI doesn't immediately have to include everything you'll eventually want; just having automated build and deploy will make your life a lot easier. Add some automated testing as soon as you can afford to (which hopefully is right away, because it's not that hard to set up), and you're ready to move.
Tired memes can be tired because they're true.
I have seen my share of startups where a platform plagued with technical debt was the main limitation for growth, which is a very avoidable situation.