Integrations are not OAI's moat as those are primarily UX developments that are kept by Apple/MSFT. Right now, and if they want, they can change some lines of code to get up and running with another provider, like Anthropic or whatever.
Only moat OAI has right now is advanced audio mode / real-time audio API, plus arguably o1 and the new eval tools shown the other day as those are essentially vertical integrations.
And maybe, like you said, first-mover advantage. But is not that clear, as even Anthropic got ahead in the race for a while with Claude 3.5 Sonnet.