So the nice thing about the current situation is that everybody is remote, so all the processes are remote-first, so remote people get included. After everybody except you go back to the office, the processes are likely to go back to personal-first with remote being an afterthought just because of you. This is where the situation starts going bad.
You go on a meeting and you can't see the slides because they failed to connect the PC to the online system and don't mind trying because "it's just you" who is missing it. Then some in-promptu meeting happens and you don't get to participate nor read the minutes. Then it's time to promote someone and the manager decides to promote someone else since they're easier to manage/coach/etc. You will have less influence over the team than everybody else. If that's ok with you, then it's fine.
Also, management changes (especially if/when your direct manager changes) may make remote working even harder.