If you work remotely, there is a good chance you will be left out. Of course, "interaction" can be done remotely. But many other things cannot. Showing your face every now and then around other people is quite important. Somebody is organising a seminar? Somebody is organising a conference? Somebody is looking for someone to teach a couple of their lessons? If you are the person that never shows up, you will be the person who won't get asked, simply because you have no connection to other people. Who am I going to ask if I want to organise something? The person I have never seen and who I know nothing about, or the person I've met, where I can gauge what they are working on, whether I get along with them, what they are interested in and what their plans and goals are?
"Disclaimer": I'm not in STEM