Which is why the license is the only thing that matters. Without the license you don't have the community. It will happen with some code, it won't happen to other code. Without the license, or without the code, it never happens.

The only thing you need to do as an open source software developer is release your code under an open source license. You don't need to respond to or even maintain an issue tracker, you don't need to accept MRs into your upstream, you don't need to care about anyone else using your code.

Open source places no other obligations on a developer other than the license. To say otherwise is to fundamentally misunderstand what open source is.