> This means anyone still using a popular browser like Chrome can visit your sites
I think this would be seen as more of a drawback than a feature. If you're trying to build a tight-knit little hobbyist community, random people popping in and complaining that "these pages are boring, where are all the images?!" isn't helpful.
Given that there are microblogging (gemini://station.martinrue.com/), reddit with optional git connection to allow for issue tracking (gemini://geminispace.org/), it seems you're wrong.