You are correct. exa uses libgit2 for its Git column, and the library's networking parts must still be included when they aren't even being used anyway.
I can see how it looks VERY SUSPICIOUS for a file lister to be parsing HTTP headers! I'm not going to sell your directory entries to advertisers, I promise.