Ennergizer

Block or not to Block?

facebookexternalhit behaves like a Spider indexing all sites, not actually what was submitted to Facebook for Card data

What originally was supposed to be previews of URLs is now being used to crawl all the internet (based on our logs from different sites). It also sometimes makes up non-existant pattern URLs to crawl more that it can find in it's index.

I assume all the data is used for LLAMA which it hides behind the default facebookexternalhit.

Go ahead, check your site logs.

Why do I need Google if it only shows results from Reddit? If you can just go to reddit and do search there?

In the past years, I've been noticing Google's declining ability to save multiple website contents into its index. Yes, it does craws the website, and most of the links, but actual amount of pages in Google has been declining in all websites that we know of.

While Microsoft is indexing and saving at a 5-10X rate more than Google.

What was your experience with Google Index?

How to check: 1. Open Search Console 2. Go to Experience > HTTPS section. Is the number of pages in the HTTPS report relative to your website's real pages?

Google lacks the resources to index the whole web now and is now behind its competitors like Microsoft?

And only enable them when you click on the extension or allow it on a specific domain?

Or at least have a policy to not allow all extensions on all domains by default as user selectable option in Chrome settings?