Reddit now blocks all search engines other than Google following 'misuse' (opens in new tab)

(9to5google.com)

6 pointstevelee1y ago1 comments

1 comments

robots.txt has always been a gentleman's agreement and for such a large site to abuse it in that way is ridiculous, and possibly, anti-competitive.

j / k navigate · click thread line to collapse

(9to5google.com)

6 pointstevelee1y ago1 comments

nness1y ago

robots.txt has always been a gentleman's agreement and for such a large site to abuse it in that way is ridiculous, and possibly, anti-competitive.

j / k navigate · click thread line to collapse