undefined | Better HN

0 pointskovek6y ago0 comments

What if there could be a robot.txt kind of setting that users could use to prevent being scraped?

0 comments

Pointless unless you want a one world governement to enforce a law monoculture.

j / k navigate · click thread line to collapse

0 pointskovek6y ago0 comments

What if there could be a robot.txt kind of setting that users could use to prevent being scraped?

Pointless unless you want a one world governement to enforce a law monoculture.

j / k navigate · click thread line to collapse