undefined | Better HN

0 pointskarn9711mo ago0 comments

Why not just rate limit every user to realistic human rates. You just punish anyone behaving like a bot.

0 comments

Because, as pointed out in another post about the same problem: Many of these scrappers make one or two requests from one IP and then move on.

Sold. Pay by page retrieval rate.

j / k navigate · click thread line to collapse

0 pointskarn9711mo ago0 comments

Why not just rate limit every user to realistic human rates. You just punish anyone behaving like a bot.

Because, as pointed out in another post about the same problem: Many of these scrappers make one or two requests from one IP and then move on.

Sold. Pay by page retrieval rate.

j / k navigate · click thread line to collapse