Website unresponsive: diagnostic steps and blocking the AI crawlers (opens in new tab)

(physicsderivationgraph.blogspot.com)

2 pointsphysicsgraph3mo ago2 comments

2 comments

might want to try something like https://webdecoy.com

Blocking IP ranges is just whack-a-mole though right? Glad you got the site back up but this necessitates a high level of vigilance going forward.

Can a softer throttling approach work? Rate limit the naughty IPs when they go over a threshold, or even increase rate limits as CPU/RAM usage climbs?

j / k navigate · click thread line to collapse

2 comments

cport13mo ago

might want to try something like https://webdecoy.com

Festro3mo ago

Blocking IP ranges is just whack-a-mole though right? Glad you got the site back up but this necessitates a high level of vigilance going forward.

Can a softer throttling approach work? Rate limit the naughty IPs when they go over a threshold, or even increase rate limits as CPU/RAM usage climbs?

j / k navigate · click thread line to collapse