Quintin Par
March 12, 2012 12:18AM
Hi all,

How can I maintain two rate limit strategies?One for spiders and one for
regular users?

I can get the IP address list of spiders from

http://www.iplists.com/ . Can I separate it by geo? Have people attempted
this?

My website is being pounded by some screen scrapers and I want to block
them, but not at the risk of blocking search engine spiders.

-Quintin
_______________________________________________
nginx mailing list
nginx@nginx.org
http://mailman.nginx.org/mailman/listinfo/nginx
Subject Author Posted

Two type of rate limiting for based on IP address

Quintin Par March 12, 2012 12:18AM

Re: Two type of rate limiting for based on IP address

Antonio P.P. Almeida March 12, 2012 10:36AM

Re: Two type of rate limiting for based on IP address

Antonio P.P. Almeida March 12, 2012 10:48AM



Sorry, only registered users may post in this forum.

Click here to login

Online Users

Guests: 232
Record Number of Users: 8 on April 13, 2023
Record Number of Guests: 421 on December 02, 2018
Powered by nginx      Powered by FreeBSD      PHP Powered      Powered by MariaDB      ipv6 ready