Forum List Message List New Topic Print View

Alt

September 27, 2016 07:30AM

Registered: 8 years ago
Posts: 43

Hello,

Not sure if it can help you, because only some bots respect it and not in the same way, but you could look at the "crawl-delay" directive in the robots.txt file: https://en.wikipedia.org/wiki/Robots_exclusion_standard#Crawl-delay_directive

Reply Quote

RSS

Subject	Author	Posted
Recommended limit_req and limit_conn for location ~ \.php$ {}	c0nw0nk	September 26, 2016 07:41PM
Re: Recommended limit_req and limit_conn for location ~ \.php$ {}	Francis Daly	September 27, 2016 03:58AM
Re: Recommended limit_req and limit_conn for location ~ \.php$ {}	itpp2012	September 27, 2016 04:59AM
Re: Recommended limit_req and limit_conn for location ~ \.php$ {}	oscaretu .	September 27, 2016 05:18AM
Re: Recommended limit_req and limit_conn for location ~ \.php$ {}	c0nw0nk	September 27, 2016 10:24AM
Re: Recommended limit_req and limit_conn for location ~ \.php$ {}	Alt	September 27, 2016 07:30AM