Welcome! Log In Create A New Profile

Advanced

Re: Slow down, but not stop, serving pages to bot that doesn't respect robots.txt delay

August 12, 2011 05:33AM
Thank you, but i want to serve the real content to the bot not an error page.

Is this possible?
Subject Author Posted

Slow down, but not stop, serving pages to bot that doesn't respect robots.txt delay

rastrano August 11, 2011 11:37AM

Re: Slow down, but not stop, serving pages to bot that doesn't respect robots.txt delay

rastrano August 11, 2011 11:56AM

Re: Slow down, but not stop, serving pages to bot that doesn't respect robots.txt delay

ressaid August 11, 2011 05:10PM

Re: Slow down, but not stop, serving pages to bot that doesn't respect robots.txt delay

rastrano August 12, 2011 05:33AM

Re: Slow down, but not stop, serving pages to bot that doesn't respect robots.txt delay

ressaid August 12, 2011 07:34AM



Sorry, only registered users may post in this forum.

Click here to login

Online Users

Guests: 61
Record Number of Users: 6 on February 13, 2018
Record Number of Guests: 421 on December 02, 2018
Powered by nginx      Powered by FreeBSD      PHP Powered      Powered by MariaDB      ipv6 ready