Welcome! Log In Create A New Profile

Re: Slow down, but not stop, serving pages to bot that doesn't respect robots.txt delay

rastrano

August 12, 2011 05:33AM

Registered: 12 years ago
Posts: 3

Thank you, but i want to serve the real content to the bot not an error page.

Is this possible?

Reply Quote

RSS

Subject	Author	Posted
Slow down, but not stop, serving pages to bot that doesn't respect robots.txt delay	rastrano	August 11, 2011 11:37AM
Re: Slow down, but not stop, serving pages to bot that doesn't respect robots.txt delay	rastrano	August 11, 2011 11:56AM
Re: Slow down, but not stop, serving pages to bot that doesn't respect robots.txt delay	ressaid	August 11, 2011 05:10PM
Re: Slow down, but not stop, serving pages to bot that doesn't respect robots.txt delay	rastrano	August 12, 2011 05:33AM
Re: Slow down, but not stop, serving pages to bot that doesn't respect robots.txt delay	ressaid	August 12, 2011 07:34AM

Sorry, only registered users may post in this forum.

Online Users

Guests: 149

Record Number of Users: 8 on April 13, 2023

Record Number of Guests: 421 on December 02, 2018