Previous Message
Next Message
Forum List
Message List
New Topic
Print View
rastrano
August 12, 2011 05:33AM
Registered: 12 years ago
Posts: 3
Thank you, but i want to serve the real content to the bot not an error page.
Is this possible?
Reply
Quote
RSS
Subject
Author
Posted
Slow down, but not stop, serving pages to bot that doesn't respect robots.txt delay
rastrano
August 11, 2011 11:37AM
Re: Slow down, but not stop, serving pages to bot that doesn't respect robots.txt delay
rastrano
August 11, 2011 11:56AM
Re: Slow down, but not stop, serving pages to bot that doesn't respect robots.txt delay
ressaid
August 11, 2011 05:10PM
Re: Slow down, but not stop, serving pages to bot that doesn't respect robots.txt delay
rastrano
August 12, 2011 05:33AM
Re: Slow down, but not stop, serving pages to bot that doesn't respect robots.txt delay
ressaid
August 12, 2011 07:34AM
Sorry, only registered users may post in this forum.
Click here to login
Online Users
Guests: 307
Record Number of Users: 8 on April 13, 2023
Record Number of Guests: 421 on December 02, 2018