Welcome! Log In Create A New Profile

Advanced

Как отбиться от 80legs.com ?

October 29, 2013 10:40AM
Повадилась такая вот напасть.

http://www.80legs.com/webcrawler.html

Как ее грамотно выпилить?

В логах много такого:

109.166.134.39 - - [29/Oct/2013:18:34:09 +0400] site.domain.com "GET /page/url/ HTTP/1.1" 502 107 "-" "Mozilla/5.0 (compatible; 008/0.85; http://www.80legs.com/webcrawler.html) Gecko/2008032620" 0.000
Subject Author Posted

Как отбиться от 80legs.com ?

Gaidamak October 29, 2013 10:40AM

Re: Как отбиться от 80legs.com ?

Peter B. Pokryshev October 29, 2013 10:46AM



Sorry, only registered users may post in this forum.

Click here to login

Online Users

Guests: 137
Record Number of Users: 8 on April 13, 2023
Record Number of Guests: 421 on December 02, 2018
Powered by nginx      Powered by FreeBSD      PHP Powered      Powered by MariaDB      ipv6 ready