Welcome! Log In Create A New Profile


fake googlebots

September 25, 2016 06:00PM
I got a spoofed googlebot hit. It was easy to detect since there were
probably a hundred requests that triggered my hacker detection map
scheme. Only two requests received a 200 return and both were harmless.

200 - - [25/Sep/2016:17:45:23 +0000] "GET / HTTP/1.1" 847 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" "-"

For the fake googlebot:
# host
Host not found: 3(NXDOMAIN)

For a real googlebot:
# host domain name pointer crawl-66-249-69-184.googlebot.com.

IP2location shows it is a Chinese ISP:

Nginx has a reverse DNS module:
I see it has a 10.1 issue:

Presuming this bug gets fixed, does anyone have code to verify
googlebots? Or some other method?

nginx mailing list
Subject Author Posted

fake googlebots

gariac September 25, 2016 06:00PM

Re: fake googlebots

wandenberg September 25, 2016 06:06PM

Re: fake googlebots

gariac September 25, 2016 06:28PM

Re: fake googlebots

Robert Paprocki September 25, 2016 06:30PM

Re: fake googlebots

Rainer Duffner September 25, 2016 06:08PM

Re: fake googlebots

dommyet September 25, 2016 11:02PM

Re: fake googlebots

gariac September 28, 2016 07:02PM

Sorry, only registered users may post in this forum.

Click here to login

Online Users

Guests: 75
Record Number of Users: 8 on April 13, 2023
Record Number of Guests: 421 on December 02, 2018
Powered by nginx      Powered by FreeBSD      PHP Powered      Powered by MariaDB      ipv6 ready