Welcome! Log In Create A New Profile

Advanced

Bloking Bad bots

November 14, 2016 10:04AM
Hello,

I have a server with several domains, in the configuration file of each domain I have a line like this to block bad bots.

If ($ http_user_agent ~ * (zealbot|MJ12bot|AhrefsBot|sogou|PaperLiBot|uipbot|DotBot|GetIntent|Cliqzbot|YandexBot|Nutch|TurnitinBot|IndeedBot)
Return 403;
}

This works fine.

The question is, if I increase the list of bad bots to 1000, for example, this would be a speed problem when nginx manages every request that arrives.

I have domains that can have 500,000 hits daily and up to 20,000 hits.

Thank you all.

Greetings.
Subject Author Posted

Bloking Bad bots

debilish99 November 14, 2016 10:04AM

Re: Bloking Bad bots

gariac November 14, 2016 10:32AM

Re: Bloking Bad bots

Anoop Alias November 14, 2016 10:42AM

Re: Bloking Bad bots

gariac November 14, 2016 11:52AM

Re: Bloking Bad bots

Robert Paprocki November 14, 2016 11:58AM

Re: Bloking Bad bots

Anonymous User November 14, 2016 12:08PM

Re: Bloking Bad bots

ph.gras November 14, 2016 12:14PM

Re: Bloking Bad bots

George November 14, 2016 05:18PM

Re: Bloking Bad bots

Star Dot November 15, 2016 12:24AM

Re: Bloking Bad bots

gariac November 15, 2016 03:56AM

Re: Bloking Bad bots

debilish99 November 15, 2016 04:05AM



Sorry, only registered users may post in this forum.

Click here to login

Online Users

Guests: 59
Record Number of Users: 6 on February 13, 2018
Record Number of Guests: 421 on December 02, 2018
Powered by nginx      Powered by FreeBSD      PHP Powered      Powered by MariaDB      ipv6 ready