Welcome! Log In Create A New Profile

Advanced

Re[2]: парсер для error.log

Михаил Монашёв
January 18, 2013 11:04AM
Здравствуйте, Anton.

>> Если в парсере заменять все числа, строки в
>> кавычках и строки, идущие от двоеточия до запятой и не содержащие
>> пробелов на ХХХ, то получится свернуть всё разнообразие сообщение в
>> несколько шаблонных фраз. Ну и ради примера приводить одну несвёрнутую
>> ошибку ещё можно. Полезная тулза, кстати получится.

> Для суммарной статистики по числу ошибок разного типа сейчас использую такой скрипт:

> sed -E 's/.* (.*) [0-9]*#0: /\1 /' < $ERROR_LOG \
> | sed 's/ \*[0-9]* / /; s/, client: .*//; s/"[^"]*"/"..."/g;' \
> | sort | uniq -c | sort -rn


217 [error] kevent() reported about an closed connection (54: Connection reset by peer) while reading response header from upstream
159 [error] b.readmanga.ru could not be resolved (3: Host not found)
125 [error] g.readmanga.ru could not be resolved (3: Host not found)
108 [error] img1.gelz.net could not be resolved (2: Server failure)
76 [error] myphotos.ya1.ru could not be resolved (3: Host not found)
72 [error] upstream prematurely closed connection while reading response header from upstream
72 [error] jarmorka.ru could not be resolved (3: Host not found)
...
2 [error] image filter: too big response: 17993058 while reading response header from upstream
2 [error] image filter: too big response: 15226607 while reading response header from upstream
2 [error] image filter: too big response: 14589082 while reading response header from upstream
2 [error] image filter: too big response: 14204255 while reading response header from upstream
2 [error] image filter: too big response: 14101173 while reading response header from upstream
2 [error] image filter: too big response: 12871436 while reading response header from upstream
2 [error] image filter: too big response: 12702013 while reading response header from upstream
2 [error] image filter: too big response: 12650307 while reading response header from upstream
2 [error] image filter: too big response: 12415575 while reading response header from upstream


Хосты без кавычек и цифры не сворачиваются :-(
Цифры ещё можно победить, а вот для "... could not be resolved" нужно
писать отдельное условие.

--
С уважением,
Михаил mailto:postmaster@softsearch.ru

_______________________________________________
nginx-ru mailing list
nginx-ru@nginx.org
http://mailman.nginx.org/mailman/listinfo/nginx-ru
Subject Author Posted

парсер для error.log

Ivan Bondarets January 16, 2013 06:00AM

Re: парсер для error.log

Un Lexx January 16, 2013 06:50AM

Re: парсер для error.log

Un Lexx January 16, 2013 06:52AM

Re: парсер для error.log

Ivan Bondarets January 17, 2013 02:48PM

Re: парсер для error.log

Михаил Монашёв January 17, 2013 03:26PM

Re[2]: парсер для error.log

Михаил Монашёв January 17, 2013 03:28PM

Re: парсер для error.log

Anton Yuzhaninov January 18, 2013 07:20AM

Re: парсер для error.log

Ivan Bondarets January 18, 2013 07:44AM

Re: парсер для error.log

Ivan Bondarets January 18, 2013 08:04AM

Re[2]: парсер для error.log

Михаил Монашёв January 18, 2013 11:04AM

Re: парсер для error.log

Anton Yuzhaninov January 18, 2013 07:16AM

Re: парсер для error.log

Валентин Бартенев January 18, 2013 08:48AM



Sorry, only registered users may post in this forum.

Click here to login

Online Users

Guests: 122
Record Number of Users: 8 on April 13, 2023
Record Number of Guests: 421 on December 02, 2018
Powered by nginx      Powered by FreeBSD      PHP Powered      Powered by MariaDB      ipv6 ready