oscaretu .
April 20, 2017 06:32AM
I was trying to say you that you don't need to store lots of unnecesary
logs when you can store just the valuable information contained in the
logs, in a processed way.

Why store thousands of log lines that show some called function
functionname1 instead of store something like this:


{
"date" : "20170420",
"functionmname1": 33,
"functionmname2": 18,
"functionmname3": 51,
"functionmname4": 68,
...
}

In JSON, in a database, or where you want...


On Thu, Apr 20, 2017 at 10:10 AM, SARA QUISPE MEJIA <a20132950@pucp.pe>
wrote:

> yes, I could do it but I want just store for example the customer, the
> function name, the date after with those information I could filter my
> report through a page.php
> But with json I don't know how can I do that?
>
>
> 2017-04-20 9:57 GMT+02:00 oscaretu . <oscaretu@gmail.com>:
>
>> If you extract the lines containing all the function names, and filter
>> them with a script that counts the number of times that the function
>> appears, you only have to store (for example in a JSON) the number of times
>> that each function was used. And you can avoid storing all the logs in a
>> database.
>>
>>
>> On Thu, Apr 20, 2017 at 9:29 AM, SARA QUISPE MEJIA <a20132950@pucp.pe>
>> wrote:
>>
>>> yes, I tried to do that and then I did the analysis with goaccess,
>>> but now I need to do an interface(page.php) for the user can choose
>>> the function that want to filter and then generate a report.
>>> So, I thought put all my information on a database like mysql
>>>
>>> 2017-04-20 9:11 GMT+02:00 oscaretu . <oscaretu@gmail.com>:
>>>
>>>> Sara, why don't you process the log file just with grep / pcregrep to
>>>> get just the lines that containt that function name?
>>>>
>>>>
>>>> On Thu, Apr 20, 2017 at 9:05 AM, SARA QUISPE MEJIA <a20132950@pucp.pe>
>>>> wrote:
>>>>
>>>>> I want to parse the log file respect to a client that means to make a
>>>>> report of how the client is using my application through the information
>>>>> provided by a log file.
>>>>>
>>>>> So I need to filter some url where I find an especific name of a
>>>>> function. For that I thought in insert my log file to database like mysql.
>>>>> Could I do that with my log file ? (I use nginx )
>>>>>
>>>>> I tried to do that with syslog-ng but it doesn't work
>>>>>
>>>>> Do you have any ideas?
>>>>>
>>>>> Thanks
>>>>>
>>>>> Sara
>>>>>
>>>>> _______________________________________________
>>>>> nginx mailing list
>>>>> nginx@nginx.org
>>>>> http://mailman.nginx.org/mailman/listinfo/nginx
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Oscar Fernandez Sierra
>>>> oscaretu@gmail.com
>>>>
>>>> _______________________________________________
>>>> nginx mailing list
>>>> nginx@nginx.org
>>>> http://mailman.nginx.org/mailman/listinfo/nginx
>>>>
>>>
>>>
>>> _______________________________________________
>>> nginx mailing list
>>> nginx@nginx.org
>>> http://mailman.nginx.org/mailman/listinfo/nginx
>>>
>>
>>
>>
>> --
>> Oscar Fernandez Sierra
>> oscaretu@gmail.com
>>
>> _______________________________________________
>> nginx mailing list
>> nginx@nginx.org
>> http://mailman.nginx.org/mailman/listinfo/nginx
>>
>
>
> _______________________________________________
> nginx mailing list
> nginx@nginx.org
> http://mailman.nginx.org/mailman/listinfo/nginx
>



--
Oscar Fernandez Sierra
oscaretu@gmail.com
_______________________________________________
nginx mailing list
nginx@nginx.org
http://mailman.nginx.org/mailman/listinfo/nginx
Subject Author Posted

nginx access logs to mysql

SARA QUISPE MEJIA April 20, 2017 03:08AM

Re: nginx access logs to mysql

oscaretu . April 20, 2017 03:12AM

Re: nginx access logs to mysql

SARA QUISPE MEJIA April 20, 2017 03:30AM

Re: nginx access logs to mysql

oscaretu . April 20, 2017 03:58AM

Re: nginx access logs to mysql

SARA QUISPE MEJIA April 20, 2017 04:12AM

Re: nginx access logs to mysql

oscaretu . April 20, 2017 06:32AM

Re: nginx access logs to mysql

Reinis Rozitis April 20, 2017 05:52AM



Sorry, only registered users may post in this forum.

Click here to login

Online Users

Guests: 235
Record Number of Users: 8 on April 13, 2023
Record Number of Guests: 421 on December 02, 2018
Powered by nginx      Powered by FreeBSD      PHP Powered      Powered by MariaDB      ipv6 ready