Maxim Dounin
January 10, 2019 08:46AM
Hello!

On Thu, Jan 10, 2019 at 08:27:08AM +0530, Anoop Alias wrote:

> Have had a really strange issue on a Nginx server configured as a reverse
> proxy wherein the server stops responding when the network connections in
> ESTABLISHED state and FIN_WAIT state in very high compared to normal
> working
>
> If you see the below network graph, at around 00:30 hours there is a big
> spike in network connections in FIN_WAIT state, to around 12000 from the
> normal value of ~20
>
> https://i.imgur.com/wb6VMWo.png
>
> At this state, Nginx stops responding fully and does not work even after a
> full restart of the service.

From the image it looks like there are CLOSE_WAIT sockets, not
FIN_WAIT. Most likely this means that nginx was blocked on
something - probably system resources somewhere inside the kernel,
or disk operation (on a dead disk?), or something like this.
E.g., this is something trivial to observe if you are serving
files from an NFS share, and the NFS server dies.

Alternatively, this might be a bug somewhere. In particular, it
looks like you are using various 3rd party modules, and a bug in
any of them can cause similar problems. But I don't really think
this is the case, as restarting nginx usually fixes such problems.

--
Maxim Dounin
http://mdounin.ru/
_______________________________________________
nginx mailing list
nginx@nginx.org
http://mailman.nginx.org/mailman/listinfo/nginx
Subject Author Posted

Nginx hang and do not respond with large number of network connection in FIN_WAIT state

Anoop Alias January 09, 2019 09:58PM

Re: Nginx hang and do not respond with large number of network connection in FIN_WAIT state

Peter Booth via nginx January 10, 2019 01:04AM

Re: Nginx hang and do not respond with large number of network connection in FIN_WAIT state

Maxim Dounin January 10, 2019 08:46AM

Re: Nginx hang and do not respond with large number of network connection in FIN_WAIT state

Anoop Alias January 10, 2019 01:06PM

Re: Nginx hang and do not respond with large number of network connection in FIN_WAIT state

Anoop Alias January 10, 2019 01:26PM

Re: Nginx hang and do not respond with large number of network connection in FIN_WAIT state

Peter Booth via nginx January 10, 2019 04:34PM

Re: Nginx hang and do not respond with large number of network connection in FIN_WAIT state

gnusys January 10, 2019 02:47PM

Re: Nginx hang and do not respond with large number of network connection in FIN_WAIT state

itpp2012 January 10, 2019 04:29PM

Re: Nginx hang and do not respond with large number of network connection in FIN_WAIT state

gnusys January 10, 2019 10:30PM

Re: Nginx hang and do not respond with large number of network connection in FIN_WAIT state

gnusys January 10, 2019 11:02PM

Re: Nginx hang and do not respond with large number of network connection in FIN_WAIT state

Peter Booth via nginx January 10, 2019 11:08PM

Re: Nginx hang and do not respond with large number of network connection in FIN_WAIT state

gnusys January 10, 2019 11:19PM

Re: Nginx hang and do not respond with large number of network connection in FIN_WAIT state

Peter Booth via nginx January 10, 2019 11:36PM

Re: Nginx hang and do not respond with large number of network connection in FIN_WAIT state

gnusys January 10, 2019 11:32PM

Re: Nginx hang and do not respond with large number of network connection in FIN_WAIT state

Peter Booth via nginx January 10, 2019 11:42PM

Re: Nginx hang and do not respond with large number of network connection in FIN_WAIT state

gnusys January 10, 2019 11:56PM

Re: Nginx hang and do not respond with large number of network connection in FIN_WAIT state

gnusys January 11, 2019 10:30PM



Sorry, only registered users may post in this forum.

Click here to login

Online Users

Guests: 302
Record Number of Users: 8 on April 13, 2023
Record Number of Guests: 421 on December 02, 2018
Powered by nginx      Powered by FreeBSD      PHP Powered      Powered by MariaDB      ipv6 ready