Welcome! Log In Create A New Profile

Advanced

RE: cache: move open to thread pool

August 28, 2018 05:18AM
Hi,

> Hi Eran,
>
> Happy to see that we are not the only place where we find open to be a problem. I took a look at your module and while the approach is sound, I decided the complexity doesn't seem to be worth it. Hope to see some numbers of how your module works at scale.
>
> - Ka-Hing
>
I don't have numbers that show the improvement we got from moving open to a thread pool,
but what I can say is that on our environment, open can sometimes take an unreasonable
time to complete - several seconds.
I noticed it several years ago, after I added a feature of 'performance counters' to my module
(posted it here - https://forum.nginx.org/read.php?2,255847,258854#msg-258854).
This is the reason I decided to implement the async open - in order to avoid having all
worker active requests hang for so long.
In my case, I was already using open file cache, and while I got a fairly good hit ratio,
these extreme cases of worker hanging for few seconds wasn't something I wanted to accept.
Also, in my setup, I'm not using proxy_cache - my servers serve as origin servers behind a CDN,
so a solution that is limited to file cache is not something I could use.

Eran
_______________________________________________
nginx-devel mailing list
nginx-devel@nginx.org
http://mailman.nginx.org/mailman/listinfo/nginx-devel
Subject Author Views Posted

cache: move open to thread pool

Ka-Hing Cheung via nginx-devel 2826 August 07, 2018 05:28PM

Re: cache: move open to thread pool

Maxim Dounin 847 August 08, 2018 02:18PM

RE: cache: move open to thread pool

erankor 807 August 08, 2018 03:46PM

Re: cache: move open to thread pool

Ka-Hing Cheung via nginx-devel 632 August 27, 2018 06:00PM

RE: cache: move open to thread pool

erankor 740 August 28, 2018 05:18AM

Re: cache: move open to thread pool

Ka-Hing Cheung via nginx-devel 634 August 09, 2018 05:44PM

Re: cache: move open to thread pool

Maxim Dounin 1098 August 10, 2018 07:42AM

Re: cache: move open to thread pool

Ka-Hing Cheung via nginx-devel 642 August 27, 2018 05:40PM

Re: cache: move open to thread pool

Maxim Dounin 759 September 03, 2018 12:10PM

Re: cache: move open to thread pool

Ka-Hing Cheung via nginx-devel 689 September 04, 2018 08:00PM

Re: cache: move open to thread pool

Maxim Dounin 650 September 13, 2018 02:12PM

Re: cache: move open to thread pool

Roman Arutyunyan 760 October 04, 2018 05:34AM

Re: cache: move open to thread pool

Roman Arutyunyan 751 November 01, 2018 08:30AM

Re: cache: move open to thread pool

Maxim Konovalov 632 November 01, 2018 12:08PM

Re: cache: move open to thread pool

Roman Arutyunyan 468 August 03, 2021 04:52AM

Re: cache: move open to thread pool

Maxim Konovalov 631 November 08, 2018 09:20AM

Re: cache: move open to thread pool

Ka-Hing Cheung via nginx-devel 668 November 15, 2018 05:54PM

Re: cache: move open to thread pool

Maxim Konovalov 704 November 16, 2018 04:12AM

Re: cache: move open to thread pool

Maxim Konovalov 674 December 05, 2018 04:44AM

Re: cache: move open to thread pool

Maxim Konovalov 616 January 10, 2019 03:32AM

Re: cache: move open to thread pool

Ka-Hing Cheung via nginx-devel 668 January 14, 2019 08:54PM

Re: cache: move open to thread pool

Ka-Hing Cheung via nginx-devel 587 January 22, 2019 01:22PM

Re: cache: move open to thread pool

Ka-Hing Cheung via nginx-devel 663 January 22, 2019 02:36PM

Re: cache: move open to thread pool

Maxim Konovalov 627 January 23, 2019 07:40AM

Re: cache: move open to thread pool

Ka-Hing Cheung via nginx-devel 610 February 06, 2019 04:20PM

Re: cache: move open to thread pool

Maxim Konovalov 649 February 07, 2019 08:40AM

Re: cache: move open to thread pool

Ka-Hing Cheung via nginx-devel 697 February 08, 2019 05:42PM

Re: cache: move open to thread pool

karton 532 July 19, 2019 11:28AM

Re: cache: move open to thread pool

Maxim Konovalov 575 July 19, 2019 02:44PM

Re: cache: move open to thread pool

karton 502 July 19, 2019 09:46PM

Re: cache: move open to thread pool

Roman Arutyunyan 551 July 22, 2019 10:06AM

Re: cache: move open to thread pool

karton 526 July 22, 2019 11:40AM

Re: cache: move open to thread pool

karton 543 July 23, 2019 11:48PM

Re: cache: move open to thread pool

Roman Arutyunyan 608 August 16, 2019 10:26AM

Re: cache: move open to thread pool

karton 667 August 16, 2019 10:52AM

Re: cache: move open to thread pool

NCviQwilt 516 September 02, 2021 12:22PM

Re: cache: move open to thread pool

Roman Arutyunyan 560 September 09, 2021 06:50AM



Sorry, you do not have permission to post/reply in this forum.

Online Users

Guests: 157
Record Number of Users: 8 on April 13, 2023
Record Number of Guests: 421 on December 02, 2018
Powered by nginx      Powered by FreeBSD      PHP Powered      Powered by MariaDB      ipv6 ready