Welcome! Log In Create A New Profile

Advanced

Re: Nginx proxy cache purge process does not clean up items fast enough for new elements

Hung Nguyen
October 16, 2019 09:58AM
Hello,

I Dont think the way you currently use nginx as cache proxy is best practice.

Serving large file then store whole file into cache with large number of request is like burning your disk, even if nginx cache manager can delete and refill cache fast enough, it will keep write/delete file infinitely.

Another option should be using nginx slice module, and serving large file using range request. Nginx cache will then work far better.

--
Hưng

> On Oct 16, 2019, at 20:44, sachin.shetty@gmail.com <nginx-forum@forum.nginx.org> wrote:
>
> Thankyou Maxim, is there anyway I can make the cache manager a bit more
> aggressive in prune and purge? We already leave 20% of space free on the
> disks, but the concurrent request rate for large files can be huge and we
> still run in to this issue.
>
> What are your thoughts about disabling buffering on such issues? This is not
> a fatal error, so we should stop buffering and switch to streaming mode and
> let the request succeed with a error log line in error.log.
>
> Thanks again for your help on this.
>
> Posted at Nginx Forum: https://forum.nginx.org/read.php?2,285896,285900#msg-285900
>
> _______________________________________________
> nginx mailing list
> nginx@nginx.org
> http://mailman.nginx.org/mailman/listinfo/nginx
_______________________________________________
nginx mailing list
nginx@nginx.org
http://mailman.nginx.org/mailman/listinfo/nginx
Subject Author Posted

Nginx proxy cache purge process does not clean up items fast enough for new elements

sachin.shetty@gmail.com October 16, 2019 05:24AM

Re: Nginx proxy cache purge process does not clean up items fast enough for new elements

Maxim Dounin October 16, 2019 08:58AM

Re: Nginx proxy cache purge process does not clean up items fast enough for new elements

sachin.shetty@gmail.com October 16, 2019 09:44AM

Re: Nginx proxy cache purge process does not clean up items fast enough for new elements

Maxim Dounin October 16, 2019 12:50PM

Re: Nginx proxy cache purge process does not clean up items fast enough for new elements

sachin.shetty@gmail.com October 17, 2019 08:13AM

Re: Nginx proxy cache purge process does not clean up items fast enough for new elements

Maxim Dounin October 17, 2019 08:58AM

Re: Nginx proxy cache purge process does not clean up items fast enough for new elements

Hung Nguyen October 16, 2019 09:58AM



Sorry, only registered users may post in this forum.

Click here to login

Online Users

Guests: 91
Record Number of Users: 6 on February 13, 2018
Record Number of Guests: 421 on December 02, 2018
Powered by nginx      Powered by FreeBSD      PHP Powered      Powered by MariaDB      ipv6 ready