Welcome! Log In Create A New Profile

Advanced

Re: Performance issue of "ngx_http_mirror_module"

October 27, 2017 10:04AM
There are a few approaches to this but they depend upon what you’re trying to achieve. Are your requests POSTs or GETs? Why do you have the mirroring configured?

If the root cause is that your mirror site cannot support the same workload as your primary site, what do you want to happen when your mirror site is overloaded?

One approach, using nginx, is to use rate limiting and connection limiting on your mirror server. This is described on the nginx website as part of the ddos mitigation section.
Or, if your bursts of activity are typically for the same resource then you can use caching with the proxy_cache_use_stale directive.

Another approach could be to use lua / openresty to implement a work- shedding interceptor (within nginx) that sits in front of your slow web server. Within lua you would need code that guesses whether or not your web server is overloaded and, if it is, it simply returns a 503 and doesn’t forward the request.



Sent from my iPhone

> On Oct 27, 2017, at 2:24 AM, 安格 <yuanm12@163.com> wrote:
>
> Dear Roman,
>
> Thanks for your valuable response.
> So ,is that means, If we optimize the parameter of the keep-alive to avoid keep-alive connection ? then we can avoid this kind of performance issue ?
> Or if the mirror subrequest is slow than original subrequest, then we can't avoid this kind of performance issue ? Thanks in advance.
>
> --
>
> Regards,
> Yuan Man
> Trouble is a Friend.
>
>
> At 2017-10-26 20:22:13, "Roman Arutyunyan" <arut@nginx.com> wrote:
> >Hi,
> >
> >On Thu, Oct 26, 2017 at 03:15:02PM +0800, 安格 wrote:
> >> Dear All,
> >>
> >>
> >> I have faced a issue with Nginx "ngx_http_mirror_module" mirror function. want to discuss with you about this.
> >>
> >>
> >> The situation is like below:
> >> While I try to copy the request form original to mirror side, if the original application can process 600 request per seconds, but the mirror environment can only process 100 requests per seconds. Normally, even the mirror environment can't process all the request in time. it's should not impact the nginx forward the request to the original environment. But we observed if the mirror environment can't process all the request, then the Nginx will fall in issue , and original environment can't feedback process result to client in time. Then from client side, it seems the Nginx is down. If you have faced same issue before ? any suggestion ?
> >
> >A mirror request is executed in parallel with the main request and does not
> >directly affect the main request execution time. However, if you send another
> >request on the same client connection, it will not be processed until the
> >previous request and all its subrequest (including mirror subrequests) finish.
> >So if you use keep-alive client connections and your mirror subrequests are
> >slow, you may experience some performance issues.
> >
> >--
> >Roman Arutyunyan
> >_______________________________________________
> >nginx mailing list
> >nginx@nginx.org
> >http://mailman.nginx.org/mailman/listinfo/nginx
>
>
> 【网易自营】好吃到爆!鲜香弹滑加热即食,经典13香/麻辣小龙虾仅75元3斤>>
> _______________________________________________
> nginx mailing list
> nginx@nginx.org
> http://mailman.nginx.org/mailman/listinfo/nginx
_______________________________________________
nginx mailing list
nginx@nginx.org
http://mailman.nginx.org/mailman/listinfo/nginx
Subject Author Posted

Performance issue of "ngx_http_mirror_module"

安格 October 26, 2017 03:16AM

Re: Performance issue of "ngx_http_mirror_module"

Roman Arutyunyan October 26, 2017 08:24AM

Re:Re: Performance issue of "ngx_http_mirror_module"

安格 October 26, 2017 09:26PM

Re: Re: Performance issue of "ngx_http_mirror_module"

Roman Arutyunyan October 27, 2017 02:56AM

Re: Performance issue of "ngx_http_mirror_module"

pbooth October 27, 2017 10:04AM

Re:Re: Performance issue of "ngx_http_mirror_module"

安格 November 02, 2017 01:10AM



Sorry, only registered users may post in this forum.

Click here to login

Online Users

Guests: 211
Record Number of Users: 8 on April 13, 2023
Record Number of Guests: 421 on December 02, 2018
Powered by nginx      Powered by FreeBSD      PHP Powered      Powered by MariaDB      ipv6 ready