Welcome! Log In Create A New Profile

Advanced

Re: Nginx flv stream gets too slow on 2000 concurrent connections

January 23, 2013 09:16AM
Thanks for helping me out guyz but w're already dealing with 3-app servers
clustering with haproxy load balancer (For this video streaming site), and
can't afford another clustering type things. You're talking about Haproxy
load-balancer to split required flv files requests to different servers.
We'll have to buy 5 more content servers for mirroring data between every
two servers to split load-balancer requests but the problem is we're
running out of budget. If you can provide me some alternate to this problem?


On Wed, Jan 23, 2013 at 6:33 PM, Geoffrey Hartz <hartz.geoffrey@gmail.com>wrote:

> It will not help you actualy but I had a similar experience.
>
> My issue was due to the system event handle (epoll, kqueue...)
>
> I noticed poor speed when hitting 2000 connections with haproxy. So I
> switch to nginx + tcp module proxy. Same results..
>
> But using haproxy + nginx (with two different event handler, I avoid
> the speed problem). At the end, I prefered use ESXi and 2/3 VM and
> split connections with DNS load balancing
>
> Maybe you should take a look at this event handler problem and do some
> tunning on kernel/OS. Nginx (maybe) isn't the actual issue.
>
> 2013/1/23 shahzaib shahzaib <shahzaib.cb@gmail.com>:
> > The average size of each flv video is 60Mb+. We've five content servers
> > (nginx-1.2.1), each with 1Gbps port and 100TB bandwidth per month. Right
> now
> > each server is consuming 10~12 bandwidth per day and we're going to run
> out
> > of bandwidth on coming last days of month. However we limited every
> > connection to 180k, you can see limit_rate 180k; in nginx.conf file.
> >
> > I am newbie to this field. Please correct me if i didn't satisfy your
> > question regarding bandwidth. :)
> >
> >
> > On Wed, Jan 23, 2013 at 5:39 PM, Dennis Jacobfeuerborn
> > <dennisml@conversis.de> wrote:
> >>
> >> On 01/23/2013 10:43 AM, shahzaib shahzaib wrote:
> >> > Hello,
> >> >
> >> > We are using nginx to serve large size of static files i.e
> >> > jpg,flv
> >> > and mp4 . Nginx stream works very well on 1000~1500 concurrent
> >> > connections
> >> > but whenever connections exceeded to 2000~2200, stream gets too slow.
> >> > We've
> >> > five content server with following specification:-
> >> >
> >> > Dual Quard Core (8cores/16threads)
> >> > RAM = 32G
> >> > HDD = Sas Hard-Raid 10
> >> >
> >> >
> >> > My nginx.conf config is given below :
> >> >
> >> > user nginx;
> >> > worker_processes 16;
> >> > worker_rlimit_nofile 300000; #2 filehandlers for each connection;
> >> >
> >> > #pid logs/nginx.pid;
> >> >
> >> >
> >> > events {
> >> > worker_connections 6000;
> >> > use epoll;
> >> > }
> >> > http {
> >> > include mime.types;
> >> > default_type application/octet-stream;
> >> > limit_rate 180k;
> >> > client_body_buffer_size 128K;
> >> > sendfile_max_chunk 128k;
> >> > server_tokens off; #Conceals nginx version
> >> > access_log off;
> >> > sendfile on;
> >> > client_header_timeout 3m;
> >> > client_body_timeout 3m;
> >> > send_timeout 3m;
> >> > keepalive_timeout 0;
> >> >
> >> > If somebody can help me improving nginx config will be helpful to
> him. I
> >> > apologize for bad engish :D
> >>
> >> What's the required bandwidth for the flv files? What is the bandwidth
> of
> >> the connection of the system? What is the bandwidth of the uplink to the
> >> Internet?
> >>
> >> Regards,
> >> Dennis
> >>
> >> _______________________________________________
> >> nginx mailing list
> >> nginx@nginx.org
> >> http://mailman.nginx.org/mailman/listinfo/nginx
> >
> >
> >
> > _______________________________________________
> > nginx mailing list
> > nginx@nginx.org
> > http://mailman.nginx.org/mailman/listinfo/nginx
>
>
>
> --
> Geoffrey HARTZ
>
> _______________________________________________
> nginx mailing list
> nginx@nginx.org
> http://mailman.nginx.org/mailman/listinfo/nginx
>
_______________________________________________
nginx mailing list
nginx@nginx.org
http://mailman.nginx.org/mailman/listinfo/nginx
Subject Author Posted

Nginx flv stream gets too slow on 2000 concurrent connections

shahzaib1232 January 23, 2013 04:44AM

Re: Nginx flv stream gets too slow on 2000 concurrent connections

skechboy January 23, 2013 06:58AM

Re: Nginx flv stream gets too slow on 2000 concurrent connections

shahzaib1232 January 23, 2013 07:12AM

Re: Nginx flv stream gets too slow on 2000 concurrent connections

shahzaib1232 January 23, 2013 07:16AM

Re: Nginx flv stream gets too slow on 2000 concurrent connections

skechboy January 23, 2013 10:21AM

Re: Nginx flv stream gets too slow on 2000 concurrent connections

shahzaib1232 January 23, 2013 10:32AM

Re: Nginx flv stream gets too slow on 2000 concurrent connections

shahzaib1232 January 23, 2013 11:52AM

RE: Nginx flv stream gets too slow on 2000 concurrent connections

Lukas Tribus January 23, 2013 01:10PM

Re: Nginx flv stream gets too slow on 2000 concurrent connections

shahzaib1232 January 23, 2013 02:02PM

Re: Nginx flv stream gets too slow on 2000 concurrent connections

shahzaib1232 January 23, 2013 02:06PM

RE: Nginx flv stream gets too slow on 2000 concurrent connections

Lukas Tribus January 23, 2013 02:20PM

Re: Nginx flv stream gets too slow on 2000 concurrent connections

Rainer Duffner January 23, 2013 02:30PM

Re: Nginx flv stream gets too slow on 2000 concurrent connections

shahzaib1232 January 23, 2013 03:22PM

Re: Nginx flv stream gets too slow on 2000 concurrent connections

shahzaib1232 January 23, 2013 03:28PM

Re: Nginx flv stream gets too slow on 2000 concurrent connections

shahzaib1232 January 23, 2013 03:40PM

Re: Nginx flv stream gets too slow on 2000 concurrent connections

Geoffrey Hartz January 23, 2013 03:44PM

Re: Nginx flv stream gets too slow on 2000 concurrent connections

Jonathan Matthews January 23, 2013 05:22PM

RE: Nginx flv stream gets too slow on 2000 concurrent connections

Lukas Tribus January 23, 2013 07:06PM

Re: Nginx flv stream gets too slow on 2000 concurrent connections

Scott Ribe January 23, 2013 07:14PM

Re: Nginx flv stream gets too slow on 2000 concurrent connections

Stefan Caunter January 23, 2013 10:52PM

Re: Nginx flv stream gets too slow on 2000 concurrent connections

shahzaib1232 January 24, 2013 01:58AM

Re: Nginx flv stream gets too slow on 2000 concurrent connections

shahzaib1232 January 24, 2013 06:32AM

Re: Nginx flv stream gets too slow on 2000 concurrent connections

姚伟斌 January 24, 2013 10:56PM

Re: Nginx flv stream gets too slow on 2000 concurrent connections

richardm January 23, 2013 04:50PM

Re: Nginx flv stream gets too slow on 2000 concurrent connections

Rainer Duffner January 23, 2013 04:52PM

Re: Nginx flv stream gets too slow on 2000 concurrent connections

Dennis Jacobfeuerborn January 23, 2013 07:42AM

Re: Nginx flv stream gets too slow on 2000 concurrent connections

shahzaib1232 January 23, 2013 08:14AM

Re: Nginx flv stream gets too slow on 2000 concurrent connections

Geoffrey Hartz January 23, 2013 08:36AM

Re: Nginx flv stream gets too slow on 2000 concurrent connections

shahzaib1232 January 23, 2013 09:16AM

Re: Nginx flv stream gets too slow on 2000 concurrent connections

Reinis Rozitis January 23, 2013 09:44AM

Re: Nginx flv stream gets too slow on 2000 concurrent connections

shahzaib1232 January 23, 2013 10:00AM

Re: Nginx flv stream gets too slow on 2000 concurrent connections

shahzaib1232 January 23, 2013 10:10AM



Sorry, only registered users may post in this forum.

Click here to login

Online Users

Guests: 166
Record Number of Users: 8 on April 13, 2023
Record Number of Guests: 421 on December 02, 2018
Powered by nginx      Powered by FreeBSD      PHP Powered      Powered by MariaDB      ipv6 ready