It looks like this issue cannot be fixed by just adjusting configuration file, so I figure I should submit an idea/feature request here.
Original thread : http://forum.nginx.org/read.php?15,5180
proxy_store, while the file is being retrieved from backend, should only make one connection to backend. say if there are 50 clients retrieving one link, they should all be pulling data from a temp_file which is being populated from one backend connection.
What is happening right now is that nginx will make 50 concurrent connections to the backend (network stampede) and write 50 temp files to disk (disk stampede).
Does this make sense? Or if there's any 3rd party mod available (free or for sale) ?
Any comment is appreciated.