Hi,

I've noticed some nginx segfaults over the last week or so with 1.0.1 and 1.0.2. I havent tested any other version for long enough.
The segfaults are not immediate and sometimes it requires several hours to reproduce through normal use.

Here is the debug info, if you require anymore information please ask.

[12702.705897] nginx[1769]: segfault at 50545448 ip 0807d1fa sp bfc241d0 error 4 in nginx[8048000+82000]

Linux hostname 2.6.38.6 #1 SMP Sat May 14 09:13:41 UTC 2011 i686 Intel(R) Xeon(TM) CPU 2.40GHz GenuineIntel GNU/Linux

# gcc -v
Reading specs from /usr/lib/gcc/i486-slackware-linux/4.5.2/specs
COLLECT_GCC=gcc
COLLECT_LTO_WRAPPER=/usr/libexec/gcc/i486-slackware-linux/4.5.2/lto-wrapper
Target: i486-slackware-linux
Configured with: ../gcc-4.5.2/configure --prefix=/usr --libdir=/usr/lib --mandir=/usr/man --infodir=/usr/info --enable-shared --enable-bootstrap --enable-languages=ada,c,c++,fortran,java,objc,lto --enable-threads=posix --enable-checking=release --with-system-zlib --with-python-dir=/lib/python2.6/site-packages --disable-libunwind-exceptions --enable-__cxa_atexit --enable-libssp --enable-lto --with-gnu-ld --verbose --with-arch=i486 --target=i486-slackware-linux --build=i486-slackware-linux --host=i486-slackware-linux
Thread model: posix
gcc version 4.5.2 (GCC)

# ldd /usr/sbin/nginx
linux-gate.so.1 => (0xffffe000)
libcrypt.so.1 => /lib/libcrypt.so.1 (0xb77ee000)
libpcre.so.0 => /usr/lib/libpcre.so.0 (0xb77b1000)
libssl.so.0 => /usr/lib/libssl.so.0 (0xb7769000)
libcrypto.so.0 => /usr/lib/libcrypto.so.0 (0xb7623000)
libdl.so.2 => /lib/libdl.so.2 (0xb761e000)
libz.so.1 => /usr/lib/libz.so.1 (0xb760a000)
libc.so.6 => /lib/libc.so.6 (0xb74a7000)
/lib/ld-linux.so.2 (0xb782c000)

glibc-2.13
pcre-8.12
openssl-0.9.8r
zlib-1.2.5

# nginx -V
nginx: nginx version: nginx/1.0.2
nginx: TLS SNI support enabled
nginx: configure arguments: --with-debug --prefix=/usr --sbin-path=/usr/sbin/nginx --conf-path=/etc/nginx/nginx.conf --pid-path=/var/run/nginx.pid --lock-path=/var/lock/nginx.lock --user=www --group=www --error-log-path=/var/log/nginx/error.log --http-log-path=/var/log/nginx/access.log --with-http_ssl_module --with-http_realip_module --with-http_addition_module --with-http_sub_module --with-http_dav_module --with-http_flv_module --with-http_gzip_static_module --with-http_secure_link_module --with-http_stub_status_module --http-client-body-temp-path=/var/lib/nginx/body --http-proxy-temp-path=/var/lib/nginx/proxy --http-fastcgi-temp-path=/var/lib/nginx/fastcgi --http-uwsgi-temp-path=/var/lib/nginx/uwsgi --http-scgi-temp-path=/var/lib/nginx/scgi --without-mail_pop3_module --without-mail_imap_module --without-mail_smtp_module

# gdb /usr/sbin/nginx /home/www/core
GNU gdb (GDB) 7.2
Copyright (C) 2010 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later http://gnu.org/licenses/gpl.html
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "i486-slackware-linux".
For bug reporting instructions, please see:
http://www.gnu.org/software/gdb/bugs/...
Reading symbols from /usr/sbin/nginx...(no debugging symbols found)...done.
[New Thread 1769]

warning: Can't read pathname for load map: Input/output error.
Reading symbols from /lib/libcrypt.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib/libcrypt.so.1
Reading symbols from /usr/lib/libpcre.so.0...(no debugging symbols found)...done.
Loaded symbols for /usr/lib/libpcre.so.0
Reading symbols from /usr/lib/libssl.so.0...(no debugging symbols found)...done.
Loaded symbols for /usr/lib/libssl.so.0
Reading symbols from /usr/lib/libcrypto.so.0...(no debugging symbols found)...done.
Loaded symbols for /usr/lib/libcrypto.so.0
Reading symbols from /lib/libdl.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libdl.so.2
Reading symbols from /usr/lib/libz.so.1...(no debugging symbols found)...done.
Loaded symbols for /usr/lib/libz.so.1
Reading symbols from /lib/libc.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib/libc.so.6
Reading symbols from /lib/ld-linux.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/ld-linux.so.2
Reading symbols from /lib/libnss_compat.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libnss_compat.so.2
Reading symbols from /lib/libnsl.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib/libnsl.so.1
Reading symbols from /lib/libnss_nis.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libnss_nis.so.2
Reading symbols from /lib/libnss_files.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libnss_files.so.2
Core was generated by `nginx: worker process '.
Program terminated with signal 11, Segmentation fault.
#0 0x0807d1fa in ?? ()
(gdb) backtrace
#0 0x0807d1fa in ?? ()
#1 0x080854ac in ?? ()
#2 0x0807d0c2 in ?? ()
#3 0x08062f13 in ?? ()
#4 0x08062a39 in ?? ()
#5 0x0806a205 in ?? ()
#6 0x080687c1 in ?? ()
#7 0x0806a7cc in ?? ()
#8 0x0806aee7 in ?? ()
#9 0x0804cea8 in ?? ()
#10 0xb7491db6 in __libc_start_main () from /lib/libc.so.6
#11 0x0804bc21 in ?? ()
(gdb) bt full
#0 0x0807d1fa in ?? ()
No symbol table info available.
#1 0x080854ac in ?? ()
No symbol table info available.
#2 0x0807d0c2 in ?? ()
No symbol table info available.
#3 0x08062f13 in ?? ()
No symbol table info available.
#4 0x08062a39 in ?? ()
No symbol table info available.
#5 0x0806a205 in ?? ()
No symbol table info available.
#6 0x080687c1 in ?? ()
No symbol table info available.
#7 0x0806a7cc in ?? ()
No symbol table info available.
#8 0x0806aee7 in ?? ()
No symbol table info available.
#9 0x0804cea8 in ?? ()
No symbol table info available.
#10 0xb7491db6 in __libc_start_main () from /lib/libc.so.6
No symbol table info available.
#11 0x0804bc21 in ?? ()
No symbol table info available.
(gdb) quit


# stat core
File: `core'
Size: 1515520 Blocks: 2488 IO Block: 4096 regular file
Device: 807h/2055d Inode: 18350096 Links: 1
Access: (0600/-rw-------) Uid: ( 48/ www) Gid: ( 48/ www)
Access: 2011-05-14 14:08:39.000000000 +0000
Modify: 2011-05-14 14:08:39.000000000 +0000
Change: 2011-05-14 14:08:39.000000000 +0000
Birth: -

/var/log/nginx# cat segfault.log|grep "14:08:39"
2011/05/14 14:08:39 [debug] 1768#0: timer delta: 501
2011/05/14 14:08:39 [debug] 1768#0: posted events 00000000
2011/05/14 14:08:39 [debug] 1768#0: worker cycle
2011/05/14 14:08:39 [debug] 1768#0: accept mutex lock failed: 0
2011/05/14 14:08:39 [debug] 1768#0: epoll timer: 500
2011/05/14 14:08:39 [debug] 1769#0: epoll: fd:7 ev:0001 d:08D42248
2011/05/14 14:08:39 [debug] 1769#0: *28081 post event 08D5AF50
2011/05/14 14:08:39 [debug] 1769#0: timer delta: 1797
2011/05/14 14:08:39 [debug] 1769#0: posted events 08D5AF50
2011/05/14 14:08:39 [debug] 1769#0: posted event 08D5AF50
2011/05/14 14:08:39 [debug] 1769#0: *28081 delete posted event 08D5AF50
2011/05/14 14:08:39 [debug] 1769#0: *28081 malloc: 08D31F70:680
2011/05/14 14:08:39 [debug] 1769#0: *28081 malloc: 08D33B18:1024
2011/05/14 14:08:39 [debug] 1769#0: *28081 posix_memalign: 08CFAE70:4096 @16
2011/05/14 14:08:39 [debug] 1769#0: *28081 http process request line
2011/05/14 14:08:39 [debug] 1769#0: *28081 recv: fd:7 536 of 1024
2011/05/14 14:08:39 [debug] 1769#0: *28081 http request line: "POST /index.php?taigachat/list.json HTTP/1.1"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http uri: "/index.php"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http args: "taigachat/list.json"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http exten: "php"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http process request header line
2011/05/14 14:08:39 [debug] 1769#0: *28081 http header: "Host: example.com"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http header: "Connection: keep-alive"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http header: "Referer: http://example.com/forum/"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http header: "Content-Length: 142"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http header: "Origin: http://example.com"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http header: "X-Requested-With: XMLHttpRequest"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http header: "User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/534.24 (KHTML, like Gecko) Chrome/11.0.696.65 Safari/534.24"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http header: "Content-Type: application/x-www-form-urlencoded"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http header: "Accept: application/json, text/javascript, */*; q=0.01"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http header: "Accept-Encoding: gzip,deflate"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http header: "Accept-Language: da-DK,da;q=0.8,en-US;q=0.6,en;q=0.4"
2011/05/14 14:08:39 [debug] 1769#0: *28081 recv: fd:7 -1 of 488
2011/05/14 14:08:39 [debug] 1769#0: *28081 recv() not ready (11: Resource temporarily unavailable)
2011/05/14 14:08:39 [debug] 1769#0: posted event 00000000
2011/05/14 14:08:39 [debug] 1769#0: worker cycle
2011/05/14 14:08:39 [debug] 1769#0: accept mutex locked
2011/05/14 14:08:39 [debug] 1769#0: epoll timer: 58203
2011/05/14 14:08:39 [debug] 1769#0: epoll: fd:7 ev:0001 d:08D42248
2011/05/14 14:08:39 [debug] 1769#0: *28081 post event 08D5AF50
2011/05/14 14:08:39 [debug] 1769#0: timer delta: 128
2011/05/14 14:08:39 [debug] 1769#0: posted events 08D5AF50
2011/05/14 14:08:39 [debug] 1769#0: posted event 08D5AF50
2011/05/14 14:08:39 [debug] 1769#0: *28081 delete posted event 08D5AF50
2011/05/14 14:08:39 [debug] 1769#0: *28081 http process request header line
2011/05/14 14:08:39 [debug] 1769#0: *28081 recv: fd:7 488 of 488
2011/05/14 14:08:39 [debug] 1769#0: *28081 http header: "Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.3"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http header: "Cookie: __utmz=206500500.1304337103.1.1.utmcsr=(direct)|utmccn=(direct)|utmcmd=(none); xf_user=1931%2C8b0bad949f0d38b81a46469cb9a941ec05485539; xf_session=53cda77e55ba8e987ba0fb8183cdd326; __utma=206500500.1451942054.1304337103.1305342568.1305355474.64; __utmc=206500500; __utmb=206500500.4.10.1305355474"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http header done
2011/05/14 14:08:39 [debug] 1769#0: *28081 event timer del: 7: 4007086959
2011/05/14 14:08:39 [debug] 1769#0: *28081 generic phase: 0
2011/05/14 14:08:39 [debug] 1769#0: *28081 rewrite phase: 1
2011/05/14 14:08:39 [debug] 1769#0: *28081 test location: "/"
2011/05/14 14:08:39 [debug] 1769#0: *28081 test location: "forum/"
2011/05/14 14:08:39 [debug] 1769#0: *28081 test location: ~ "\.(jpg|jpeg|gif|css|png|js|ico)$"
2011/05/14 14:08:39 [debug] 1769#0: *28081 test location: ~ "\.php$"
2011/05/14 14:08:39 [debug] 1769#0: *28081 using configuration "\.php$"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http cl:142 max:52428800
2011/05/14 14:08:39 [debug] 1769#0: *28081 rewrite phase: 3
2011/05/14 14:08:39 [debug] 1769#0: *28081 post rewrite phase: 4
2011/05/14 14:08:39 [debug] 1769#0: *28081 generic phase: 5
2011/05/14 14:08:39 [debug] 1769#0: *28081 generic phase: 6
2011/05/14 14:08:39 [debug] 1769#0: *28081 generic phase: 7
2011/05/14 14:08:39 [debug] 1769#0: *28081 access phase: 8
2011/05/14 14:08:39 [debug] 1769#0: *28081 access phase: 9
2011/05/14 14:08:39 [debug] 1769#0: *28081 post access phase: 10
2011/05/14 14:08:39 [debug] 1769#0: *28081 try files phase: 11
2011/05/14 14:08:39 [debug] 1769#0: *28081 http client request body preread 137
2011/05/14 14:08:39 [debug] 1769#0: *28081 http read client request body
2011/05/14 14:08:39 [debug] 1769#0: *28081 recv: fd:7 5 of 5
2011/05/14 14:08:39 [debug] 1769#0: *28081 http client request body recv 5
2011/05/14 14:08:39 [debug] 1769#0: *28081 http client request body rest 0
2011/05/14 14:08:39 [debug] 1769#0: *28081 http init upstream, client timer: 0
2011/05/14 14:08:39 [debug] 1769#0: *28081 epoll add event: fd:7 op:3 ev:80000005
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script copy: "SCRIPT_FILENAME"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script var: "/home/www/example.com/htdocs"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script var: "/index.php"
2011/05/14 14:08:39 [debug] 1769#0: *28081 fastcgi param: "SCRIPT_FILENAME: /home/www/example.com/htdocs/index.php"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script copy: "QUERY_STRING"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script var: "taigachat/list.json"
2011/05/14 14:08:39 [debug] 1769#0: *28081 fastcgi param: "QUERY_STRING: taigachat/list.json"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script copy: "REQUEST_METHOD"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script var: "POST"
2011/05/14 14:08:39 [debug] 1769#0: *28081 fastcgi param: "REQUEST_METHOD: POST"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script copy: "CONTENT_TYPE"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script var: "application/x-www-form-urlencoded"
2011/05/14 14:08:39 [debug] 1769#0: *28081 fastcgi param: "CONTENT_TYPE: application/x-www-form-urlencoded"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script copy: "CONTENT_LENGTH"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script var: "142"
2011/05/14 14:08:39 [debug] 1769#0: *28081 fastcgi param: "CONTENT_LENGTH: 142"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script copy: "SCRIPT_NAME"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script var: "/index.php"
2011/05/14 14:08:39 [debug] 1769#0: *28081 fastcgi param: "SCRIPT_NAME: /index.php"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script copy: "REQUEST_URI"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script var: "/index.php?taigachat/list.json"
2011/05/14 14:08:39 [debug] 1769#0: *28081 fastcgi param: "REQUEST_URI: /index.php?taigachat/list.json"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script copy: "DOCUMENT_URI"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script var: "/index.php"
2011/05/14 14:08:39 [debug] 1769#0: *28081 fastcgi param: "DOCUMENT_URI: /index.php"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script copy: "DOCUMENT_ROOT"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script var: "/home/www/example.com/htdocs"
2011/05/14 14:08:39 [debug] 1769#0: *28081 fastcgi param: "DOCUMENT_ROOT: /home/www/example.com/htdocs"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script copy: "SERVER_PROTOCOL"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script var: "HTTP/1.1"
2011/05/14 14:08:39 [debug] 1769#0: *28081 fastcgi param: "SERVER_PROTOCOL: HTTP/1.1"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script copy: "GATEWAY_INTERFACE"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script copy: "CGI/1.1"
2011/05/14 14:08:39 [debug] 1769#0: *28081 fastcgi param: "GATEWAY_INTERFACE: CGI/1.1"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script copy: "SERVER_SOFTWARE"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script copy: "nginx/"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script var: "1.0.2"
2011/05/14 14:08:39 [debug] 1769#0: *28081 fastcgi param: "SERVER_SOFTWARE: nginx/1.0.2"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script copy: "REMOTE_ADDR"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script var: "[REMOTE IP ADDRESS]"
2011/05/14 14:08:39 [debug] 1769#0: *28081 fastcgi param: "REMOTE_ADDR: [REMOTE IP ADDRESS]"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script copy: "REMOTE_PORT"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script var: "58057"
2011/05/14 14:08:39 [debug] 1769#0: *28081 fastcgi param: "REMOTE_PORT: 58057"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script copy: "SERVER_ADDR"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script var: "[SERVER IP ADDRESS]"
2011/05/14 14:08:39 [debug] 1769#0: *28081 fastcgi param: "SERVER_ADDR: [SERVER IP ADDRESS]"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script copy: "SERVER_PORT"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script var: "80"
2011/05/14 14:08:39 [debug] 1769#0: *28081 fastcgi param: "SERVER_PORT: 80"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script copy: "SERVER_NAME"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script var: "example.com"
2011/05/14 14:08:39 [debug] 1769#0: *28081 fastcgi param: "SERVER_NAME: example.com"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script copy: "REDIRECT_STATUS"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http script copy: "200"
2011/05/14 14:08:39 [debug] 1769#0: *28081 fastcgi param: "REDIRECT_STATUS: 200"
2011/05/14 14:08:39 [debug] 1769#0: *28081 fastcgi param: "HTTP_HOST: example.com"
2011/05/14 14:08:39 [debug] 1769#0: *28081 fastcgi param: "HTTP_CONNECTION: keep-alive"
2011/05/14 14:08:39 [debug] 1769#0: *28081 fastcgi param: "HTTP_REFERER: http://example.com/forum/"
2011/05/14 14:08:39 [debug] 1769#0: *28081 fastcgi param: "HTTP_CONTENT_LENGTH: 142"
2011/05/14 14:08:39 [debug] 1769#0: *28081 fastcgi param: "HTTP_ORIGIN: http://example.com"
2011/05/14 14:08:39 [debug] 1769#0: *28081 fastcgi param: "HTTP_X_REQUESTED_WITH: XMLHttpRequest"
2011/05/14 14:08:39 [debug] 1769#0: *28081 fastcgi param: "HTTP_USER_AGENT: Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/534.24 (KHTML, like Gecko) Chrome/11.0.696.65 Safari/534.24"
2011/05/14 14:08:39 [debug] 1769#0: *28081 fastcgi param: "HTTP_CONTENT_TYPE: application/x-www-form-urlencoded"
2011/05/14 14:08:39 [debug] 1769#0: *28081 fastcgi param: "HTTP_ACCEPT: application/json, text/javascript, */*; q=0.01"
2011/05/14 14:08:39 [debug] 1769#0: *28081 fastcgi param: "HTTP_ACCEPT_ENCODING: gzip,deflate"
2011/05/14 14:08:39 [debug] 1769#0: *28081 fastcgi param: "HTTP_ACCEPT_LANGUAGE: da-DK,da;q=0.8,en-US;q=0.6,en;q=0.4"
2011/05/14 14:08:39 [debug] 1769#0: *28081 fastcgi param: "HTTP_ACCEPT_CHARSET: ISO-8859-1,utf-8;q=0.7,*;q=0.3"
2011/05/14 14:08:39 [debug] 1769#0: *28081 fastcgi param: "HTTP_COOKIE: __utmz=206500500.1304337103.1.1.utmcsr=(direct)|utmccn=(direct)|utmcmd=(none); xf_user=1931%2C8b0bad949f0d38b81a46469cb9a941ec05485539; xf_session=53cda77e55ba8e987ba0fb8183cdd326; __utma=206500500.1451942054.1304337103.1305342568.1305355474.64; __utmc=206500500; __utmb=206500500.4.10.1305355474"
2011/05/14 14:08:39 [debug] 1769#0: *28081 posix_memalign: 08CFD490:4096 @16
2011/05/14 14:08:39 [debug] 1769#0: *28081 http cleanup add: 08CFD510
2011/05/14 14:08:39 [debug] 1769#0: *28081 get rr peer, try: 1
2011/05/14 14:08:39 [debug] 1769#0: *28081 socket 9
2011/05/14 14:08:39 [debug] 1769#0: *28081 epoll add connection: fd:9 ev:80000005
2011/05/14 14:08:39 [debug] 1769#0: *28081 connect to unix:/var/run/php-fpm.sock, fd:9 #28082
2011/05/14 14:08:39 [debug] 1769#0: *28081 connected
2011/05/14 14:08:39 [debug] 1769#0: *28081 http upstream connect: 0
2011/05/14 14:08:39 [debug] 1769#0: *28081 http upstream send request
2011/05/14 14:08:39 [debug] 1769#0: *28081 chain writer buf fl:0 s:1448
2011/05/14 14:08:39 [debug] 1769#0: *28081 chain writer buf fl:0 s:137
2011/05/14 14:08:39 [debug] 1769#0: *28081 chain writer buf fl:0 s:15
2011/05/14 14:08:39 [debug] 1769#0: *28081 chain writer buf fl:0 s:5
2011/05/14 14:08:39 [debug] 1769#0: *28081 chain writer buf fl:0 s:11
2011/05/14 14:08:39 [debug] 1769#0: *28081 chain writer in: 08CFD554
2011/05/14 14:08:39 [debug] 1769#0: *28081 writev: 1616
2011/05/14 14:08:39 [debug] 1769#0: *28081 chain writer out: 00000000
2011/05/14 14:08:39 [debug] 1769#0: *28081 event timer add: 9: 180000:4007208884
2011/05/14 14:08:39 [debug] 1769#0: *28081 http finalize request: -4, "/index.php?taigachat/list.json" a:1, c:2
2011/05/14 14:08:39 [debug] 1769#0: *28081 http request count:2 blk:0
2011/05/14 14:08:39 [debug] 1769#0: posted event 00000000
2011/05/14 14:08:39 [debug] 1769#0: worker cycle
2011/05/14 14:08:39 [debug] 1769#0: accept mutex locked
2011/05/14 14:08:39 [debug] 1769#0: epoll timer: 180000
2011/05/14 14:08:39 [debug] 1769#0: epoll: fd:7 ev:0005 d:08D42248
2011/05/14 14:08:39 [debug] 1769#0: *28081 post event 08D5AF50
2011/05/14 14:08:39 [debug] 1769#0: *28081 post event 08D67F58
2011/05/14 14:08:39 [debug] 1769#0: epoll: fd:9 ev:0004 d:08D4243D
2011/05/14 14:08:39 [debug] 1769#0: *28081 post event 08D6805C
2011/05/14 14:08:39 [debug] 1769#0: timer delta: 1
2011/05/14 14:08:39 [debug] 1769#0: posted events 08D6805C
2011/05/14 14:08:39 [debug] 1769#0: posted event 08D6805C
2011/05/14 14:08:39 [debug] 1769#0: *28081 delete posted event 08D6805C
2011/05/14 14:08:39 [debug] 1769#0: *28081 http upstream request: "/index.php?taigachat/list.json"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http upstream dummy handler
2011/05/14 14:08:39 [debug] 1769#0: posted event 08D67F58
2011/05/14 14:08:39 [debug] 1769#0: *28081 delete posted event 08D67F58
2011/05/14 14:08:39 [debug] 1769#0: *28081 http run request: "/index.php?taigachat/list.json"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http request empty handler
2011/05/14 14:08:39 [debug] 1769#0: posted event 08D5AF50
2011/05/14 14:08:39 [debug] 1769#0: *28081 delete posted event 08D5AF50
2011/05/14 14:08:39 [debug] 1769#0: *28081 http run request: "/index.php?taigachat/list.json"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http read client request body
2011/05/14 14:08:39 [debug] 1769#0: *28081 add cleanup: 08CFD63C
2011/05/14 14:08:39 [debug] 1769#0: *28081 hashed path: /var/lib/nginx/body/0000000001
2011/05/14 14:08:39 [debug] 1769#0: *28081 temp fd:13
2011/05/14 14:08:39 [warn] 1769#0: *28081 a client request body is buffered to a temporary file /var/lib/nginx/body/0000000001 while sending request to upstream, client: [REMOTE IP ADDRESS], server: example.com, request: "POST /index.php?taigachat/list.json HTTP/1.1", upstream: "fastcgi://unix:/var/run/php-fpm.sock:", host: "example.com", referrer: "http://example.com/forum/"
2011/05/14 14:08:39 [debug] 1769#0: *28081 write: 13, 08CFB790, 5, 0
2011/05/14 14:08:39 [debug] 1769#0: *28081 recv: fd:7 0 of 0
2011/05/14 14:08:39 [debug] 1769#0: *28081 http client request body recv 0
2011/05/14 14:08:39 [info] 1769#0: *28081 client closed prematurely connection while sending request to upstream, client: [REMOTE IP ADDRESS], server: example.com, request: "POST /index.php?taigachat/list.json HTTP/1.1", upstream: "fastcgi://unix:/var/run/php-fpm.sock:", host: "example.com", referrer: "http://example.com/forum/"
2011/05/14 14:08:39 [debug] 1769#0: *28081 http finalize request: 400, "/index.php?taigachat/list.json" a:1, c:1
2011/05/14 14:08:39 [debug] 1769#0: *28081 http terminate request count:1
2011/05/14 14:08:39 [debug] 1769#0: *28081 cleanup http upstream request: "/index.php"
2011/05/14 14:08:39 [debug] 1769#0: *28081 finalize http upstream request: -4
2011/05/14 14:08:39 [debug] 1769#0: *28081 finalize http fastcgi request
2011/05/14 14:08:39 [debug] 1769#0: *28081 free rr peer 1 0
2011/05/14 14:08:39 [debug] 1769#0: *28081 close http upstream connection: 9
2011/05/14 14:08:39 [debug] 1769#0: *28081 event timer del: 9: 4007208884
2011/05/14 14:08:39 [debug] 1769#0: *28081 reusable connection: 0
2011/05/14 14:08:39 [debug] 1769#0: *28081 http finalize request: -4, "/index.php?taigachat/list.json" a:1, c:1
2011/05/14 14:08:39 [debug] 1769#0: *28081 set http keepalive handler
2011/05/14 14:08:39 [debug] 1769#0: *28081 http close request
2011/05/14 14:08:39 [debug] 1769#0: *28081 http log handler
2011/05/14 14:08:39 [debug] 1769#0: *28081 run cleanup: 08CFD63C
2011/05/14 14:08:39 [debug] 1769#0: *28081 file cleanup: fd:13
2011/05/14 14:08:39 [debug] 1769#0: *28081 free: 08CFAE70, unused: 5
2011/05/14 14:08:39 [debug] 1769#0: *28081 free: 08CFD490, unused: 3417
2011/05/14 14:08:39 [debug] 1769#0: *28081 event timer add: 7: 75000:4007103885
2011/05/14 14:08:39 [debug] 1769#0: *28081 free: 08D31F70
2011/05/14 14:08:39 [debug] 1769#0: *28081 free: 08D33B18
2011/05/14 14:08:39 [debug] 1769#0: *28081 hc free: 00000000 0
2011/05/14 14:08:39 [debug] 1769#0: *28081 hc busy: 00000000 0
2011/05/14 14:08:39 [debug] 1769#0: *28081 tcp_nodelay
2011/05/14 14:08:39 [debug] 1769#0: *28081 reusable connection: 1
2011/05/14 14:08:39 [notice] 1767#0: signal 17 (SIGCHLD) received
2011/05/14 14:08:39 [alert] 1767#0: worker process 1769 exited on signal 11 (core dumped)
2011/05/14 14:08:39 [debug] 1767#0: wake up, sigio 0
2011/05/14 14:08:39 [debug] 1767#0: reap children
2011/05/14 14:08:39 [debug] 1767#0: child: 0 1768 e:0 t:0 d:0 r:1 j:0
2011/05/14 14:08:39 [debug] 1767#0: child: 1 1769 e:0 t:1 d:0 r:1 j:0
2011/05/14 14:08:39 [debug] 1767#0: pass close channel s:1 pid:1769 to:1768
2011/05/14 14:08:39 [debug] 1767#0: channel 7:10
2011/05/14 14:08:39 [debug] 1768#0: epoll: fd:9 ev:0001 d:08D41C6C
2011/05/14 14:08:39 [debug] 1768#0: channel handler
2011/05/14 14:08:39 [debug] 1768#0: channel: 16
2011/05/14 14:08:39 [debug] 1768#0: channel command: 2
2011/05/14 14:08:39 [debug] 1768#0: close channel s:1 pid:1769 our:1769 fd:3
2011/05/14 14:08:39 [debug] 1768#0: channel: -2
2011/05/14 14:08:39 [debug] 1768#0: timer delta: 376
2011/05/14 14:08:39 [debug] 1768#0: posted events 00000000
2011/05/14 14:08:39 [debug] 1768#0: worker cycle
2011/05/14 14:08:39 [debug] 1768#0: accept mutex locked
2011/05/14 14:08:39 [debug] 1768#0: epoll add event: fd:8 op:1 ev:00000001
2011/05/14 14:08:39 [debug] 1768#0: epoll timer: 21259
2011/05/14 14:08:39 [notice] 1767#0: start worker process 3483
2011/05/14 14:08:39 [debug] 1767#0: pass channel s:1 pid:3483 fd:7 to s:0 pid:1768 fd:3
2011/05/14 14:08:39 [debug] 1767#0: sigsuspend
2011/05/14 14:08:39 [debug] 1768#0: epoll: fd:9 ev:0001 d:08D41C6C
2011/05/14 14:08:39 [debug] 1768#0: post event 08D5AC44
2011/05/14 14:08:39 [debug] 1768#0: timer delta: 0
2011/05/14 14:08:39 [debug] 1768#0: posted events 08D5AC44
2011/05/14 14:08:39 [debug] 1768#0: posted event 08D5AC44
2011/05/14 14:08:39 [notice] 1767#0: signal 29 (SIGIO) received
2011/05/14 14:08:39 [debug] 1768#0: delete posted event 08D5AC44
2011/05/14 14:08:39 [debug] 1767#0: wake up, sigio 0
2011/05/14 14:08:39 [debug] 1768#0: channel handler
2011/05/14 14:08:39 [debug] 1767#0: sigsuspend
2011/05/14 14:08:39 [debug] 1768#0: channel: 16
2011/05/14 14:08:39 [debug] 1768#0: channel command: 1
2011/05/14 14:08:39 [debug] 1768#0: get channel s:1 pid:3483 fd:3
2011/05/14 14:08:39 [debug] 1768#0: channel: -2
2011/05/14 14:08:39 [debug] 1768#0: posted event 00000000
2011/05/14 14:08:39 [debug] 1768#0: worker cycle
2011/05/14 14:08:39 [debug] 1768#0: accept mutex locked
2011/05/14 14:08:39 [debug] 1768#0: epoll timer: 21259
2011/05/14 14:08:39 [notice] 3483#0: sched_setaffinity(0x0000000A)
2011/05/14 14:08:39 [debug] 3483#0: malloc: 08D0A9F8:6144
2011/05/14 14:08:39 [debug] 3483#0: malloc: 08D41C08:102400
2011/05/14 14:08:39 [debug] 3483#0: malloc: 08D5AC10:53248
2011/05/14 14:08:39 [debug] 3483#0: malloc: 08D67C18:53248
2011/05/14 14:08:39 [debug] 3483#0: epoll add event: fd:10 op:1 ev:00000001
2011/05/14 14:08:39 [debug] 3483#0: setproctitle: "nginx: worker process"
2011/05/14 14:08:39 [debug] 3483#0: worker cycle
2011/05/14 14:08:39 [debug] 3483#0: accept mutex lock failed: 0
2011/05/14 14:08:39 [debug] 3483#0: epoll timer: 500


# cat nginx.conf
user www www;
worker_processes 2;
worker_cpu_affinity 0101 1010;
error_log /var/log/nginx/segfault.log debug;
#error_log /var/log/nginx/error.log notice;

worker_rlimit_core 500M;
working_directory /home/www/;

events {
worker_connections 1024;
}
http {
include mime.types;
default_type application/octet-stream;
log_format upstream '$remote_addr - - [$time_local] "$request" $status '
'upstream $upstream_response_time request $request_time bytes $bytes_sent body_bytes $body_bytes_sent '
'[$host]';

sendfile on;
server_tokens off;
keepalive_timeout 75;
client_max_body_size 50M;

gzip on;
gzip_proxied any;
gzip_vary on;
gzip_disable "msie6";
gzip_types text/plain text/css application/json application/x-javascript text/xml application/xml application/xml+rss text/javascript;

fastcgi_max_temp_file_size 0;
open_file_cache max=1000 inactive=120s;
open_file_cache_valid 120s;
open_file_cache_min_uses 5;
open_file_cache_errors on;

index index.php index.html;
include /etc/nginx/enabled/*.conf;
}

# cat enabled/default.conf
server {
listen 80 default;
server_name _;
server_name_in_redirect off;

log_format vhost '$host $remote_addr - $remote_user [$time_local] "$request" '
'$status $body_bytes_sent "$http_referer" '
'"$http_user_agent" "$http_x_forwarded_for"';

access_log /var/log/nginx/default_vhost.log vhost;
root /home/www/default/;

location ~ \.php$ {
try_files $uri =404;
fastcgi_pass unix:/var/run/php-fpm.sock;
fastcgi_index index.php;
include fastcgi.conf;
fastcgi_intercept_errors on;
}

location ~* \.(jpg|jpeg|gif|css|png|js|ico)$ {
log_not_found off;
access_log off;
expires max;
}
}

# cat enabled/example.com.conf
server {
server_name www.example.com;
rewrite ^ $scheme://example.com$request_uri? permanent;
}

server {
server_name example.com;
root /home/www/example.com/htdocs/;

location ~* \.(jpg|jpeg|gif|css|png|js|ico)$ {
access_log off;
expires 30d;
}

location ^~ /forum/ {
rewrite ^/forum/$ /$1? last;
rewrite ^/forum/(.+)$ /$1? permanent;
}

location / {
try_files $uri $uri/ /index.php?$uri&$args;
}

location /blog/ {
try_files $uri $uri/ /blog/index.php?$uri&$args;
}

location ~ \.php$ {
try_files $uri =404;
access_log /var/log/nginx/upstream.log upstream;
fastcgi_pass unix:/var/run/php-fpm.sock;
fastcgi_index index.php;
include fastcgi.conf;
fastcgi_intercept_errors on;
fastcgi_ignore_client_abort on;
}

location ~ /\.ht {
access_log off;
log_not_found off;
deny all;
}

location ~ /(internal_data|library)/ {
allow 127.0.0.1;
deny all;
}
}

# cat localhost.conf
server {
server_name localhost 127.0.0.1;
access_log off;
root /home/www/default/;
location /nginx_status {
stub_status on;
access_log off;
allow 127.0.0.1;
deny all;
}
}

# cat fastcgi.conf

fastcgi_param SCRIPT_FILENAME $document_root$fastcgi_script_name;
fastcgi_param QUERY_STRING $query_string;
fastcgi_param REQUEST_METHOD $request_method;
fastcgi_param CONTENT_TYPE $content_type;
fastcgi_param CONTENT_LENGTH $content_length;

fastcgi_param SCRIPT_NAME $fastcgi_script_name;
fastcgi_param REQUEST_URI $request_uri;
fastcgi_param DOCUMENT_URI $document_uri;
fastcgi_param DOCUMENT_ROOT $document_root;
fastcgi_param SERVER_PROTOCOL $server_protocol;

fastcgi_param GATEWAY_INTERFACE CGI/1.1;
fastcgi_param SERVER_SOFTWARE nginx/$nginx_version;

fastcgi_param REMOTE_ADDR $remote_addr;
fastcgi_param REMOTE_PORT $remote_port;
fastcgi_param SERVER_ADDR $server_addr;
fastcgi_param SERVER_PORT $server_port;
fastcgi_param SERVER_NAME $server_name;

# PHP only, required if PHP was built with --enable-force-cgi-redirect
fastcgi_param REDIRECT_STATUS 200;






Also an earlier segfault, however I was not running a error_log at debug at the time. Same nginx build and same config as above.

# nginx -V
nginx: nginx version: nginx/1.0.2
nginx: TLS SNI support enabled
nginx: configure arguments: --with-debug --prefix=/usr --sbin-path=/usr/sbin/nginx --conf-path=/etc/nginx/nginx.conf --pid-path=/var/run/nginx.pid --lock-path=/var/lock/nginx.lock --user=www --group=www --error-log-path=/var/log/nginx/error.log --http-log-path=/var/log/nginx/access.log --with-http_ssl_module --with-http_realip_module --with-http_addition_module --with-http_sub_module --with-http_dav_module --with-http_flv_module --with-http_gzip_static_module --with-http_secure_link_module --with-http_stub_status_module --http-client-body-temp-path=/var/lib/nginx/body --http-proxy-temp-path=/var/lib/nginx/proxy --http-fastcgi-temp-path=/var/lib/nginx/fastcgi --http-uwsgi-temp-path=/var/lib/nginx/uwsgi --http-scgi-temp-path=/var/lib/nginx/scgi --without-mail_pop3_module --without-mail_imap_module --without-mail_smtp_module

# stat core
File: `core'
Size: 1490944 Blocks: 2232 IO Block: 4096 regular file
Device: 807h/2055d Inode: 18350095 Links: 1
Access: (0600/-rw-------) Uid: ( 48/ www) Gid: ( 48/ www)
Access: 2011-05-14 10:14:35.000000000 +0000
Modify: 2011-05-14 10:14:35.000000000 +0000
Change: 2011-05-14 10:14:35.000000000 +0000
Birth: -

# gdb /usr/sbin/nginx /home/www/core
GNU gdb (GDB) 7.2
Copyright (C) 2010 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later http://gnu.org/licenses/gpl.html
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "i486-slackware-linux".
For bug reporting instructions, please see:
http://www.gnu.org/software/gdb/bugs/...
Reading symbols from /usr/sbin/nginx...(no debugging symbols found)...done.
[New Thread 18354]

warning: Can't read pathname for load map: Input/output error.
Reading symbols from /lib/libcrypt.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib/libcrypt.so.1
Reading symbols from /usr/lib/libpcre.so.0...(no debugging symbols found)...done.
Loaded symbols for /usr/lib/libpcre.so.0
Reading symbols from /usr/lib/libssl.so.0...(no debugging symbols found)...done.
Loaded symbols for /usr/lib/libssl.so.0
Reading symbols from /usr/lib/libcrypto.so.0...(no debugging symbols found)...done.
Loaded symbols for /usr/lib/libcrypto.so.0
Reading symbols from /lib/libdl.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libdl.so.2
Reading symbols from /usr/lib/libz.so.1...(no debugging symbols found)...done.
Loaded symbols for /usr/lib/libz.so.1
Reading symbols from /lib/libc.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib/libc.so.6
Reading symbols from /lib/ld-linux.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/ld-linux.so.2
Reading symbols from /lib/libnss_compat.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libnss_compat.so.2
Reading symbols from /lib/libnsl.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib/libnsl.so.1
Reading symbols from /lib/libnss_nis.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libnss_nis.so.2
Reading symbols from /lib/libnss_files.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libnss_files.so.2
Core was generated by `nginx:'.
Program terminated with signal 11, Segmentation fault.
#0 0x0807d1fa in ?? ()
(gdb) bt
#0 0x0807d1fa in ?? ()
#1 0x080854ac in ?? ()
#2 0x0807d0c2 in ?? ()
#3 0x08062f13 in ?? ()
#4 0x08062a39 in ?? ()
#5 0x0806a205 in ?? ()
#6 0x080687c1 in ?? ()
#7 0x0806a7cc in ?? ()
#8 0x0806aee7 in ?? ()
#9 0x0804cea8 in ?? ()
#10 0xb74afdb6 in __libc_start_main () from /lib/libc.so.6
#11 0x0804bc21 in ?? ()
(gdb) bt full
#0 0x0807d1fa in ?? ()
No symbol table info available.
#1 0x080854ac in ?? ()
No symbol table info available.
#2 0x0807d0c2 in ?? ()
No symbol table info available.
#3 0x08062f13 in ?? ()
No symbol table info available.
#4 0x08062a39 in ?? ()
No symbol table info available.
#5 0x0806a205 in ?? ()
No symbol table info available.
#6 0x080687c1 in ?? ()
No symbol table info available.
#7 0x0806a7cc in ?? ()
No symbol table info available.
#8 0x0806aee7 in ?? ()
No symbol table info available.
#9 0x0804cea8 in ?? ()
No symbol table info available.
#10 0xb74afdb6 in __libc_start_main () from /lib/libc.so.6
No symbol table info available.
#11 0x0804bc21 in ?? ()
No symbol table info available.
(gdb) quit

# error.log
2011/05/14 10:14:35 [warn] 18354#0: *1707 a client request body is buffered to a temporary file /var/lib/nginx/body/0000000001 while sending request to upstream, client: [CLIENT IP ADDRESS], server: example.com, request: "POST /login/csrf-token-refresh HTTP/1.1", upstream: "fastcgi://unix:/var/run/php-fpm.sock:", host: "example.com", referrer: "http://example.com/threads/THREADNAME.9709/"
2011/05/14 10:14:35 [info] 18354#0: *1707 client closed prematurely connection while sending request to upstream, client: [CLIENT IP ADDRESS], server: example.com, request: "POST /login/csrf-token-refresh HTTP/1.1", upstream: "fastcgi://unix:/var/run/php-fpm.sock:", host: "example.com", referrer: "http://example.com/threads/THREADNAME.9709/"
2011/05/14 10:14:35 [notice] 18353#0: signal 17 (SIGCHLD) received
2011/05/14 10:14:35 [alert] 18353#0: worker process 18354 exited on signal 11 (core dumped)
2011/05/14 10:14:35 [notice] 18353#0: start worker process 14632
2011/05/14 10:14:35 [notice] 18353#0: signal 29 (SIGIO) received
2011/05/14 10:14:35 [notice] 14632#0: sched_setaffinity(0x0000000A)