Welcome! Log In Create A New Profile

Advanced

OOM в linux под нагрузкой

Alex Loskutov
May 12, 2010 05:02AM
Здравствуйте.
Вопрос не напрямую по nginx, но быть может вы можете посоветовать, куда
смотреть.
В пиках нагрузки (до 500 запросов в секунду) в системе возникает OOM,
oom_killer убивает сначала memcached (начинает использоваться резервный), а
потом воркеры nginx.
ядро 2.6.18-8.el5PAE #1 SMP i686
nginx/0.6.35
4 гигабайта оперативки (остаются в основном свободными во время развития
проблемы)
netstat -ant | wc -l под нагрузкой до 35000

в error.log только
2010/05/12 00:01:57 [alert] 13602#0: worker process 25850 exited on signal 9
2010/05/12 00:01:57 [crit] 25858#0: *69590141 SSL_do_handshake() failed
(SSL: error:140760FC:SSL routines:SSL23_GET_CLIENT_HELLO:unknown protocol)
while reading client request line, client: 10.11.2.195, server: nginx-1
2010/05/12 00:02:02 [alert] 13602#0: worker process 25858 exited on signal 9
2010/05/12 00:02:07 [alert] 13602#0: worker process 25867 exited on signal 9
2010/05/12 00:02:12 [alert] 13602#0: worker process 25886 exited on signal 9
....

/var/log/messages ниже

Спасибо заранее.

meminfo при маленькой нагрузке
# cat /proc/meminfo
MemTotal: 4152052 kB
MemFree: 149664 kB
Buffers: 103956 kB
Cached: 3257540 kB
SwapCached: 34836 kB
Active: 2304564 kB
Inactive: 1621656 kB
HighTotal: 3276480 kB
HighFree: 4516 kB
LowTotal: 875572 kB
LowFree: 145148 kB
SwapTotal: 2031608 kB
SwapFree: 1914948 kB
Dirty: 9596 kB
Writeback: 0 kB
AnonPages: 558040 kB
Mapped: 37780 kB
Slab: 62512 kB
PageTables: 2976 kB
NFS_Unstable: 0 kB
Bounce: 0 kB
CommitLimit: 4107632 kB
Committed_AS: 796096 kB
VmallocTotal: 116728 kB
VmallocUsed: 3464 kB
VmallocChunk: 113172 kB
HugePages_Total: 0
HugePages_Free: 0
HugePages_Rsvd: 0
Hugepagesize: 2048 kB

/var/log/messages:
May 12 00:01:37 localhost kernel: printk: 96236 messages suppressed.
May 12 00:01:37 localhost kernel: nginx invoked oom-killer: gfp_mask=0xd0,
order=1, oomkilladj=0
May 12 00:01:37 localhost kernel: [<c0450ace>] out_of_memory+0x3b/0x179
May 12 00:01:37 localhost kernel: [<c0451f01>] __alloc_pages+0x1fe/0x27e
May 12 00:01:37 localhost kernel: [<c0465e28>]
cache_alloc_refill+0x26d/0x44f
May 12 00:01:37 localhost kernel: nginx invoked oom-killer: gfp_mask=0xd0,
order=1, oomkilladj=0
May 12 00:01:37 localhost kernel: nginx invoked oom-killer: gfp_mask=0xd0,
order=1, oomkilladj=0
May 12 00:01:37 localhost kernel: [<c0450ace>] [<c0450ace>]
out_of_memory+0x3b/0x179
May 12 00:01:37 localhost kernel: out_of_memory+0x3b/0x179
May 12 00:01:37 localhost kernel: [<c0451f01>] [<c0451f01>]
__alloc_pages+0x1fe/0x27e
May 12 00:01:37 localhost kernel: __alloc_pages+0x1fe/0x27e
May 12 00:01:37 localhost kernel: [<c0465e28>] [<c0465e28>]
cache_alloc_refill+0x26d/0x44f
May 12 00:01:37 localhost kernel: cache_alloc_refill+0x26d/0x44f
May 12 00:01:37 localhost kernel: [<c0465bb1>] [<c0465bb1>]
kmem_cache_alloc+0x41/0x4b
May 12 00:01:37 localhost kernel: [<c059c045>] kmem_cache_alloc+0x41/0x4b
May 12 00:01:37 localhost kernel: [<c059c045>] sk_alloc+0x1e/0xe6
May 12 00:01:37 localhost kernel: sk_alloc+0x1e/0xe6
May 12 00:01:37 localhost kernel: [<c05dd45a>] [<c05dd45a>]
inet_create+0x10c/0x231
May 12 00:01:38 localhost kernel: inet_create+0x10c/0x231
May 12 00:01:38 localhost kernel: [<c059a5d0>] [<c059a5d0>]
__sock_create+0x133/0x213
May 12 00:01:38 localhost kernel: __sock_create+0x133/0x213
May 12 00:01:38 localhost kernel: [<c059a6c9>] [<c059a6c9>]
sock_create+0xb/0xe
May 12 00:01:38 localhost kernel: sock_create+0xb/0xe
May 12 00:01:38 localhost kernel: [<c059a8a8>] [<c059a8a8>]
sys_socket+0x18/0x38
May 12 00:01:38 localhost kernel: sys_socket+0x18/0x38
May 12 00:01:38 localhost kernel: [<c059b2a8>] [<c059b2a8>]
sys_socketcall+0x6c/0x19e
May 12 00:01:38 localhost kernel: sys_socketcall+0x6c/0x19e
May 12 00:01:38 localhost kernel: [<c0403e95>] [<c04063f2>]
sysenter_past_esp+0x56/0x79
May 12 00:01:38 localhost kernel: do_IRQ+0xa5/0xae
May 12 00:01:38 localhost kernel: [<c0403e95>] sysenter_past_esp+0x56/0x79
May 12 00:01:38 localhost kernel: =======================
May 12 00:01:39 localhost kernel: Mem-info:
May 12 00:01:39 localhost kernel: DMA per-cpu:
May 12 00:01:39 localhost kernel: =======================
May 12 00:01:39 localhost kernel: Mem-info:
May 12 00:01:39 localhost kernel: cpu 0 hot: high 0, batch 1 used:0
May 12 00:01:39 localhost kernel: cpu 0 cold: high 0, batch 1 used:0
May 12 00:01:39 localhost kernel: DMA per-cpu:
May 12 00:01:39 localhost kernel: cpu 1 hot: high 0, batch 1 used:0
May 12 00:01:40 localhost kernel: cpu 1 cold: high 0, batch 1 used:0
May 12 00:01:40 localhost kernel: cpu 0 hot: high 0, batch 1 used:0
May 12 00:01:40 localhost kernel: cpu 0 cold: high 0, batch 1 used:0
May 12 00:01:40 localhost kernel: cpu 1 hot: high 0, batch 1 used:0
May 12 00:01:40 localhost kernel: cpu 1 cold: high 0, batch 1 used:0
May 12 00:01:40 localhost kernel: cpu 2 hot: high 0, batch 1 used:0
May 12 00:01:40 localhost kernel: cpu 2 cold: high 0, batch 1 used:0
May 12 00:01:40 localhost kernel: cpu 2 hot: high 0, batch 1 used:0
May 12 00:01:41 localhost kernel: cpu 2 cold: high 0, batch 1 used:0
May 12 00:01:41 localhost kernel: cpu 3 hot: high 0, batch 1 used:0
May 12 00:01:41 localhost kernel: cpu 3 cold: high 0, batch 1 used:0
May 12 00:01:41 localhost kernel: cpu 3 hot: high 0, batch 1 used:0
May 12 00:01:41 localhost kernel: cpu 3 cold: high 0, batch 1 used:0
May 12 00:01:41 localhost kernel: DMA32 per-cpu: empty
May 12 00:01:41 localhost kernel: Normal per-cpu:
May 12 00:01:41 localhost kernel: DMA32 per-cpu: empty
May 12 00:01:41 localhost kernel: Normal per-cpu:
May 12 00:01:41 localhost kernel: cpu 0 hot: high 186, batch 31 used:162
May 12 00:01:41 localhost kernel: cpu 0 cold: high 62, batch 15 used:60
May 12 00:01:41 localhost kernel: cpu 0 hot: high 186, batch 31 used:162
May 12 00:01:41 localhost kernel: cpu 0 cold: high 62, batch 15 used:60
May 12 00:01:41 localhost kernel: cpu 1 hot: high 186, batch 31 used:35
May 12 00:01:42 localhost kernel: cpu 1 cold: high 62, batch 15 used:51
May 12 00:01:42 localhost kernel: cpu 2 hot: high 186, batch 31 used:95
May 12 00:01:42 localhost kernel: cpu 2 cold: high 62, batch 15 used:56
May 12 00:01:42 localhost kernel: cpu 3 hot: high 186, batch 31 used:18
May 12 00:01:42 localhost kernel: cpu 3 cold: high 62, batch 15 used:61
May 12 00:01:42 localhost kernel: HighMem per-cpu:
May 12 00:01:42 localhost kernel: cpu 1 hot: high 186, batch 31 used:35
May 12 00:01:42 localhost kernel: cpu 1 cold: high 62, batch 15 used:51
May 12 00:01:42 localhost kernel: cpu 2 hot: high 186, batch 31 used:95
May 12 00:01:42 localhost kernel: cpu 2 cold: high 62, batch 15 used:56
May 12 00:01:42 localhost kernel: cpu 3 hot: high 186, batch 31 used:18
May 12 00:01:42 localhost kernel: cpu 3 cold: high 62, batch 15 used:61
May 12 00:01:42 localhost kernel: cpu 0 hot: high 186, batch 31 used:159
May 12 00:01:42 localhost kernel: cpu 0 cold: high 62, batch 15 used:49
May 12 00:01:42 localhost kernel: HighMem per-cpu:
May 12 00:01:42 localhost kernel: cpu 0 hot: high 186, batch 31 used:159
May 12 00:01:42 localhost kernel: cpu 0 cold: high 62, batch 15 used:49
May 12 00:01:42 localhost kernel: cpu 1 hot: high 186, batch 31 used:18
May 12 00:01:42 localhost kernel: cpu 1 cold: high 62, batch 15 used:58
May 12 00:01:42 localhost kernel: cpu 2 hot: high 186, batch 31 used:185
May 12 00:01:42 localhost kernel: cpu 2 cold: high 62, batch 15 used:49
May 12 00:01:42 localhost kernel: cpu 3 hot: high 186, batch 31 used:163
May 12 00:01:42 localhost kernel: cpu 3 cold: high 62, batch 15 used:42
May 12 00:01:42 localhost kernel: cpu 1 hot: high 186, batch 31 used:18
May 12 00:01:42 localhost kernel: cpu 1 cold: high 62, batch 15 used:58
May 12 00:01:42 localhost kernel: cpu 2 hot: high 186, batch 31 used:185
May 12 00:01:42 localhost kernel: cpu 2 cold: high 62, batch 15 used:49
May 12 00:01:42 localhost kernel: cpu 3 hot: high 186, batch 31 used:163
May 12 00:01:42 localhost kernel: cpu 3 cold: high 62, batch 15 used:42
May 12 00:01:42 localhost kernel: Free pages: 122804kB (11176kB
HighMem)
May 12 00:01:42 localhost kernel: Free pages: 122804kB (11176kB
HighMem)
May 12 00:01:42 localhost kernel: Active:654227 inactive:160962 dirty:0
writeback:1008 unstable:0 free:30701 slab:188684 mapped:9241 pagetables:766
May 12 00:01:42 localhost kernel: Active:654227 inactive:160962 dirty:0
writeback:1008 unstable:0 free:30701 slab:188684 mapped:9241 pagetables:766
May 12 00:01:42 localhost kernel: DMA free:3548kB min:68kB low:84kB
high:100kB active:0kB inactive:0kB present:16384kB pages_scanned:0
all_unreclaimable? yes
May 12 00:01:43 localhost kernel: lowmem_reserve[]: 0 0DMA free:3548kB
min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16384kB
pages_scanned:0 all_unreclaimable? yes
May 12 00:01:43 localhost kernel: 880 4592
May 12 00:01:43 localhost kernel: DMA32 free:0kB min:0kB low:0kB high:0kB
active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
May 12 00:01:43 localhost kernel: lowmem_reserve[]: 0lowmem_reserve[]: 0 0
880 4592
May 12 00:01:43 localhost kernel: DMA32 free:0kB min:0kB low:0kB high:0kB
active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
May 12 00:01:43 localhost kernel: lowmem_reserve[]: 0 0 880 4592
May 12 00:01:43 localhost kernel: Normal free:108080kB min:3756kB low:4692kB
high:5632kB active:136kB inactive:4108kB present:901120kB pages_scanned:8392
all_unreclaimable? yes
May 12 00:01:43 localhost kernel: lowmem_reserve[]: 0 0 0 29696
May 12 00:01:43 localhost kernel: HighMem free:11176kB min:512kB low:4476kB
high:8440kB active:2616772kB inactive:639740kB present:3801088kB
pages_scanned:0 all_unreclaimable? no
May 12 00:01:43 localhost kernel: lowmem_reserve[]: 0 0 0 0
May 12 00:01:43 localhost kernel: 0 880DMA: 4592
May 12 00:01:43 localhost kernel: Normal free:108080kB min:3756kB low:4692kB
high:5632kB active:136kB inactive:4108kB present:901120kB pages_scanned:8392
all_unreclaimable? yes
May 12 00:01:43 localhost kernel: lowmem_reserve[]: 0 0 0 29696
May 12 00:01:43 localhost kernel: HighMem free:11176kB min:512kB low:4476kB
high:8440kB active:2616772kB inactive:639740kB present:3801088kB
pages_scanned:0 all_unreclaimable? no
May 12 00:01:43 localhost kernel: lowmem_reserve[]: 0 0 03*4kB 0*8kB 1*16kB
0*32kB 1*64kB 1*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 0*4096kB = 3548kB
May 12 00:01:43 localhost kernel: DMA32: empty
May 12 00:01:43 localhost kernel: Normal: 0
May 12 00:01:43 localhost kernel: DMA: 26844*4kB 0*8kB 0*16kB 0*32kB 1*64kB
1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 108080kB
May 12 00:01:43 localhost kernel: HighMem: 3*4kB 0*8kB 1*16kB 0*32kB 1*64kB
1*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 0*4096kB = 3548kB
May 12 00:01:43 localhost kernel: DMA32: empty
May 12 00:01:43 localhost kernel: Normal: 952*4kB 95*8kB 95*16kB 23*32kB
0*64kB 4*128kB 3*256kB 6*512kB 0*1024kB 0*2048kB 0*4096kB = 11176kB
May 12 00:01:43 localhost kernel: 26844*4kB 0*8kB 0*16kB 0*32kB 1*64kB
1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 108080kB
May 12 00:01:43 localhost kernel: HighMem: Swap cache: add 1091416, delete
1088465, find 517981/637567, race 0+1
May 12 00:01:43 localhost kernel: Free swap = 1934920kB
May 12 00:01:43 localhost kernel: Total swap = 2031608kB
May 12 00:01:43 localhost kernel: Free swap: 1934920kB
May 12 00:01:43 localhost kernel: 952*4kB 95*8kB 95*16kB 23*32kB 0*64kB
4*128kB 3*256kB 6*512kB 0*1024kB 0*2048kB 0*4096kB = 11176kB
May 12 00:01:43 localhost kernel: Swap cache: add 1091416, delete 1088465,
find 517981/637567, race 0+1
May 12 00:01:43 localhost kernel: Free swap = 1934920kB
May 12 00:01:43 localhost kernel: Total swap = 2031608kB
May 12 00:01:44 localhost kernel: Free swap: 1934920kB
May 12 00:01:44 localhost kernel: 1179648 pages of RAM
May 12 00:01:44 localhost kernel: 1179648 pages of RAM
May 12 00:01:44 localhost kernel: 950272 pages of HIGHMEM
May 12 00:01:44 localhost kernel: 141635 reserved pages
May 12 00:01:44 localhost kernel: 745935 pages shared
May 12 00:01:44 localhost kernel: 2970 pages swap cached
May 12 00:01:44 localhost kernel: 950272 pages of HIGHMEM
May 12 00:01:44 localhost kernel: 141635 reserved pages
May 12 00:01:44 localhost kernel: 745935 pages shared
May 12 00:01:44 localhost kernel: 2970 pages swap cached
May 12 00:01:44 localhost kernel: 0 pages dirty
May 12 00:01:44 localhost kernel: 0 pages dirty
May 12 00:01:44 localhost kernel: 934 pages writeback
May 12 00:01:44 localhost kernel: 9241 pages mapped
May 12 00:01:44 localhost kernel: 188684 pages slab
May 12 00:01:45 localhost kernel: 766 pages pagetables
May 12 00:01:45 localhost kernel: 934 pages writeback
May 12 00:01:45 localhost kernel: 9241 pages mapped
May 12 00:01:45 localhost kernel: 188684 pages slab
May 12 00:01:45 localhost kernel: 766 pages pagetables
May 12 00:01:45 localhost kernel: nginx invoked oom-killer: gfp_mask=0xd0,
order=1, oomkilladj=0
May 12 00:01:45 localhost kernel: nginx invoked oom-killer: gfp_mask=0xd0,
order=1, oomkilladj=0
May 12 00:01:45 localhost kernel: [<c0450ace>] [<c0450ace>]
out_of_memory+0x3b/0x179
May 12 00:01:45 localhost kernel: out_of_memory+0x3b/0x179
May 12 00:01:45 localhost kernel: [<c0451f01>] [<c0451f01>]
__alloc_pages+0x1fe/0x27e
May 12 00:01:45 localhost kernel: __alloc_pages+0x1fe/0x27e
May 12 00:01:45 localhost kernel: [<c0465e28>] [<c0465e28>]
cache_alloc_refill+0x26d/0x44f
May 12 00:01:45 localhost kernel: cache_alloc_refill+0x26d/0x44f
May 12 00:01:45 localhost kernel: [<c0465bb1>] [<c0465bb1>]
kmem_cache_alloc+0x41/0x4b
May 12 00:01:45 localhost kernel: kmem_cache_alloc+0x41/0x4b
May 12 00:01:45 localhost kernel: [<c059c045>] [<c059c045>]
sk_alloc+0x1e/0xe6
May 12 00:01:45 localhost kernel: sk_alloc+0x1e/0xe6
May 12 00:01:46 localhost kernel: [<c05dd45a>] [<c05dd45a>]
inet_create+0x10c/0x231
May 12 00:01:46 localhost kernel: inet_create+0x10c/0x231
May 12 00:01:46 localhost kernel: [<c059a5d0>] [<c059a5d0>]
__sock_create+0x133/0x213
May 12 00:01:46 localhost kernel: __sock_create+0x133/0x213
May 12 00:01:46 localhost kernel: [<c059a6c9>] [<c059a6c9>]
sock_create+0xb/0xe
May 12 00:01:46 localhost kernel: sock_create+0xb/0xe
May 12 00:01:46 localhost kernel: [<c059a8a8>] [<c059a8a8>]
sys_socket+0x18/0x38
May 12 00:01:46 localhost kernel: sys_socket+0x18/0x38
May 12 00:01:46 localhost kernel: [<c059b2a8>] [<c059b2a8>]
sys_socketcall+0x6c/0x19e
May 12 00:01:46 localhost kernel: sys_socketcall+0x6c/0x19e
May 12 00:01:46 localhost kernel: [<c0403e95>] [<c04063f2>]
sysenter_past_esp+0x56/0x79
May 12 00:01:46 localhost kernel: do_IRQ+0xa5/0xae
May 12 00:01:46 localhost kernel: [<c0403e95>] sysenter_past_esp+0x56/0x79
May 12 00:01:46 localhost kernel: =======================
May 12 00:01:46 localhost kernel: Mem-info:
May 12 00:01:46 localhost kernel: DMA per-cpu:
May 12 00:01:46 localhost kernel: cpu 0 hot: high 0, batch 1 used:0
May 12 00:01:46 localhost kernel: cpu 0 cold: high 0, batch 1 used:0
May 12 00:01:46 localhost kernel: =======================
May 12 00:01:46 localhost kernel: Mem-info:
May 12 00:01:47 localhost kernel: DMA per-cpu:
May 12 00:01:47 localhost kernel: cpu 1 hot: high 0, batch 1 used:0
May 12 00:01:47 localhost kernel: cpu 1 cold: high 0, batch 1 used:0
May 12 00:01:47 localhost kernel: cpu 0 hot: high 0, batch 1 used:0
May 12 00:01:47 localhost kernel: cpu 0 cold: high 0, batch 1 used:0
May 12 00:01:47 localhost kernel: cpu 1 hot: high 0, batch 1 used:0
May 12 00:01:47 localhost kernel: cpu 1 cold: high 0, batch 1 used:0
May 12 00:01:48 localhost kernel: cpu 2 hot: high 0, batch 1 used:0
May 12 00:01:48 localhost kernel: cpu 2 cold: high 0, batch 1 used:0
May 12 00:01:48 localhost kernel: cpu 2 hot: high 0, batch 1 used:0
May 12 00:01:48 localhost kernel: cpu 2 cold: high 0, batch 1 used:0
May 12 00:01:48 localhost kernel: cpu 3 hot: high 0, batch 1 used:0
May 12 00:01:48 localhost kernel: cpu 3 cold: high 0, batch 1 used:0
May 12 00:01:48 localhost kernel: cpu 3 hot: high 0, batch 1 used:0
May 12 00:01:48 localhost kernel: cpu 3 cold: high 0, batch 1 used:0
May 12 00:01:48 localhost kernel: DMA32 per-cpu: empty
May 12 00:01:48 localhost kernel: Normal per-cpu:
May 12 00:01:49 localhost kernel: DMA32 per-cpu: empty
May 12 00:01:49 localhost kernel: Normal per-cpu:
May 12 00:01:49 localhost kernel: cpu 0 hot: high 186, batch 31 used:162
May 12 00:01:49 localhost kernel: cpu 0 cold: high 62, batch 15 used:60
May 12 00:01:49 localhost kernel: cpu 0 hot: high 186, batch 31 used:162
May 12 00:01:49 localhost kernel: cpu 0 cold: high 62, batch 15 used:60
May 12 00:01:49 localhost kernel: cpu 1 hot: high 186, batch 31 used:35
May 12 00:01:49 localhost kernel: cpu 1 cold: high 62, batch 15 used:51
May 12 00:01:49 localhost kernel: cpu 1 hot: high 186, batch 31 used:35
May 12 00:01:49 localhost kernel: cpu 1 cold: high 62, batch 15 used:51
May 12 00:01:49 localhost kernel: cpu 2 hot: high 186, batch 31 used:95
May 12 00:01:49 localhost kernel: cpu 2 cold: high 62, batch 15 used:56
May 12 00:01:49 localhost kernel: cpu 2 hot: high 186, batch 31 used:95
May 12 00:01:49 localhost kernel: cpu 2 cold: high 62, batch 15 used:56
May 12 00:01:49 localhost kernel: cpu 3 hot: high 186, batch 31 used:18
May 12 00:01:49 localhost kernel: cpu 3 cold: high 62, batch 15 used:61
May 12 00:01:49 localhost kernel: HighMem per-cpu:
May 12 00:01:49 localhost kernel: cpu 3 hot: high 186, batch 31 used:18
May 12 00:01:49 localhost kernel: cpu 3 cold: high 62, batch 15 used:61
May 12 00:01:49 localhost kernel: cpu 0 hot: high 186, batch 31 used:159
May 12 00:01:49 localhost kernel: cpu 0 cold: high 62, batch 15 used:49
May 12 00:01:49 localhost kernel: HighMem per-cpu:
May 12 00:01:49 localhost kernel: cpu 0 hot: high 186, batch 31 used:159
May 12 00:01:49 localhost kernel: cpu 0 cold: high 62, batch 15 used:49
May 12 00:01:49 localhost kernel: cpu 1 hot: high 186, batch 31 used:16
May 12 00:01:49 localhost kernel: cpu 1 cold: high 62, batch 15 used:58
May 12 00:01:49 localhost kernel: cpu 1 hot: high 186, batch 31 used:16
May 12 00:01:49 localhost kernel: cpu 1 cold: high 62, batch 15 used:58
May 12 00:01:49 localhost kernel: cpu 2 hot: high 186, batch 31 used:185
May 12 00:01:49 localhost kernel: cpu 2 cold: high 62, batch 15 used:49
May 12 00:01:50 localhost kernel: cpu 3 hot: high 186, batch 31 used:163
May 12 00:01:50 localhost kernel: cpu 3 cold: high 62, batch 15 used:42
May 12 00:01:50 localhost kernel: cpu 2 hot: high 186, batch 31 used:185
May 12 00:01:50 localhost kernel: cpu 2 cold: high 62, batch 15 used:49
May 12 00:01:50 localhost kernel: cpu 3 hot: high 186, batch 31 used:163
May 12 00:01:50 localhost kernel: cpu 3 cold: high 62, batch 15 used:42
May 12 00:01:50 localhost kernel: Free pages: 122804kB (11176kB
HighMem)
May 12 00:01:50 localhost kernel: Free pages: 122804kB (11176kB
HighMem)
May 12 00:01:50 localhost kernel: Active:654227 inactive:160962 dirty:0
writeback:934 unstable:0 free:30701 slab:188684 mapped:9241 pagetables:766
May 12 00:01:50 localhost kernel: DMA free:3548kB min:68kB low:84kB
high:100kB active:0kB inactive:0kB present:16384kB pages_scanned:0
all_unreclaimable? yes
May 12 00:01:50 localhost kernel: lowmem_reserve[]: 0 0 880 4592
May 12 00:01:50 localhost kernel: DMA32 free:0kB min:0kB low:0kB high:0kB
active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
May 12 00:01:50 localhost kernel: lowmem_reserve[]: 0 0 880 4592
May 12 00:01:50 localhost kernel: Normal free:108080kB min:3756kB low:4692kB
high:5632kB active:136kB inactive:4108kB present:901120kB pages_scanned:8392
all_unreclaimable? yes
May 12 00:01:50 localhost kernel: lowmem_reserve[]: 0 0Active:654227
inactive:160962 dirty:0 writeback:934 unstable:0 free:30701 slab:188684
mapped:9241 pagetables:766
May 12 00:01:50 localhost kernel: DMA free:3548kB min:68kB low:84kB
high:100kB active:0kB inactive:0kB present:16384kB pages_scanned:0
all_unreclaimable? yes
May 12 00:01:50 localhost kernel: 0 29696
May 12 00:01:50 localhost kernel: HighMem free:11176kB min:512kB low:4476kB
high:8440kB active:2616772kB inactive:639740kB present:3801088kB
pages_scanned:0 all_unreclaimable? no
May 12 00:01:50 localhost kernel: lowmem_reserve[]: 0 0 0 0
May 12 00:01:50 localhost kernel: DMA: lowmem_reserve[]: 0 0 880 4592
May 12 00:01:50 localhost kernel: DMA32 free:0kB min:0kB low:0kB high:0kB
active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
May 12 00:01:50 localhost kernel: lowmem_reserve[]: 0 0 880 4592
May 12 00:01:50 localhost kernel: Normal free:108080kB min:3756kB low:4692kB
high:5632kB active:136kB inactive:4108kB present:901120kB pages_scanned:8392
all_unreclaimable? yes
May 12 00:01:50 localhost kernel: lowmem_reserve[]:3*4kB 0*8kB 1*16kB 0*32kB
1*64kB 1*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 0*4096kB = 3548kB
May 12 00:01:50 localhost kernel: DMA32: empty
May 12 00:01:50 localhost kernel: Normal: 0 0 0 29696
May 12 00:01:50 localhost kernel: HighMem free:11176kB min:512kB low:4476kB
high:8440kB active:2616772kB inactive:639740kB present:3801088kB
pages_scanned:0 all_unreclaimable? no
May 12 00:01:50 localhost kernel: lowmem_reserve[]: 0 0 0 0
May 12 00:01:50 localhost kernel: DMA: 26844*4kB 0*8kB 0*16kB 0*32kB 1*64kB
1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 108080kB
May 12 00:01:50 localhost kernel: HighMem: 3*4kB 0*8kB 1*16kB 0*32kB 1*64kB
1*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 0*4096kB = 3548kB
May 12 00:01:50 localhost kernel: DMA32: empty
May 12 00:01:51 localhost kernel: Normal: 952*4kB 95*8kB 95*16kB 23*32kB
0*64kB 4*128kB 3*256kB 6*512kB 0*1024kB 0*2048kB 0*4096kB = 11176kB
May 12 00:01:51 localhost kernel: 26844*4kB 0*8kB 0*16kB 0*32kB 1*64kB
1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 108080kB
May 12 00:01:51 localhost kernel: HighMem: Swap cache: add 1091416, delete
1088465, find 517981/637567, race 0+1
May 12 00:01:51 localhost kernel: Free swap = 1934920kB
May 12 00:01:51 localhost kernel: Total swap = 2031608kB
May 12 00:01:51 localhost kernel: Free swap: 1934920kB
May 12 00:01:51 localhost kernel: 952*4kB 95*8kB 95*16kB 23*32kB 0*64kB
4*128kB 3*256kB 6*512kB 0*1024kB 0*2048kB 0*4096kB = 11176kB
May 12 00:01:51 localhost kernel: Swap cache: add 1091416, delete 1088465,
find 517981/637567, race 0+1
May 12 00:01:51 localhost kernel: Free swap = 1934920kB
May 12 00:01:51 localhost kernel: Total swap = 2031608kB
May 12 00:01:51 localhost kernel: Free swap: 1934920kB
May 12 00:01:51 localhost kernel: 1179648 pages of RAM
May 12 00:01:51 localhost kernel: 1179648 pages of RAM
May 12 00:01:51 localhost kernel: 950272 pages of HIGHMEM
May 12 00:01:51 localhost kernel: 141635 reserved pages
May 12 00:01:51 localhost kernel: 745937 pages shared
May 12 00:01:51 localhost kernel: 2970 pages swap cached
May 12 00:01:51 localhost kernel: 950272 pages of HIGHMEM
May 12 00:01:51 localhost kernel: 141635 reserved pages
May 12 00:01:51 localhost kernel: 745937 pages shared
May 12 00:01:51 localhost kernel: 2970 pages swap cached
May 12 00:01:51 localhost kernel: 0 pages dirty
May 12 00:01:51 localhost kernel: 934 pages writeback
May 12 00:01:51 localhost kernel: 9241 pages mapped
May 12 00:01:51 localhost kernel: 0 pages dirty
May 12 00:01:51 localhost kernel: 188684 pages slab
May 12 00:01:51 localhost kernel: 766 pages pagetables
May 12 00:01:51 localhost kernel: 934 pages writeback
May 12 00:01:51 localhost kernel: 9241 pages mapped
May 12 00:01:51 localhost kernel: 188684 pages slab
May 12 00:01:51 localhost kernel: 766 pages pagetables
May 12 00:01:51 localhost kernel: nginx invoked oom-killer: gfp_mask=0xd0,
order=1, oomkilladj=0
May 12 00:01:51 localhost kernel: nginx invoked oom-killer: gfp_mask=0xd0,
order=1, oomkilladj=0
May 12 00:01:51 localhost kernel: [<c0450ace>] [<c0450ace>]
out_of_memory+0x3b/0x179
May 12 00:01:51 localhost kernel: out_of_memory+0x3b/0x179
May 12 00:01:51 localhost kernel: [<c0451f01>] [<c0451f01>]
__alloc_pages+0x1fe/0x27e
May 12 00:01:51 localhost kernel: __alloc_pages+0x1fe/0x27e
May 12 00:01:52 localhost kernel: [<c0465e28>] [<c0465e28>]
cache_alloc_refill+0x26d/0x44f
May 12 00:01:52 localhost kernel: cache_alloc_refill+0x26d/0x44f
May 12 00:01:52 localhost kernel: [<c0465bb1>] [<c0465bb1>]
kmem_cache_alloc+0x41/0x4b
May 12 00:01:52 localhost kernel: kmem_cache_alloc+0x41/0x4b
May 12 00:01:52 localhost kernel: [<c059c045>] [<c059c045>]
sk_alloc+0x1e/0xe6
May 12 00:01:52 localhost kernel: sk_alloc+0x1e/0xe6
May 12 00:01:52 localhost kernel: [<c05dd45a>] [<c05dd45a>]
inet_create+0x10c/0x231
May 12 00:01:52 localhost kernel: inet_create+0x10c/0x231
May 12 00:01:52 localhost kernel: [<c059a5d0>] [<c059a5d0>]
__sock_create+0x133/0x213
May 12 00:01:52 localhost kernel: __sock_create+0x133/0x213
May 12 00:01:52 localhost kernel: [<c059a6c9>] [<c059a6c9>]
sock_create+0xb/0xe
May 12 00:01:52 localhost kernel: sock_create+0xb/0xe
May 12 00:01:52 localhost kernel: [<c059a8a8>] [<c059a8a8>]
sys_socket+0x18/0x38
May 12 00:01:52 localhost kernel: sys_socket+0x18/0x38
May 12 00:01:52 localhost kernel: [<c059b2a8>] [<c059b2a8>]
sys_socketcall+0x6c/0x19e
May 12 00:01:52 localhost kernel: sys_socketcall+0x6c/0x19e
May 12 00:01:52 localhost kernel: [<c04063f2>] [<c0403e95>]
sysenter_past_esp+0x56/0x79
May 12 00:01:52 localhost kernel: do_IRQ+0xa5/0xae
May 12 00:01:52 localhost kernel: [<c0403e95>] sysenter_past_esp+0x56/0x79
May 12 00:01:52 localhost kernel: =======================
May 12 00:01:52 localhost kernel: Mem-info:
May 12 00:01:52 localhost kernel: DMA per-cpu:
May 12 00:01:52 localhost kernel: =======================
May 12 00:01:52 localhost kernel: cpu 0 hot: high 0, batch 1 used:0
May 12 00:01:52 localhost kernel: cpu 0 cold: high 0, batch 1 used:0
May 12 00:01:52 localhost kernel: Mem-info:
May 12 00:01:52 localhost kernel: DMA per-cpu:
May 12 00:01:52 localhost kernel: cpu 0 hot: high 0, batch 1 used:0
May 12 00:01:52 localhost kernel: cpu 0 cold: high 0, batch 1 used:0
May 12 00:01:53 localhost kernel: cpu 1 hot: high 0, batch 1 used:0
May 12 00:01:53 localhost kernel: cpu 1 cold: high 0, batch 1 used:0
May 12 00:01:53 localhost kernel: cpu 1 hot: high 0, batch 1 used:0
May 12 00:01:53 localhost kernel: cpu 1 cold: high 0, batch 1 used:0
May 12 00:01:53 localhost kernel: cpu 2 hot: high 0, batch 1 used:0
May 12 00:01:53 localhost kernel: cpu 2 cold: high 0, batch 1 used:0
May 12 00:01:53 localhost kernel: cpu 2 hot: high 0, batch 1 used:0
May 12 00:01:53 localhost kernel: cpu 2 cold: high 0, batch 1 used:0
May 12 00:01:53 localhost kernel: cpu 3 hot: high 0, batch 1 used:0
May 12 00:01:53 localhost kernel: cpu 3 cold: high 0, batch 1 used:0
May 12 00:01:53 localhost kernel: cpu 3 hot: high 0, batch 1 used:0
May 12 00:01:53 localhost kernel: cpu 3 cold: high 0, batch 1 used:0
May 12 00:01:53 localhost kernel: DMA32 per-cpu: empty
May 12 00:01:53 localhost kernel: Normal per-cpu:
May 12 00:01:53 localhost kernel: DMA32 per-cpu: empty
May 12 00:01:53 localhost kernel: Normal per-cpu:
May 12 00:01:53 localhost kernel: cpu 0 hot: high 186, batch 31 used:162
May 12 00:01:53 localhost kernel: cpu 0 cold: high 62, batch 15 used:60
May 12 00:01:53 localhost kernel: cpu 0 hot: high 186, batch 31 used:162
May 12 00:01:53 localhost kernel: cpu 0 cold: high 62, batch 15 used:60
May 12 00:01:53 localhost kernel: cpu 1 hot: high 186, batch 31 used:35
May 12 00:01:53 localhost kernel: cpu 1 cold: high 62, batch 15 used:51
May 12 00:01:53 localhost kernel: cpu 1 hot: high 186, batch 31 used:35
May 12 00:01:53 localhost kernel: cpu 1 cold: high 62, batch 15 used:51
May 12 00:01:53 localhost kernel: cpu 2 hot: high 186, batch 31 used:95
May 12 00:01:53 localhost kernel: cpu 2 cold: high 62, batch 15 used:56
May 12 00:01:53 localhost kernel: cpu 3 hot: high 186, batch 31 used:18
May 12 00:01:53 localhost kernel: cpu 2 hot: high 186, batch 31 used:95
May 12 00:01:53 localhost kernel: cpu 2 cold: high 62, batch 15 used:56
May 12 00:01:53 localhost kernel: cpu 3 hot: high 186, batch 31 used:18
May 12 00:01:53 localhost kernel: cpu 3 cold: high 62, batch 15 used:61
May 12 00:01:53 localhost kernel: HighMem per-cpu:
May 12 00:01:53 localhost kernel: cpu 3 cold: high 62, batch 15 used:61
May 12 00:01:53 localhost kernel: HighMem per-cpu:
May 12 00:01:53 localhost kernel: cpu 0 hot: high 186, batch 31 used:159
May 12 00:01:53 localhost kernel: cpu 0 cold: high 62, batch 15 used:49
May 12 00:01:53 localhost kernel: cpu 0 hot: high 186, batch 31 used:159
May 12 00:01:53 localhost kernel: cpu 0 cold: high 62, batch 15 used:49
May 12 00:01:53 localhost kernel: cpu 1 hot: high 186, batch 31 used:14
May 12 00:01:53 localhost kernel: cpu 1 cold: high 62, batch 15 used:58
May 12 00:01:53 localhost kernel: cpu 1 hot: high 186, batch 31 used:14
May 12 00:01:53 localhost kernel: cpu 1 cold: high 62, batch 15 used:58
May 12 00:01:53 localhost kernel: cpu 2 hot: high 186, batch 31 used:185
May 12 00:01:53 localhost kernel: cpu 2 cold: high 62, batch 15 used:49
May 12 00:01:53 localhost kernel: cpu 3 hot: high 186, batch 31 used:163
May 12 00:01:53 localhost kernel: cpu 2 hot: high 186, batch 31 used:185
May 12 00:01:53 localhost kernel: cpu 2 cold: high 62, batch 15 used:49
May 12 00:01:53 localhost kernel: cpu 3 hot: high 186, batch 31 used:163
May 12 00:01:53 localhost kernel: cpu 3 cold: high 62, batch 15 used:42
May 12 00:01:53 localhost kernel: cpu 3 cold: high 62, batch 15 used:42
May 12 00:01:53 localhost kernel: Free pages: 122804kB (11176kB
HighMem)
May 12 00:01:53 localhost kernel: Free pages: 122804kB (11176kB
HighMem)
May 12 00:01:53 localhost kernel: Active:654227 inactive:160962 dirty:0
writeback:934 unstable:0 free:30701 slab:188684 mapped:9241 pagetables:766
May 12 00:01:53 localhost kernel: Active:654227 inactive:160962 dirty:0
writeback:934 unstable:0 free:30701 slab:188684 mapped:9241 pagetables:766
May 12 00:01:53 localhost kernel: DMA free:3548kB min:68kB low:84kB
high:100kB active:0kB inactive:0kB present:16384kB pages_scanned:0
all_unreclaimable? yes
May 12 00:01:54 localhost kernel: lowmem_reserve[]: 0 0DMA free:3548kB
min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16384kB
pages_scanned:0 all_unreclaimable? yes
May 12 00:01:54 localhost kernel: lowmem_reserve[]: 0 0 880 4592
May 12 00:01:54 localhost kernel: DMA32 free:0kB min:0kB low:0kB high:0kB
active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
May 12 00:01:54 localhost kernel: lowmem_reserve[]: 0 0 880 4592
May 12 00:01:54 localhost kernel: Normal free:108080kB min:3756kB low:4692kB
high:5632kB active:136kB inactive:4108kB present:901120kB pages_scanned:8392
all_unreclaimable? yes
May 12 00:01:54 localhost kernel: lowmem_reserve[]: 0 0 0 29696
May 12 00:01:54 localhost kernel: 880 4592
May 12 00:01:54 localhost kernel: DMA32 free:0kB min:0kB low:0kB high:0kB
active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
May 12 00:01:54 localhost kernel: lowmem_reserve[]: 0 0 880 4592
May 12 00:01:54 localhost kernel: Normal free:108080kB min:3756kB low:4692kB
high:5632kB active:136kB inactive:4108kB present:901120kB pages_scanned:8392
all_unreclaimable? yes
May 12 00:01:54 localhost kernel: lowmem_reserve[]:HighMem free:11176kB
min:512kB low:4476kB high:8440kB active:2616772kB inactive:639740kB
present:3801088kB pages_scanned:0 all_unreclaimable? no
May 12 00:01:54 localhost kernel: lowmem_reserve[]: 0 0 0 0
May 12 00:01:54 localhost kernel: DMA: 0 0 0 29696
May 12 00:01:54 localhost kernel: HighMem free:11176kB min:512kB low:4476kB
high:8440kB active:2616772kB inactive:639740kB present:3801088kB
pages_scanned:0 all_unreclaimable? no
May 12 00:01:54 localhost kernel: lowmem_reserve[]: 0 0 0 0
May 12 00:01:54 localhost kernel: DMA: 3*4kB 0*8kB 1*16kB 0*32kB 1*64kB
1*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 0*4096kB = 3548kB
May 12 00:01:54 localhost kernel: DMA32: empty
May 12 00:01:54 localhost kernel: Normal: 3*4kB 0*8kB 1*16kB 0*32kB 1*64kB
1*128kB 1*256kB 26844*4kB 0*8kB 0*16kB 0*32kB 1*64kB 1*128kB 0*256kB 1*512kB
0*512kB 1*1024kB 1*2048kB 0*4096kB = 3548kB
May 12 00:01:54 localhost kernel: DMA32: empty
May 12 00:01:54 localhost kernel: Normal: 0*1024kB 0*2048kB 0*4096kB =
108080kB
May 12 00:01:55 localhost kernel: HighMem: 26844*4kB 0*8kB 0*16kB 0*32kB
1*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 952*4kB 95*8kB 95*16kB 23*32kB
0*64kB 4*128kB 3*256kB 6*512kB 0*1024kB 0*2048kB 0*4096kB = 11176kB
May 12 00:01:55 localhost kernel: 0*2048kB 0*4096kB = 108080kB
May 12 00:01:55 localhost kernel: HighMem: Swap cache: add 1091416, delete
1088465, find 517981/637567, race 0+1
May 12 00:01:55 localhost kernel: Free swap = 1934920kB
May 12 00:01:55 localhost kernel: 952*4kB 95*8kB 95*16kB 23*32kB 0*64kB
4*128kB 3*256kB 6*512kB 0*1024kB 0*2048kB 0*4096kB = 11176kB
May 12 00:01:55 localhost kernel: Swap cache: add 1091416, delete 1088465,
find 517981/637567, race 0+1
May 12 00:01:55 localhost kernel: Free swap = 1934920kB
May 12 00:01:55 localhost kernel: Total swap = 2031608kB
May 12 00:01:55 localhost kernel: Free swap: 1934920kB
May 12 00:01:55 localhost kernel: Total swap = 2031608kB
May 12 00:01:55 localhost kernel: Free swap: 1934920kB
May 12 00:01:55 localhost kernel: 1179648 pages of RAM
May 12 00:01:55 localhost kernel: 1179648 pages of RAM
May 12 00:01:55 localhost kernel: 950272 pages of HIGHMEM
May 12 00:01:55 localhost kernel: 950272 pages of HIGHMEM
May 12 00:01:55 localhost kernel: 141635 reserved pages
May 12 00:01:55 localhost kernel: 745934 pages shared
May 12 00:01:55 localhost kernel: 2970 pages swap cached
May 12 00:01:55 localhost kernel: 141635 reserved pages
May 12 00:01:55 localhost kernel: 745934 pages shared
May 12 00:01:55 localhost kernel: 2970 pages swap cached
May 12 00:01:55 localhost kernel: 0 pages dirty
May 12 00:01:55 localhost kernel: 934 pages writeback
May 12 00:01:55 localhost kernel: 9241 pages mapped
May 12 00:01:55 localhost kernel: 0 pages dirty
May 12 00:01:55 localhost kernel: 934 pages writeback
May 12 00:01:55 localhost kernel: 9241 pages mapped
May 12 00:01:55 localhost kernel: 188684 pages slab
May 12 00:01:55 localhost kernel: 766 pages pagetables
May 12 00:01:55 localhost kernel: 188684 pages slab
May 12 00:01:55 localhost kernel: 766 pages pagetables
May 12 00:01:55 localhost kernel: nginx invoked oom-killer: gfp_mask=0xd0,
order=1, oomkilladj=0
May 12 00:01:55 localhost kernel: nginx invoked oom-killer: gfp_mask=0xd0,
order=1, oomkilladj=0
May 12 00:01:55 localhost kernel: [<c0450ace>] [<c0450ace>]
out_of_memory+0x3b/0x179
May 12 00:01:55 localhost kernel: out_of_memory+0x3b/0x179
May 12 00:01:55 localhost kernel: [<c0451f01>] [<c0451f01>]
__alloc_pages+0x1fe/0x27e
May 12 00:01:56 localhost kernel: __alloc_pages+0x1fe/0x27e
May 12 00:01:56 localhost kernel: [<c0465e28>] [<c0465e28>]
cache_alloc_refill+0x26d/0x44f
May 12 00:01:56 localhost kernel: cache_alloc_refill+0x26d/0x44f
May 12 00:01:56 localhost kernel: [<c0465bb1>] [<c0465bb1>]
kmem_cache_alloc+0x41/0x4b
May 12 00:01:56 localhost kernel: kmem_cache_alloc+0x41/0x4b
May 12 00:01:56 localhost kernel: [<c059c045>] [<c059c045>]
sk_alloc+0x1e/0xe6
May 12 00:01:56 localhost kernel: sk_alloc+0x1e/0xe6
May 12 00:01:56 localhost kernel: [<c05dd45a>] [<c05dd45a>]
inet_create+0x10c/0x231
May 12 00:01:56 localhost kernel: inet_create+0x10c/0x231
May 12 00:01:56 localhost kernel: [<c059a5d0>] [<c059a5d0>]
__sock_create+0x133/0x213
May 12 00:01:56 localhost kernel: __sock_create+0x133/0x213
May 12 00:01:56 localhost kernel: [<c059a6c9>] [<c059a6c9>]
sock_create+0xb/0xe
May 12 00:01:56 localhost kernel: sock_create+0xb/0xe
May 12 00:01:56 localhost kernel: [<c059a8a8>] [<c059a8a8>]
sys_socket+0x18/0x38
May 12 00:01:56 localhost kernel: sys_socket+0x18/0x38
May 12 00:01:56 localhost kernel: [<c059b2a8>] [<c059b2a8>]
sys_socketcall+0x6c/0x19e
May 12 00:01:56 localhost kernel: sys_socketcall+0x6c/0x19e
May 12 00:01:56 localhost kernel: [<c0403e95>] [<c04063f2>]
sysenter_past_esp+0x56/0x79
May 12 00:01:56 localhost kernel: do_IRQ+0xa5/0xae
May 12 00:01:56 localhost kernel: [<c0403e95>] sysenter_past_esp+0x56/0x79
May 12 00:01:56 localhost kernel: =======================
May 12 00:01:56 localhost kernel: Mem-info:
May 12 00:01:56 localhost kernel: DMA per-cpu:
May 12 00:01:56 localhost kernel: cpu 0 hot: high 0, batch 1 used:0
May 12 00:01:56 localhost kernel: cpu 0 cold: high 0, batch 1 used:0
May 12 00:01:56 localhost kernel: =======================
May 12 00:01:57 localhost kernel: Mem-info:
May 12 00:01:57 localhost kernel: DMA per-cpu:cpu 1 hot: high 0, batch 1
used:0
May 12 00:01:57 localhost kernel: cpu 1 cold: high 0, batch 1 used:0
May 12 00:01:57 localhost kernel:
May 12 00:01:57 localhost kernel: cpu 2 hot: high 0, batch 1 used:0
May 12 00:01:57 localhost kernel: cpu 2 cold: high 0, batch 1 used:0
May 12 00:01:57 localhost kernel: cpu 0 hot: high 0, batch 1 used:0
May 12 00:01:57 localhost kernel: cpu 0 cold: high 0, batch 1 used:0
May 12 00:01:57 localhost kernel: cpu 1 hot: high 0, batch 1 used:0
May 12 00:01:57 localhost kernel: cpu 1 cold: high 0, batch 1 used:0
May 12 00:01:57 localhost kernel: cpu 2 hot: high 0, batch 1 used:0
May 12 00:01:57 localhost kernel: cpu 2 cold: high 0, batch 1 used:0
May 12 00:01:57 localhost kernel: cpu 3 hot: high 0, batch 1 used:0
May 12 00:01:57 localhost kernel: cpu 3 cold: high 0, batch 1 used:0
May 12 00:01:57 localhost kernel: DMA32 per-cpu: empty
May 12 00:01:57 localhost kernel: Normal per-cpu:
May 12 00:01:57 localhost kernel: cpu 3 hot: high 0, batch 1 used:0
May 12 00:01:57 localhost kernel: cpu 3 cold: high 0, batch 1 used:0
May 12 00:01:57 localhost kernel: DMA32 per-cpu: empty
May 12 00:01:57 localhost kernel: cpu 0 hot: high 186, batch 31 used:162
May 12 00:01:57 localhost kernel: cpu 0 cold: high 62, batch 15 used:60
May 12 00:01:57 localhost kernel: Normal per-cpu:
May 12 00:01:57 localhost kernel: cpu 0 hot: high 186, batch 31 used:162
May 12 00:01:57 localhost kernel: cpu 0 cold: high 62, batch 15 used:60
May 12 00:01:57 localhost kernel: cpu 1 hot: high 186, batch 31 used:35
May 12 00:01:57 localhost kernel: cpu 1 cold: high 62, batch 15 used:51
May 12 00:01:58 localhost kernel: cpu 1 hot: high 186, batch 31 used:35
May 12 00:01:58 localhost kernel: cpu 1 cold: high 62, batch 15 used:51
May 12 00:01:58 localhost kernel: cpu 2 hot: high 186, batch 31 used:95
May 12 00:01:58 localhost kernel: cpu 2 cold: high 62, batch 15 used:56
May 12 00:01:58 localhost kernel: cpu 2 hot: high 186, batch 31 used:95
May 12 00:01:58 localhost kernel: cpu 2 cold: high 62, batch 15 used:56
May 12 00:01:58 localhost kernel: cpu 3 hot: high 186, batch 31 used:18
May 12 00:01:58 localhost kernel: cpu 3 cold: high 62, batch 15 used:61
May 12 00:01:58 localhost kernel: HighMem per-cpu:
May 12 00:01:58 localhost kernel: cpu 3 hot: high 186, batch 31 used:18
May 12 00:01:58 localhost kernel: cpu 3 cold: high 62, batch 15 used:61
May 12 00:01:58 localhost kernel: HighMem per-cpu:
May 12 00:01:58 localhost kernel: cpu 0 hot: high 186, batch 31 used:159
May 12 00:01:58 localhost kernel: cpu 0 cold: high 62, batch 15 used:49
May 12 00:01:58 localhost kernel: cpu 0 hot: high 186, batch 31 used:159
May 12 00:01:58 localhost kernel: cpu 0 cold: high 62, batch 15 used:49
May 12 00:01:58 localhost kernel: cpu 1 hot: high 186, batch 31 used:13
May 12 00:01:58 localhost kernel: cpu 1 cold: high 62, batch 15 used:58
May 12 00:01:58 localhost kernel: cpu 1 hot: high 186, batch 31 used:13
May 12 00:01:58 localhost kernel: cpu 1 cold: high 62, batch 15 used:58
May 12 00:01:58 localhost kernel: cpu 2 hot: high 186, batch 31 used:185
May 12 00:01:58 localhost kernel: cpu 2 cold: high 62, batch 15 used:49
May 12 00:01:58 localhost kernel: cpu 2 hot: high 186, batch 31 used:185
May 12 00:01:58 localhost kernel: cpu 2 cold: high 62, batch 15 used:49
May 12 00:01:58 localhost kernel: cpu 3 hot: high 186, batch 31 used:163
May 12 00:01:58 localhost kernel: cpu 3 cold: high 62, batch 15 used:42
May 12 00:01:58 localhost kernel: cpu 3 hot: high 186, batch 31 used:163
May 12 00:01:58 localhost kernel: cpu 3 cold: high 62, batch 15 used:42
May 12 00:01:58 localhost kernel: Free pages: 122804kB (11176kB
HighMem)
May 12 00:01:58 localhost kernel: Free pages: 122804kB (11176kB
HighMem)
May 12 00:01:58 localhost kernel: Active:654241 inactive:160962 dirty:0
writeback:934 unstable:0 free:30701 slab:188684 mapped:9241 pagetables:766
May 12 00:01:58 localhost kernel: Active:654241 inactive:160962 dirty:0
writeback:934 unstable:0 free:30701 slab:188684 mapped:9241 pagetables:766
May 12 00:01:58 localhost kernel: DMA free:3548kB min:68kB low:84kB
high:100kB active:0kB inactive:0kB present:16384kB pages_scanned:0
all_unreclaimable? yes
May 12 00:01:58 localhost kernel: lowmem_reserve[]: 0 0 880 4592
May 12 00:01:58 localhost kernel: DMA32 free:0kB min:0kB low:0kB high:0kB
active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
May 12 00:01:58 localhost kernel: lowmem_reserve[]: 0 0 880 4592
May 12 00:01:58 localhost kernel: Normal free:108080kB min:3756kB low:4692kB
high:5632kB active:136kB inactive:4108kB present:901120kB pages_scanned:8392
all_unreclaimable? yes
May 12 00:01:58 localhost kernel: lowmem_reserve[]: 0 0DMA free:3548kB
min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16384kB
pages_scanned:0 all_unreclaimable? yes
May 12 00:01:58 localhost kernel: lowmem_reserve[]: 0 0 880 4592
May 12 00:01:58 localhost kernel: DMA32 free:0kB min:0kB low:0kB high:0kB
active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
May 12 00:01:58 localhost kernel: lowmem_reserve[]: 0 0 29696
May 12 00:01:59 localhost kernel: HighMem free:11176kB min:512kB low:4476kB
high:8440kB active:2616828kB inactive:639740kB present:3801088kB
pages_scanned:0 all_unreclaimable? no
May 12 00:01:59 localhost kernel: lowmem_reserve[]: 0 0 0 0
May 12 00:01:59 localhost kernel: DMA: 0 880 4592
May 12 00:01:59 localhost kernel: Normal free:108080kB min:3756kB low:4692kB
high:5632kB active:136kB inactive:4108kB present:901120kB pages_scanned:8392
all_unreclaimable? yes
May 12 00:01:59 localhost kernel: lowmem_reserve[]: 0 0 0 29696
May 12 00:01:59 localhost kernel: HighMem free:11176kB min:512kB low:4476kB
high:8440kB active:2616828kB inactive:639740kB present:3801088kB
pages_scanned:0 all_unreclaimable? no
May 12 00:01:59 localhost kernel: lowmem_reserve[]: 0 0 0 0
May 12 00:01:59 localhost kernel: DMA: 3*4kB 0*8kB 1*16kB 0*32kB 1*64kB
1*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 0*4096kB 3*4kB 0*8kB 1*16kB 0*32kB
1*64kB 1*128kB 1*256kB = 3548kB
May 12 00:01:59 localhost kernel: DMA32: empty
May 12 00:01:59 localhost kernel: Normal: 0*512kB 1*1024kB 1*2048kB 0*4096kB
= 3548kB
May 12 00:01:59 localhost kernel: DMA32: empty
May 12 00:01:59 localhost kernel: Normal: 26844*4kB 0*8kB 0*16kB 0*32kB
1*64kB 1*128kB 26844*4kB 0*8kB 0*16kB 0*32kB 0*256kB 1*512kB 0*1024kB
0*2048kB 0*4096kB = 108080kB
May 12 00:01:59 localhost kernel: HighMem: 1*64kB 1*128kB 0*256kB 1*512kB
0*1024kB 0*2048kB 0*4096kB = 108080kB
May 12 00:01:59 localhost kernel: HighMem: 952*4kB 95*8kB 95*16kB 23*32kB
0*64kB 4*128kB 3*256kB 6*512kB 0*1024kB 0*2048kB 0*4096kB = 11176kB
May 12 00:01:59 localhost kernel: 952*4kB 95*8kB Swap cache: add 1091416,
delete 1088465, find 517981/637567, race 0+1
May 12 00:01:59 localhost kernel: Free swap = 1934920kB
May 12 00:01:59 localhost kernel: Total swap = 2031608kB
May 12 00:01:59 localhost kernel: Free swap: 1934920kB
May 12 00:01:59 localhost kernel: 95*16kB 23*32kB 0*64kB 4*128kB 3*256kB
6*512kB 0*1024kB 0*2048kB 0*4096kB = 11176kB
May 12 00:01:59 localhost kernel: Swap cache: add 1091416, delete 1088465,
find 517981/637567, race 0+1
May 12 00:01:59 localhost kernel: Free swap = 1934920kB
May 12 00:01:59 localhost kernel: Total swap = 2031608kB
May 12 00:01:59 localhost kernel: Free swap: 1934920kB
May 12 00:01:59 localhost kernel: 1179648 pages of RAM
May 12 00:01:59 localhost kernel: 1179648 pages of RAM
May 12 00:02:00 localhost kernel: 950272 pages of HIGHMEM
May 12 00:02:00 localhost kernel: 950272 pages of HIGHMEM
May 12 00:02:00 localhost kernel: 141635 reserved pages
May 12 00:02:00 localhost kernel: 745927 pages shared
May 12 00:02:00 localhost kernel: 2970 pages swap cached
May 12 00:02:00 localhost kernel: 141635 reserved pages
May 12 00:02:00 localhost kernel: 745927 pages shared
May 12 00:02:00 localhost kernel: 2970 pages swap cached
May 12 00:02:00 localhost kernel: 0 pages dirty
May 12 00:02:00 localhost kernel: 934 pages writeback
May 12 00:02:00 localhost kernel: 0 pages dirty
May 12 00:02:00 localhost kernel: 934 pages writeback
May 12 00:02:00 localhost kernel: 9241 pages mapped
May 12 00:02:00 localhost kernel: 9241 pages mapped
May 12 00:02:00 localhost kernel: 188684 pages slab
May 12 00:02:00 localhost kernel: 766 pages pagetables
May 12 00:02:00 localhost kernel: 188684 pages slab
May 12 00:02:00 localhost kernel: 766 pages pagetables
May 12 00:02:00 localhost kernel: nginx invoked oom-killer: gfp_mask=0xd0,
order=1, oomkilladj=0
May 12 00:02:00 localhost kernel: [<c0450ace>] out_of_memory+0x3b/0x179
May 12 00:02:00 localhost kernel: [<c0451f01>] __alloc_pages+0x1fe/0x27e
May 12 00:02:00 localhost kernel: [<c0465e28>]
cache_alloc_refill+0x26d/0x44f
May 12 00:02:00 localhost kernel: [<c0465bb1>] kmem_cache_alloc+0x41/0x4b
May 12 00:02:00 localhost kernel: [<c059c045>] sk_alloc+0x1e/0xe6
May 12 00:02:00 localhost kernel: [<c05dd45a>] inet_create+0x10c/0x231
May 12 00:02:00 localhost kernel: [<c059a5d0>] __sock_create+0x133/0x213
May 12 00:02:00 localhost kernel: [<c059a6c9>] sock_create+0xb/0xe
May 12 00:02:00 localhost kernel: [<c059a8a8>] sys_socket+0x18/0x38
May 12 00:02:00 localhost kernel: [<c059b2a8>] sys_socketcall+0x6c/0x19e
May 12 00:02:00 localhost kernel: [<c04063f2>] do_IRQ+0xa5/0xae
May 12 00:02:00 localhost kernel: [<c0403e95>] sysenter_past_esp+0x56/0x79
May 12 00:02:00 localhost kernel: =======================
May 12 00:02:00 localhost kernel: Mem-info:
May 12 00:02:00 localhost kernel: DMA per-cpu:
May 12 00:02:00 localhost kernel: cpu 0 hot: high 0, batch 1 used:0
May 12 00:02:00 localhost kernel: cpu 0 cold: high 0, batch 1 used:0
May 12 00:02:00 localhost kernel: cpu 1 hot: high 0, batch 1 used:0
May 12 00:02:00 localhost kernel: cpu 1 cold: high 0, batch 1 used:0
May 12 00:02:00 localhost kernel: cpu 2 hot: high 0, batch 1 used:0
May 12 00:02:00 localhost kernel: cpu 2 cold: high 0, batch 1 used:0
May 12 00:02:00 localhost kernel: cpu 3 hot: high 0, batch 1 used:0
May 12 00:02:00 localhost kernel: cpu 3 cold: high 0, batch 1 used:0
May 12 00:02:00 localhost kernel: DMA32 per-cpu: empty
May 12 00:02:00 localhost kernel: Normal per-cpu:
May 12 00:02:00 localhost kernel: cpu 0 hot: high 186, batch 31 used:162
May 12 00:02:00 localhost kernel: cpu 0 cold: high 62, batch 15 used:60
May 12 00:02:00 localhost kernel: cpu 1 hot: high 186, batch 31 used:35
May 12 00:02:00 localhost kernel: cpu 1 cold: high 62, batch 15 used:51
May 12 00:02:00 localhost kernel: cpu 2 hot: high 186, batch 31 used:95
May 12 00:02:00 localhost kernel: cpu 2 cold: high 62, batch 15 used:56
May 12 00:02:01 localhost kernel: cpu 3 hot: high 186, batch 31 used:18
May 12 00:02:01 localhost kernel: cpu 3 cold: high 62, batch 15 used:62
May 12 00:02:01 localhost kernel: HighMem per-cpu:
May 12 00:02:01 localhost kernel: cpu 0 hot: high 186, batch 31 used:159
May 12 00:02:01 localhost kernel: cpu 0 cold: high 62, batch 15 used:49
May 12 00:02:01 localhost kernel: cpu 1 hot: high 186, batch 31 used:11
May 12 00:02:01 localhost kernel: cpu 1 cold: high 62, batch 15 used:58
May 12 00:02:01 localhost kernel: cpu 2 hot: high 186, batch 31 used:185
May 12 00:02:01 localhost kernel: cpu 2 cold: high 62, batch 15 used:49
May 12 00:02:01 localhost kernel: cpu 3 hot: high 186, batch 31 used:163
May 12 00:02:01 localhost kernel: cpu 3 cold: high 62, batch 15 used:42
May 12 00:02:01 localhost kernel: Free pages: 122896kB (11176kB
HighMem)
May 12 00:02:01 localhost kernel: Active:654209 inactive:160962 dirty:0
writeback:934 unstable:0 free:30730 slab:188684 mapped:9241 pagetables:766
May 12 00:02:01 localhost kernel: DMA free:3548kB min:68kB low:84kB
high:100kB active:0kB inactive:0kB present:16384kB pages_scanned:0
all_unreclaimable? yes
May 12 00:02:01 localhost kernel: lowmem_reserve[]: 0 0 880 4592
May 12 00:02:01 localhost kernel: DMA32 free:0kB min:0kB low:0kB high:0kB
active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
May 12 00:02:01 localhost kernel: lowmem_reserve[]: 0 0 880 4592
May 12 00:02:01 localhost kernel: Normal free:108260kB min:3756kB low:4692kB
high:5632kB active:8kB inactive:4108kB present:901120kB pages_scanned:0
all_unreclaimable? no
May 12 00:02:01 localhost kernel: lowmem_reserve[]: 0 0 0 29696
May 12 00:02:01 localhost kernel: HighMem free:11176kB min:512kB low:4476kB
high:8440kB active:2616828kB inactive:639740kB present:3801088kB
pages_scanned:0 all_unreclaimable? no
May 12 00:02:01 localhost kernel: lowmem_reserve[]: 0 0 0 0
May 12 00:02:01 localhost kernel: DMA: 3*4kB 0*8kB 1*16kB 0*32kB 1*64kB
1*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 0*4096kB = 3548kB
May 12 00:02:01 localhost kernel: DMA32: empty
May 12 00:02:01 localhost kernel: Normal: 26876*4kB 14*8kB 0*16kB 0*32kB
1*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 108320kB
May 12 00:02:01 localhost kernel: HighMem: 952*4kB 95*8kB 95*16kB 23*32kB
0*64kB 4*128kB 3*256kB 6*512kB 0*1024kB 0*2048kB 0*4096kB = 11176kB
May 12 00:02:01 localhost kernel: Swap cache: add 1091416, delete 1088529,
find 517981/637567, race 0+1
May 12 00:02:01 localhost kernel: Free swap = 1934920kB
May 12 00:02:02 localhost kernel: Total swap = 2031608kB
May 12 00:02:02 localhost kernel: Free swap: 1934920kB
May 12 00:02:02 localhost kernel: 1179648 pages of RAM
May 12 00:02:02 localhost kernel: 950272 pages of HIGHMEM
May 12 00:02:02 localhost kernel: 141635 reserved pages
May 12 00:02:02 localhost kernel: 745928 pages shared
May 12 00:02:02 localhost kernel: 2887 pages swap cached
May 12 00:02:02 localhost kernel: 0 pages dirty
May 12 00:02:02 localhost kernel: 749 pages writeback
May 12 00:02:02 localhost kernel: 9241 pages mapped
May 12 00:02:02 localhost kernel: 188760 pages slab
May 12 00:02:02 localhost kernel: 766 pages pagetables
May 12 00:02:02 localhost kernel: [<c0465bb1>] kmem_cache_alloc+0x41/0x4b
May 12 00:02:02 localhost kernel: [<c059c045>] sk_alloc+0x1e/0xe6
May 12 00:02:02 localhost kernel: [<c05dd45a>] inet_create+0x10c/0x231
May 12 00:02:02 localhost kernel: [<c059a5d0>] __sock_create+0x133/0x213
May 12 00:02:02 localhost kernel: [<c059a6c9>] sock_create+0xb/0xe
May 12 00:02:03 localhost kernel: [<c059a8a8>] sys_socket+0x18/0x38
May 12 00:02:03 localhost kernel: [<c059b2a8>] sys_socketcall+0x6c/0x19e
May 12 00:02:03 localhost kernel: [<c0403e95>] sysenter_past_esp+0x56/0x79
May 12 00:02:03 localhost kernel: =======================
May 12 00:02:03 localhost kernel: Mem-info:
May 12 00:02:03 localhost kernel: DMA per-cpu:
May 12 00:02:03 localhost kernel: cpu 0 hot: high 0, batch 1 used:0
May 12 00:02:03 localhost kernel: cpu 0 cold: high 0, batch 1 used:0
May 12 00:02:03 localhost kernel: cpu 1 hot: high 0, batch 1 used:0
May 12 00:02:04 localhost kernel: cpu 1 cold: high 0, batch 1 used:0
May 12 00:02:04 localhost kernel: cpu 2 hot: high 0, batch 1 used:0
May 12 00:02:04 localhost kernel: cpu 2 cold: high 0, batch 1 used:0
May 12 00:02:04 localhost kernel: cpu 3 hot: high 0, batch 1 used:0
May 12 00:02:04 localhost kernel: cpu 3 cold: high 0, batch 1 used:0
May 12 00:02:04 localhost kernel: DMA32 per-cpu: empty
May 12 00:02:04 localhost kernel: Normal per-cpu:
May 12 00:02:04 localhost kernel: cpu 0 hot: high 186, batch 31 used:176
May 12 00:02:04 localhost kernel: cpu 0 cold: high 62, batch 15 used:60
May 12 00:02:04 localhost kernel: cpu 1 hot: high 186, batch 31 used:35
May 12 00:02:04 localhost kernel: cpu 1 cold: high 62, batch 15 used:51
May 12 00:02:04 localhost kernel: cpu 2 hot: high 186, batch 31 used:104
May 12 00:02:04 localhost kernel: cpu 2 cold: high 62, batch 15 used:48
May 12 00:02:04 localhost kernel: cpu 3 hot: high 186, batch 31 used:18
May 12 00:02:04 localhost kernel: cpu 3 cold: high 62, batch 15 used:47
May 12 00:02:04 localhost kernel: HighMem per-cpu:
May 12 00:02:04 localhost kernel: cpu 0 hot: high 186, batch 31 used:159
May 12 00:02:05 localhost kernel: cpu 0 cold: high 62, batch 15 used:49
May 12 00:02:05 localhost kernel: cpu 1 hot: high 186, batch 31 used:8
May 12 00:02:05 localhost kernel: cpu 1 cold: high 62, batch 15 used:58
May 12 00:02:05 localhost kernel: cpu 2 hot: high 186, batch 31 used:185
May 12 00:02:05 localhost kernel: cpu 2 cold: high 62, batch 15 used:49
May 12 00:02:05 localhost kernel: cpu 3 hot: high 186, batch 31 used:163
May 12 00:02:05 localhost kernel: cpu 3 cold: high 62, batch 15 used:42
May 12 00:02:05 localhost kernel: Free pages: 124284kB (11176kB
HighMem)
May 12 00:02:05 localhost kernel: Active:654240 inactive:160446 dirty:0
writeback:527 unstable:0 free:31071 slab:188837 mapped:9241 pagetables:766
May 12 00:02:05 localhost kernel: DMA free:3548kB min:68kB low:84kB
high:100kB active:0kB inactive:0kB present:16384kB pages_scanned:0
all_unreclaimable? yes
May 12 00:02:05 localhost kernel: lowmem_reserve[]: 0 0 880 4592
May 12 00:02:05 localhost kernel: DMA32 free:0kB min:0kB low:0kB high:0kB
active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
May 12 00:02:05 localhost kernel: lowmem_reserve[]: 0 0 880 4592
May 12 00:02:05 localhost kernel: Normal free:109484kB min:3756kB low:4692kB
high:5632kB active:132kB inactive:2044kB present:901120kB pages_scanned:0
all_unreclaimable? no
May 12 00:02:05 localhost kernel: lowmem_reserve[]: 0 0 0 29696
May 12 00:02:05 localhost kernel: HighMem free:11176kB min:512kB low:4476kB
high:8440kB active:2616828kB inactive:639740kB present:3801088kB
pages_scanned:0 all_unreclaimable? no
May 12 00:02:05 localhost kernel: lowmem_reserve[]: 0 0 0 0
May 12 00:02:05 localhost kernel: DMA: 3*4kB 0*8kB 1*16kB 0*32kB 1*64kB
1*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 0*4096kB = 3548kB
May 12 00:02:07 localhost kernel: DMA32: empty
May 12 00:02:07 localhost kernel: Normal: 27075*4kB 60*8kB 0*16kB 0*32kB
1*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 109484kB
May 12 00:02:07 localhost kernel: HighMem: 952*4kB 95*8kB 95*16kB 23*32kB
0*64kB 4*128kB 3*256kB 6*512kB 0*1024kB 0*2048kB 0*4096kB = 11176kB
May 12 00:02:07 localhost kernel: Swap cache: add 1091416, delete 1088979,
find 517981/637567, race 0+1
May 12 00:02:07 localhost kernel: Free swap = 1934920kB
May 12 00:02:07 localhost kernel: Total swap = 2031608kB
May 12 00:02:07 localhost kernel: Free swap: 1934920kB
May 12 00:02:07 localhost kernel: 1179648 pages of RAM
May 12 00:02:07 localhost kernel: 950272 pages of HIGHMEM
May 12 00:02:07 localhost kernel: 141635 reserved pages
May 12 00:02:07 localhost kernel: 745928 pages shared
May 12 00:02:07 localhost kernel: 2456 pages swap cached
May 12 00:02:07 localhost kernel: 0 pages dirty
May 12 00:02:07 localhost kernel: 194 pages writeback
May 12 00:02:07 localhost kernel: 9241 pages mapped
May 12 00:02:07 localhost kernel: 189115 pages slab
May 12 00:02:07 localhost kernel: 766 pages pagetables
May 12 00:02:07 localhost kernel: Out of memory: Killed process 13606
(nginx).
May 12 00:02:07 localhost kernel: printk: 135598 messages suppressed.
May 12 00:02:07 localhost kernel: nginx invoked oom-killer: gfp_mask=0xd0,
order=1, oomkilladj=0
May 12 00:02:08 localhost kernel: [<c0450ace>] out_of_memory+0x3b/0x179
May 12 00:02:08 localhost kernel: [<c0451f01>] __alloc_pages+0x1fe/0x27e
May 12 00:02:08 localhost kernel: [<c0465e28>]
cache_alloc_refill+0x26d/0x44f
May 12 00:02:08 localhost kernel: [<c0465bb1>] kmem_cache_alloc+0x41/0x4b
May 12 00:02:08 localhost kernel: [<c059c045>] sk_alloc+0x1e/0xe6
May 12 00:02:08 localhost kernel: [<c05dd45a>] inet_create+0x10c/0x231
May 12 00:02:08 localhost kernel: [<c059a5d0>] __sock_create+0x133/0x213
May 12 00:02:08 localhost kernel: [<c059a6c9>] sock_create+0xb/0xe
May 12 00:02:08 localhost kernel: [<c059a8a8>] sys_socket+0x18/0x38
May 12 00:02:08 localhost kernel: [<c059b2a8>] sys_socketcall+0x6c/0x19e
May 12 00:02:08 localhost kernel: [<c0403e95>] sysenter_past_esp+0x56/0x79
May 12 00:02:08 localhost kernel: =======================
May 12 00:02:08 localhost kernel: Mem-info:
May 12 00:02:08 localhost kernel: DMA per-cpu:
May 12 00:02:08 localhost kernel: cpu 0 hot: high 0, batch 1 used:0
May 12 00:02:08 localhost kernel: cpu 0 cold: high 0, batch 1 used:0
May 12 00:02:08 localhost kernel: cpu 1 hot: high 0, batch 1 used:0
May 12 00:02:08 localhost kernel: cpu 1 cold: high 0, batch 1 used:0
May 12 00:02:08 localhost kernel: cpu 2 hot: high 0, batch 1 used:0
May 12 00:02:08 localhost kernel: cpu 2 cold: high 0, batch 1 used:0
May 12 00:02:08 localhost kernel: cpu 3 hot: high 0, batch 1 used:0
May 12 00:02:08 localhost kernel: cpu 3 cold: high 0, batch 1 used:0
May 12 00:02:08 localhost kernel: DMA32 per-cpu: empty
May 12 00:02:08 localhost kernel: Normal per-cpu:
May 12 00:02:08 localhost kernel: cpu 0 hot: high 186, batch 31 used:1
May 12 00:02:08 localhost kernel: cpu 0 cold: high 62, batch 15 used:49
May 12 00:02:08 localhost kernel: cpu 1 hot: high 186, batch 31 used:4
May 12 00:02:08 localhost kernel: cpu 1 cold: high 62, batch 15 used:61
May 12 00:02:08 localhost kernel: cpu 2 hot: high 186, batch 31 used:24
May 12 00:02:08 localhost kernel: cpu 2 cold: high 62, batch 15 used:48
May 12 00:02:08 localhost kernel: cpu 3 hot: high 186, batch 31 used:21
May 12 00:02:08 localhost kernel: cpu 3 cold: high 62, batch 15 used:48
May 12 00:02:08 localhost kernel: HighMem per-cpu:
May 12 00:02:09 localhost kernel: cpu 0 hot: high 186, batch 31 used:0
May 12 00:02:09 localhost kernel: cpu 0 cold: high 62, batch 15 used:22
May 12 00:02:09 localhost kernel: cpu 1 hot: high 186, batch 31 used:0
May 12 00:02:09 localhost kernel: cpu 1 cold: high 62, batch 15 used:48
May 12 00:02:09 localhost kernel: cpu 2 hot: high 186, batch 31 used:29
May 12 00:02:09 localhost kernel: cpu 2 cold: high 62, batch 15 used:28
May 12 00:02:09 localhost kernel: cpu 3 hot: high 186, batch 31 used:16
May 12 00:02:09 localhost kernel: cpu 3 cold: high 62, batch 15 used:34
May 12 00:02:09 localhost kernel: Free pages: 176232kB (34612kB
HighMem)
May 12 00:02:09 localhost kernel: Active:649045 inactive:159818 dirty:55
writeback:33 unstable:0 free:44058 slab:182485 mapped:9330 pagetables:759
May 12 00:02:09 localhost kernel: DMA free:3552kB min:68kB low:84kB
high:100kB active:0kB inactive:0kB present:16384kB pages_scanned:0
all_unreclaimable? yes
May 12 00:02:09 localhost kernel: lowmem_reserve[]: 0 0 880 4592
May 12 00:02:10 localhost kernel: DMA32 free:0kB min:0kB low:0kB high:0kB
active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
May 12 00:02:10 localhost kernel: lowmem_reserve[]: 0 0 880 4592
May 12 00:02:10 localhost kernel: Normal free:138068kB min:3756kB low:4692kB
high:5632kB active:84kB inactive:68kB present:901120kB pages_scanned:3104
all_unreclaimable? yes
May 12 00:02:10 localhost kernel: lowmem_reserve[]: 0 0 0 29696
May 12 00:02:10 localhost kernel: HighMem free:34612kB min:512kB low:4476kB
high:8440kB active:2596180kB inactive:639120kB present:3801088kB
pages_scanned:0 all_unreclaimable? no
May 12 00:02:10 localhost kernel: lowmem_reserve[]: 0 0 0 0
May 12 00:02:10 localhost kernel: DMA: 78*4kB 1*8kB 0*16kB 1*32kB 0*64kB
1*128kB 0*256kB 0*512kB 1*1024kB 1*2048kB 0*4096kB = 3552kB
May 12 00:02:10 localhost kernel: DMA32: empty
May 12 00:02:10 localhost kernel: Normal: 34341*4kB 0*8kB 0*16kB 0*32kB
1*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 138068kB
May 12 00:02:10 localhost kernel: HighMem: 515*4kB 2755*8kB 339*16kB 23*32kB
0*64kB 4*128kB 3*256kB 6*512kB 0*1024kB 0*2048kB 0*4096kB = 34612kB
May 12 00:02:10 localhost kernel: Swap cache: add 1093192, delete 1089598,
find 518314/638147, race 0+1
May 12 00:02:10 localhost kernel: Free swap = 1937820kB
May 12 00:02:10 localhost kernel: Total swap = 2031608kB
May 12 00:02:10 localhost kernel: Free swap: 1937820kB
May 12 00:02:10 localhost kernel: 1179648 pages of RAM
May 12 00:02:10 localhost kernel: 950272 pages of HIGHMEM
May 12 00:02:10 localhost kernel: 141635 reserved pages
May 12 00:02:11 localhost kernel: 738674 pages shared
May 12 00:02:11 localhost kernel: 3613 pages swap cached
May 12 00:02:11 localhost kernel: 55 pages dirty
May 12 00:02:11 localhost kernel: 33 pages writeback
May 12 00:02:11 localhost kernel: 9330 pages mapped
May 12 00:02:11 localhost kernel: 182485 pages slab
May 12 00:02:11 localhost kernel: 759 pages pagetables
May 12 00:02:11 localhost kernel: possible SYN flooding on port 443. Sending
cookies.
May 12 00:02:11 localhost kernel: Out of memory: Killed process 25816
(nginx).
May 12 00:02:11 localhost kernel: printk: 198999 messages suppressed.
May 12 00:02:11 localhost kernel: nginx invoked oom-killer: gfp_mask=0xd0,
order=1, oomkilladj=0
May 12 00:02:11 localhost kernel: [<c0450ace>] out_of_memory+0x3b/0x179
May 12 00:02:11 localhost kernel: [<c0451f01>] __alloc_pages+0x1fe/0x27e
May 12 00:02:11 localhost kernel: [<c0465e28>]
cache_alloc_refill+0x26d/0x44f
May 12 00:02:11 localhost kernel: [<c0465bb1>] kmem_cache_alloc+0x41/0x4b
May 12 00:02:11 localhost kernel: [<c059c045>] sk_alloc+0x1e/0xe6
May 12 00:02:11 localhost kernel: [<c05dd45a>] inet_create+0x10c/0x231
May 12 00:02:11 localhost kernel: [<c059a5d0>] __sock_create+0x133/0x213
May 12 00:02:11 localhost kernel: [<c059a6c9>] sock_create+0xb/0xe
May 12 00:02:11 localhost kernel: [<c059a8a8>] sys_socket+0x18/0x38
May 12 00:02:11 localhost kernel: [<c059b2a8>] sys_socketcall+0x6c/0x19e
May 12 00:02:11 localhost kernel: [<c0403e95>] sysenter_past_esp+0x56/0x79
May 12 00:02:11 localhost kernel: =======================
May 12 00:02:11 localhost kernel: Mem-info:
May 12 00:02:11 localhost kernel: DMA per-cpu:
May 12 00:02:11 localhost kernel: cpu 0 hot: high 0, batch 1 used:0
May 12 00:02:11 localhost kernel: cpu 0 cold: high 0, batch 1 used:0
May 12 00:02:11 localhost kernel: cpu 1 hot: high 0, batch 1 used:0
May 12 00:02:11 localhost kernel: cpu 1 cold: high 0, batch 1 used:0
May 12 00:02:11 localhost kernel: cpu 2 hot: high 0, batch 1 used:0
May 12 00:02:11 localhost kernel: cpu 2 cold: high 0, batch 1 used:0
May 12 00:02:11 localhost kernel: cpu 3 hot: high 0, batch 1 used:0
May 12 00:02:11 localhost kernel: cpu 3 cold: high 0, batch 1 used:0
May 12 00:02:11 localhost kernel: DMA32 per-cpu: empty
May 12 00:02:12 localhost kernel: Normal per-cpu:
May 12 00:02:12 localhost kernel: cpu 0 hot: high 186, batch 31 used:31
May 12 00:02:12 localhost kernel: cpu 0 cold: high 62, batch 15 used:58
May 12 00:02:12 localhost kernel: cpu 1 hot: high 186, batch 31 used:105
May 12 00:02:13 localhost kernel: cpu 1 cold: high 62, batch 15 used:47
May 12 00:02:13 localhost kernel: cpu 2 hot: high 186, batch 31 used:6
May 12 00:02:13 localhost kernel: cpu 2 cold: high 62, batch 15 used:47
May 12 00:02:14 localhost kernel: cpu 3 hot: high 186, batch 31 used:24
May 12 00:02:14 localhost kernel: cpu 3 cold: high 62, batch 15 used:52
May 12 00:02:15 localhost kernel: HighMem per-cpu:
May 12 00:02:15 localhost kernel: cpu 0 hot: high 186, batch 31 used:12
May 12 00:02:16 localhost kernel: cpu 0 cold: high 62, batch 15 used:22
May 12 00:02:16 localhost kernel: cpu 1 hot: high 186, batch 31 used:177
May 12 00:02:17 localhost kernel: cpu 1 cold: high 62, batch 15 used:16
May 12 00:02:17 localhost kernel: cpu 2 hot: high 186, batch 31 used:14
May 12 00:02:18 localhost kernel: cpu 2 cold: high 62, batch 15 used:11
May 12 00:02:18 localhost kernel: cpu 3 hot: high 186, batch 31 used:2
May 12 00:02:18 localhost kernel: cpu 3 cold: high 62, batch 15 used:34
May 12 00:02:18 localhost kernel: Free pages: 190492kB (55012kB
HighMem)
May 12 00:02:19 localhost kernel: Active:643824 inactive:159875 dirty:12
writeback:5 unstable:0 free:47623 slab:183951 mapped:9332 pagetables:730


--
С уважением,
Алексей Лоскутов
_______________________________________________
nginx-ru mailing list
nginx-ru@nginx.org
http://nginx.org/mailman/listinfo/nginx-ru
Subject Author Posted

OOM в linux под нагрузкой

Alex Loskutov May 12, 2010 05:02AM

Re: OOM в linux под нагрузкой

lampoon May 12, 2010 05:52AM

Re: OOM в linux под нагрузкой

Dmitry Dedukhin May 12, 2010 05:54AM

Re: OOM в linux под нагрузкой

Boris Dolgov May 12, 2010 07:22AM

Re: OOM в linux под нагрузкой

Marko Kevac May 12, 2010 08:24AM



Sorry, only registered users may post in this forum.

Click here to login

Online Users

Guests: 301
Record Number of Users: 8 on April 13, 2023
Record Number of Guests: 421 on December 02, 2018
Powered by nginx      Powered by FreeBSD      PHP Powered      Powered by MariaDB      ipv6 ready