Hello Everyone ,
I am runing CentOS 5 with ipvsadm v1.24 2003/06/07 (compiled with popt and
IPVS v1.2.0) which is pushing ~10mbit and unfortunatelly I am having
serious issues with the machine after ~24hrs it freezes and OOM issues
appear .
In stock running kernel 2.6.18-8.el5 .
Does anyone have any ideea if this is an issue within the ipvs code or
something else ?
Slabtop shows this :
Active / Total Objects (% used) : 1071145 / 1141936 (93.8%)
Active / Total Slabs (% used) : 189599 / 189599 (100.0%)
Active / Total Caches (% used) : 93 / 141 (66.0%)
Active / Total Size (% used) : 745844.78K / 753778.20K (98.9%)
Minimum / Average / Maximum Object : 0.01K / 0.66K / 128.00K
OBJS ACTIVE USE OBJ SIZE SLABS OBJ/SLAB CACHE SIZE NAME
347362 347309 99% 0.03K 3074 113 12296K size-32
346044 346044 100% 2.00K 173022 2 692088K size-2048
174168 174168 100% 0.06K 2952 59 11808K size-64
126990 99513 78% 0.12K 4233 30 16932K ip_vs_conn
56952 30763 54% 0.05K 791 72 3164K buffer_head
Personally I suspect a memory leak within ipvs code.
Below a snippet of the messages:
kernel: DMA: 1*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 1*512kB
1*1024kB 1*2048kB 0*4096kB = 3588kB
kernel: DMA32: empty
kernel: Normal: 1*4kB 1*8kB 0*16kB 0*32kB 0*64kB 1*128kB 1*256kB 0*512kB
1*1024kB 1*2048kB 0*4096kB = 3468kB
kernel: HighMem: 28*4kB 3*8kB 521*16kB 406*32kB 144*64kB 47*128kB 37*256kB
17*512kB 3*1024kB 2*2048kB 231*4096kB = 1008216kB
kernel: Swap cache: add 0, delete 0, find 0/0, race 0+0
kernel: Free swap = 4194216kB
kernel: Total swap = 4194216kB
kernel: Free swap: 4194216kB
kernel: 524275 pages of RAM
ipfail: [2977]: info: Ping node count is balanced.
kernel: 294899 pages of HIGHMEM
kernel: 5344 reserved pages
kernel: 16069 pages shared
kernel: 0 pages swap cached
kernel: 0 pages dirty
kernel: 0 pages writeback
kernel: 3560 pages mapped
kernel: 221334 pages slab
kernel: 410 pages pagetables
kernel: sendmail invoked oom-killer: gfp_mask=0xd0, order=0, oomkilladj=0
kernel: [<c0452c4e>] out_of_memory+0x3b/0x179
kernel: [<c0454081>] __alloc_pages+0x1fe/0x27e
kernel: [<c0454126>] __get_free_pages+0x25/0x31
kernel: [<c0499e48>] proc_file_read+0x74/0x224
kernel: [<c047291f>] sys_fstat64+0x1e/0x23
kernel: [<c0499dd4>] proc_file_read+0x0/0x224
kernel: [<c046aee8>] vfs_read+0x9f/0x141
kernel: [<c046b336>] sys_read+0x3c/0x63
kernel: [<c0403eff>] syscall_call+0x7/0xb
lvs2 kernel: =======================
kernel: Mem-info:
kernel: DMA per-cpu:
kernel: cpu 0 hot: high 0, batch 1 used:0
kernel: cpu 0 cold: high 0, batch 1 used:0
cpu 1 hot: high 0, batch 1 used:0
kernel: cpu 1 cold: high 0, batch 1 used:0
kernel: DMA32 per-cpu: empty
Please let me know if anyone has hit this issue or has a fix for this.
Thanks !
|