LVS
lvs-users
Google
 
Web LinuxVirtualServer.org

[lvs-users] OOM Issue

To: <lvs-users@xxxxxxxxxxxxxxxxxxxxxx>
Subject: [lvs-users] OOM Issue
From: "Valcu Gheorghe" <valcu.g@xxxxxxxxxx>
Date: Wed, 6 Feb 2008 22:50:46 +0200
Hello Everyone ,

I am runing CentOS 5 with ipvsadm v1.24 2003/06/07 (compiled with popt and
IPVS v1.2.0) which is pushing ~10mbit  and  unfortunatelly I am having
serious issues with the machine after ~24hrs it freezes and OOM issues
appear .

In stock running kernel 2.6.18-8.el5 .

Does anyone have any ideea if this is an issue within the ipvs code or
something else ?

Slabtop shows this :
 Active / Total Objects (% used)    : 1071145 / 1141936 (93.8%)
 Active / Total Slabs (% used)      : 189599 / 189599 (100.0%)
 Active / Total Caches (% used)     : 93 / 141 (66.0%)
 Active / Total Size (% used)       : 745844.78K / 753778.20K (98.9%)
 Minimum / Average / Maximum Object : 0.01K / 0.66K / 128.00K

  OBJS ACTIVE  USE OBJ SIZE  SLABS OBJ/SLAB CACHE SIZE NAME
347362 347309  99%    0.03K   3074      113     12296K size-32
346044 346044 100%    2.00K 173022        2    692088K size-2048
174168 174168 100%    0.06K   2952       59     11808K size-64
126990  99513  78%    0.12K   4233       30     16932K ip_vs_conn
 56952  30763  54%    0.05K    791       72      3164K buffer_head


Personally I  suspect a memory leak within ipvs code.



Below a snippet of the messages:

 kernel: DMA: 1*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 1*512kB
1*1024kB 1*2048kB 0*4096kB = 3588kB
 kernel: DMA32: empty
 kernel: Normal: 1*4kB 1*8kB 0*16kB 0*32kB 0*64kB 1*128kB 1*256kB 0*512kB
1*1024kB 1*2048kB 0*4096kB = 3468kB
 kernel: HighMem: 28*4kB 3*8kB 521*16kB 406*32kB 144*64kB 47*128kB 37*256kB
17*512kB 3*1024kB 2*2048kB 231*4096kB = 1008216kB
 kernel: Swap cache: add 0, delete 0, find 0/0, race 0+0
 kernel: Free swap  = 4194216kB
 kernel: Total swap = 4194216kB
 kernel: Free swap:       4194216kB
 kernel: 524275 pages of RAM
 ipfail: [2977]: info: Ping node count is balanced.
 kernel: 294899 pages of HIGHMEM
 kernel: 5344 reserved pages
 kernel: 16069 pages shared
 kernel: 0 pages swap cached
 kernel: 0 pages dirty
 kernel: 0 pages writeback
 kernel: 3560 pages mapped
 kernel: 221334 pages slab
 kernel: 410 pages pagetables
 kernel: sendmail invoked oom-killer: gfp_mask=0xd0, order=0, oomkilladj=0
 kernel:  [<c0452c4e>] out_of_memory+0x3b/0x179
 kernel:  [<c0454081>] __alloc_pages+0x1fe/0x27e
 kernel:  [<c0454126>] __get_free_pages+0x25/0x31
 kernel:  [<c0499e48>] proc_file_read+0x74/0x224
 kernel:  [<c047291f>] sys_fstat64+0x1e/0x23
 kernel:  [<c0499dd4>] proc_file_read+0x0/0x224
 kernel:  [<c046aee8>] vfs_read+0x9f/0x141
 kernel:  [<c046b336>] sys_read+0x3c/0x63
 kernel:  [<c0403eff>] syscall_call+0x7/0xb
 lvs2 kernel:  =======================
 kernel: Mem-info:
 kernel: DMA per-cpu:
 kernel: cpu 0 hot: high 0, batch 1 used:0
 kernel: cpu 0 cold: high 0, batch 1 used:0
 cpu 1 hot: high 0, batch 1 used:0
 kernel: cpu 1 cold: high 0, batch 1 used:0
 kernel: DMA32 per-cpu: empty

Please let me know if anyone has hit this issue or has a fix for this.

Thanks !



<Prev in Thread] Current Thread [Next in Thread>