LVS
lvs-users
Google
 
Web LinuxVirtualServer.org

Re: [lvs-users] net-snmp-lvs-module: stats fail under high load

To: lvs-users@xxxxxxxxxxxxxxxxxxxxxx
Subject: Re: [lvs-users] net-snmp-lvs-module: stats fail under high load
From: Robin Bowes <robin-lists@xxxxxxxxxxxxxx>
Date: Tue, 08 Dec 2009 18:09:56 +0000
On 08/12/09 16:27, Robin Bowes wrote:
> So, looks like that might be the problem; lvsServiceStatsConns is 32-bit.

Wrong!

> I wonder if it's as simple as changing ASN_COUNTER to ASN_COUNTER64 in
> the appropriate place in lvs.c ?

Well, I don't think it will hurt, but it didn't fix things.

I tried using ipvsadm while throwing lots of connections at the LVS host:

# ipvsadm --list --rate
IP Virtual Server version 1.2.1 (size=4096)
Prot LocalAddress:Port                 CPS    InPPS   OutPPS    InBPS
OutBPS
  -> RemoteAddress:Port
TCP  192.168.55.60:http                  0    52619        0  3578025
     0
  -> b011.private.b.example.com          0     6580        0   447439
     0
  -> b013.private.b.example.com          0     6578        0   447290
     0
  -> b012.private.b.example.com          0     6581        0   447528
     0
  -> b010.private.b.example.com          0     6573        0   446936
     0
  -> b008.private.b.example.com          0     6581        0   447507
     0
  -> b009.private.b.example.com          0     6578        0   447330
     0
  -> b007.private.b.example.com          0     6573        0   446939
     0
  -> b006.private.b.example.com          0     6574        0   447056
     0

Notice that ipvsadm reports "02 for connection rate too, so it looks
like the problem is in (lib)ipvsadm.

Now, net-snmp-lvs-module-0.0.4 comes with ipvsadm v1.24 and I see v1.25
is available. However, I've failed to get net-snmp-lvs-module to build
with ipvsadm 1.25 on CentOS 5.4

make -C libipvs
make[1]: Entering directory
`/home/rpmbuild/rpmbuild/BUILD/net-snmp-lvs-module-0.0.4/ipvsadm-1.25/libipvs'
gcc -Wall -Wunused -Wstrict-prototypes -g -fPIC -DLIBIPVS_USE_NL
-DHAVE_NET_IP_VS_H -c -o libipvs.o libipvs.c
In file included from libipvs.h:13,
                 from libipvs.c:23:
ip_vs.h:16:31: error: netlink/genl/genl.h: No such file or directory
ip_vs.h:17:31: error: netlink/genl/ctrl.h: No such file or directory
In file included from libipvs.h:13,
                 from libipvs.c:23:

I've installed libnl-devel, but it doesn't contain those files in v1.0.
I've also tried building libnl v1.1 but that won't build on CentOS either:

rpmbuild -ba libnl.spec
[snip]
gcc -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions
-fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -g
-I./include -I../include -I.  -D_GNU_SOURCE -Wall -ggdb -fPIC -c -o
route/link/vlan.o route/link/vlan.c
route/link/vlan.c:51: error: 'VLAN_FLAG_REORDER_HDR' undeclared here
(not in a function)
make[2]: *** [route/link/vlan.o] Error 1
gcc -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions
-fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -g
-I./include -I../include -I.  -D_GNU_SOURCE -Wall -ggdb -fPIC -c -o
route/link/vlan.o route/link/vlan.c
route/link/vlan.c:51: error: 'VLAN_FLAG_REORDER_HDR' undeclared here
(not in a function)
make[2]: *** [route/link/vlan.o] Error 1
make[1]: *** [all] Error 2
make: *** [all] Error 2
error: Bad exit status from /var/tmp/rpm-tmp.32736 (%build)

Any ideas how I might take this forward?

R.

_______________________________________________
Please read the documentation before posting - it's available at:
http://www.linuxvirtualserver.org/

LinuxVirtualServer.org mailing list - lvs-users@xxxxxxxxxxxxxxxxxxxxxx
Send requests to lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx
or go to http://lists.graemef.net/mailman/listinfo/lvs-users

<Prev in Thread] Current Thread [Next in Thread>