LVS
lvs-users
Google
 
Web LinuxVirtualServer.org

Re: [lvs-users] Ldirector Performance Testing

To: "LinuxVirtualServer.org users mailing list." <lvs-users@xxxxxxxxxxxxxxxxxxxxxx>
Subject: Re: [lvs-users] Ldirector Performance Testing
From: Anil Pillai <rcamphor@xxxxxxxxx>
Date: Fri, 29 Oct 2010 16:38:29 +0530
One observation.

[root@DR01 tmp]# ipvsadm -L -n --rate
IP Virtual Server version 1.2.1 (size=4096)
Prot LocalAddress:Port                 CPS    InPPS   OutPPS    InBPS
OutBPS
  -> RemoteAddress:Port
TCP  192.168.16.183:8080               190     1333        0   228019
0
  -> 192.168.16.180:8080                32      221        0    37969
0
  -> 192.168.16.181:8080                32      220        0    37934
0
  -> 192.168.16.178:8080                32      224        0    38017
0
  -> 192.168.16.176:8080                32      224        0    38083
0
As per my understanding, CPS means connection per second.
Here it shows 190 connections on VIP and 32 on each real server. What i have
noticed 32 is the max it shows for real servers.
Not sure, if this can be increased or how this is controlled ?



On Fri, Oct 29, 2010 at 10:55 AM, Anil Pillai <rcamphor@xxxxxxxxx> wrote:

> Yes, i have done the test from two systems as well.
>
> I have monitored the CPU load reals server & director and it was nominal.
>
>
>
> On Fri, Oct 29, 2010 at 8:30 AM, Henrique Fernandes <sf.rique@xxxxxxxxx>wrote:
>
>> Are you runing ab in two diferente machines ?
>>
>> 10.84.53.243 <http://10.84.53.243:60300/>
>>  <http://192.168.16.178:8080/>10.84.53.244 <http://10.84.53.244:55993/>
>>
>>
>> Can you see the cpu load on both machines and the ldirectord server ?
>>
>>
>> []'sf.rique
>>
>>
>> On Thu, Oct 28, 2010 at 5:48 PM, Anil Pillai <rcamphor@xxxxxxxxx> wrote:
>>
>> > yes still its the same.
>> >
>> > Will change it to wrr and see.
>> >
>> > On Fri, Oct 29, 2010 at 2:47 AM, Sfrique <sf.rique@xxxxxxxxx> wrote:
>> >
>> > >  Wlc is the balancer method....
>> > > You could choose between others... Like wrr
>> > >
>> > > well you got 150 again??
>> > >
>> > > It seens you are using 2 servers to run ab.
>> > >
>> > > I will look into it closer later im on my phone...
>> > >  ----- Original message -----
>> > > > Please find the latest stats
>> > > >
>> > > > [root@DR01 ha.d]# ipvsadm -L -n
>> > > > IP Virtual Server version 1.2.1 (size=4096)
>> > > > Prot LocalAddress:Port Scheduler Flags
>> > > >    -> RemoteAddress:Port                    Forward Weight
>> ActiveConn
>> > > InActConn
>> > > > TCP  192.168.16.183:8080 wlc
>> > > >    -> 192.168.16.178:8080                  Route    1          100
>> > >         5129
>> > > >    -> 192.168.16.176:8080                  Route    1          100
>> > >         5116
>> > > >    -> 192.168.16.177:8080                  Route    1          100
>> > >         5117
>> > > > [root@DR01 ha.d]# ipvsadm -L -n --stats
>> > > > IP Virtual Server version 1.2.1 (size=4096)
>> > > > Prot LocalAddress:Port                            Conns    InPkts
>> > > OutPkts  InBytes
>> > > > OutBytes
>> > > >    -> RemoteAddress:Port
>> > > > TCP  192.168.16.183:8080                        22106    154555
>> > >     0 26451062
>> > > > 0
>> > > >    -> 192.168.16.178:8080                          7377      51598
>> > >         0  8828089
>> > > > 0
>> > > >    -> 192.168.16.176:8080                          7374      51578
>> > >         0  8824550
>> > > > 0
>> > > >    -> 192.168.16.177:8080                          7355      51379
>> > >         0  8798423
>> > > > 0
>> > > > [root@DR01 ha.d]# ipvsadm -L -n --rate
>> > > > IP Virtual Server version 1.2.1 (size=4096)
>> > > > Prot LocalAddress:Port                                CPS      InPPS
>> > > OutPPS      InBPS
>> > > > OutBPS
>> > > >    -> RemoteAddress:Port
>> > > > TCP  192.168.16.183:8080                              19
>>  150
>> > >           0      23312
>> > > > 0
>> > > >    -> 192.168.16.178:8080                                6
>> > > 50              0        7775
>> > > > 0
>> > > >    -> 192.168.16.176:8080                                6
>> > > 50              0        7741
>> > > > 0
>> > > >    -> 192.168.16.177:8080                                6
>> > > 50              0        7796
>> > > > 0
>> > > >
>> > > > [root@DR01 ha.d]# ipvsadm -L -n --connection
>> > > > IP Virtual Server version 1.2.1 (size=4096)
>> > > > IPVS connection entries
>> > > > pro expire state            source                        virtual
>> > >               destination
>> > > > TCP 00:22  FIN_WAIT      10.84.53.244:56447 192.168.16.183:8080
>> > > > 192.168.16.176:8080
>> > > > TCP 00:16  FIN_WAIT      10.84.53.243:60102 192.168.16.183:8080
>> > > > 192.168.16.178:8080
>> > > > TCP 00:12  FIN_WAIT      10.84.53.244:55531 192.168.16.183:8080
>> > > > 192.168.16.178:8080
>> > > > TCP 00:03  FIN_WAIT      10.84.53.243:58875 192.168.16.183:8080
>> > > > 192.168.16.177:8080
>> > > > TCP 00:22  FIN_WAIT      10.84.53.244:56341 192.168.16.183:8080
>> > > > 192.168.16.176:8080
>> > > > TCP 00:17  FIN_WAIT      10.84.53.244:55922 192.168.16.183:8080
>> > > > 192.168.16.178:8080
>> > > > TCP 00:05  FIN_WAIT      10.84.53.244:54851 192.168.16.183:8080
>> > > > 192.168.16.176:8080
>> > > > TCP 00:20  FIN_WAIT      10.84.53.244:56227 192.168.16.183:8080
>> > > > 192.168.16.178:8080
>> > > > TCP 00:00  FIN_WAIT      10.84.53.244:54475 192.168.16.183:8080
>> > > > 192.168.16.177:8080
>> > > > TCP 00:18  FIN_WAIT      10.84.53.243:60300 192.168.16.183:8080
>> > > > 192.168.16.178:8080
>> > > > TCP 00:18  FIN_WAIT      10.84.53.244:55993 192.168.16.183:8080
>> > > > 192.168.16.176:8080
>> > > > TCP 00:17  FIN_WAIT      10.84.53.244:55956 192.168.16.183:8080
>> > > > 192.168.16.177:8080
>> > > > TCP 00:11  FIN_WAIT      10.84.53.244:55404 192.168.16.183:8080
>> > > > 192.168.16.176:8080
>> > > > TCP 00:06  FIN_WAIT      10.84.53.243:59238 192.168.16.183:8080
>> > > > 192.168.16.176:8080
>> > > > TCP 00:18  FIN_WAIT      10.84.53.243:60293 192.168.16.183:8080
>> > > > 192.168.16.177:8080
>> > > > TCP 00:16  FIN_WAIT      10.84.53.244:55866 192.168.16.183:8080
>> > > > 192.168.16.177:8080
>> > > > TCP 00:17  FIN_WAIT      10.84.53.244:55905 192.168.16.183:8080
>> > > > 192.168.16.176:8080
>> > > > TCP 00:24  FIN_WAIT      10.84.53.243:60891 192.168.16.183:8080
>> > > > 192.168.16.177:8080
>> > > > TCP 00:20  FIN_WAIT      10.84.53.243:60458 192.168.16.183:8080
>> > > > 192.168.16.178:8080
>> > > > TCP 00:12  FIN_WAIT      10.84.53.244:55486 192.168.16.183:8080
>> > > > 192.168.16.177:8080
>> > > > TCP 00:06  FIN_WAIT      10.84.53.243:59241 192.168.16.183:8080
>> > > > 192.168.16.177:8080
>> > > > TCP 00:01  FIN_WAIT      10.84.53.244:54504 192.168.16.183:8080
>> > > > 192.168.16.176:8080
>> > > > TCP 00:14  FIN_WAIT      10.84.53.243:59877 192.168.16.183:8080
>> > > > 192.168.16.177:8080
>> > > > I am not clear about the question on wlc and ipvs.
>> > > >
>> > > > Regards,
>> > > >
>> > > > On Thu, Oct 28, 2010 at 5:11 PM, Henrique Fernandes
>> > > > <sf.rique@xxxxxxxxx>wrote:
>> > > >
>> > > > > When you give ab to 192.168.16.183:8080 it does not get 450
>> > > > > connections ?
>> > > > >
>> > > > > Do this:
>> > > > >
>> > > > > #ipvsadm --zero
>> > > > >
>> > > > > Check to see if stats is zero for each server.
>> > > > >
>> > > > > Now use ab to server 192.168.16.183:8080 while the test are being
>> > use,
>> > >
>> > > > > see --conections, try to get like more than once.
>> > > > >
>> > > > > after test over, use --stats and  post here again!
>> > > > >
>> > > > > I guess as you are seeing you can figureout
>> > > > >
>> > > > > By the way, is a choise of your to use  wlc balancer and route in
>> > ipvs
>> > > > > ?
>> > > > >
>> > > > >
>> > > > >
>> > > > >
>> > > > > []'sf.rique
>> > > > >
>> > > > >
>> > > > > On Thu, Oct 28, 2010 at 3:59 AM, Anil Pillai <rcamphor@xxxxxxxxx>
>> > > > > wrote:
>> > > > >
>> > > > > > Below is the the output of commands.
>> > > > > >
>> > > > > >
>> > > > > > [root@DR01 ~]# ipvsadm -L -n
>> > > > > > IP Virtual Server version 1.2.1 (size=4096)
>> > > > > > Prot LocalAddress:Port Scheduler Flags
>> > > > > > -> RemoteAddress:Port                    Forward Weight
>> ActiveConn
>> > > InActConn
>> > > > > > TCP  192.168.16.183:8080 wlc
>> > > > > > -> 192.168.16.178:8080                  Route    1          0
>> > >           59
>> > > > > > -> 192.168.16.176:8080                  Route    1          0
>> > >           59
>> > > > > > -> 192.168.16.177:8080                  Route    1          0
>> > >           81
>> > > > > >
>> > > > > > [root@DR01 ~]# ipvsadm -L -n --stats
>> > > > > > IP Virtual Server version 1.2.1 (size=4096)
>> > > > > > Prot LocalAddress:Port                            Conns
>>  InPkts
>> > > OutPkts  InBytes
>> > > > > > OutBytes
>> > > > > > -> RemoteAddress:Port
>> > > > > > TCP  192.168.16.183:8080                        23514    164005
>> > >         0 23122438
>> > > > > > 0
>> > > > > > -> 192.168.16.178:8080                          8532      59554
>> > >         0  8380480
>> > > > > > 0
>> > > > > > -> 192.168.16.176:8080                          7628      53138
>> > >         0  7459184
>> > > > > > 0
>> > > > > > -> 192.168.16.177:8080                          7354      51313
>> > >         0  7282774
>> > > > > > 0
>> > > > > >
>> > > > > > [root@DR01 ~]# ipvsadm -L -n --connection
>> > > > > > IPVS connection entries
>> > > > > > pro expire state            source
>>  virtual
>> > >
>> > > > > > destination
>> > > > > >
>> > > > > > --connection, didn;t give any output.
>> > > > > >
>> > > > > > Yes, i get 150 on each server when tested simultaneously.
>> > > > > >
>> > > > > >
>> > > > > > On Wed, Oct 27, 2010 at 8:03 PM, Henrique Fernandes
>> > > > > > <sf.rique@xxxxxxxxx
>> > > > > > > wrote:
>> > > > > >
>> > > > > > > Can you please post the outputs of this comands in the
>> diretord.
>> > > > > > >
>> > > > > > > #ipvsadm -L -n
>> > > > > > >
>> > > > > > > #ipvsadm -L --n --stats
>> > > > > > >
>> > > > > > > #ipvsadm -L -n --connection
>> > > > > > >
>> > > > > > >
>> > > > > > > And if you use ab to test both servers at same time you get
>> 150
>> > on
>> > > > > > > each
>> > > > > ?
>> > > > > > >
>> > > > > > >
>> > > > > > >
>> > > > > > > []'sf.rique
>> > > > > > >
>> > > > > > >
>> > > > > > > On Wed, Oct 27, 2010 at 10:50 AM, Anil Pillai <
>> > rcamphor@xxxxxxxxx>
>> > >
>> > > > > > wrote:
>> > > > > > >
>> > > > > > > > Hi,
>> > > > > > > >
>> > > > > > > > I have a LVS/DR setup (ldirectord) with One Director and two
>> > Real
>> > >
>> > > > > > > Servers.
>> > > > > > > > On Real Servers i have Apache Webserver running on port
>> 8080.
>> > > > > > > > Each Apache is capable of serving 150 TPS.
>> > > > > > > > Now when i did load testing via Virtual IP, i am still
>> getting
>> > > > > > > > same
>> > > > > TPS
>> > > > > > > > (150).
>> > > > > > > > For load testing i have used apache benckmark (ab) tool.
>> > > > > > > > As per my understanding via Load Balancer (VIP) TPS should
>> > > > > > > > increase
>> > > > > and
>> > > > > > > > should get around 300 TPS.
>> > > > > > > >
>> > > > > > > > Not sure where i am going wrong. Can anyone help me on this
>> ?
>> > > > > > > >
>> > > > > > > > Below is the Setup Details:
>> > > > > > > >
>> > > > > > > > Director (Just acts as director only):
>> > > > > > > >
>> > > > > > > > 10.50.57.55 -> Virtual IP
>> > > > > > > > 10.50.57.45 -> Physical IP
>> > > > > > > >
>> > > > > > > > Real Server 1:
>> > > > > > > > 10.50.57.22 -> Physical IP on eth0
>> > > > > > > > lo:0          Link encap:Local Loopback
>> > > > > > > >
>> > > > > > > > inet addr:10.50.57.55  Mask:255.255.255.255
>> > > > > > > >
>> > > > > > > > UP LOOPBACK RUNNING  MTU:16436  Metric:1
>> > > > > > > >
>> > > > > > > > Real Server 2:
>> > > > > > > > 10.50.57.23 -> Physical IP on eth0
>> > > > > > > > lo:0          Link encap:Local Loopback
>> > > > > > > >
>> > > > > > > > inet addr:10.50.57.55  Mask:255.255.255.255
>> > > > > > > >
>> > > > > > > > UP LOOPBACK RUNNING  MTU:16436  Metric:1
>> > > > > > > >
>> > > > > > > > # Global Directives
>> > > > > > > > checktimeout=3
>> > > > > > > > checkinterval=6
>> > > > > > > > autoreload=yes
>> > > > > > > > logfile="/var/log/ldirectord.log"
>> > > > > > > > quiescent=yes
>> > > > > > > > # HTTP services
>> > > > > > > > virtual=10.50.57.55:8080
>> > > > > > > > service=http
>> > > > > > > > scheduler=rr
>> > > > > > > > protocol=tcp
>> > > > > > > > checktype=negotiate
>> > > > > > > > real=10.50.57.22:8080
>> > > > > > > > real=10.50.57.23:8080
>> > > > > > > > request="test/lvs.html"
>> > > > > > > > receive="Test Page"
>> > > > > > > >
>> > > > > > > >
>> > > > > > > > Added Below line in sysctl.conf on Real Servers:
>> > > > > > > > net.ipv4.conf.lo.arp_ignore = 1
>> > > > > > > > net.ipv4.conf.lo.arp_announce = 2
>> > > > > > > > net.ipv4.conf.all.arp_ignore = 1
>> > > > > > > > net.ipv4.conf.all.arp_announce = 2
>> > > > > > > >
>> > > > > > > >
>> > > > > > > > Regards,
>> > > > > > > > _______________________________________________
>> > > > > > > > Please read the documentation before posting - it's
>> available
>> > at:
>> > >
>> > > > > > > > http://www.linuxvirtualserver.org/
>> > > > > > > >
>> > > > > > > > LinuxVirtualServer.org mailing list -
>> > > > > lvs-users@xxxxxxxxxxxxxxxxxxxxxx
>> > > > > > > > Send requests to lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx
>> > > > > > > > or go to
>> http://lists.graemef.net/mailman/listinfo/lvs-users
>> > > > > > > >
>> > > > > > > _______________________________________________
>> > > > > > > Please read the documentation before posting - it's available
>> at:
>> > > > > > > http://www.linuxvirtualserver.org/
>> > > > > > >
>> > > > > > > LinuxVirtualServer.org mailing list -
>> > > > > > > lvs-users@xxxxxxxxxxxxxxxxxxxxxx Send requests to
>> > > > > > > lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx or go to
>> > > > > > > http://lists.graemef.net/mailman/listinfo/lvs-users
>> > > > > > >
>> > > > > > _______________________________________________
>> > > > > > Please read the documentation before posting - it's available
>> at:
>> > > > > > http://www.linuxvirtualserver.org/
>> > > > > >
>> > > > > > LinuxVirtualServer.org mailing list -
>> > > > > > lvs-users@xxxxxxxxxxxxxxxxxxxxxx Send requests to
>> > > > > > lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx or go to
>> > > > > > http://lists.graemef.net/mailman/listinfo/lvs-users
>> > > > > >
>> > > > > _______________________________________________
>> > > > > Please read the documentation before posting - it's available at:
>> > > > > http://www.linuxvirtualserver.org/
>> > > > >
>> > > > > LinuxVirtualServer.org mailing list -
>> > lvs-users@xxxxxxxxxxxxxxxxxxxxxx
>> > > > > Send requests to lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx
>> > > > > or go to http://lists.graemef.net/mailman/listinfo/lvs-users
>> > > > >
>> > > > _______________________________________________
>> > > > Please read the documentation before posting - it's available at:
>> > > > http://www.linuxvirtualserver.org/
>> > > >
>> > > > LinuxVirtualServer.org mailing list -
>> lvs-users@xxxxxxxxxxxxxxxxxxxxxx
>> > > > Send requests to lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx
>> > > > or go to http://lists.graemef.net/mailman/listinfo/lvs-users
>> > >
>> > >
>> > _______________________________________________
>>  > Please read the documentation before posting - it's available at:
>> > http://www.linuxvirtualserver.org/
>> >
>> > LinuxVirtualServer.org mailing list - lvs-users@xxxxxxxxxxxxxxxxxxxxxx
>> > Send requests to lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx
>> > or go to http://lists.graemef.net/mailman/listinfo/lvs-users
>> >
>> _______________________________________________
>> Please read the documentation before posting - it's available at:
>> http://www.linuxvirtualserver.org/
>>
>> LinuxVirtualServer.org mailing list - lvs-users@xxxxxxxxxxxxxxxxxxxxxx
>> Send requests to lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx
>> or go to http://lists.graemef.net/mailman/listinfo/lvs-users
>>
>
>
_______________________________________________
Please read the documentation before posting - it's available at:
http://www.linuxvirtualserver.org/

LinuxVirtualServer.org mailing list - lvs-users@xxxxxxxxxxxxxxxxxxxxxx
Send requests to lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx
or go to http://lists.graemef.net/mailman/listinfo/lvs-users

<Prev in Thread] Current Thread [Next in Thread>