LVS
lvs-users
Google
 
Web LinuxVirtualServer.org

Re: [lvs-users] Ldirector Performance Testing

To: "LinuxVirtualServer.org users mailing list." <lvs-users@xxxxxxxxxxxxxxxxxxxxxx>
Subject: Re: [lvs-users] Ldirector Performance Testing
From: Anil Pillai <rcamphor@xxxxxxxxx>
Date: Fri, 29 Oct 2010 10:55:44 +0530
Yes, i have done the test from two systems as well.

I have monitored the CPU load reals server & director and it was nominal.



On Fri, Oct 29, 2010 at 8:30 AM, Henrique Fernandes <sf.rique@xxxxxxxxx>wrote:

> Are you runing ab in two diferente machines ?
>
> 10.84.53.243 <http://10.84.53.243:60300/>
>  <http://192.168.16.178:8080/>10.84.53.244 <http://10.84.53.244:55993/>
>
>
> Can you see the cpu load on both machines and the ldirectord server ?
>
>
> []'sf.rique
>
>
> On Thu, Oct 28, 2010 at 5:48 PM, Anil Pillai <rcamphor@xxxxxxxxx> wrote:
>
> > yes still its the same.
> >
> > Will change it to wrr and see.
> >
> > On Fri, Oct 29, 2010 at 2:47 AM, Sfrique <sf.rique@xxxxxxxxx> wrote:
> >
> > >  Wlc is the balancer method....
> > > You could choose between others... Like wrr
> > >
> > > well you got 150 again??
> > >
> > > It seens you are using 2 servers to run ab.
> > >
> > > I will look into it closer later im on my phone...
> > >  ----- Original message -----
> > > > Please find the latest stats
> > > >
> > > > [root@DR01 ha.d]# ipvsadm -L -n
> > > > IP Virtual Server version 1.2.1 (size=4096)
> > > > Prot LocalAddress:Port Scheduler Flags
> > > >    -> RemoteAddress:Port                    Forward Weight ActiveConn
> > > InActConn
> > > > TCP  192.168.16.183:8080 wlc
> > > >    -> 192.168.16.178:8080                  Route    1          100
> > >         5129
> > > >    -> 192.168.16.176:8080                  Route    1          100
> > >         5116
> > > >    -> 192.168.16.177:8080                  Route    1          100
> > >         5117
> > > > [root@DR01 ha.d]# ipvsadm -L -n --stats
> > > > IP Virtual Server version 1.2.1 (size=4096)
> > > > Prot LocalAddress:Port                            Conns    InPkts
> > > OutPkts  InBytes
> > > > OutBytes
> > > >    -> RemoteAddress:Port
> > > > TCP  192.168.16.183:8080                        22106    154555
> > >     0 26451062
> > > > 0
> > > >    -> 192.168.16.178:8080                          7377      51598
> > >         0  8828089
> > > > 0
> > > >    -> 192.168.16.176:8080                          7374      51578
> > >         0  8824550
> > > > 0
> > > >    -> 192.168.16.177:8080                          7355      51379
> > >         0  8798423
> > > > 0
> > > > [root@DR01 ha.d]# ipvsadm -L -n --rate
> > > > IP Virtual Server version 1.2.1 (size=4096)
> > > > Prot LocalAddress:Port                                CPS      InPPS
> > > OutPPS      InBPS
> > > > OutBPS
> > > >    -> RemoteAddress:Port
> > > > TCP  192.168.16.183:8080                              19
>  150
> > >           0      23312
> > > > 0
> > > >    -> 192.168.16.178:8080                                6
> > > 50              0        7775
> > > > 0
> > > >    -> 192.168.16.176:8080                                6
> > > 50              0        7741
> > > > 0
> > > >    -> 192.168.16.177:8080                                6
> > > 50              0        7796
> > > > 0
> > > >
> > > > [root@DR01 ha.d]# ipvsadm -L -n --connection
> > > > IP Virtual Server version 1.2.1 (size=4096)
> > > > IPVS connection entries
> > > > pro expire state            source                        virtual
> > >               destination
> > > > TCP 00:22  FIN_WAIT      10.84.53.244:56447 192.168.16.183:8080
> > > > 192.168.16.176:8080
> > > > TCP 00:16  FIN_WAIT      10.84.53.243:60102 192.168.16.183:8080
> > > > 192.168.16.178:8080
> > > > TCP 00:12  FIN_WAIT      10.84.53.244:55531 192.168.16.183:8080
> > > > 192.168.16.178:8080
> > > > TCP 00:03  FIN_WAIT      10.84.53.243:58875 192.168.16.183:8080
> > > > 192.168.16.177:8080
> > > > TCP 00:22  FIN_WAIT      10.84.53.244:56341 192.168.16.183:8080
> > > > 192.168.16.176:8080
> > > > TCP 00:17  FIN_WAIT      10.84.53.244:55922 192.168.16.183:8080
> > > > 192.168.16.178:8080
> > > > TCP 00:05  FIN_WAIT      10.84.53.244:54851 192.168.16.183:8080
> > > > 192.168.16.176:8080
> > > > TCP 00:20  FIN_WAIT      10.84.53.244:56227 192.168.16.183:8080
> > > > 192.168.16.178:8080
> > > > TCP 00:00  FIN_WAIT      10.84.53.244:54475 192.168.16.183:8080
> > > > 192.168.16.177:8080
> > > > TCP 00:18  FIN_WAIT      10.84.53.243:60300 192.168.16.183:8080
> > > > 192.168.16.178:8080
> > > > TCP 00:18  FIN_WAIT      10.84.53.244:55993 192.168.16.183:8080
> > > > 192.168.16.176:8080
> > > > TCP 00:17  FIN_WAIT      10.84.53.244:55956 192.168.16.183:8080
> > > > 192.168.16.177:8080
> > > > TCP 00:11  FIN_WAIT      10.84.53.244:55404 192.168.16.183:8080
> > > > 192.168.16.176:8080
> > > > TCP 00:06  FIN_WAIT      10.84.53.243:59238 192.168.16.183:8080
> > > > 192.168.16.176:8080
> > > > TCP 00:18  FIN_WAIT      10.84.53.243:60293 192.168.16.183:8080
> > > > 192.168.16.177:8080
> > > > TCP 00:16  FIN_WAIT      10.84.53.244:55866 192.168.16.183:8080
> > > > 192.168.16.177:8080
> > > > TCP 00:17  FIN_WAIT      10.84.53.244:55905 192.168.16.183:8080
> > > > 192.168.16.176:8080
> > > > TCP 00:24  FIN_WAIT      10.84.53.243:60891 192.168.16.183:8080
> > > > 192.168.16.177:8080
> > > > TCP 00:20  FIN_WAIT      10.84.53.243:60458 192.168.16.183:8080
> > > > 192.168.16.178:8080
> > > > TCP 00:12  FIN_WAIT      10.84.53.244:55486 192.168.16.183:8080
> > > > 192.168.16.177:8080
> > > > TCP 00:06  FIN_WAIT      10.84.53.243:59241 192.168.16.183:8080
> > > > 192.168.16.177:8080
> > > > TCP 00:01  FIN_WAIT      10.84.53.244:54504 192.168.16.183:8080
> > > > 192.168.16.176:8080
> > > > TCP 00:14  FIN_WAIT      10.84.53.243:59877 192.168.16.183:8080
> > > > 192.168.16.177:8080
> > > > I am not clear about the question on wlc and ipvs.
> > > >
> > > > Regards,
> > > >
> > > > On Thu, Oct 28, 2010 at 5:11 PM, Henrique Fernandes
> > > > <sf.rique@xxxxxxxxx>wrote:
> > > >
> > > > > When you give ab to 192.168.16.183:8080 it does not get 450
> > > > > connections ?
> > > > >
> > > > > Do this:
> > > > >
> > > > > #ipvsadm --zero
> > > > >
> > > > > Check to see if stats is zero for each server.
> > > > >
> > > > > Now use ab to server 192.168.16.183:8080 while the test are being
> > use,
> > >
> > > > > see --conections, try to get like more than once.
> > > > >
> > > > > after test over, use --stats and  post here again!
> > > > >
> > > > > I guess as you are seeing you can figureout
> > > > >
> > > > > By the way, is a choise of your to use  wlc balancer and route in
> > ipvs
> > > > > ?
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > []'sf.rique
> > > > >
> > > > >
> > > > > On Thu, Oct 28, 2010 at 3:59 AM, Anil Pillai <rcamphor@xxxxxxxxx>
> > > > > wrote:
> > > > >
> > > > > > Below is the the output of commands.
> > > > > >
> > > > > >
> > > > > > [root@DR01 ~]# ipvsadm -L -n
> > > > > > IP Virtual Server version 1.2.1 (size=4096)
> > > > > > Prot LocalAddress:Port Scheduler Flags
> > > > > > -> RemoteAddress:Port                    Forward Weight
> ActiveConn
> > > InActConn
> > > > > > TCP  192.168.16.183:8080 wlc
> > > > > > -> 192.168.16.178:8080                  Route    1          0
> > >           59
> > > > > > -> 192.168.16.176:8080                  Route    1          0
> > >           59
> > > > > > -> 192.168.16.177:8080                  Route    1          0
> > >           81
> > > > > >
> > > > > > [root@DR01 ~]# ipvsadm -L -n --stats
> > > > > > IP Virtual Server version 1.2.1 (size=4096)
> > > > > > Prot LocalAddress:Port                            Conns    InPkts
> > > OutPkts  InBytes
> > > > > > OutBytes
> > > > > > -> RemoteAddress:Port
> > > > > > TCP  192.168.16.183:8080                        23514    164005
> > >         0 23122438
> > > > > > 0
> > > > > > -> 192.168.16.178:8080                          8532      59554
> > >         0  8380480
> > > > > > 0
> > > > > > -> 192.168.16.176:8080                          7628      53138
> > >         0  7459184
> > > > > > 0
> > > > > > -> 192.168.16.177:8080                          7354      51313
> > >         0  7282774
> > > > > > 0
> > > > > >
> > > > > > [root@DR01 ~]# ipvsadm -L -n --connection
> > > > > > IPVS connection entries
> > > > > > pro expire state            source                        virtual
> > >
> > > > > > destination
> > > > > >
> > > > > > --connection, didn;t give any output.
> > > > > >
> > > > > > Yes, i get 150 on each server when tested simultaneously.
> > > > > >
> > > > > >
> > > > > > On Wed, Oct 27, 2010 at 8:03 PM, Henrique Fernandes
> > > > > > <sf.rique@xxxxxxxxx
> > > > > > > wrote:
> > > > > >
> > > > > > > Can you please post the outputs of this comands in the
> diretord.
> > > > > > >
> > > > > > > #ipvsadm -L -n
> > > > > > >
> > > > > > > #ipvsadm -L --n --stats
> > > > > > >
> > > > > > > #ipvsadm -L -n --connection
> > > > > > >
> > > > > > >
> > > > > > > And if you use ab to test both servers at same time you get 150
> > on
> > > > > > > each
> > > > > ?
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > []'sf.rique
> > > > > > >
> > > > > > >
> > > > > > > On Wed, Oct 27, 2010 at 10:50 AM, Anil Pillai <
> > rcamphor@xxxxxxxxx>
> > >
> > > > > > wrote:
> > > > > > >
> > > > > > > > Hi,
> > > > > > > >
> > > > > > > > I have a LVS/DR setup (ldirectord) with One Director and two
> > Real
> > >
> > > > > > > Servers.
> > > > > > > > On Real Servers i have Apache Webserver running on port 8080.
> > > > > > > > Each Apache is capable of serving 150 TPS.
> > > > > > > > Now when i did load testing via Virtual IP, i am still
> getting
> > > > > > > > same
> > > > > TPS
> > > > > > > > (150).
> > > > > > > > For load testing i have used apache benckmark (ab) tool.
> > > > > > > > As per my understanding via Load Balancer (VIP) TPS should
> > > > > > > > increase
> > > > > and
> > > > > > > > should get around 300 TPS.
> > > > > > > >
> > > > > > > > Not sure where i am going wrong. Can anyone help me on this ?
> > > > > > > >
> > > > > > > > Below is the Setup Details:
> > > > > > > >
> > > > > > > > Director (Just acts as director only):
> > > > > > > >
> > > > > > > > 10.50.57.55 -> Virtual IP
> > > > > > > > 10.50.57.45 -> Physical IP
> > > > > > > >
> > > > > > > > Real Server 1:
> > > > > > > > 10.50.57.22 -> Physical IP on eth0
> > > > > > > > lo:0          Link encap:Local Loopback
> > > > > > > >
> > > > > > > > inet addr:10.50.57.55  Mask:255.255.255.255
> > > > > > > >
> > > > > > > > UP LOOPBACK RUNNING  MTU:16436  Metric:1
> > > > > > > >
> > > > > > > > Real Server 2:
> > > > > > > > 10.50.57.23 -> Physical IP on eth0
> > > > > > > > lo:0          Link encap:Local Loopback
> > > > > > > >
> > > > > > > > inet addr:10.50.57.55  Mask:255.255.255.255
> > > > > > > >
> > > > > > > > UP LOOPBACK RUNNING  MTU:16436  Metric:1
> > > > > > > >
> > > > > > > > # Global Directives
> > > > > > > > checktimeout=3
> > > > > > > > checkinterval=6
> > > > > > > > autoreload=yes
> > > > > > > > logfile="/var/log/ldirectord.log"
> > > > > > > > quiescent=yes
> > > > > > > > # HTTP services
> > > > > > > > virtual=10.50.57.55:8080
> > > > > > > > service=http
> > > > > > > > scheduler=rr
> > > > > > > > protocol=tcp
> > > > > > > > checktype=negotiate
> > > > > > > > real=10.50.57.22:8080
> > > > > > > > real=10.50.57.23:8080
> > > > > > > > request="test/lvs.html"
> > > > > > > > receive="Test Page"
> > > > > > > >
> > > > > > > >
> > > > > > > > Added Below line in sysctl.conf on Real Servers:
> > > > > > > > net.ipv4.conf.lo.arp_ignore = 1
> > > > > > > > net.ipv4.conf.lo.arp_announce = 2
> > > > > > > > net.ipv4.conf.all.arp_ignore = 1
> > > > > > > > net.ipv4.conf.all.arp_announce = 2
> > > > > > > >
> > > > > > > >
> > > > > > > > Regards,
> > > > > > > > _______________________________________________
> > > > > > > > Please read the documentation before posting - it's available
> > at:
> > >
> > > > > > > > http://www.linuxvirtualserver.org/
> > > > > > > >
> > > > > > > > LinuxVirtualServer.org mailing list -
> > > > > lvs-users@xxxxxxxxxxxxxxxxxxxxxx
> > > > > > > > Send requests to lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx
> > > > > > > > or go to http://lists.graemef.net/mailman/listinfo/lvs-users
> > > > > > > >
> > > > > > > _______________________________________________
> > > > > > > Please read the documentation before posting - it's available
> at:
> > > > > > > http://www.linuxvirtualserver.org/
> > > > > > >
> > > > > > > LinuxVirtualServer.org mailing list -
> > > > > > > lvs-users@xxxxxxxxxxxxxxxxxxxxxx Send requests to
> > > > > > > lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx or go to
> > > > > > > http://lists.graemef.net/mailman/listinfo/lvs-users
> > > > > > >
> > > > > > _______________________________________________
> > > > > > Please read the documentation before posting - it's available at:
> > > > > > http://www.linuxvirtualserver.org/
> > > > > >
> > > > > > LinuxVirtualServer.org mailing list -
> > > > > > lvs-users@xxxxxxxxxxxxxxxxxxxxxx Send requests to
> > > > > > lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx or go to
> > > > > > http://lists.graemef.net/mailman/listinfo/lvs-users
> > > > > >
> > > > > _______________________________________________
> > > > > Please read the documentation before posting - it's available at:
> > > > > http://www.linuxvirtualserver.org/
> > > > >
> > > > > LinuxVirtualServer.org mailing list -
> > lvs-users@xxxxxxxxxxxxxxxxxxxxxx
> > > > > Send requests to lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx
> > > > > or go to http://lists.graemef.net/mailman/listinfo/lvs-users
> > > > >
> > > > _______________________________________________
> > > > Please read the documentation before posting - it's available at:
> > > > http://www.linuxvirtualserver.org/
> > > >
> > > > LinuxVirtualServer.org mailing list -
> lvs-users@xxxxxxxxxxxxxxxxxxxxxx
> > > > Send requests to lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx
> > > > or go to http://lists.graemef.net/mailman/listinfo/lvs-users
> > >
> > >
> > _______________________________________________
>  > Please read the documentation before posting - it's available at:
> > http://www.linuxvirtualserver.org/
> >
> > LinuxVirtualServer.org mailing list - lvs-users@xxxxxxxxxxxxxxxxxxxxxx
> > Send requests to lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx
> > or go to http://lists.graemef.net/mailman/listinfo/lvs-users
> >
> _______________________________________________
> Please read the documentation before posting - it's available at:
> http://www.linuxvirtualserver.org/
>
> LinuxVirtualServer.org mailing list - lvs-users@xxxxxxxxxxxxxxxxxxxxxx
> Send requests to lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx
> or go to http://lists.graemef.net/mailman/listinfo/lvs-users
>
_______________________________________________
Please read the documentation before posting - it's available at:
http://www.linuxvirtualserver.org/

LinuxVirtualServer.org mailing list - lvs-users@xxxxxxxxxxxxxxxxxxxxxx
Send requests to lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx
or go to http://lists.graemef.net/mailman/listinfo/lvs-users

<Prev in Thread] Current Thread [Next in Thread>