|
One observation.
[root@DR01 tmp]# ipvsadm -L -n --rate
IP Virtual Server version 1.2.1 (size=4096)
Prot LocalAddress:Port CPS InPPS OutPPS InBPS
OutBPS
-> RemoteAddress:Port
TCP 192.168.16.183:8080 190 1333 0 228019
0
-> 192.168.16.180:8080 32 221 0 37969
0
-> 192.168.16.181:8080 32 220 0 37934
0
-> 192.168.16.178:8080 32 224 0 38017
0
-> 192.168.16.176:8080 32 224 0 38083
0
As per my understanding, CPS means connection per second.
Here it shows 190 connections on VIP and 32 on each real server. What i have
noticed 32 is the max it shows for real servers.
Not sure, if this can be increased or how this is controlled ?
On Fri, Oct 29, 2010 at 10:55 AM, Anil Pillai <rcamphor@xxxxxxxxx> wrote:
> Yes, i have done the test from two systems as well.
>
> I have monitored the CPU load reals server & director and it was nominal.
>
>
>
> On Fri, Oct 29, 2010 at 8:30 AM, Henrique Fernandes <sf.rique@xxxxxxxxx>wrote:
>
>> Are you runing ab in two diferente machines ?
>>
>> 10.84.53.243 <http://10.84.53.243:60300/>
>> <http://192.168.16.178:8080/>10.84.53.244 <http://10.84.53.244:55993/>
>>
>>
>> Can you see the cpu load on both machines and the ldirectord server ?
>>
>>
>> []'sf.rique
>>
>>
>> On Thu, Oct 28, 2010 at 5:48 PM, Anil Pillai <rcamphor@xxxxxxxxx> wrote:
>>
>> > yes still its the same.
>> >
>> > Will change it to wrr and see.
>> >
>> > On Fri, Oct 29, 2010 at 2:47 AM, Sfrique <sf.rique@xxxxxxxxx> wrote:
>> >
>> > > Wlc is the balancer method....
>> > > You could choose between others... Like wrr
>> > >
>> > > well you got 150 again??
>> > >
>> > > It seens you are using 2 servers to run ab.
>> > >
>> > > I will look into it closer later im on my phone...
>> > > ----- Original message -----
>> > > > Please find the latest stats
>> > > >
>> > > > [root@DR01 ha.d]# ipvsadm -L -n
>> > > > IP Virtual Server version 1.2.1 (size=4096)
>> > > > Prot LocalAddress:Port Scheduler Flags
>> > > > -> RemoteAddress:Port Forward Weight
>> ActiveConn
>> > > InActConn
>> > > > TCP 192.168.16.183:8080 wlc
>> > > > -> 192.168.16.178:8080 Route 1 100
>> > > 5129
>> > > > -> 192.168.16.176:8080 Route 1 100
>> > > 5116
>> > > > -> 192.168.16.177:8080 Route 1 100
>> > > 5117
>> > > > [root@DR01 ha.d]# ipvsadm -L -n --stats
>> > > > IP Virtual Server version 1.2.1 (size=4096)
>> > > > Prot LocalAddress:Port Conns InPkts
>> > > OutPkts InBytes
>> > > > OutBytes
>> > > > -> RemoteAddress:Port
>> > > > TCP 192.168.16.183:8080 22106 154555
>> > > 0 26451062
>> > > > 0
>> > > > -> 192.168.16.178:8080 7377 51598
>> > > 0 8828089
>> > > > 0
>> > > > -> 192.168.16.176:8080 7374 51578
>> > > 0 8824550
>> > > > 0
>> > > > -> 192.168.16.177:8080 7355 51379
>> > > 0 8798423
>> > > > 0
>> > > > [root@DR01 ha.d]# ipvsadm -L -n --rate
>> > > > IP Virtual Server version 1.2.1 (size=4096)
>> > > > Prot LocalAddress:Port CPS InPPS
>> > > OutPPS InBPS
>> > > > OutBPS
>> > > > -> RemoteAddress:Port
>> > > > TCP 192.168.16.183:8080 19
>> 150
>> > > 0 23312
>> > > > 0
>> > > > -> 192.168.16.178:8080 6
>> > > 50 0 7775
>> > > > 0
>> > > > -> 192.168.16.176:8080 6
>> > > 50 0 7741
>> > > > 0
>> > > > -> 192.168.16.177:8080 6
>> > > 50 0 7796
>> > > > 0
>> > > >
>> > > > [root@DR01 ha.d]# ipvsadm -L -n --connection
>> > > > IP Virtual Server version 1.2.1 (size=4096)
>> > > > IPVS connection entries
>> > > > pro expire state source virtual
>> > > destination
>> > > > TCP 00:22 FIN_WAIT 10.84.53.244:56447 192.168.16.183:8080
>> > > > 192.168.16.176:8080
>> > > > TCP 00:16 FIN_WAIT 10.84.53.243:60102 192.168.16.183:8080
>> > > > 192.168.16.178:8080
>> > > > TCP 00:12 FIN_WAIT 10.84.53.244:55531 192.168.16.183:8080
>> > > > 192.168.16.178:8080
>> > > > TCP 00:03 FIN_WAIT 10.84.53.243:58875 192.168.16.183:8080
>> > > > 192.168.16.177:8080
>> > > > TCP 00:22 FIN_WAIT 10.84.53.244:56341 192.168.16.183:8080
>> > > > 192.168.16.176:8080
>> > > > TCP 00:17 FIN_WAIT 10.84.53.244:55922 192.168.16.183:8080
>> > > > 192.168.16.178:8080
>> > > > TCP 00:05 FIN_WAIT 10.84.53.244:54851 192.168.16.183:8080
>> > > > 192.168.16.176:8080
>> > > > TCP 00:20 FIN_WAIT 10.84.53.244:56227 192.168.16.183:8080
>> > > > 192.168.16.178:8080
>> > > > TCP 00:00 FIN_WAIT 10.84.53.244:54475 192.168.16.183:8080
>> > > > 192.168.16.177:8080
>> > > > TCP 00:18 FIN_WAIT 10.84.53.243:60300 192.168.16.183:8080
>> > > > 192.168.16.178:8080
>> > > > TCP 00:18 FIN_WAIT 10.84.53.244:55993 192.168.16.183:8080
>> > > > 192.168.16.176:8080
>> > > > TCP 00:17 FIN_WAIT 10.84.53.244:55956 192.168.16.183:8080
>> > > > 192.168.16.177:8080
>> > > > TCP 00:11 FIN_WAIT 10.84.53.244:55404 192.168.16.183:8080
>> > > > 192.168.16.176:8080
>> > > > TCP 00:06 FIN_WAIT 10.84.53.243:59238 192.168.16.183:8080
>> > > > 192.168.16.176:8080
>> > > > TCP 00:18 FIN_WAIT 10.84.53.243:60293 192.168.16.183:8080
>> > > > 192.168.16.177:8080
>> > > > TCP 00:16 FIN_WAIT 10.84.53.244:55866 192.168.16.183:8080
>> > > > 192.168.16.177:8080
>> > > > TCP 00:17 FIN_WAIT 10.84.53.244:55905 192.168.16.183:8080
>> > > > 192.168.16.176:8080
>> > > > TCP 00:24 FIN_WAIT 10.84.53.243:60891 192.168.16.183:8080
>> > > > 192.168.16.177:8080
>> > > > TCP 00:20 FIN_WAIT 10.84.53.243:60458 192.168.16.183:8080
>> > > > 192.168.16.178:8080
>> > > > TCP 00:12 FIN_WAIT 10.84.53.244:55486 192.168.16.183:8080
>> > > > 192.168.16.177:8080
>> > > > TCP 00:06 FIN_WAIT 10.84.53.243:59241 192.168.16.183:8080
>> > > > 192.168.16.177:8080
>> > > > TCP 00:01 FIN_WAIT 10.84.53.244:54504 192.168.16.183:8080
>> > > > 192.168.16.176:8080
>> > > > TCP 00:14 FIN_WAIT 10.84.53.243:59877 192.168.16.183:8080
>> > > > 192.168.16.177:8080
>> > > > I am not clear about the question on wlc and ipvs.
>> > > >
>> > > > Regards,
>> > > >
>> > > > On Thu, Oct 28, 2010 at 5:11 PM, Henrique Fernandes
>> > > > <sf.rique@xxxxxxxxx>wrote:
>> > > >
>> > > > > When you give ab to 192.168.16.183:8080 it does not get 450
>> > > > > connections ?
>> > > > >
>> > > > > Do this:
>> > > > >
>> > > > > #ipvsadm --zero
>> > > > >
>> > > > > Check to see if stats is zero for each server.
>> > > > >
>> > > > > Now use ab to server 192.168.16.183:8080 while the test are being
>> > use,
>> > >
>> > > > > see --conections, try to get like more than once.
>> > > > >
>> > > > > after test over, use --stats and post here again!
>> > > > >
>> > > > > I guess as you are seeing you can figureout
>> > > > >
>> > > > > By the way, is a choise of your to use wlc balancer and route in
>> > ipvs
>> > > > > ?
>> > > > >
>> > > > >
>> > > > >
>> > > > >
>> > > > > []'sf.rique
>> > > > >
>> > > > >
>> > > > > On Thu, Oct 28, 2010 at 3:59 AM, Anil Pillai <rcamphor@xxxxxxxxx>
>> > > > > wrote:
>> > > > >
>> > > > > > Below is the the output of commands.
>> > > > > >
>> > > > > >
>> > > > > > [root@DR01 ~]# ipvsadm -L -n
>> > > > > > IP Virtual Server version 1.2.1 (size=4096)
>> > > > > > Prot LocalAddress:Port Scheduler Flags
>> > > > > > -> RemoteAddress:Port Forward Weight
>> ActiveConn
>> > > InActConn
>> > > > > > TCP 192.168.16.183:8080 wlc
>> > > > > > -> 192.168.16.178:8080 Route 1 0
>> > > 59
>> > > > > > -> 192.168.16.176:8080 Route 1 0
>> > > 59
>> > > > > > -> 192.168.16.177:8080 Route 1 0
>> > > 81
>> > > > > >
>> > > > > > [root@DR01 ~]# ipvsadm -L -n --stats
>> > > > > > IP Virtual Server version 1.2.1 (size=4096)
>> > > > > > Prot LocalAddress:Port Conns
>> InPkts
>> > > OutPkts InBytes
>> > > > > > OutBytes
>> > > > > > -> RemoteAddress:Port
>> > > > > > TCP 192.168.16.183:8080 23514 164005
>> > > 0 23122438
>> > > > > > 0
>> > > > > > -> 192.168.16.178:8080 8532 59554
>> > > 0 8380480
>> > > > > > 0
>> > > > > > -> 192.168.16.176:8080 7628 53138
>> > > 0 7459184
>> > > > > > 0
>> > > > > > -> 192.168.16.177:8080 7354 51313
>> > > 0 7282774
>> > > > > > 0
>> > > > > >
>> > > > > > [root@DR01 ~]# ipvsadm -L -n --connection
>> > > > > > IPVS connection entries
>> > > > > > pro expire state source
>> virtual
>> > >
>> > > > > > destination
>> > > > > >
>> > > > > > --connection, didn;t give any output.
>> > > > > >
>> > > > > > Yes, i get 150 on each server when tested simultaneously.
>> > > > > >
>> > > > > >
>> > > > > > On Wed, Oct 27, 2010 at 8:03 PM, Henrique Fernandes
>> > > > > > <sf.rique@xxxxxxxxx
>> > > > > > > wrote:
>> > > > > >
>> > > > > > > Can you please post the outputs of this comands in the
>> diretord.
>> > > > > > >
>> > > > > > > #ipvsadm -L -n
>> > > > > > >
>> > > > > > > #ipvsadm -L --n --stats
>> > > > > > >
>> > > > > > > #ipvsadm -L -n --connection
>> > > > > > >
>> > > > > > >
>> > > > > > > And if you use ab to test both servers at same time you get
>> 150
>> > on
>> > > > > > > each
>> > > > > ?
>> > > > > > >
>> > > > > > >
>> > > > > > >
>> > > > > > > []'sf.rique
>> > > > > > >
>> > > > > > >
>> > > > > > > On Wed, Oct 27, 2010 at 10:50 AM, Anil Pillai <
>> > rcamphor@xxxxxxxxx>
>> > >
>> > > > > > wrote:
>> > > > > > >
>> > > > > > > > Hi,
>> > > > > > > >
>> > > > > > > > I have a LVS/DR setup (ldirectord) with One Director and two
>> > Real
>> > >
>> > > > > > > Servers.
>> > > > > > > > On Real Servers i have Apache Webserver running on port
>> 8080.
>> > > > > > > > Each Apache is capable of serving 150 TPS.
>> > > > > > > > Now when i did load testing via Virtual IP, i am still
>> getting
>> > > > > > > > same
>> > > > > TPS
>> > > > > > > > (150).
>> > > > > > > > For load testing i have used apache benckmark (ab) tool.
>> > > > > > > > As per my understanding via Load Balancer (VIP) TPS should
>> > > > > > > > increase
>> > > > > and
>> > > > > > > > should get around 300 TPS.
>> > > > > > > >
>> > > > > > > > Not sure where i am going wrong. Can anyone help me on this
>> ?
>> > > > > > > >
>> > > > > > > > Below is the Setup Details:
>> > > > > > > >
>> > > > > > > > Director (Just acts as director only):
>> > > > > > > >
>> > > > > > > > 10.50.57.55 -> Virtual IP
>> > > > > > > > 10.50.57.45 -> Physical IP
>> > > > > > > >
>> > > > > > > > Real Server 1:
>> > > > > > > > 10.50.57.22 -> Physical IP on eth0
>> > > > > > > > lo:0 Link encap:Local Loopback
>> > > > > > > >
>> > > > > > > > inet addr:10.50.57.55 Mask:255.255.255.255
>> > > > > > > >
>> > > > > > > > UP LOOPBACK RUNNING MTU:16436 Metric:1
>> > > > > > > >
>> > > > > > > > Real Server 2:
>> > > > > > > > 10.50.57.23 -> Physical IP on eth0
>> > > > > > > > lo:0 Link encap:Local Loopback
>> > > > > > > >
>> > > > > > > > inet addr:10.50.57.55 Mask:255.255.255.255
>> > > > > > > >
>> > > > > > > > UP LOOPBACK RUNNING MTU:16436 Metric:1
>> > > > > > > >
>> > > > > > > > # Global Directives
>> > > > > > > > checktimeout=3
>> > > > > > > > checkinterval=6
>> > > > > > > > autoreload=yes
>> > > > > > > > logfile="/var/log/ldirectord.log"
>> > > > > > > > quiescent=yes
>> > > > > > > > # HTTP services
>> > > > > > > > virtual=10.50.57.55:8080
>> > > > > > > > service=http
>> > > > > > > > scheduler=rr
>> > > > > > > > protocol=tcp
>> > > > > > > > checktype=negotiate
>> > > > > > > > real=10.50.57.22:8080
>> > > > > > > > real=10.50.57.23:8080
>> > > > > > > > request="test/lvs.html"
>> > > > > > > > receive="Test Page"
>> > > > > > > >
>> > > > > > > >
>> > > > > > > > Added Below line in sysctl.conf on Real Servers:
>> > > > > > > > net.ipv4.conf.lo.arp_ignore = 1
>> > > > > > > > net.ipv4.conf.lo.arp_announce = 2
>> > > > > > > > net.ipv4.conf.all.arp_ignore = 1
>> > > > > > > > net.ipv4.conf.all.arp_announce = 2
>> > > > > > > >
>> > > > > > > >
>> > > > > > > > Regards,
>> > > > > > > > _______________________________________________
>> > > > > > > > Please read the documentation before posting - it's
>> available
>> > at:
>> > >
>> > > > > > > > http://www.linuxvirtualserver.org/
>> > > > > > > >
>> > > > > > > > LinuxVirtualServer.org mailing list -
>> > > > > lvs-users@xxxxxxxxxxxxxxxxxxxxxx
>> > > > > > > > Send requests to lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx
>> > > > > > > > or go to
>> http://lists.graemef.net/mailman/listinfo/lvs-users
>> > > > > > > >
>> > > > > > > _______________________________________________
>> > > > > > > Please read the documentation before posting - it's available
>> at:
>> > > > > > > http://www.linuxvirtualserver.org/
>> > > > > > >
>> > > > > > > LinuxVirtualServer.org mailing list -
>> > > > > > > lvs-users@xxxxxxxxxxxxxxxxxxxxxx Send requests to
>> > > > > > > lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx or go to
>> > > > > > > http://lists.graemef.net/mailman/listinfo/lvs-users
>> > > > > > >
>> > > > > > _______________________________________________
>> > > > > > Please read the documentation before posting - it's available
>> at:
>> > > > > > http://www.linuxvirtualserver.org/
>> > > > > >
>> > > > > > LinuxVirtualServer.org mailing list -
>> > > > > > lvs-users@xxxxxxxxxxxxxxxxxxxxxx Send requests to
>> > > > > > lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx or go to
>> > > > > > http://lists.graemef.net/mailman/listinfo/lvs-users
>> > > > > >
>> > > > > _______________________________________________
>> > > > > Please read the documentation before posting - it's available at:
>> > > > > http://www.linuxvirtualserver.org/
>> > > > >
>> > > > > LinuxVirtualServer.org mailing list -
>> > lvs-users@xxxxxxxxxxxxxxxxxxxxxx
>> > > > > Send requests to lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx
>> > > > > or go to http://lists.graemef.net/mailman/listinfo/lvs-users
>> > > > >
>> > > > _______________________________________________
>> > > > Please read the documentation before posting - it's available at:
>> > > > http://www.linuxvirtualserver.org/
>> > > >
>> > > > LinuxVirtualServer.org mailing list -
>> lvs-users@xxxxxxxxxxxxxxxxxxxxxx
>> > > > Send requests to lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx
>> > > > or go to http://lists.graemef.net/mailman/listinfo/lvs-users
>> > >
>> > >
>> > _______________________________________________
>> > Please read the documentation before posting - it's available at:
>> > http://www.linuxvirtualserver.org/
>> >
>> > LinuxVirtualServer.org mailing list - lvs-users@xxxxxxxxxxxxxxxxxxxxxx
>> > Send requests to lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx
>> > or go to http://lists.graemef.net/mailman/listinfo/lvs-users
>> >
>> _______________________________________________
>> Please read the documentation before posting - it's available at:
>> http://www.linuxvirtualserver.org/
>>
>> LinuxVirtualServer.org mailing list - lvs-users@xxxxxxxxxxxxxxxxxxxxxx
>> Send requests to lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx
>> or go to http://lists.graemef.net/mailman/listinfo/lvs-users
>>
>
>
_______________________________________________
Please read the documentation before posting - it's available at:
http://www.linuxvirtualserver.org/
LinuxVirtualServer.org mailing list - lvs-users@xxxxxxxxxxxxxxxxxxxxxx
Send requests to lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx
or go to http://lists.graemef.net/mailman/listinfo/lvs-users
|
