On Sun, 2003-06-22 at 21:31, Roberto Nibali wrote:
> > I tried using the attached perl script as well and I got the following
> >
> > from the script :
> >
> > maxed out at 2288: Operation now in progress
> >
> >>From ipvsadm
> >
> > IP Virtual Server version 1.0.7 (size=4096)
> > Prot LocalAddress:Port Scheduler Flags
> > -> RemoteAddress:Port Forward Weight ActiveConn InActConn
> > TCP 192.168.55.5:http rr
> > -> 192.168.55.3:http Route 1 1145 1
> > -> 192.168.55.1:http Route 1 1145 0
>
> So the server simply can't handle more of your requests. Again, it would
> be interesting to get some more information on from the RS while on load.
I spent the rest of last week on this and I managed to get over it.
First I added 2 more real servers, one that is the same as the others
and one that was a lot more powerful. Then I realised that some of the
values I was changing were not being applied to the webserver, like
changing the max file handles. The other thing I noticed is that I had
the keepalived timeouts set way too low for doing tests like this. The
reason it was always hitting 1145 was that was about the time it was
taking to get to the time out in keepalived and then it was timing out
the real servers and dropping them from the table, then it brought them
back so fast I did not notice. The program watch is great for this
(watch -n1 ipvsadm)
With this and 4 real servers I was able to get over 108000 connections
through the load balancer to the real servers. At this point the client
machines started dying :)
Lessons learned:
ab blows chunks
my kid sis can write perl scripts that are more useful for this
all docs on lvs performance are out of date, to this end I need to write
a paper on this
keepalived rocks more than god (the company I work for funded some of
the changes we need as well)
If you have any further questions please feel free to email me. I will
post once I have done more benchmarking and written docs about it.
Take care - RL
--
MSN:lazzurs@xxxxxxxxxxxxxx |"All that is etched in stone
Yahoo:admroblaz AIM:admroblaz |is truly only scribbled in
ICQ:66324927 |sand" - RL
Jabber:admroblaz@xxxxxxxxxx |Join Eff http://www.eff.org
e-mail:lazzurs@xxxxxxxxxxxxxxxxx|Take care all - Rob Laz
|