LVS
lvs-users
Google
 
Web LinuxVirtualServer.org

[lvs-users] connections are remaining established for very long periods

To: "'lvs-users@xxxxxxxxxxxxxxxxxxxxxx'" <lvs-users@xxxxxxxxxxxxxxxxxxxxxx>
Subject: [lvs-users] connections are remaining established for very long periods
From: Gary Smith <gary.smith@xxxxxxxxxxxxx>
Date: Sun, 25 Apr 2010 13:37:29 -0700
I've setup several a few different clusters this week on our test servers and I 
have noticed that there are a lot of lingering connections that are marked as 
open on some of the real servers.  I have a clamsmtpd cluster, spamassassin 
cluster, and a mysql cluster in place.  

The clamsmtpd cluster is ranging somewhere in the ~240 established connections 
per server.  On the calling servers there are two.  Coincidentally, there have 
been about 500 requests per server total in the last 48 hours per server, thus 
50% of the connections are still appearing open.  The big concern here is that 
production has this number per minute (not ever 48 hours).  

I had a similar issue with mysql but I dropped the idle connection timeout to 
15 minutes and it stabilized.  Any ideas on how to resolve these connections 
with the other services?

Ipvsadm -Sn
-A -t 10.80.55.11:3917 -s wlc
-a -t 10.80.55.11:3917 -r 10.80.50.2:3917 -m -w 100
-a -t 10.80.55.11:3917 -r 10.80.50.3:3917 -m -w 100
-A -t 10.80.55.13:5847 -s wlc
-a -t 10.80.55.13:5847 -r 10.80.51.3:5847 -m -w 100
-a -t 10.80.55.13:5847 -r 10.80.51.2:5847 -m -w 100


Output from netstat -atunepn
tcp        0      0 10.80.51.2:5847             10.80.91.15:53714         
ESTABLISHED 500        23388      1843/perl
--rate
IP Virtual Server version 1.2.1 (size=4096)
Prot LocalAddress:Port                 CPS    InPPS   OutPPS    InBPS   OutBPS
  -> RemoteAddress:Port
TCP  10.80.55.11:3917                    0        2        2      153     1135
  -> 10.80.50.2:3917                     0        1        1      111      667
  -> 10.80.50.3:3917                     0        0        1       42      468
TCP  10.80.55.13:5847                    0        0        0        0        0
  -> 10.80.51.3:5847                     0        0        0        0        0
  -> 10.80.51.2:5847                     0        0        0        0        0

--stats
IP Virtual Server version 1.2.1 (size=4096)
Prot LocalAddress:Port               Conns   InPkts  OutPkts  InBytes OutBytes
  -> RemoteAddress:Port
TCP  10.80.55.11:3917                80577  1141313  1149588  143804K  562393K
  -> 10.80.50.2:3917                 40248   571893   575238 72416158  280880K
  -> 10.80.50.3:3917                 40329   569420   574350 71388368  281512K
TCP  10.80.55.13:5847                  834     6475     4290  1590616   354409
  -> 10.80.51.3:5847                   440     3376     2255   825578   185876
  -> 10.80.51.2:5847                   394     3099     2035   765038   168533
All of the OS's are CentOS 5.4 (current updates).

        

_______________________________________________
Please read the documentation before posting - it's available at:
http://www.linuxvirtualserver.org/

LinuxVirtualServer.org mailing list - lvs-users@xxxxxxxxxxxxxxxxxxxxxx
Send requests to lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx
or go to http://lists.graemef.net/mailman/listinfo/lvs-users

<Prev in Thread] Current Thread [Next in Thread>
  • [lvs-users] connections are remaining established for very long periods, Gary Smith <=