|
Sorry to answer myself, but narrowed down the problem.
I sniffed the traffic on the load balancer coming from one of the "stuck"
IPs and I'm getting no traffic whatsoever.
So basically while getting no traffic coming in, having no destination to go
to and having a timeout of 35 seconds, the connection entries counts down
from 59 seconds to 0 seconds and loops back to 59 seconds again. Is there a
way to remove these connections? Anyone have any idea why they are looping
when no traffic is coming in?
Thanks for your time
-----Original Message-----
From: lvs-users-bounces@xxxxxxxxxxxxxxxxxxxxxx
[mailto:lvs-users-bounces@xxxxxxxxxxxxxxxxxxxxxx] On Behalf Of Benjamin
Lawetz
Sent: June 30, 2005 1:17 PM
To: lvs-users@xxxxxxxxxxxxxxxxxxxxxx
Subject: SIP UDP timeout not being respected
Hi,
I have a setup that load balances SIP UDP packets between 4 servers. Today
one of my servers failed and mon removed it from the load-balancing, but
some of the connections still remain and keep getting refreshed.
I noticed something bizarre though with the ipvsadm UDP timeout, it is set
to 35s, but the 3 connections that "stay stuck" seem to have an expire of 60
seconds instead of 35. And even though the server is removed and the rest of
the connections timeout and get redirected to another server. Those 3 just
keep going to the failed server.
Anyone have any idea why these 3 connections are (so it seems)
auto-refreshing every 60s on a server that doesn't exist?
Any way to clear these?
Ipvsadm startup script:
echo 1 > /proc/sys/net/ipv4/ip_forward
/sbin/ipvsadm --set 0 0 35
/sbin/ipvsadm -A -u 192.168.89.220:5060 -s rr
/sbin/ipvsadm -a -u 192.168.89.220:5060 -r 192.168.89.231 -i -w 5
/sbin/ipvsadm -a -u 192.168.89.220:5060 -r 192.168.89.232 -i -w 5
/sbin/ipvsadm -a -u 192.168.89.220:5060 -r 192.168.89.233 -i -w 5
/sbin/ipvsadm -a -u 192.168.89.220:5060 -r 192.168.89.234 -i -w 5
Before removal this is what I have:
Ipvsadm -L -n:
IP Virtual Server version 1.2.1 (size=4096) Prot LocalAddress:Port Scheduler
Flags
-> RemoteAddress:Port Forward Weight ActiveConn InActConn
UDP 192.168.89.220:5060 rr
-> 192.168.89.233:5060 Tunnel 5 0 4
-> 192.168.89.231:5060 Tunnel 5 0 3
-> 192.168.89.232:5060 Tunnel 5 0 3
-> 192.168.89.234:5060 Tunnel 5 0 6
Ipvsadm -L -n -c:
IPVS connection entries
pro expire state source virtual destination
UDP 00:30 UDP 10.10.250.209:5060 192.168.89.220:5060
192.168.89.231:5060
UDP 00:25 UDP 192.168.85.25:1035 192.168.89.220:5060
192.168.89.233:5060
UDP 00:34 UDP 10.10.125.23:5060 192.168.89.220:5060
192.168.89.232:5060
UDP 00:26 UDP 206.55.81.128:5060 192.168.89.220:5060
192.168.89.234:5060
UDP 00:22 UDP 10.10.233.189:5060 192.168.89.220:5060
192.168.89.232:5060
UDP 00:32 UDP 192.168.85.25:5060 192.168.89.220:5060
192.168.89.234:5060
UDP 00:21 UDP 10.10.142.148:5060 192.168.89.220:5060
192.168.89.234:5060
UDP 00:20 UDP 192.168.85.25:1036 192.168.89.220:5060
192.168.89.232:5060
UDP 00:34 UDP 10.10.249.211:5060 192.168.89.220:5060
192.168.89.234:5060
UDP 00:23 UDP 10.10.249.211:1024 192.168.89.220:5060
192.168.89.233:5060
UDP 00:31 UDP 10.10.208.97:5060 192.168.89.220:5060
192.168.89.234:5060
UDP 00:32 UDP 10.10.184.83:5060 192.168.89.220:5060
192.168.89.231:5060
UDP 00:27 UDP 70.80.53.141:5060 192.168.89.220:5060
192.168.89.233:5060
UDP 00:40 UDP 192.168.85.5:58040 192.168.89.220:5060
192.168.89.233:5060
UDP 00:28 UDP 10.10.14.83:5060 192.168.89.220:5060
192.168.89.234:5060
UDP 00:25 UDP 10.10.215.175:6084 192.168.89.220:5060
192.168.89.231:5060
After removal I have:
Ipvsadm -L -n:
IP Virtual Server version 1.2.1 (size=4096) Prot LocalAddress:Port Scheduler
Flags
-> RemoteAddress:Port Forward Weight ActiveConn InActConn
UDP 192.168.89.220:5060 rr
-> 192.168.89.231:5060 Tunnel 5 0 3
-> 192.168.89.232:5060 Tunnel 5 0 3
-> 192.168.89.234:5060 Tunnel 5 0 6
Ipvsadm -L -n -c:
IPVS connection entries
pro expire state source virtual destination
UDP 00:28 UDP 10.10.250.209:5060 192.168.89.220:5060
192.168.89.231:5060
UDP 00:31 UDP 192.168.85.25:1035 192.168.89.220:5060
192.168.89.231:5060
UDP 00:31 UDP 10.10.125.23:5060 192.168.89.220:5060
192.168.89.232:5060
UDP 00:31 UDP 10.10.81.128:5060 192.168.89.220:5060
192.168.89.234:5060
UDP 00:29 UDP 10.10.233.189:5060 192.168.89.220:5060
192.168.89.232:5060
UDP 00:27 UDP 192.168.85.25:5060 192.168.89.220:5060
192.168.89.234:5060
UDP 00:24 UDP 10.10.142.148:5060 192.168.89.220:5060
192.168.89.234:5060
UDP 00:24 UDP 192.168.85.25:1036 192.168.89.220:5060
192.168.89.232:5060
UDP 00:33 UDP 10.10.249.211:5060 192.168.89.220:5060
192.168.89.234:5060
UDP 00:40 UDP 10.10.249.211:1024 192.168.89.220:5060
192.168.89.233:5060
UDP 00:11 UDP 10.10.208.97:5060 192.168.89.220:5060
192.168.89.234:5060
UDP 00:57 UDP 10.10.53.141:5060 192.168.89.220:5060
192.168.89.233:5060
UDP 00:57 UDP 192.168.85.5:58040 192.168.89.220:5060
192.168.89.233:5060
UDP 00:33 UDP 10.10.14.83:5060 192.168.89.220:5060
192.168.89.234:5060
UDP 00:33 UDP 10.10.215.175:6084 192.168.89.220:5060
192.168.89.231:5060
--
Thanks for your help
Benjamin
|
