Hi,
I have a setup that load balances SIP UDP packets between 4 servers. Today
one of my servers failed and mon removed it from the load-balancing, but
some of the connections still remain and keep getting refreshed.
I noticed something bizarre though with the ipvsadm UDP timeout, it is set
to 35s, but the 3 connections that "stay stuck" seem to have an expire of 60
seconds instead of 35. And even though the server is removed and the rest of
the connections timeout and get redirected to another server. Those 3 just
keep going to the failed server.
Anyone have any idea why these 3 connections are (so it seems)
auto-refreshing every 60s on a server that doesn't exist?
Any way to clear these?
Ipvsadm startup script:
echo 1 > /proc/sys/net/ipv4/ip_forward
/sbin/ipvsadm --set 0 0 35
/sbin/ipvsadm -A -u 192.168.89.220:5060 -s rr
/sbin/ipvsadm -a -u 192.168.89.220:5060 -r 192.168.89.231 -i -w 5
/sbin/ipvsadm -a -u 192.168.89.220:5060 -r 192.168.89.232 -i -w 5
/sbin/ipvsadm -a -u 192.168.89.220:5060 -r 192.168.89.233 -i -w 5
/sbin/ipvsadm -a -u 192.168.89.220:5060 -r 192.168.89.234 -i -w 5
Before removal this is what I have:
Ipvsadm -L -n:
IP Virtual Server version 1.2.1 (size=4096)
Prot LocalAddress:Port Scheduler Flags
-> RemoteAddress:Port Forward Weight ActiveConn InActConn
UDP 192.168.89.220:5060 rr
-> 192.168.89.233:5060 Tunnel 5 0 4
-> 192.168.89.231:5060 Tunnel 5 0 3
-> 192.168.89.232:5060 Tunnel 5 0 3
-> 192.168.89.234:5060 Tunnel 5 0 6
Ipvsadm -L -n -c:
IPVS connection entries
pro expire state source virtual destination
UDP 00:30 UDP 10.10.250.209:5060 192.168.89.220:5060
192.168.89.231:5060
UDP 00:25 UDP 192.168.85.25:1035 192.168.89.220:5060
192.168.89.233:5060
UDP 00:34 UDP 10.10.125.23:5060 192.168.89.220:5060
192.168.89.232:5060
UDP 00:26 UDP 206.55.81.128:5060 192.168.89.220:5060
192.168.89.234:5060
UDP 00:22 UDP 10.10.233.189:5060 192.168.89.220:5060
192.168.89.232:5060
UDP 00:32 UDP 192.168.85.25:5060 192.168.89.220:5060
192.168.89.234:5060
UDP 00:21 UDP 10.10.142.148:5060 192.168.89.220:5060
192.168.89.234:5060
UDP 00:20 UDP 192.168.85.25:1036 192.168.89.220:5060
192.168.89.232:5060
UDP 00:34 UDP 10.10.249.211:5060 192.168.89.220:5060
192.168.89.234:5060
UDP 00:23 UDP 10.10.249.211:1024 192.168.89.220:5060
192.168.89.233:5060
UDP 00:31 UDP 10.10.208.97:5060 192.168.89.220:5060
192.168.89.234:5060
UDP 00:32 UDP 10.10.184.83:5060 192.168.89.220:5060
192.168.89.231:5060
UDP 00:27 UDP 70.80.53.141:5060 192.168.89.220:5060
192.168.89.233:5060
UDP 00:40 UDP 192.168.85.5:58040 192.168.89.220:5060
192.168.89.233:5060
UDP 00:28 UDP 10.10.14.83:5060 192.168.89.220:5060
192.168.89.234:5060
UDP 00:25 UDP 10.10.215.175:6084 192.168.89.220:5060
192.168.89.231:5060
After removal I have:
Ipvsadm -L -n:
IP Virtual Server version 1.2.1 (size=4096)
Prot LocalAddress:Port Scheduler Flags
-> RemoteAddress:Port Forward Weight ActiveConn InActConn
UDP 192.168.89.220:5060 rr
-> 192.168.89.231:5060 Tunnel 5 0 3
-> 192.168.89.232:5060 Tunnel 5 0 3
-> 192.168.89.234:5060 Tunnel 5 0 6
Ipvsadm -L -n -c:
IPVS connection entries
pro expire state source virtual destination
UDP 00:28 UDP 10.10.250.209:5060 192.168.89.220:5060
192.168.89.231:5060
UDP 00:31 UDP 192.168.85.25:1035 192.168.89.220:5060
192.168.89.231:5060
UDP 00:31 UDP 10.10.125.23:5060 192.168.89.220:5060
192.168.89.232:5060
UDP 00:31 UDP 10.10.81.128:5060 192.168.89.220:5060
192.168.89.234:5060
UDP 00:29 UDP 10.10.233.189:5060 192.168.89.220:5060
192.168.89.232:5060
UDP 00:27 UDP 192.168.85.25:5060 192.168.89.220:5060
192.168.89.234:5060
UDP 00:24 UDP 10.10.142.148:5060 192.168.89.220:5060
192.168.89.234:5060
UDP 00:24 UDP 192.168.85.25:1036 192.168.89.220:5060
192.168.89.232:5060
UDP 00:33 UDP 10.10.249.211:5060 192.168.89.220:5060
192.168.89.234:5060
UDP 00:40 UDP 10.10.249.211:1024 192.168.89.220:5060
192.168.89.233:5060
UDP 00:11 UDP 10.10.208.97:5060 192.168.89.220:5060
192.168.89.234:5060
UDP 00:57 UDP 10.10.53.141:5060 192.168.89.220:5060
192.168.89.233:5060
UDP 00:57 UDP 192.168.85.5:58040 192.168.89.220:5060
192.168.89.233:5060
UDP 00:33 UDP 10.10.14.83:5060 192.168.89.220:5060
192.168.89.234:5060
UDP 00:33 UDP 10.10.215.175:6084 192.168.89.220:5060
192.168.89.231:5060
--
Thanks for your help
Benjamin
|