LVS
lvs-users
Google
 
Web LinuxVirtualServer.org

RedHat ES3 LVS-Nat - Arp issues

To: lvs-users@xxxxxxxxxxxxxxxxxxxxxx
Subject: RedHat ES3 LVS-Nat - Arp issues
From: "Michael Sztachanski" <michael.sztachanski@xxxxxxxxxxxxxxxxxxxxxx>
Date: Thu, 23 Sep 2004 17:41:52 +1000
Genltemen,

have read throught most of the archives and have not been able to find an 
answer to my problem, must be going blind from lack of sleep so please be 
genlte if I've over looked something.

This is a installation in our intranet.

There are two win2k IIS real servers behind the LVS.

ip: 172.24.24.21
nm: 255.255.255.0
gw: 172.24.24.1

the same is on real server 2 but a diff ip address.

Am getting copious amounts of arpping and caching at eth0 on both LVS routers. 
I'm expecting 4000 users to go though this LVS, will that much  arp traffic on 
the eth0 side kill connections? I have already increased the arp cache size to 
4096, but I'm
still getting overflows.

Sep 23 13:11:45 wbnel01a kernel: NET: 30 messages suppressed.
Sep 23 13:11:45 wbnel01a kernel: Neighbour table overflow.
Sep 23 13:11:49 wbnel01a kernel: NET: 1 messages suppressed.
Sep 23 13:11:49 wbnel01a kernel: Neighbour table overflow.
Sep 23 13:11:52 wbnel01a kernel: NET: 19 messages suppressed.
Sep 23 13:11:52 wbnel01a kernel: Neighbour table overflow.
Sep 23 13:11:58 wbnel01a kernel: NET: 14 messages suppressed.
Sep 23 13:11:58 wbnel01a kernel: Neighbour table overflow.

I'm using RHES3:
kernel  2.4.21-20.ELsmp

RedHat Cluster Suite - LVS packages:
clumanager-1.2.16-1
ipvsadm-1.21-9.ipvs108
piranha-0.7.6-1
redhat-config-cluster-1.0.2-2.0
rh-cs-en-3-1

----------------
LVS sysA:


lvs.cf

serial_no = 287
primary = 10.0.2.32
primary_private = 172.24.24.2
service = lvs
backup_active = 1
backup = 10.0.2.33
backup_private = 172.24.24.3
heartbeat = 1
heartbeat_port = 539
keepalive = 4
deadtime = 8
network = nat
nat_router = 172.24.24.1 eth1:1
nat_nmask = 255.255.255.0
debug_level = NONE
virtual gnetest {
     active = 1
     address = 10.0.1.99 eth0:1
     vip_nmask = 255.255.248.0
     port = 80
     persistent = 3600
     send = "GET / HTTP/1.0\r\n\r\n"
     expect = "HTTP"
     use_regex = 0
     load_monitor = none
     scheduler = rr
     protocol = tcp
     timeout = 6
     reentry = 15
     quiesce_server = 0
     server wbne10a {
         address = 172.24.24.21
         active = 1
         weight = 1
     }
     server wbnew10b {
         address = 172.24.24.22
         active = 1
         weight = 1
     }
}

-----
eth0      Link encap:Ethernet  HWaddr 00:0D:60:9C:08:86  
          inet addr:10.0.2.32  Bcast:10.0.7.255  Mask:255.255.248.0
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:27195370 errors:0 dropped:0 overruns:0 frame:0
          TX packets:12666815 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:3128017632 (2983.1 Mb)  TX bytes:1724413408 (1644.5 Mb)
          Interrupt:16 

eth0:1    Link encap:Ethernet  HWaddr 00:0D:60:9C:08:86  
          inet addr:10.0.1.99  Bcast:10.0.7.255  Mask:255.255.248.0
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:3332520 errors:0 dropped:0 overruns:0 frame:0
          TX packets:12771782 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:717670823 (684.4 Mb)  TX bytes:1125877191 (1073.7 Mb)
          Interrupt:16 

eth0:88   Link encap:Ethernet  HWaddr 00:0D:60:9C:08:86  
          inet addr:10.0.1.88  Bcast:10.0.7.255  Mask:255.255.248.0
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:3332520 errors:0 dropped:0 overruns:0 frame:0
          TX packets:12771782 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:717670823 (684.4 Mb)  TX bytes:1125877191 (1073.7 Mb)
          Interrupt:16 

eth0:89   Link encap:Ethernet  HWaddr 00:0D:60:9C:08:86  
          inet addr:10.0.1.89  Bcast:10.0.7.255  Mask:255.255.248.0
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:3332520 errors:0 dropped:0 overruns:0 frame:0
          TX packets:12771782 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:717670823 (684.4 Mb)  TX bytes:1125877191 (1073.7 Mb)
          Interrupt:16 

eth1      Link encap:Ethernet  HWaddr 00:0D:60:9C:08:87  
          inet addr:172.24.24.2  Bcast:172.24.24.255  Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:3332520 errors:0 dropped:0 overruns:0 frame:0
          TX packets:12771782 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:717670823 (684.4 Mb)  TX bytes:1125877191 (1073.7 Mb)
          Interrupt:17 

eth1:1    Link encap:Ethernet  HWaddr 00:0D:60:9C:08:87  
          inet addr:172.24.24.1  Bcast:172.24.24.255  Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:3332520 errors:0 dropped:0 overruns:0 frame:0
          TX packets:12771782 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:717670823 (684.4 Mb)  TX bytes:1125877191 (1073.7 Mb)
          Interrupt:17 

lo        Link encap:Local Loopback  
          inet addr:127.0.0.1  Mask:255.0.0.0
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:126 errors:0 dropped:0 overruns:0 frame:0
          TX packets:126 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:16606 (16.2 Kb)  TX bytes:16606 (16.2 Kb)

--------------------------------------------------

LVS sysB:

eth0      Link encap:Ethernet  HWaddr 00:0D:60:9C:EB:1A  
          inet addr:10.0.2.33  Bcast:10.0.7.255  Mask:255.255.248.0
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:2680645 errors:0 dropped:0 overruns:0 frame:0
          TX packets:48901 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:497278881 (474.2 Mb)  TX bytes:3417780 (3.2 Mb)
          Interrupt:16 

eth1      Link encap:Ethernet  HWaddr 00:0D:60:9C:EB:1B  
          inet addr:172.24.24.3  Bcast:172.24.24.255  Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:2679782 errors:0 dropped:0 overruns:0 frame:0
          TX packets:46733 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:497213909 (474.1 Mb)  TX bytes:2991455 (2.8 Mb)
          Interrupt:17 

lo        Link encap:Local Loopback  
          inet addr:127.0.0.1  Mask:255.0.0.0
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:33 errors:0 dropped:0 overruns:0 frame:0
          TX packets:33 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:4537 (4.4 Kb)  TX bytes:4537 (4.4 Kb)

Have I missed anything obvious in my config's or is this normal?

regards

Michael Sztachanski

Systems Admin/Engineer
Enterprise Web Services
CADRE TECHNOLOGY
Level 1, 157 Ann Street, BRISBANE QLD 4000

phone: +61 7 3011 7151


<Prev in Thread] Current Thread [Next in Thread>