LVS
lvs-users
Google
 
Web LinuxVirtualServer.org

[lvs-users] Not forwarding request packets

To: lvs-users@xxxxxxxxxxxxxxxxxxxxxx
Subject: [lvs-users] Not forwarding request packets
From: "David Dyer-Bennet" <dd-b@xxxxxxxx>
Date: Tue, 2 Sep 2008 15:52:30 -0500 (CDT)
Still trying to get my first LVS config going.

All these systems are running Centos 5.2.

Everybody involved in this setup (lvs nodes and real server nodes) is a
XEN dom0 at the moment; the long-term plan involves using some windows
servers as HVM guests under Xen later, hence I needed Xen in the picture. 
The long-term plan is that there will be additional virtual machines on
the same physical machines running LVS that are used for virtual servers. 
*Right now* the LVS machines aren't doing anything else, but the long-term
plan is more complicated, and has affected the exact setup I'm trying to
use even in this simple case.

I may be getting in trouble between the Xen bridging configuration and the
NAT configuration for LVS.  I've never used either before this project,
never used Linux as a router at all.

I've got a primary and backup LVS, and two real servers, but I don't think
the current problem involves the backup LVS, and I think the two real
servers are really the same.

The public virtual IP is being assigned (on eth0:1: 192.168.1.16).  The
private virtual IP is being assigned (on eth1:1 172.17.0.100).  But
requests from outside sent to the public virtual IP do not get routed,
they simply go to the local Apache server on port 80 (I've put index pages
in on all the servers to make it really obvious which one I'm reaching on
any give request).

Here's the current running setup on the active LVS:

[root@prcapp02 ddb]# ifconfig
eth0      Link encap:Ethernet  HWaddr 00:1E:C9:B3:2A:86
          inet addr:192.168.1.14  Bcast:192.168.1.255  Mask:255.255.255.0
          inet6 addr: fe80::21e:c9ff:feb3:2a86/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:6350542 errors:0 dropped:0 overruns:0 frame:0
          TX packets:68611 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:4553207506 (4.2 GiB)  TX bytes:7187952 (6.8 MiB)

eth0:1    Link encap:Ethernet  HWaddr 00:1E:C9:B3:2A:86
          inet addr:192.168.1.16  Bcast:192.168.1.255  Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1

eth1      Link encap:Ethernet  HWaddr 00:1E:C9:B3:2A:88
          inet addr:172.17.0.1  Bcast:172.17.0.255  Mask:255.255.255.0
          inet6 addr: fe80::21e:c9ff:feb3:2a88/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:5532 errors:0 dropped:0 overruns:0 frame:0
          TX packets:4080 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:1309860 (1.2 MiB)  TX bytes:317610 (310.1 KiB)
          Interrupt:16 Memory:f4000000-f4012100

eth1:1    Link encap:Ethernet  HWaddr 00:1E:C9:B3:2A:88
          inet addr:172.17.0.100  Bcast:172.17.0.255  Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          Interrupt:16 Memory:f4000000-f4012100

lo        Link encap:Local Loopback
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:817 errors:0 dropped:0 overruns:0 frame:0
          TX packets:817 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:90549 (88.4 KiB)  TX bytes:90549 (88.4 KiB)

peth0     Link encap:Ethernet  HWaddr FE:FF:FF:FF:FF:FF
          inet6 addr: fe80::fcff:ffff:feff:ffff/64 Scope:Link
          UP BROADCAST RUNNING NOARP  MTU:1500  Metric:1
          RX packets:6580880 errors:0 dropped:0 overruns:0 frame:0
          TX packets:68951 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:4593627013 (4.2 GiB)  TX bytes:7731455 (7.3 MiB)
          Interrupt:16 Memory:f8000000-f8012100

vif0.0    Link encap:Ethernet  HWaddr FE:FF:FF:FF:FF:FF
          inet6 addr: fe80::fcff:ffff:feff:ffff/64 Scope:Link
          UP BROADCAST RUNNING NOARP  MTU:1500  Metric:1
          RX packets:68611 errors:0 dropped:0 overruns:0 frame:0
          TX packets:6350542 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:7187952 (6.8 MiB)  TX bytes:4553207506 (4.2 GiB)

virbr0    Link encap:Ethernet  HWaddr 00:00:00:00:00:00
          inet addr:192.168.122.1  Bcast:192.168.122.255  Mask:255.255.255.0
          inet6 addr: fe80::200:ff:fe00:0/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:37 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:0 (0.0 b)  TX bytes:9256 (9.0 KiB)

xenbr0    Link encap:Ethernet  HWaddr FE:FF:FF:FF:FF:FF
          UP BROADCAST RUNNING NOARP  MTU:1500  Metric:1
          RX packets:5543427 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:4255979394 (3.9 GiB)  TX bytes:0 (0.0 b)

[root@prcapp02 ddb]# brctl show
bridge name     bridge id               STP enabled     interfaces
virbr0          8000.000000000000       yes
xenbr0          8000.feffffffffff       no              peth0
                                                        vif0.0
[root@prcapp02 ddb]# cat /etc/sysconfig/ha/lvs.cf
serial_no = 33
primary = 192.168.1.14
primary_private = 172.17.0.1
service = lvs
backup_active = 1
backup = 192.168.1.15
backup_private = 172.17.0.2
heartbeat = 1
heartbeat_port = 539
keepalive = 6
deadtime = 18
network = nat
nat_router = 172.17.0.100 eth1:1
nat_nmask = 255.255.255.0
debug_level = NONE
monitor_links = 1
virtual test1 {
     active = 1
     address = 192.168.1.16 eth0:1
     port = 80
     send = "GET / HTTP/1.0\r\n\r\n"
     expect = "HTTP"
     use_regex = 0
     load_monitor = none
     scheduler = wlc
     protocol = tcp
     timeout = 6
     reentry = 15
     quiesce_server = 0
     server v1 {
         address = 172.17.0.4
         active = 1
         weight = 1
     }
     server v2 {
         address = 172.17.0.5
         active = 1
         weight = 1
     }
}


[root@prcapp02 ddb]# ipvsadm -l
IP Virtual Server version 1.2.1 (size=4096)
Prot LocalAddress:Port Scheduler Flags
  -> RemoteAddress:Port           Forward Weight ActiveConn InActConn
TCP  prcvmod01.pinerivercapital.l wlc
  -> 172.17.0.4:http              Masq    1      0          0


Any ideas which silly mistakes I'm making, or which explanatory documents
will make everything clear?

-- 
David Dyer-Bennet, dd-b@xxxxxxxx; http://dd-b.net/
Snapshots: http://dd-b.net/dd-b/SnapshotAlbum/data/
Photos: http://dd-b.net/photography/gallery/
Dragaera: http://dragaera.info



<Prev in Thread] Current Thread [Next in Thread>