Still trying to get my first LVS config going.
All these systems are running Centos 5.2.
Everybody involved in this setup (lvs nodes and real server nodes) is a
XEN dom0 at the moment; the long-term plan involves using some windows
servers as HVM guests under Xen later, hence I needed Xen in the picture.
The long-term plan is that there will be additional virtual machines on
the same physical machines running LVS that are used for virtual servers.
*Right now* the LVS machines aren't doing anything else, but the long-term
plan is more complicated, and has affected the exact setup I'm trying to
use even in this simple case.
I may be getting in trouble between the Xen bridging configuration and the
NAT configuration for LVS. I've never used either before this project,
never used Linux as a router at all.
I've got a primary and backup LVS, and two real servers, but I don't think
the current problem involves the backup LVS, and I think the two real
servers are really the same.
The public virtual IP is being assigned (on eth0:1: 192.168.1.16). The
private virtual IP is being assigned (on eth1:1 172.17.0.100). But
requests from outside sent to the public virtual IP do not get routed,
they simply go to the local Apache server on port 80 (I've put index pages
in on all the servers to make it really obvious which one I'm reaching on
any give request).
Here's the current running setup on the active LVS:
[root@prcapp02 ddb]# ifconfig
eth0 Link encap:Ethernet HWaddr 00:1E:C9:B3:2A:86
inet addr:192.168.1.14 Bcast:192.168.1.255 Mask:255.255.255.0
inet6 addr: fe80::21e:c9ff:feb3:2a86/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:6350542 errors:0 dropped:0 overruns:0 frame:0
TX packets:68611 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:4553207506 (4.2 GiB) TX bytes:7187952 (6.8 MiB)
eth0:1 Link encap:Ethernet HWaddr 00:1E:C9:B3:2A:86
inet addr:192.168.1.16 Bcast:192.168.1.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
eth1 Link encap:Ethernet HWaddr 00:1E:C9:B3:2A:88
inet addr:172.17.0.1 Bcast:172.17.0.255 Mask:255.255.255.0
inet6 addr: fe80::21e:c9ff:feb3:2a88/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:5532 errors:0 dropped:0 overruns:0 frame:0
TX packets:4080 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:1309860 (1.2 MiB) TX bytes:317610 (310.1 KiB)
Interrupt:16 Memory:f4000000-f4012100
eth1:1 Link encap:Ethernet HWaddr 00:1E:C9:B3:2A:88
inet addr:172.17.0.100 Bcast:172.17.0.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
Interrupt:16 Memory:f4000000-f4012100
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:817 errors:0 dropped:0 overruns:0 frame:0
TX packets:817 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:90549 (88.4 KiB) TX bytes:90549 (88.4 KiB)
peth0 Link encap:Ethernet HWaddr FE:FF:FF:FF:FF:FF
inet6 addr: fe80::fcff:ffff:feff:ffff/64 Scope:Link
UP BROADCAST RUNNING NOARP MTU:1500 Metric:1
RX packets:6580880 errors:0 dropped:0 overruns:0 frame:0
TX packets:68951 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:4593627013 (4.2 GiB) TX bytes:7731455 (7.3 MiB)
Interrupt:16 Memory:f8000000-f8012100
vif0.0 Link encap:Ethernet HWaddr FE:FF:FF:FF:FF:FF
inet6 addr: fe80::fcff:ffff:feff:ffff/64 Scope:Link
UP BROADCAST RUNNING NOARP MTU:1500 Metric:1
RX packets:68611 errors:0 dropped:0 overruns:0 frame:0
TX packets:6350542 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:7187952 (6.8 MiB) TX bytes:4553207506 (4.2 GiB)
virbr0 Link encap:Ethernet HWaddr 00:00:00:00:00:00
inet addr:192.168.122.1 Bcast:192.168.122.255 Mask:255.255.255.0
inet6 addr: fe80::200:ff:fe00:0/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:37 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 b) TX bytes:9256 (9.0 KiB)
xenbr0 Link encap:Ethernet HWaddr FE:FF:FF:FF:FF:FF
UP BROADCAST RUNNING NOARP MTU:1500 Metric:1
RX packets:5543427 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:4255979394 (3.9 GiB) TX bytes:0 (0.0 b)
[root@prcapp02 ddb]# brctl show
bridge name bridge id STP enabled interfaces
virbr0 8000.000000000000 yes
xenbr0 8000.feffffffffff no peth0
vif0.0
[root@prcapp02 ddb]# cat /etc/sysconfig/ha/lvs.cf
serial_no = 33
primary = 192.168.1.14
primary_private = 172.17.0.1
service = lvs
backup_active = 1
backup = 192.168.1.15
backup_private = 172.17.0.2
heartbeat = 1
heartbeat_port = 539
keepalive = 6
deadtime = 18
network = nat
nat_router = 172.17.0.100 eth1:1
nat_nmask = 255.255.255.0
debug_level = NONE
monitor_links = 1
virtual test1 {
active = 1
address = 192.168.1.16 eth0:1
port = 80
send = "GET / HTTP/1.0\r\n\r\n"
expect = "HTTP"
use_regex = 0
load_monitor = none
scheduler = wlc
protocol = tcp
timeout = 6
reentry = 15
quiesce_server = 0
server v1 {
address = 172.17.0.4
active = 1
weight = 1
}
server v2 {
address = 172.17.0.5
active = 1
weight = 1
}
}
[root@prcapp02 ddb]# ipvsadm -l
IP Virtual Server version 1.2.1 (size=4096)
Prot LocalAddress:Port Scheduler Flags
-> RemoteAddress:Port Forward Weight ActiveConn InActConn
TCP prcvmod01.pinerivercapital.l wlc
-> 172.17.0.4:http Masq 1 0 0
Any ideas which silly mistakes I'm making, or which explanatory documents
will make everything clear?
--
David Dyer-Bennet, dd-b@xxxxxxxx; http://dd-b.net/
Snapshots: http://dd-b.net/dd-b/SnapshotAlbum/data/
Photos: http://dd-b.net/photography/gallery/
Dragaera: http://dragaera.info
|