LVS
lvs-users
Google
 
Web LinuxVirtualServer.org

Problem Adding new RealServer LVS-TUN

To: LinuxVirtualServer.org users mailing list. <lvs-users@xxxxxxxxxxxxxxxxxxxxxx>
Subject: Problem Adding new RealServer LVS-TUN
From: Kalpin Erlangga Silaen <kalpin@xxxxxxxxxxxxx>
Date: Wed, 16 May 2007 12:44:15 +0700
Hello All,

Last month I have success implement heartbeat LVS-TUN with ldirectord.conf in 
ldirector server:

checktimeout=10
checkinterval=2
autoreload=yes
logfile="/var/log/ldirectord.log"
quiescent=yes

virtual=10.10.20.100:25
        fallback=127.0.0.1:25
        real=10.10.20.130:25 ipip
        real=10.10.20.131:25 ipip
        service=smtp
        scheduler=wlc
        #persistent=600
        protocol=tcp

And adding new VIP :

eth0:0    Link encap:Ethernet  HWaddr 00:13:72:25:ED:01
          inet addr:10.10.20.100  Bcast:10.10.20.255  Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          Interrupt:177

For Real Server:

Adding tunl0:

tunl0     Link encap:IPIP Tunnel  HWaddr
          inet addr:10.10.20.100  Mask:255.255.255.255
          UP RUNNING NOARP  MTU:1480  Metric:1
          RX packets:17197237 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:2374949221 (2.2 GiB)  TX bytes:0 (0.0 b)

and in sysctl.conf:

net.ipv4.ip_forward = 1
net.ipv4.conf.eth0.arp_ignore = 1
net.ipv4.conf.eth0.arp_announce = 2
net.ipv4.conf.all.arp_ignore = 1
net.ipv4.conf.all.arp_announce = 2
net.ipv4.conf.tunl0.arp_ignore = 1
net.ipv4.conf.tunl0.arp_announce = 2

And with 1 ldirector + 2 Realserver was work wonderfull. But today I add new 
real server with same configuration:

a. Add tunl0 with same VIP
b. Add sysctl.conf like above
c. Same firewall with 2 realserver

in ldirectord.conf now:

checktimeout=10
checkinterval=2
autoreload=yes
logfile="/var/log/ldirectord.log"
quiescent=yes

virtual=10.10.20.100:25
        fallback=127.0.0.1:25
        real=10.10.20.130:25 ipip
        real=10.10.20.131:25 ipip
        real=10.10.20.161:25 ipip
        service=smtp
        scheduler=wlc
        #persistent=600
        protocol=tcp

But it's not work. Is there any missing step ?

FYI:

Ldirector using Fedora Core 5 with Kernel 2.6.18 and Real Server 1 & 2 (which 
works) using Fedora Core 5 with Kernel 2.6.18 too. But latest real server 
(which not works) using CentOS 4.4 with kernel 2.6.9-42.

If I checked the logs in latest realserver which not works, there is only 
connection from ldirector:

May 16 19:30:04 trilian postfix/smtpd[15280]: connect from unknown[10.10.20.99]
May 16 19:30:04 trilian postfix/smtpd[15280]: disconnect from 
unknown[10.10.20.99]
May 16 19:30:06 trilian postfix/smtpd[15280]: connect from unknown[10.10.20.99]
May 16 19:30:06 trilian postfix/smtpd[15280]: disconnect from 
unknown[10.10.20.99]
May 16 19:30:08 trilian postfix/smtpd[15280]: connect from unknown[10.10.20.99]
May 16 19:30:08 trilian postfix/smtpd[15280]: disconnect from 
unknown[10.10.20.99]
May 16 19:30:10 trilian postfix/smtpd[15280]: connect from unknown[10.10.20.99]
May 16 19:30:10 trilian postfix/smtpd[15280]: disconnect from 
unknown[10.10.20.99]
May 16 19:30:12 trilian postfix/smtpd[15280]: connect from unknown[10.10.20.99]
May 16 19:30:12 trilian postfix/smtpd[15280]: disconnect from 
unknown[10.10.20.99]

but in successfully real server (Real server 1 & 2):

May 16 12:38:29 tanahlot postfix/qmgr[26926]: B35A1810197: from=<>, size=3713, 
nrcpt=1 (queue active)
May 16 12:38:29 tanahlot postfix/smtpd[29208]: disconnect from 
batubulan.net2cyber.net[127.0.0.1]
May 16 12:38:29 tanahlot amavis[30211]: (30211-05) Passed CLEAN, 
[203.153.119.26] <> -> <kusnur@xxxxxxxxx>, Message-ID: 
<20070516053657.791E075477@cluster1>, mail_id: uxR-D6ZryJi9, Hits: -100.74, 
queued_as: B35A1810197, 231 ms
May 16 12:38:29 tanahlot postfix/smtp[29222]: 865BA810163: 
to=<kusnur@xxxxxxxxx>, relay=127.0.0.1[127.0.0.1], delay=0, status=sent (250 
2.6.0 Ok, id=30211-05, from MTA([127.0.0.1]:10025): 250 Ok: queued as 
B35A1810197)
May 16 12:38:29 tanahlot postfix/qmgr[26926]: 865BA810163: removed
May 16 12:38:29 tanahlot postfix/smtp[30379]: B35A1810197: 
to=<kusnur@xxxxxxxxxxxxxxxxxx>, relay=metro.com.s7a1.psmtp.com[64.18.6.14], 
delay=0, status=sent (250 M2007051612381705120 Message accepted for delivery)

If I tried to remove working Realserver 1 & 2 and let only Realserver 3 which 
not work in ldirectord.conf, then trying to telnet port 25 to  Virtual IP, then 
there is no response. Trying check tcpdump in Realserver 3 seems, there is no 
smtp connection from outside except from LDirector server. But If I telnet to 
port 25 in Real IP (not tunl0) then I get response like smtp connection.


Need your help


-- 
Best regards,
 Kalpin                          mailto:kalpin@xxxxxxxxxxxxx


<Prev in Thread] Current Thread [Next in Thread>