LVS
lvs-users
Google
 
Web LinuxVirtualServer.org

Re: Strange problems...

To: lvs-users@xxxxxxxxxxxxxxxxxxxxxx
Subject: Re: Strange problems...
From: Matt.Gregory@xxxxxxxxx
Date: Wed, 14 Aug 2002 13:36:39 -0400
This is a repost since my other message got blocked because of size.

==== repost ====
----- Forwarded by Matt Gregory/CTI on 08/14/2002 01:16 PM -----

I have decided to post the configure script for rc.lvs_dr, the rc.lvs_dr 
script and it's output (rc.lvs_dr.out) here and let you see from it what 
is happening.

One of my coworkers went down to our datacenter and plugged in the 
additional nic, but somewhere along the line unpluged or turned of one of 
the realservers so please just ignore the fact that 
prod-zope-atl01.dmz-atl.bogus isn't replying to a ping... that's 
explainable.

The thing that's puzzling me is this error:
SIOCSIFNETMASK: Cannot assign requested address
SIOCADDRT: No such device

I added four lines to the rc.lvs_dr script, one comment and an if block 
with an include for the attatched include (which dumps the date and 
redirects stderr to stdout so that we can get all the info in the output 
file.

here is the output of the script:

------- One Network Two nic -------
Started Wed Aug 7 22:11:10 EDT 2002
-----------------------------------
looking for standard utilities
$ECHO=/bin/echo
$PING=/bin/ping -U -c 1
testing ping
ping can send one packet. is OK.
$FPING=/bin/ping -U -c 1
$IFCONFIG=/sbin/ifconfig
$NETSTAT=/bin/netstat
$ROUTE=/sbin/route
$AWK=/bin/awk
$AWK=/usr/bin/awk
$GREP=/bin/grep
$HOSTNAME_CMD=/bin/hostname
$UNAME_CMD=/bin/uname
$CAT=/bin/cat
$CUT=/bin/cut
$CUT=/usr/bin/cut
$TAIL=/usr/bin/tail
$XARGS=/usr/bin/xargs
$PS=/bin/ps
$KILL=/bin/kill
$WC=/usr/bin/wc
$TRACEROUTE=/usr/sbin/traceroute
$ARP=/sbin/arp
$ROUTE=/sbin/route
$TR=/usr/bin/tr
$EXPR=/usr/bin/expr
$CHMOD=/bin/chmod
$MV=/bin/mv
$RM=/bin/rm
$MKDIR=/bin/mkdir
$SSH=/usr/bin/ssh
$NTPD=/usr/sbin/ntpd
$IP=/sbin/ip
rc.lvs version 0.9.2 Aug 2001
(C) 2000-2001 Joseph Mack jmack@xxxxxxxx, distributed under GPL license
This file is part of the LVS project http://www.linuxvirtualserver.org
setting up prod-apache-atl01

find_System_map
System.map
$SYSTEM_MAP=/boot/System.map
System.map
$SYSTEM_MAP=/usr/src/linux/System.map

$IPTABLES=/sbin/iptables
$LSMOD=/sbin/lsmod
$RMMOD=/sbin/rmmod
$INSMOD=/sbin/insmod
number nics on director 2
LVS director 

find_kernel_function_name_2_4
find_kernel_name_2_4: parameter ip_vs
check_function_in_kernel
function ip_vs_init not in kernel
find_module_name_2_4
find_module_name_2_4: parameter ip_vs
module name ip_vs is ip_vs
attempting to load module: ip_vs
module ip_vs already loaded 
searching for ipchains
ipchains not loaded, good
loading ip_tables module 
find_kernel_function_name_2_4
find_kernel_name_2_4: parameter ip_tables
check_function_in_kernel
function ipt_tables not in kernel
find_module_name_2_4
find_module_name_2_4: parameter ip_tables
module name ip_tables is ip_tables
attempting to load module: ip_tables
module ip_tables already loaded 
setting default policy to ACCEPT for LVS devices
clearing iptables/ipchain rules 
showing iptables nat rules 
Chain PREROUTING (policy ACCEPT)
target     prot opt source               destination 

Chain POSTROUTING (policy ACCEPT)
target     prot opt source               destination 

Chain OUTPUT (policy ACCEPT)
target     prot opt source               destination 
showing iptables rules 
Chain INPUT (policy ACCEPT)
target     prot opt source               destination 

Chain FORWARD (policy ACCEPT)
target     prot opt source               destination 

Chain OUTPUT (policy ACCEPT)
target     prot opt source               destination 
set_director_ip_forwarding on vs-dr director (1 on, 0 off).
set ip_forward OFF for vs-dr director (1 on, 0 off).
proc/sys/net/ipv4/ip_forward 0

director is not gw for realservers: leave icmp redirects on.
setting icmp redirects (1 on, 0 off) 
/proc/sys/net/ipv4/conf/all/send_redirects 1
/proc/sys/net/ipv4/conf/default/send_redirects 1
/proc/sys/net/ipv4/conf/eth0/send_redirects 1

10.80.1.40 not found on any network devices, good

adding ethernet device and routing for VIP 10.80.1.40 
SIOCSIFNETMASK: Cannot assign requested address
SIOCADDRT: No such device
listing ifconfig info for VIP 10.80.1.40 
eth1:1    Link encap:Ethernet  HWaddr 00:02:B3:93:D9:81 
          BROADCAST MULTICAST  MTU:1500  Metric:1
          Interrupt:5 Base address:0xf000 

checking VIP 10.80.1.40 is reachable from self (director): PING 10.80.1.40 
(10.80.1.40) from 10.80.1.5 : 56(84) bytes of data.
From 10.80.1.5: Destination Host Unreachable

--- 10.80.1.40 ping statistics ---
1 packets transmitted, 0 packets received, +1 errors, 100% packet loss
listing routing info for VIP 10.80.1.40 

 
clearing ipvsadm table 
installing LVS services with ipvsadm
initialising persistence for 10.80.1.40 to N 
persistence for 10.80.1.40 N 
non-persistent service on 10.80.1.40:http
checking realserver prod-apache-atl01.dmz-atl.bogus reachable from 
director - PING prod-apache-atl01.dmz-atl.bogus (10.80.1.41) from 
10.80.1.41 : 56(84) bytes of data.
64 bytes from prod-apache-atl01.dmz-atl.bogus (10.80.1.41): icmp_seq=0 
ttl=255 time=168 usec

--- prod-apache-atl01.dmz-atl.bogus ping statistics ---
1 packets transmitted, 1 packets received, 0% packet loss
round-trip min/avg/max/mdev = 0.168/0.168/0.168/0.000 ms
director starting in ON state 
persistence for 10.80.1.40 already set to N 
persistence for 10.80.1.40 N 
non-persistent service on 10.80.1.40:webcache
checking realserver prod-zope-atl01.dmz-atl.bogus reachable from director 
- PING prod-zope-atl01.dmz-atl.bogus (10.80.1.21) from 10.80.1.5 : 56(84) 
bytes of data.
From localhost (10.80.1.5): Destination Host Unreachable

--- prod-zope-atl01.dmz-atl.bogus ping statistics ---
1 packets transmitted, 0 packets received, +1 errors, 100% packet loss
director starting in ON state 
checking realserver prod-zope-atl02.dmz-atl.bogus reachable from director 
- PING prod-zope-atl02.dmz-atl.bogus (10.80.1.22) from 10.80.1.5 : 56(84) 
bytes of data.
64 bytes from prod-zope-atl02.dmz-atl.bogus (10.80.1.22): icmp_seq=0 
ttl=255 time=388 usec

--- prod-zope-atl02.dmz-atl.bogus ping statistics ---
1 packets transmitted, 1 packets received, 0% packet loss
round-trip min/avg/max/mdev = 0.388/0.388/0.388/0.000 ms
director starting in ON state 
persistence for 10.80.1.40 already set to N 
persistence for 10.80.1.40 N 
non-persistent service on 10.80.1.40:ssh
checking realserver prod-zope-atl01.dmz-atl.bogus reachable from director 
- PING prod-zope-atl01.dmz-atl.bogus (10.80.1.21) from 10.80.1.5 : 56(84) 
bytes of data.
From ns.dmz-atl.bogus (10.80.1.5): Destination Host Unreachable

--- prod-zope-atl01.dmz-atl.bogus ping statistics ---
1 packets transmitted, 0 packets received, +1 errors, 100% packet loss
director starting in ON state 
checking realserver prod-zope-atl02.dmz-atl.bogus reachable from director 
- PING prod-zope-atl02.dmz-atl.bogus (10.80.1.22) from 10.80.1.5 : 56(84) 
bytes of data.
64 bytes from prod-zope-atl02.dmz-atl.bogus (10.80.1.22): icmp_seq=0 
ttl=255 time=375 usec

--- prod-zope-atl02.dmz-atl.bogus ping statistics ---
1 packets transmitted, 1 packets received, 0% packet loss
round-trip min/avg/max/mdev = 0.375/0.375/0.375/0.000 ms
director starting in ON state 
checking realserver prod-apache-atl01.dmz-atl.bogus reachable from 
director - PING prod-apache-atl01.dmz-atl.bogus (10.80.1.41) from 
10.80.1.41 : 56(84) bytes of data.
64 bytes from prod-apache-atl01.dmz-atl.bogus (10.80.1.41): icmp_seq=0 
ttl=255 time=164 usec

--- prod-apache-atl01.dmz-atl.bogus ping statistics ---
1 packets transmitted, 1 packets received, 0% packet loss
round-trip min/avg/max/mdev = 0.164/0.164/0.164/0.000 ms
director starting in ON state 
 
displaying ipvsadm settings 
IP Virtual Server version 1.0.2 (size=4096)
Prot LocalAddress:Port Scheduler Flags
  -> RemoteAddress:Port           Forward Weight ActiveConn InActConn
TCP  lvs-apache-atl01.dmz-atl.bog rr
  -> prod-apache-atl01.dmz-atl.bogus:ssh Local   1      0          0  
  -> prod-zope-atl02.dmz-atl.bogus:ssh Route   1      0          0 
  -> prod-zope-atl01.dmz-atl.bogus:ssh Route   1      0          0 
TCP  lvs-apache-atl01.dmz-atl.bog rr
  -> prod-apache-atl01.dmz-atl.bogus:http Local   1      0          0  
TCP  lvs-apache-atl01.dmz-atl.bog rr
  -> prod-zope-atl02.dmz-atl.bogus:webcache Route   1      0          0   
  -> prod-zope-atl01.dmz-atl.bogus:webcache Route   1      0          0   

checking for valid server_gw for vs-dr LVS.
director_vip_device=eth1:1, server_gw=10.80.1.3
default gw for the vs-dr servers is NOT on director, good 
DIRECTOR_GW not set, good.
DIRECTOR_GW=
installing default gw 10.80.1.3 for vs-dr
deleting current default gw 10.80.1.3
setting default gw to 10.80.1.3
showing routing table

Kernel IP routing table
Destination     Gateway         Genmask         Flags   MSS Window  irtt 
Iface
10.80.1.0       0.0.0.0         255.255.255.0   U        40 0          0 
eth0
127.0.0.0       0.0.0.0         255.0.0.0       U        40 0          0 
lo
0.0.0.0         10.80.1.3       0.0.0.0         UG       40 0          0 
eth0

checking if DEFAULT_GW 10.80.1.3 is reachable - PING 10.80.1.3 (10.80.1.3) 
from 10.80.1.5 : 56(84) bytes of data.
64 bytes from 10.80.1.3: icmp_seq=0 ttl=255 time=636 usec

--- 10.80.1.3 ping statistics ---
1 packets transmitted, 1 packets received, 0% packet loss
round-trip min/avg/max/mdev = 0.636/0.636/0.636/0.000 ms
good
DIRECTOR_GW=
masquerading handled by LVS code. 
Chain PREROUTING (policy ACCEPT)
target     prot opt source               destination 

Chain POSTROUTING (policy ACCEPT)
target     prot opt source               destination 

Chain OUTPUT (policy ACCEPT)
target     prot opt source               destination 
not adding filter rules.
ntpd not running, won't be restarted

The location of the output files rc.lvs, mon.cf and ntp.conf is the 
default = ./
You can change this by editing the variables $rc_lvs_home, $rc_mon_home, 
$rc_ntp_home 
 
Remember to run this rc.lvs script on the real-servers too.

This script will use ssh to do this for you if you run it with
./configure lvs_xx.conf -i



Matt Gregory
Web Developer
CTI, Inc.
cell: 678-458-6513
ioem: matt.gregory@xxxxxxxxx *see key block below
ooem: matthew.gregory@xxxxxxxxxxxx




Joseph Mack <mack.joseph@xxxxxxx>
Sent by: lvs-users-admin@xxxxxxxxxxxxxxxxxxxxxx
08/08/2002 06:50 AM
Please respond to lvs-users

 
        To:     lvs-users@xxxxxxxxxxxxxxxxxxxxxx
        cc: 
        Subject:        Re: Strange problems...


Matt.Gregory@xxxxxxxxx wrote:
> 
> That's just it, the realserver ip of 41 shouldn't be (and isn't) in the
> rc.lvs_dr script because it's just a realserver ip at this point.

the realservers IPs are in the script (among other things) so that the 
script knows whether it's running on a director or realserver.

> If I may refer back to my original email, this is a very multi-function
> box at this point, serving as my nameserver (realserver 10.80.1.5) my
> Apache proxy (10.80.1.41) and my Director for zope (LVS 10.80.1.20). The
> only problem is that I can't bring up 10.80.1.41.  I am using
> ifconfig/route.

In that case you'll need a route. 

Joe

-- 
Joseph Mack PhD, Senior Systems Engineer, Lockheed Martin
contractor to the National Environmental Supercomputer Center, 
mailto:mack.joseph@xxxxxxx ph# 919-541-0007, RTP, NC, USA

_______________________________________________
LinuxVirtualServer.org mailing list - lvs-users@xxxxxxxxxxxxxxxxxxxxxx
Send requests to lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx
or go to http://www.in-addr.de/mailman/listinfo/lvs-users






<Prev in Thread] Current Thread [Next in Thread>