Re: ldirectord died suddenly and not able to start!

[Jiang <bearie66@xxxxxxxxx>]

I just found out that might because I changed "checkinterval" in
global configuration from 1 to 60... but I don't know why... each time
I change it back to 1, i can start ldirectord...

Any ideas?


On 6/16/06, Jiang <bearie66@xxxxxxxxx> wrote:
> Hi,
>
> Recently, during my LVS setup try out. I noticed that ldirectord
> always died suddenly without any logs or debug info. I tried
> ldirectord -d start, attached is the result:
>
> ldirectord -d start
> ***********************************************************************************
> [root@ICUCP1 init.d]# ldirectord -d start
> DEBUG2: Running exec(/usr/sbin/ldirectord -d start)
> Running exec(/usr/sbin/ldirectord -d start)
> DEBUG2: Starting Linux Director v1.77.2.32 with pid: 6114
> Starting Linux Director v1.77.2.32 with pid: 6114
> DEBUG2: Running system(./ipvsadm -A -t 10.226.200.210:80 -s rr )
> Running system(./ipvsadm -A -t 10.226.200.210:80 -s rr )
> Usage: ipvsadm
>           {start|stop|restart|status|panic|save|reload|reload-force}
> DEBUG2: system(./ipvsadm -A -t 10.226.200.210:80 -s rr ) failed:
> system(./ipvsadm -A -t 10.226.200.210:80 -s rr ) failed:
> DEBUG2: Added virtual server: 10.226.200.210:80
> Added virtual server: 10.226.200.210:80
> DEBUG2: Running system(./ipvsadm -A -t 10.226.200.210:8070 -s rr )
> Running system(./ipvsadm -A -t 10.226.200.210:8070 -s rr )
> Usage: ipvsadm
>           {start|stop|restart|status|panic|save|reload|reload-force}
> DEBUG2: system(./ipvsadm -A -t 10.226.200.210:8070 -s rr ) failed:
> system(./ipvsadm -A -t 10.226.200.210:8070 -s rr ) failed:
> DEBUG2: Added virtual server: 10.226.200.210:8070
> Added virtual server: 10.226.200.210:8070
> DEBUG2: Running system(./ipvsadm -A -t 10.226.200.210:9005 -s rr )
> Running system(./ipvsadm -A -t 10.226.200.210:9005 -s rr )
> Usage: ipvsadm
>           {start|stop|restart|status|panic|save|reload|reload-force}
> DEBUG2: system(./ipvsadm -A -t 10.226.200.210:9005 -s rr ) failed:
> system(./ipvsadm -A -t 10.226.200.210:9005 -s rr ) failed:
> DEBUG2: Added virtual server: 10.226.200.210:9005
> Added virtual server: 10.226.200.210:9005
> DEBUG2: Running system(./ipvsadm -A -t 10.226.200.210:9007 -s rr )
> Running system(./ipvsadm -A -t 10.226.200.210:9007 -s rr )
> Usage: ipvsadm
>           {start|stop|restart|status|panic|save|reload|reload-force}
> DEBUG2: system(./ipvsadm -A -t 10.226.200.210:9007 -s rr ) failed:
> system(./ipvsadm -A -t 10.226.200.210:9007 -s rr ) failed:
> DEBUG2: Added virtual server: 10.226.200.210:9007
> Added virtual server: 10.226.200.210:9007
> DEBUG2: Disabled server=10.226.200.213
> DEBUG2: Disabled server=10.226.200.211
> DEBUG2: Disabled server=10.226.200.213
> DEBUG2: Disabled server=10.226.200.213
> DEBUG2: Disabled server=10.226.200.211
> DEBUG2: Disabled server=10.226.200.211
> DEBUG2: Disabled server=10.226.200.211
> DEBUG2: Disabled server=10.226.200.213
> DEBUG2: Checking negotiate: real
> server=negotiate:http:tcp:10.226.200.211:80:::\/ldirector\.html:lb
> (virtual=tcp:10.226.200.210:80)
> DEBUG2: check_http: url="http://10.226.200.211:80/ldirector.html";
> virtualhost="10.226.200.211"
> LWP::UserAgent::new: ()
> LWP::UserAgent::request: ()
> LWP::UserAgent::send_request: GET http://10.226.200.211:80/ldirector.html
> LWP::UserAgent::_need_proxy: Not proxied
> LWP::Protocol::http::request: ()
> LWP::Protocol::collect: read 3 bytes
> LWP::UserAgent::request: Simple response: OK
> DEBUG2: Running system(./ipvsadm -a -t 10.226.200.210:80 -r
> 10.226.200.211:80 -g -w 1)
> Running system(./ipvsadm -a -t 10.226.200.210:80 -r 10.226.200.211:80 -g -w 1)
> Usage: ipvsadm
>           {start|stop|restart|status|panic|save|reload|reload-force}
> DEBUG2: system(./ipvsadm -a -t 10.226.200.210:80 -r 10.226.200.211:80
> -g -w 1) failed:
> system(./ipvsadm -a -t 10.226.200.210:80 -r 10.226.200.211:80 -g -w 1) failed:
> DEBUG2: Added real server: 10.226.200.211:80 ( x 10.226.200.210:80)
> (Weight set to 1)
> Added real server: 10.226.200.211:80 ( x 10.226.200.210:80) (Weight set to 1)
> DEBUG2: Enabled server=10.226.200.211
> DEBUG2: check_http: http://10.226.200.211:80/ldirector.html is up
> DEBUG2: Checking negotiate: real
> server=negotiate:http:tcp:10.226.200.213:80:::\/ldirector\.html:lb
> (virtual=tcp:10.226.200.210:80)
> DEBUG2: check_http: url="http://10.226.200.213:80/ldirector.html";
> virtualhost="10.226.200.213"
> LWP::UserAgent::new: ()
> LWP::UserAgent::request: ()
> LWP::UserAgent::send_request: GET http://10.226.200.213:80/ldirector.html
> LWP::UserAgent::_need_proxy: Not proxied
> LWP::Protocol::http::request: ()
> LWP::UserAgent::request: Simple response: Internal Server Error
> DEBUG2: Disabled server=10.226.200.213
> DEBUG3: Headers Client-Date: Fri, 16 Jun 2006 18:56:38 GMT
> DEBUG2: check_http: http://10.226.200.213:80/ldirector.html is down
> DEBUG2: Checking connect: real
> server=connect:tcp:10.226.200.211:8070:::\/:
> (virtual=tcp:10.226.200.210:8070)
> DEBUG3: Connected to  (port 8070)
> DEBUG2: Running system(./ipvsadm -a -t 10.226.200.210:8070 -r
> 10.226.200.211:8070 -g -w 1)
> Running system(./ipvsadm -a -t 10.226.200.210:8070 -r
> 10.226.200.211:8070 -g -w 1)
> Usage: ipvsadm
>           {start|stop|restart|status|panic|save|reload|reload-force}
> DEBUG2: system(./ipvsadm -a -t 10.226.200.210:8070 -r
> 10.226.200.211:8070 -g -w 1) failed:
> system(./ipvsadm -a -t 10.226.200.210:8070 -r 10.226.200.211:8070 -g
> -w 1) failed:
> DEBUG2: Added real server: 10.226.200.211:8070 ( x
> 10.226.200.210:8070) (Weight set to 1)
> Added real server: 10.226.200.211:8070 ( x 10.226.200.210:8070)
> (Weight set to 1)
> DEBUG2: Enabled server=10.226.200.211
> DEBUG3: Activated service 10.226.200.211:8070
> DEBUG2: Checking connect: real
> server=connect:tcp:10.226.200.213:8070:::\/:
> (virtual=tcp:10.226.200.210:8070)
> DEBUG2: Disabled server=10.226.200.213
> DEBUG3: Deactivated service 10.226.200.213:8070: Died at
> /usr/sbin/ldirectord line 2000.
> DEBUG2: Checking connect: real
> server=connect:tcp:10.226.200.211:9005:::\/:
> (virtual=tcp:10.226.200.210:9005)
> DEBUG3: Connected to  (port 9005)
> DEBUG2: Running system(./ipvsadm -a -t 10.226.200.210:9005 -r
> 10.226.200.211:9005 -g -w 1)
> Running system(./ipvsadm -a -t 10.226.200.210:9005 -r
> 10.226.200.211:9005 -g -w 1)
> Usage: ipvsadm
>           {start|stop|restart|status|panic|save|reload|reload-force}
> DEBUG2: system(./ipvsadm -a -t 10.226.200.210:9005 -r
> 10.226.200.211:9005 -g -w 1) failed:
> system(./ipvsadm -a -t 10.226.200.210:9005 -r 10.226.200.211:9005 -g
> -w 1) failed:
> DEBUG2: Added real server: 10.226.200.211:9005 ( x
> 10.226.200.210:9005) (Weight set to 1)
> Added real server: 10.226.200.211:9005 ( x 10.226.200.210:9005)
> (Weight set to 1)
> DEBUG2: Enabled server=10.226.200.211
> DEBUG3: Activated service 10.226.200.211:9005
> DEBUG2: Checking connect: real
> server=connect:tcp:10.226.200.213:9005:::\/:
> (virtual=tcp:10.226.200.210:9005)
> DEBUG2: Disabled server=10.226.200.213
> DEBUG3: Deactivated service 10.226.200.213:9005: Died at
> /usr/sbin/ldirectord line 2000.
> DEBUG2: Checking connect: real
> server=connect:tcp:10.226.200.211:9007:::\/:
> (virtual=tcp:10.226.200.210:9007)
> DEBUG3: Connected to  (port 9007)
> DEBUG2: Running system(./ipvsadm -a -t 10.226.200.210:9007 -r
> 10.226.200.211:9007 -g -w 1)
> Running system(./ipvsadm -a -t 10.226.200.210:9007 -r
> 10.226.200.211:9007 -g -w 1)
> Usage: ipvsadm
>           {start|stop|restart|status|panic|save|reload|reload-force}
> DEBUG2: system(./ipvsadm -a -t 10.226.200.210:9007 -r
> 10.226.200.211:9007 -g -w 1) failed:
> system(./ipvsadm -a -t 10.226.200.210:9007 -r 10.226.200.211:9007 -g
> -w 1) failed:
> DEBUG2: Added real server: 10.226.200.211:9007 ( x
> 10.226.200.210:9007) (Weight set to 1)
> Added real server: 10.226.200.211:9007 ( x 10.226.200.210:9007)
> (Weight set to 1)
> DEBUG2: Enabled server=10.226.200.211
> DEBUG3: Activated service 10.226.200.211:9007
> DEBUG2: Checking connect: real
> server=connect:tcp:10.226.200.213:9007:::\/:
> (virtual=tcp:10.226.200.210:9007)
> DEBUG2: Disabled server=10.226.200.213
> DEBUG3: Deactivated service 10.226.200.213:9007: Died at
> /usr/sbin/ldirectord line 2000.
> Alarm clock
> ***********************************************************************************
>
> And my ldirectord.cf configuration is as below:
>
> ***********************************************************************************
> checktimeout=3
> checkinterval=60
> autoreload=yes
> logfile="/var/log/ldirectord.log"
> quiescent=yes
>
> virtual=10.226.200.210:80
>         real=10.226.200.211:80 gate
>         real=10.226.200.213:80 gate
>         service=http
>         request="ldirector.html"
>         receive="lb"
>         scheduler=rr
>         protocol=tcp
>
> virtual=10.226.200.210:8070
>         real=10.226.200.211:8070 gate
>         real=10.226.200.213:8070 gate
>         #fallback=127.0.0.1:21
>         service=none
>         scheduler=rr
>         #persistent=600
>         #netmask=255.255.255.255
>         checktype=connect
>         #checkcount=3
>         protocol=tcp
>
> virtual=10.226.200.210:9005
>         real=10.226.200.211:9005 gate
>         real=10.226.200.213:9005 gate
>         #fallback=127.0.0.1:21
>         service=none
>         scheduler=rr
>         #persistent=600
>         #netmask=255.255.255.255
>         checktype=connect
>         #checkcount=3
>         protocol=tcp
>
> virtual=10.226.200.210:9007
>        real=10.226.200.211:9007 gate
>         real=10.226.200.213:9007 gate
>         #fallback=127.0.0.1:21
>         service=none
>         scheduler=rr
>         #persistent=600
>         #netmask=255.255.255.255
>         checktype=connect
>         #checkcount=3
>         protocol=tcp
> ***********************************************************************************
>
> Any ideas? Please help!
>
> - Jiang -

--
Regards,
Jiang Lei