LVS
lvs-users
Google
 
Web LinuxVirtualServer.org

Re: System crash

To: "LinuxVirtualServer.org users mailing list." <lvs-users@xxxxxxxxxxxxxxxxxxxxxx>
Subject: Re: System crash
From: Roberto Nibali <ratz@xxxxxx>
Date: Fri, 01 Oct 2004 08:26:44 +0200
Hi,

I've been using IVPS 1.0.x for years now and I never had any problem.

Oh, is it that old already ;).

I recently built a new cluster, running Fedora Core 2 and IPVS 1.2.0. Since then, I'm having big problems. Eventhough the servers are not loaded, the director periodically crashed.

No more network, no more interactive console access ... the only thing left is Alt-SysRq ! No single char logged (to disk or to the console) that could help :(

Ah, I'm afraid you need to enable some debugging flags in your kernel (CONFIG_FRAME_POINTER, CONFIG_DEBUG_SPINLOCK_SLEEP, CONFIG_DEBUG_SPINLOCK, and of course CONFIG_DEBUG_KERNEL). For what it's worth, could you send following things after you have booted your kernel?

o dmesg -s 31337
o dmidecode
o biosdecode
o lspci -v
o .config (evt. zcat /proc/config.gz)

Maybe there's a HW combo I happen to recognize giving problems with 2.6.x 
kernels.

Alt-SysRq-p has recently shown that something related to ipvs tcp defense was found in the stack trace. Unfornunately, I wasn't able to read enough infos as they scroll way too fast.

Is it always showing this strack trace when crashing? Could you try to copy the stack trace by hand and running it through ksymoops and send the output here, please?

Right now, I don't know what I can try and test ? I've changed the NIC driver, I've stopped the backup director, I've just stopped the sync daemon ... and still hoping it won't crash again. If it crashes again, I'll run without ipvs for a few days to see if it's really the cause.

Yes, at least then we knew if it had been LVS related or not.

Has anybody already faced such a situation ? Any help appreciated.

Yes, for me the following line in the bootloader configuration helped:

append="pci=noapic"

helped, but your problems is much likely of different nature.

HTH and best regards,
Roberto Nibali, ratz
--
-------------------------------------------------------------
addr://Rathausgasse 31, CH-5001 Aarau  tel://++41 62 823 9355
http://www.terreactive.com             fax://++41 62 823 9356
-------------------------------------------------------------
terreActive AG                       Wir sichern Ihren Erfolg
-------------------------------------------------------------
Besuchen Sie uns am 29. und 30.9. an der security-zone.info
Weitere Informationen finden Sie auf www.security-zone.info
Wir freuen uns, Sie an der Messe begrüssen zu dürfen.
-------------------------------------------------------------

<Prev in Thread] Current Thread [Next in Thread>