On Fri, 23 Jun 2006, Roberto Nibali wrote:
> Could you send us along your slabtop output and /proc/interrupts, please? It's
> probably not related to your oops, but better safe than sorry :).
slabtop:
Active / Total Objects (% used) : 506383 / 528573 (95.8%)
Active / Total Slabs (% used) : 35423 / 36138 (98.0%)
Active / Total Caches (% used) : 46 / 66 (69.7%)
Active / Total Size (% used) : 126046.91K / 129271.86K (97.5%)
Minimum / Average / Maximum Object : 0.01K / 0.24K / 128.00K
OBJS ACTIVE USE OBJ SIZE SLABS OBJ/SLAB CACHE SIZE NAME
194880 194880 100% 0.12K 6496 32 25984K dentry_cache
178633 178633 100% 0.50K 25519 8 102076K inode_cache
62080 62080 100% 0.09K 1552 42 6208K buffer_head
47799 47799 100% 0.03K 423 128 1692K size-32
17430 3948 22% 0.12K 581 32 2324K ip_vs_conn
4880 1100 22% 0.09K 122 42 488K vm_area_struct
3120 3120 100% 0.09K 78 42 312K blkdev_requests
2808 288 10% 0.05K 36 85 144K journal_head
2655 2655 100% 0.06K 45 64 180K cdev_cache
1980 846 42% 0.19K 99 21 396K ip_dst_cache
1320 1320 100% 0.12K 44 32 176K filp
1260 1134 90% 0.19K 63 21 252K skbuff_head_cache
1196 886 74% 0.28K 92 14 368K ip_conntrack
1080 1080 100% 0.12K 36 32 144K size-128
840 714 85% 0.25K 56 16 224K size-256
708 708 100% 0.06K 12 64 48K size-64
556 466 83% 2.00K 278 2 1112K size-2048
354 228 64% 0.06K 6 64 24K fs_cache
339 213 62% 0.03K 3 128 12K pae_pgd
339 213 62% 0.03K 3 128 12K tcp_bind_bucket
312 312 100% 0.16K 13 25 52K mm_struct
295 295 100% 0.06K 5 64 20K inet_peer_cache
268 268 100% 1.00K 67 4 268K size-1024
261 261 100% 0.13K 9 31 36K sigqueue
253 252 99% 0.01K 1 341 4K revoke_table
240 240 100% 0.12K 8 32 32K arp_cache
226 226 100% 0.03K 2 128 8K size-32(DMA)
226 226 100% 0.03K 2 128 8K uid_cache
226 226 100% 0.03K 2 128 8K revoke_record
226 226 100% 0.03K 2 128 8K ip_fib_hash
225 135 60% 4.00K 225 1 900K size-4096
225 163 72% 0.41K 25 9 100K files_cache
213 123 57% 1.28K 71 3 284K signal_act
200 200 100% 0.50K 25 8 100K size-512
200 200 100% 1.00K 50 4 200K sock
118 118 100% 0.06K 2 64 8K mnt_cache
118 118 100% 0.06K 2 64 8K bdev_cache
104 104 100% 0.14K 4 27 16K kmem_cache
90 90 100% 0.12K 3 32 12K tcp_tw_bucket
80 80 100% 0.09K 2 42 8K file_lock_cache
/proc/interrupts
CPU0 CPU1
0: 2925013 3035328 IO-APIC-edge timer
1: 2 2 IO-APIC-edge keyboard
2: 0 0 XT-PIC cascade
8: 0 1 IO-APIC-edge rtc
12: 20 21 IO-APIC-edge PS/2 Mouse
14: 0 2 IO-APIC-edge ide0
16: 0 0 IO-APIC-level usb-uhci
19: 0 0 IO-APIC-level usb-uhci
23: 0 0 IO-APIC-level ehci_hcd
24: 62720 53155 IO-APIC-level cciss0
25: 70631732 20 IO-APIC-level eth0
26: 7 69761378 IO-APIC-level eth1
NMI: 0 0
LOC: 5960190 5960217
ERR: 0
MIS: 0
> However, thanks, comments are below:
>
> > CONFIG_HIGHMEM64G=y
> > CONFIG_HIGHMEM=y
>
> Do you need high memory support? This normally degrades performance on 32bit
> boxes, especially with regard to DMA writes.
No, however the .config is based on the one included in Red Hat Enterprise
Linux 3,
since these servers are using this distribution, although the running kernel is
the mainstream kernel.
> > CONFIG_HIGHIO=y
>
> This can give weird results in VFS, we've fixes some issues there in
> 2.4.33-RC1. Should not be related to your problem though.
>
> > CONFIG_NR_CPUS=8
> > CONFIG_X86_NUMA=y
> > CONFIG_X86_SUMMIT=y
> > CONFIG_X86_CLUSTERED_APIC=y
>
> What kind of machine do you have? dmidecode output, please.
dmidecode:
SMBIOS 2.3 present.
50 structures occupying 1349 bytes.
Table at 0x000EC000.
Handle 0x0000
DMI type 0, 20 bytes.
BIOS Information
Vendor: HP
Version: P52
Release Date: 08/26/2004
Address: 0xF0000
Runtime Size: 64 kB
ROM Size: 4096 kB
Characteristics:
PCI is supported
PNP is supported
BIOS is upgradeable
BIOS shadowing is allowed
ESCD support is available
Boot from CD is supported
Selectable boot is supported
5.25"/360 KB floppy services are supported (int 13h)
5.25"/1.2 MB floppy services are supported (int 13h)
3.5"/720 KB floppy services are supported (int 13h)
Print screen service is supported (int 5h)
8042 keyboard services are supported (int 9h)
Serial services are supported (int 14h)
Printer services are supported (int 17h)
CGA/mono video services are supported (int 10h)
ACPI is supported
USB legacy is supported
BIOS boot specification is supported
Handle 0x0100
DMI type 1, 25 bytes.
System Information
Manufacturer: HP
Product Name: ProLiant DL360 G4
Version: Not Specified
Serial Number: AUB44604VM
UUID: 33353435-3731-4155-4234-34363034564D
Wake-up Type: Power Switch
Handle 0x0300
DMI type 3, 17 bytes.
Chassis Information
Manufacturer: HP
Type: Unknown
Lock: Not Present
Version: Not Specified
Serial Number: AUB44604VM
Asset Tag:
Boot-up State: Unknown
Power Supply State: Unknown
Thermal State: Unknown
Security Status: Unknown
OEM Information: 0x00000000
Handle 0x0400
DMI type 4, 32 bytes.
Processor Information
Socket Designation: Proc 1
Type: Central Processor
Family: Xeon
Manufacturer: Intel
ID: 41 0F 00 00 FF FB EB BF
Signature: Type 0, Family F, Model 4, Stepping 1
Flags:
FPU (Floating-point unit on-chip)
VME (Virtual mode extension)
DE (Debugging extension)
PSE (Page size extension)
TSC (Time stamp counter)
MSR (Model specific registers)
PAE (Physical address extension)
MCE (Machine check exception)
CX8 (CMPXCHG8 instruction supported)
APIC (On-chip APIC hardware supported)
SEP (Fast system call)
MTRR (Memory type range registers)
PGE (Page global enable)
MCA (Machine check architecture)
CMOV (Conditional move instruction supported)
PAT (Page attribute table)
PSE-36 (36-bit page size extension)
CLFSH (CLFLUSH instruction supported)
DS (Debug store)
ACPI (ACPI supported)
MMX (MMX technology supported)
FXSR (Fast floating-point save and restore)
SSE (Streaming SIMD extensions)
SSE2 (Streaming SIMD extensions 2)
SS (Self-snoop)
HTT (Hyper-threading technology)
TM (Thermal monitor supported)
SBF (Signal break on FERR)
Version: Not Specified
Voltage: 1.4 V
External Clock: 800 MHz
Max Speed: 4800 MHz
Current Speed: 3400 MHz
Status: Populated, Enabled
Upgrade: ZIF Socket
L1 Cache Handle: 0x0710
L2 Cache Handle: 0x0720
L3 Cache Handle: 0x0730
Handle 0x0406
DMI type 4, 32 bytes.
Processor Information
Socket Designation: Proc 2
Type: Central Processor
Family: Xeon
Manufacturer: Intel
ID: 41 0F 00 00 FF FB EB BF
Signature: Type 0, Family F, Model 4, Stepping 1
Flags:
FPU (Floating-point unit on-chip)
VME (Virtual mode extension)
DE (Debugging extension)
PSE (Page size extension)
TSC (Time stamp counter)
MSR (Model specific registers)
PAE (Physical address extension)
MCE (Machine check exception)
CX8 (CMPXCHG8 instruction supported)
APIC (On-chip APIC hardware supported)
SEP (Fast system call)
MTRR (Memory type range registers)
PGE (Page global enable)
MCA (Machine check architecture)
CMOV (Conditional move instruction supported)
PAT (Page attribute table)
PSE-36 (36-bit page size extension)
CLFSH (CLFLUSH instruction supported)
DS (Debug store)
ACPI (ACPI supported)
MMX (MMX technology supported)
FXSR (Fast floating-point save and restore)
SSE (Streaming SIMD extensions)
SSE2 (Streaming SIMD extensions 2)
SS (Self-snoop)
HTT (Hyper-threading technology)
TM (Thermal monitor supported)
SBF (Signal break on FERR)
Version: Not Specified
Voltage: 1.4 V
External Clock: 800 MHz
Max Speed: 4800 MHz
Current Speed: 3400 MHz
Status: Populated, Idle
Upgrade: ZIF Socket
L1 Cache Handle: 0x0716
L2 Cache Handle: 0x0726
L3 Cache Handle: 0x0736
Handle 0x0710
DMI type 7, 19 bytes.
Cache Information
Socket Designation: Processor 1 Internal L1 Cache
Configuration: Enabled, Not Socketed, Level 1
Operational Mode: Write Back
Location: Internal
Installed Size: 16 KB
Maximum Size: 32 KB
Supported SRAM Types:
Burst
Installed SRAM Type: Burst
Speed: Unknown
Error Correction Type: Unknown
System Type: Unknown
Associativity: 4-way Set-associative
Handle 0x0716
DMI type 7, 19 bytes.
Cache Information
Socket Designation: Processor 2 Internal L1 Cache
Configuration: Enabled, Not Socketed, Level 1
Operational Mode: Write Back
Location: Internal
Installed Size: 16 KB
Maximum Size: 32 KB
Supported SRAM Types:
Burst
Installed SRAM Type: Burst
Speed: Unknown
Error Correction Type: Unknown
System Type: Unknown
Associativity: 4-way Set-associative
Handle 0x0720
DMI type 7, 19 bytes.
Cache Information
Socket Designation: Processor 1 Internal L2 Cache
Configuration: Enabled, Not Socketed, Level 2
Operational Mode: Write Back
Location: Internal
Installed Size: 1024 KB
Maximum Size: 2048 KB
Supported SRAM Types:
Burst
Installed SRAM Type: Burst
Speed: Unknown
Error Correction Type: Unknown
System Type: Unknown
Associativity: Other
Handle 0x0726
DMI type 7, 19 bytes.
Cache Information
Socket Designation: Processor 2 Internal L2 Cache
Configuration: Enabled, Not Socketed, Level 2
Operational Mode: Write Back
Location: Internal
Installed Size: 1024 KB
Maximum Size: 2048 KB
Supported SRAM Types:
Burst
Installed SRAM Type: Burst
Speed: Unknown
Error Correction Type: Unknown
System Type: Unknown
Associativity: Other
Handle 0x0730
DMI type 7, 19 bytes.
Cache Information
Socket Designation: Processor 1 Internal L3 Cache
Configuration: Enabled, Not Socketed, Level 3
Operational Mode: Write Back
Location: Internal
Installed Size: 0 KB
Maximum Size: 1024 KB
Supported SRAM Types:
Burst
Installed SRAM Type: Burst
Speed: Unknown
Error Correction Type: Unknown
System Type: Unknown
Associativity: Other
Handle 0x0736
DMI type 7, 19 bytes.
Cache Information
Socket Designation: Processor 2 Internal L3 Cache
Configuration: Enabled, Not Socketed, Level 3
Operational Mode: Write Back
Location: Internal
Installed Size: 0 KB
Maximum Size: 1024 KB
Supported SRAM Types:
Burst
Installed SRAM Type: Burst
Speed: Unknown
Error Correction Type: Unknown
System Type: Unknown
Associativity: Other
Handle 0x0801
DMI type 8, 9 bytes.
Port Connector Information
Internal Reference Designator: J53
Internal Connector Type: Access Bus (USB)
External Reference Designator: USB Port 1
External Connector Type: Access Bus (USB)
Port Type: USB
Handle 0x0802
DMI type 8, 9 bytes.
Port Connector Information
Internal Reference Designator: J2
Internal Connector Type: Access Bus (USB)
External Reference Designator: USB Port 2
External Connector Type: Access Bus (USB)
Port Type: USB
Handle 0x0901
DMI type 9, 13 bytes.
System Slot Information
Designation: PCI Slot 1
Type: 64-bit PCI-X
Current Usage: Available
Length: Short
ID: 1
Characteristics:
3.3 V is provided
PME signal is supported
Handle 0x0902
DMI type 9, 13 bytes.
System Slot Information
Designation: PCI Slot 2
Type: 64-bit PCI-X
Current Usage: Available
Length: Long
ID: 2
Characteristics:
3.3 V is provided
PME signal is supported
Handle 0x0B00
DMI type 11, 5 bytes.
OEM Strings
String 1: Product ID: 354571-371
Handle 0x1000
DMI type 16, 15 bytes.
Physical Memory Array
Location: System Board Or Motherboard
Use: System Memory
Error Correction Type: Single-bit ECC
Maximum Capacity: 8 GB
Error Information Handle: Not Provided
Number Of Devices: 4
Handle 0x1100
DMI type 17, 23 bytes.
Memory Device
Array Handle: 0x1000
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 1024 MB
Form Factor: DIMM
Set: 1
Locator: DIMM 01
Bank Locator: Not Specified
Type: DDR
Type Detail: Synchronous
Speed: 333 MHz (3.0 ns)
Handle 0x1101
DMI type 17, 23 bytes.
Memory Device
Array Handle: 0x1000
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 1024 MB
Form Factor: DIMM
Set: 1
Locator: DIMM 02
Bank Locator: Not Specified
Type: DDR
Type Detail: Synchronous
Speed: 333 MHz (3.0 ns)
Handle 0x1102
DMI type 17, 23 bytes.
Memory Device
Array Handle: 0x1000
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: No Module Installed
Form Factor: DIMM
Set: 2
Locator: DIMM 03
Bank Locator: Not Specified
Type: DDR
Type Detail: Synchronous
Speed: 333 MHz (3.0 ns)
Handle 0x1103
DMI type 17, 23 bytes.
Memory Device
Array Handle: 0x1000
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: No Module Installed
Form Factor: DIMM
Set: 2
Locator: DIMM 04
Bank Locator: Not Specified
Type: DDR
Type Detail: Synchronous
Speed: 333 MHz (3.0 ns)
Handle 0x1300
DMI type 19, 15 bytes.
Memory Array Mapped Address
Starting Address: 0x00000000000
Ending Address: 0x0007FFFFFFF
Range Size: 2 GB
Physical Array Handle: 0x1000
Partition Width: 0
Handle 0x1400
DMI type 20, 19 bytes.
Memory Device Mapped Address
Starting Address: 0x00000000000
Ending Address: 0x0007FFFFFFF
Range Size: 2 GB
Physical Device Handle: 0x1100
Memory Array Mapped Address Handle: 0x1300
Partition Row Position: 1
Interleave Position: 1
Interleaved Data Depth: Unknown
Handle 0x1401
DMI type 20, 19 bytes.
Memory Device Mapped Address
Starting Address: 0x00000000000
Ending Address: 0x0007FFFFFFF
Range Size: 2 GB
Physical Device Handle: 0x1101
Memory Array Mapped Address Handle: 0x1300
Partition Row Position: 1
Interleave Position: 2
Interleaved Data Depth: Unknown
Handle 0x1402
DMI type 20, 19 bytes.
Memory Device Mapped Address
Starting Address: 0x00000000000
Ending Address: 0x000000003FF
Range Size: 1 kB
Physical Device Handle: 0x1102
Memory Array Mapped Address Handle: 0x1300
Partition Row Position: 1
Interleave Position: 1
Interleaved Data Depth: Unknown
Handle 0x1403
DMI type 20, 19 bytes.
Memory Device Mapped Address
Starting Address: 0x00000000000
Ending Address: 0x000000003FF
Range Size: 1 kB
Physical Device Handle: 0x1103
Memory Array Mapped Address Handle: 0x1300
Partition Row Position: 1
Interleave Position: 2
Interleaved Data Depth: Unknown
Handle 0x1450
DMI type 20, 19 bytes.
Memory Device Mapped Address
Starting Address: 0x00000000000
Ending Address: 0x000000003FF
Range Size: 1 kB
Physical Device Handle: 0x0000
Memory Array Mapped Address Handle: 0x0000
Partition Row Position: 1
Interleave Position: 1
Interleaved Data Depth: Unknown
Handle 0x1451
DMI type 20, 19 bytes.
Memory Device Mapped Address
Starting Address: 0x00000000000
Ending Address: 0x000000003FF
Range Size: 1 kB
Physical Device Handle: 0x0000
Memory Array Mapped Address Handle: 0x0000
Partition Row Position: 1
Interleave Position: 2
Interleaved Data Depth: Unknown
Handle 0x1452
DMI type 20, 19 bytes.
Memory Device Mapped Address
Starting Address: 0x00000000000
Ending Address: 0x000000003FF
Range Size: 1 kB
Physical Device Handle: 0x0000
Memory Array Mapped Address Handle: 0x0000
Partition Row Position: 1
Interleave Position: 1
Interleaved Data Depth: Unknown
Handle 0x1453
DMI type 20, 19 bytes.
Memory Device Mapped Address
Starting Address: 0x00000000000
Ending Address: 0x000000003FF
Range Size: 1 kB
Physical Device Handle: 0x0000
Memory Array Mapped Address Handle: 0x0000
Partition Row Position: 1
Interleave Position: 2
Interleaved Data Depth: Unknown
Handle 0x1460
DMI type 20, 19 bytes.
Memory Device Mapped Address
Starting Address: 0x00000000000
Ending Address: 0x000000003FF
Range Size: 1 kB
Physical Device Handle: 0x0000
Memory Array Mapped Address Handle: 0x0000
Partition Row Position: 1
Interleave Position: 1
Interleaved Data Depth: Unknown
Handle 0x1461
DMI type 20, 19 bytes.
Memory Device Mapped Address
Starting Address: 0x00000000000
Ending Address: 0x000000003FF
Range Size: 1 kB
Physical Device Handle: 0x0000
Memory Array Mapped Address Handle: 0x0000
Partition Row Position: 1
Interleave Position: 2
Interleaved Data Depth: Unknown
Handle 0x1462
DMI type 20, 19 bytes.
Memory Device Mapped Address
Starting Address: 0x00000000000
Ending Address: 0x000000003FF
Range Size: 1 kB
Physical Device Handle: 0x0000
Memory Array Mapped Address Handle: 0x0000
Partition Row Position: 1
Interleave Position: 1
Interleaved Data Depth: Unknown
Handle 0x1463
DMI type 20, 19 bytes.
Memory Device Mapped Address
Starting Address: 0x00000000000
Ending Address: 0x000000003FF
Range Size: 1 kB
Physical Device Handle: 0x0000
Memory Array Mapped Address Handle: 0x0000
Partition Row Position: 1
Interleave Position: 2
Interleaved Data Depth: Unknown
Handle 0x2000
DMI type 32, 11 bytes.
System Boot Information
Status: No errors detected
Handle 0xC100
DMI type 193, 7 bytes.
OEM-specific Type
Header And Data:
C1 07 00 C1 01 01 02
Strings:
08/26/2004
03/16/2004
Handle 0xC200
DMI type 194, 5 bytes.
OEM-specific Type
Header And Data:
C2 05 00 C2 0D
Handle 0xC300
DMI type 195, 5 bytes.
OEM-specific Type
Header And Data:
C3 05 00 C3 01
Strings:
$0E110741
Handle 0xC400
DMI type 196, 5 bytes.
OEM-specific Type
Header And Data:
C4 05 00 C4 00
Handle 0xC500
DMI type 197, 10 bytes.
OEM-specific Type
Header And Data:
C5 0A 00 C5 00 04 00 01 FF 01
Handle 0xC506
DMI type 197, 10 bytes.
OEM-specific Type
Header And Data:
C5 0A 06 C5 06 04 06 00 FF 02
Handle 0xC600
DMI type 198, 10 bytes.
OEM-specific Type
Header And Data:
C6 0A 00 C6 17 00 00 01 3C 00
Handle 0xC700
DMI type 199, 28 bytes.
OEM-specific Type
Header And Data:
C7 1C 00 C7 09 00 00 00 04 20 02 08 41 0F 00 00
13 00 00 00 04 20 30 07 34 0F 00 00
Handle 0xCD00
DMI type 205, 22 bytes.
OEM-specific Type
Header And Data:
CD 16 00 CD 01 01 46 41 54 78 00 00 D3 FF 00 00
00 00 00 80 05 00
Handle 0xCA00
DMI type 202, 8 bytes.
OEM-specific Type
Header And Data:
CA 08 00 CA 00 11 FF 01
Handle 0xCA01
DMI type 202, 8 bytes.
OEM-specific Type
Header And Data:
CA 08 01 CA 01 11 FF 02
Handle 0xCA02
DMI type 202, 8 bytes.
OEM-specific Type
Header And Data:
CA 08 02 CA 02 11 FF 03
Handle 0xCA03
DMI type 202, 8 bytes.
OEM-specific Type
Header And Data:
CA 08 03 CA 03 11 FF 04
Handle 0xD100
DMI type 209, 20 bytes.
OEM-specific Type
Header And Data:
D1 14 00 D1 10 02 00 12 79 3A BD 6B 11 02 00 12
79 3A BD 6A
Handle 0x7F00
DMI type 127, 4 bytes.
End Of Table
>
> > CONFIG_X86_IO_APIC=y
> > CONFIG_X86_LOCAL_APIC=y
>
> Probably not needed for your machine and can cause the problem indicated by
> another poster which asked you to instrument irqbalance.
>
> > CONFIG_IP_VS=m
> > CONFIG_IP_VS_TAB_BITS=16
> > CONFIG_IP_VS_RR=m
> > CONFIG_IP_VS_WRR=m
> > CONFIG_IP_VS_LC=m
> > CONFIG_IP_VS_WLC=m
> > CONFIG_IP_VS_LBLC=m
> > CONFIG_IP_VS_LBLCR=m
> > CONFIG_IP_VS_DH=m
> > CONFIG_IP_VS_SH=m
> > CONFIG_IP_VS_SED=m
> > CONFIG_IP_VS_NQ=m
> > CONFIG_IP_VS_FTP=m
>
> Ok.
>
> > CONFIG_DEBUG_KERNEL=y
> > CONFIG_DEBUG_STACKOVERFLOW=y
> > CONFIG_DEBUG_HIGHMEM=y
> > CONFIG_MAGIC_SYSRQ=y
>
> Please make sure, you've also set those (at least the frame pointer one) to
> get reliable stack traces:
>
> CONFIG_DEBUG_SLAB=y
> CONFIG_FRAME_POINTER=y
Thanks, I'll recompile with these settings.
Regards;
Con.
|