Comment 66 for bug 245779

Revision history for this message
Charles (taylorc) wrote :

I am encountering soft lockups related the bond module. I suspect they are related however this situation is a bit different.

This server is dedicated, no virtualization, host or guest, here.

cat /proc/version_signature
Ubuntu 2.6.24-24.60-server

This unit runs bonding on 2 x Intel e1000 interfaces and serves up ISO and OVF files via NFS off a RAID6 array of 4 drives for use by VMWare ESXi clients.

This server is dedicated, no virtualization, host or guest, here.

Oct 14 06:34:55 iSCSI-A kernel: [3158205.689661] BUG: soft lockup - CPU#0 stuck for 11s! [bond0:4387]
Oct 14 06:34:55 iSCSI-A kernel: [3158205.689686]
Oct 14 06:34:55 iSCSI-A kernel: [3158205.689699] Pid: 4387, comm: bond0 Not tainted (2.6.24-24-server #1)
Oct 14 06:34:55 iSCSI-A kernel: [3158205.689703] EIP: 0060:[sunrpc:_spin_lock+0x7/0x10] EFLAGS: 00000286 CPU: 0
Oct 14 06:34:55 iSCSI-A kernel: [3158205.689715] EIP is at _spin_lock+0x7/0x10
Oct 14 06:34:55 iSCSI-A kernel: [3158205.689720] EAX: f7ce4134 EBX: f7ce405c ECX: 00000001 EDX: f7ce405c
Oct 14 06:34:55 iSCSI-A kernel: [3158205.689726] ESI: 00000000 EDI: f7d1f000 EBP: f7167480 ESP: df99dcc0
Oct 14 06:34:55 iSCSI-A kernel: [3158205.689732] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068
Oct 14 06:34:55 iSCSI-A kernel: [3158205.689738] CR0: 8005003b CR2: b7fa9000 CR3: 0049e000 CR4: 000006b0
Oct 14 06:34:55 iSCSI-A kernel: [3158205.689745] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Oct 14 06:34:55 iSCSI-A kernel: [3158205.689750] DR6: ffff0ff0 DR7: 00000400
Oct 14 06:34:55 iSCSI-A kernel: [3158205.689760] [<f8d80606>] ad_rx_machine+0x26/0x6b0 [bonding]
Oct 14 06:34:55 iSCSI-A kernel: [3158205.689822] [<f8d80ce4>] bond_3ad_lacpdu_recv+0x54/0x240 [bonding]
Oct 14 06:34:55 iSCSI-A kernel: [3158205.689855] [<f8d80e8a>] bond_3ad_lacpdu_recv+0x1fa/0x240 [bonding]
Oct 14 06:34:55 iSCSI-A kernel: [3158205.689920] [<f8d80ce4>] bond_3ad_lacpdu_recv+0x54/0x240 [bonding]
Oct 14 06:34:55 iSCSI-A kernel: [3158205.689934] [deadline_dispatch_requests+0x44/0xd0] deadline_dispatch_requests+0x44/0xd0
Oct 14 06:34:55 iSCSI-A kernel: [3158205.689954] [scsi_mod:elv_next_request+0xaf/0x760] elv_next_request+0xaf/0x1c0
Oct 14 06:34:55 iSCSI-A kernel: [3158205.689964] [<f8982b90>] ata_scsi_rw_xlat+0x0/0x220 [libata]
Oct 14 06:34:55 iSCSI-A kernel: [3158205.689997] [<f88e2a4b>] e1000_alloc_rx_buffers+0xab/0x3a0 [e1000]
Oct 14 06:34:55 iSCSI-A kernel: [3158205.690020] [e1000:__netdev_alloc_skb+0x22/0x2b00] __netdev_alloc_skb+0x22/0x50
Oct 14 06:34:55 iSCSI-A kernel: [3158205.690040] [e1000:__netdev_alloc_skb+0x22/0x2b00] __netdev_alloc_skb+0x22/0x50
Oct 14 06:34:55 iSCSI-A kernel: [3158205.690052] [<f8d80c90>] bond_3ad_lacpdu_recv+0x0/0x240 [bonding]
Oct 14 06:34:55 iSCSI-A kernel: [3158205.690075] [e1000:netif_receive_skb+0x381/0xcf0] netif_receive_skb+0x381/0x460
Oct 14 06:34:55 iSCSI-A kernel: [3158205.690109] [<f88e356b>] e1000_clean_rx_irq+0x26b/0x530 [e1000]
Oct 14 06:34:55 iSCSI-A kernel: [3158205.690137] [<f88e337c>] e1000_clean_rx_irq+0x7c/0x530 [e1000]
Oct 14 06:34:55 iSCSI-A kernel: [3158205.690201] [<f88e3300>] e1000_clean_rx_irq+0x0/0x530 [e1000]
Oct 14 06:34:55 iSCSI-A kernel: [3158205.690229] [<f88e069e>] e1000_clean+0x5e/0x250 [e1000]
Oct 14 06:34:55 iSCSI-A kernel: [3158205.690272] [net_rx_action+0x12d/0x210] net_rx_action+0x12d/0x210
Oct 14 06:34:55 iSCSI-A kernel: [3158205.690314] [__do_softirq+0x82/0x110] __do_softirq+0x82/0x110
Oct 14 06:34:55 iSCSI-A kernel: [3158205.690341] [do_softirq+0x55/0x60] do_softirq+0x55/0x60
Oct 14 06:34:55 iSCSI-A kernel: [3158205.690352] [irq_exit+0x6d/0x80] irq_exit+0x6d/0x80
Oct 14 06:34:55 iSCSI-A kernel: [3158205.690359] [do_IRQ+0x40/0x70] do_IRQ+0x40/0x70
Oct 14 06:34:55 iSCSI-A kernel: [3158205.690366] [find_busiest_group+0x1bd/0x760] find_busiest_group+0x1bd/0x760
Oct 14 06:34:55 iSCSI-A kernel: [3158205.690391] [common_interrupt+0x23/0x28] common_interrupt+0x23/0x28
Oct 14 06:34:55 iSCSI-A kernel: [3158205.690437] [sunrpc:_spin_lock+0x3/0x10] _spin_lock+0x3/0x10
Oct 14 06:34:55 iSCSI-A kernel: [3158205.690451] [<f8d80606>] ad_rx_machine+0x26/0x6b0 [bonding]
Oct 14 06:34:55 iSCSI-A kernel: [3158205.690493] [__switch_to+0x9e/0x150] __switch_to+0x9e/0x150
Oct 14 06:34:55 iSCSI-A kernel: [3158205.690518] [<f8d812b0>] bond_3ad_state_machine_handler+0xf0/0x9c0 [bonding]
Oct 14 06:34:55 iSCSI-A kernel: [3158205.690543] [nfs:schedule+0x217/0x6b0] schedule+0x217/0x630
Oct 14 06:34:55 iSCSI-A kernel: [3158205.690579] [<f8d811c0>] bond_3ad_state_machine_handler+0x0/0x9c0 [bonding]
Oct 14 06:34:55 iSCSI-A kernel: [3158205.690596] [run_workqueue+0xbf/0x160] run_workqueue+0xbf/0x160
Oct 14 06:34:55 iSCSI-A kernel: [3158205.690624] [worker_thread+0x0/0xe0] worker_thread+0x0/0xe0
Oct 14 06:34:55 iSCSI-A kernel: [3158205.690635] [worker_thread+0x84/0xe0] worker_thread+0x84/0xe0
Oct 14 06:34:55 iSCSI-A kernel: [3158205.690649] [<c0145fb0>] autoremove_wake_function+0x0/0x40
Oct 14 06:34:55 iSCSI-A kernel: [3158205.690669] [worker_thread+0x0/0xe0] worker_thread+0x0/0xe0
Oct 14 06:34:55 iSCSI-A kernel: [3158205.690680] [kthread+0x42/0x70] kthread+0x42/0x70
Oct 14 06:34:55 iSCSI-A kernel: [3158205.690687] [kthread+0x0/0x70] kthread+0x0/0x70
Oct 14 06:34:55 iSCSI-A kernel: [3158205.690701] [kernel_thread_helper+0x7/0x10] kernel_thread_helper+0x7/0x10