Traceback from kernel panic on ipp007


{{{
<Sep/07 01:29 am>ipp007 login: [2395956.265819] general protection fault: 0000 [#1] SMP 
<Sep/07 01:29 am>[2395956.268338] last sysfs file: /sys/devices/system/cpu/sched_mc_power_savings
<Sep/07 01:29 am>[2395956.268338] CPU 3 
<Sep/07 01:29 am>[2395956.268338] Modules linked in: w83627hf hwmon_vid autofs4 smsc37b787_wdt k8temp forcedeth i2c_nforce2 i2c_core tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan
<Sep/07 01:29 am>[2395956.268338] Pid: 1265, comm: rpciod/3 Not tainted 2.6.28-rc7-00105-gfeaf384 #4
<Sep/07 01:29 am>[2395956.268338] RIP: 0010:[<ffffffff802488f9>]  [<ffffffff802488f9>] run_workqueue+0x73/0x1ed
<Sep/07 01:29 am>[2395956.268338] RSP: 0018:ffff88012e4e1e80  EFLAGS: 00010087
<Sep/07 01:29 am>[2395956.268338] RAX: d5a634efd4cd3b73 RBX: ffff8801a79d0580 RCX: 0000000000000000
<Sep/07 01:29 am>[2395956.268338] RDX: 69ed07f12b0e060f RSI: ffff8801a79d05b0 RDI: ffff88022e5a9e00
<Sep/07 01:29 am>[2395956.268338] RBP: ffff88022e5a9e00 R08: 0000000000000001 R09: 0000000000000001
<Sep/07 01:29 am>[2395956.268338] R10: 0000000000000000 R11: 0000000000000000 R12: ffff8801a79d0578
<Sep/07 01:29 am>[2395956.268338] R13: ce626d2fbf655724 R14: ffffffff808b85a0 R15: 0000000000000000
<Sep/07 01:29 am>[2395956.268338] FS:  00007f1b71a976f0(0000) GS:ffff88022fa0c780(0000) knlGS:0000000000000000

<Sep/07 01:29 am>[2395956.268338] CS:  0010 DS: 0018 ES: 0018 CR0: 000000008005003b
<Sep/07 01:29 am>[2395956.268338] CR2: 0000000000fac038 CR3: 0000000226072000 CR4: 00000000000006e0
<Sep/07 01:29 am>[2395956.268338] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
<Sep/07 01:29 am>[2395956.268338] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
<Sep/07 01:29 am>[2395956.268338] Process rpciod/3 (pid: 1265, threadinfo ffff88012e4e0000, task ffff88012e4b4bf0)
<Sep/07 01:29 am>[2395956.268338] Stack:
<Sep/07 01:29 am>[2395956.268338]  0000000000000001 0000000000000046 6b556154906e425d 1f64521966722b36
<Sep/07 01:29 am>[2395956.268338]  ea826d58ed753b71 ffff88022e5a9e00 ffff88022fa15bf0 ffff88022e5a9e00
<Sep/07 01:29 am>[2395956.268338]  ffff88022e5a9e40 ffff88022fa15bf0 ffffffff808b5d60 ffffffff80249511
<Sep/07 01:29 am>[2395956.268338] Call Trace:
<Sep/07 01:29 am>[2395956.268338]  [<ffffffff80249511>] ? worker_thread+0xd8/0xe3
<Sep/07 01:29 am>[2395956.268338]  [<ffffffff8024bfda>] ? autoremove_wake_function+0x0/0x2e
<Sep/07 01:29 am>[2395956.268338]  [<ffffffff80249439>] ? worker_thread+0x0/0xe3
<Sep/07 01:29 am>[2395956.268338]  [<ffffffff8024becc>] ? kthread+0x47/0x73
<Sep/07 01:29 am>[2395956.268338]  [<ffffffff80234852>] ? schedule_tail+0x27/0x5f
<Sep/07 01:29 am>[2395956.268338]  [<ffffffff8020cd19>] ? child_rip+0xa/0x11
<Sep/07 01:29 am>[2395956.268338]  [<ffffffff80212496>] ? c1e_idle+0x0/0xe9
<Sep/07 01:29 am>[2395956.268338]  [<ffffffff8024be85>] ? kthread+0x0/0x73
<Sep/07 01:29 am>[2395956.268338]  [<ffffffff8020cd0f>] ? child_rip+0x0/0x11
<Sep/07 01:29 am>[2395956.268338] Code: 4c 8d 63 f8 48 8d 7c 24 10 48 8d 73 18 fc 4d 8b 6c 24 18 b9 06 00 00 00 f3 a5 4c 89 a5 80 00 00 00 48 89 ef 48 8b 43 08 48 8b 13 <48> 89 42 08 48 89 10 48 89 5b 08 48 89 1b e8 d1 ed 36 00 48 8b 
<Sep/07 01:29 am>[2395956.268338] RIP  [<ffffffff802488f9>] run_workqueue+0x73/0x1ed
<Sep/07 01:29 am>[2395956.268338]  RSP <ffff88012e4e1e80>

<Sep/07 01:29 am>[2395956.268338] ---[ end trace 398f4c384aa9d40b ]---
<Sep/07 01:30 am>[2395960.117080] BUG: spinlock lockup on CPU#1, umount.nfs/19348, ffff88022e5a9e00
<Sep/07 01:30 am>[2395960.117080] Pid: 19348, comm: umount.nfs Tainted: G      D    2.6.28-rc7-00105-gfeaf384 #4
<Sep/07 01:30 am>[2395960.117080] Call Trace:
<Sep/07 01:30 am>[2395960.117080]  [<ffffffff803a103f>] _raw_spin_lock+0xfb/0x122
<Sep/07 01:30 am>[2395960.117080]  [<ffffffff8024912b>] __cancel_work_timer+0x120/0x1a3
<Sep/07 01:30 am>[2395960.117080]  [<ffffffff802490a1>] __cancel_work_timer+0x96/0x1a3
<Sep/07 01:30 am>[2395960.117080]  [<ffffffff8058a0f0>] xs_destroy+0x31/0x79
<Sep/07 01:30 am>[2395960.117080]  [<ffffffff80588458>] xprt_destroy+0x0/0x7c
                 <Sep/07 01:30 am>[2395960.117080]  [<ffffffff803995bf>] kref_put+0x41/0x4c
<Sep/07 01:30 am>[2395960.117080]  [<ffffffff80587073>] rpc_free_client+0x0/0xd1
<Sep/07 01:30 am>[2395960.117080]  [<ffffffff80587136>] rpc_free_client+0xc3/0xd1
<Sep/07 01:30 am>[2395960.117080]  [<ffffffff803995bf>] kref_put+0x41/0x4c
<Sep/07 01:30 am>[2395960.117080]  [<ffffffff80587144>] rpc_free_auth+0x0/0x40
<Sep/07 01:30 am>[2395960.117080]  [<ffffffff803995bf>] kref_put+0x41/0x4c
<Sep/07 01:30 am>[2395960.117080]  [<ffffffff8058724e>] rpc_shutdown_client+0xca/0xd5
<Sep/07 01:30 am>[2395960.117080]  [<ffffffff802423c7>] try_to_del_timer_sync+0x51/0x5a
<Sep/07 01:30 am>[2395960.117080]  [<ffffffff80328526>] nfs_free_client+0x79/0xc8
<Sep/07 01:30 am>[2395960.117080]  [<ffffffff803287a9>] nfs_free_server+0xb6/0xf4
<Sep/07 01:30 am>[2395960.117080]  [<ffffffff802ae0cf>] deactivate_super+0x65/0x7e
<Sep/07 01:30 am>[2395960.117080]  [<ffffffff802c00b4>] sys_umount+0x2df/0x33e
<Sep/07 01:30 am>[2395960.117080]  [<ffffffff8020bd2b>] system_call_fastpath+0x16/0x1b

<Sep/07 01:31 am>[2395960.118594] BUG: spinlock lockup on CPU#3, ppStats/19352, <Sep/07 01:31 am>
                 <Sep/07 01:31 am>[2395960.118594] Pid: 19352, comm: ppStats Tainted: G      D    2.6.28-rc7-00105-gfeaf384 #4
<Sep/07 01:31 am>[2395960.118594] Call Trace:
<Sep/07 01:31 am>[2395960.118594]  <IRQ>  [<ffffffff803a103f>] _raw_spin_lock+0xfb/0x122
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff805b7758>] _spin_lock_irqsave+0x37/0x3f
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff802492ab>] __queue_work+0x10/0x32
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff802492ab>] __queue_work+0x10/0x32
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff8024932c>] queue_work_on+0x37/0x40
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff8058ce2d>] rpc_wake_up_task_queue_locked+0x261/0x2a6
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff8058cf8e>] rpc_wake_up_queued_task+0x1d/0x2a
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff8058b47a>] xs_tcp_data_recv+0x3b3/0x442
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff8053746e>] tcp_read_sock+0x97/0x211
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff8058b0c7>] xs_tcp_data_recv+0x0/0x442
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff8058bbd5>] xs_tcp_data_ready+0x64/0x77
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff80540998>] tcp_rcv_established+0x5f1/0x761
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff80545c7b>] tcp_v4_do_rcv+0x2c/0x1b7
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff80547501>] tcp_v4_rcv+0x28e/0x68d
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff805478ad>] tcp_v4_rcv+0x63a/0x68d
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff8052e344>] ip_local_deliver+0xcb/0x164
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff8052e2d4>] ip_local_deliver+0x5b/0x164
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff8052e8d7>] ip_rcv+0x4fa/0x54f
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff805164df>] netif_receive_skb+0x252/0x29b

<Sep/07 01:31 am>[2395960.118594]  [<ffffffff80516397>] netif_receive_skb+0x10a/0x29b
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff80518c1e>] process_backlog+0x71/0xbe
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff8051870b>] net_rx_action+0xc5/0x1fb
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff8051869d>] net_rx_action+0x57/0x1fb
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff8023e144>] __do_softirq+0x7a/0x13d
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff8020d07c>] call_softirq+0x1c/0x28
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff8020e028>] do_softirq+0x2c/0x68
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff8023e084>] irq_exit+0x3f/0x85
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff8020e1ae>] do_IRQ+0x14a/0x16c
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff8058d0bf>] __rpc_execute+0x73/0x228
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff8020c2f6>] ret_from_intr+0x0/0xa
<Sep/07 01:31 am>[2395960.118594]  <EOI>  [<ffffffff8058d0bf>] __rpc_execute+0x73/0x228
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff80258499>] lock_release+0x21/0x150
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff805b7388>] _spin_unlock+0x17/0x20
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff8058d0bf>] __rpc_execute+0x73/0x228
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff80586f15>] rpc_run_task+0x4f/0x56
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff803372ed>] nfs_read_rpcsetup+0x1bf/0x1dd
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff803353d8>] nfs_pageio_doio+0x2a/0x51
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff80336d15>] nfs_readpages+0x12c/0x17e
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff80337624>] nfs_pagein_one+0x0/0xc9
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff802839b7>] __do_page_cache_readahead+0x14f/0x1e4
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff802838c6>] __do_page_cache_readahead+0x5e/0x1e4

<Sep/07 01:31 am>[2395960.118594]  [<ffffffff8027dd51>] filemap_fault+0x163/0x34a
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff8028a4c9>] __do_fault+0x54/0x3e3
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff8028c1a9>] handle_mm_fault+0x379/0x728
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff805b99e1>] do_page_fault+0x424/0x7df
<Sep/07 01:31 am>[2395960.118594]  [<ffffffff805b795d>] error_exit+0x0/0x9a

File erased !


}}}