IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links
wiki:ipp057-crash-20131022T145000

from console

File content:
0x139
<Oct/22 02:47 pm>[7263007.149771]  [<ffffffff811f0dc2>] nfsd+0xf3/0x139
<Oct/22 02:47 pm>[7263007.154966]  [<ffffffff810546e2>] kthread+0x7d/0x85
<Oct/22 02:47 pm>[7263007.160301]  [<ffffffff81003794>] kernel_thread_helper+0x4/0x10
<Oct/22 02:47 pm>[7263007.166755]  [<ffffffff81054665>] ? kthread+0x0/0x85
<Oct/22 02:47 pm>[7263007.172198]  [<ffffffff81003790>] ? kernel_thread_helper+0x0/0x10
<Oct/22 02:47 pm>[7263007.178814] sending NMI to all CPUs:
<Oct/22 02:47 pm>[7263007.182862] NMI backtrace for cpu 0
<Oct/22 02:47 pm>[7263007.186812] CPU 0 
<Oct/22 02:47 pm>[7263007.188903] Modules linked in: w83793 hwmon_vid autofs4 i2c_i801 i2c_core iTCO_wdt e1000e ioatdma dca rtc_cmos tg3 libphy e1000 fuse dm_snapshot dm_mirror dm_region_hash dm_log scsi_wait_scan qla2xxx megaraid_sas megaraid_mbox megaraid_mm aacraid 3w_9xxx 3w_xxxx arcmsr aic7xxx aic79xx sr_mod sg ata_piix ahci sata_sis sata_nv sata_via pata_sl82c105 pata_sis
<Oct/22 02:47 pm>[7263007.224668] 
<Oct/22 02:47 pm>[7263007.226584] Pid: 8547, comm: nfsd Tainted: G      D    2.6.34.4 #3 S7010/empty
<Oct/22 02:47 pm>[7263007.234494] RIP: 0010:[<ffffffff812c08af>]  [<ffffffff812c08af>] delay_tsc+0x25/0x59
<Oct/22 02:47 pm>[7263007.243012] RSP: 0018:ffff880002603a98  EFLAGS: 00000092
<Oct/22 02:47 pm>[7263007.248864] RAX: 000000007f893bfc RBX: 00000000627a6d37 RCX: 000000007f893be0
<Oct/22 02:47 pm>[7263007.256702] RDX: 000000000044fd59 RSI: 0000000000000000 RDI: 0000000000000001
<Oct/22 02:47 pm>[7263007.264560] RBP: ffff880002603aa0 R08: 0000000000000000 R09: 0000000000000000
<Oct/22 02:47 pm>[7263007.272433] R10: 0000000000000000 R11: ffff8800026038d0 R12: ffff880655233c00
<Oct/22 02:47 pm>[7263007.280300] R13: 0000000000000000 R14: ffff880619e9c0c0 R15: ffff880619e9c548
<Oct/22 02:47 pm>[7263007.288149] FS:  0000000000000000(0000) GS:ffff880002600000(0000) knlGS:0000000000000000
<Oct/22 02:47 pm>[7263007.296945] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b

<Oct/22 02:47 pm>[7263007.303187] CR2: 0000000001186008 CR3: 0000000001a8a000 CR4: 00000000000006f0
<Oct/22 02:47 pm>[7263007.311057] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
<Oct/22 02:47 pm>[7263007.318880] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
<Oct/22 02:47 pm>[7263007.326733] Process nfsd (pid: 8547, threadinfo ffff880619ab8000, task ffff880619e9c0c0)
<Oct/22 02:47 pm>[7263007.335560] Stack:
                 <Oct/22 02:47 pm>[7263007.338003]  ffffffff81019da9 ffff880002603ab0 ffffffff812c08fe ffff880002603af0
<Oct/22 02:47 pm>[7263007.345919] <0> ffffffff812c4e65 000000009ef2fcf8 ffff880655233c00 ffff88061caf3090
<Oct/22 02:47 pm>[7263007.354606] <0> 0000000000013c00 ffff880002603b60 0000000000000000 ffff880002603b10
<Oct/22 02:47 pm>[7263007.363660] Call Trace:
<Oct/22 02:47 pm>[7263007.366566]  <IRQ> 
<Oct/22 02:47 pm>[7263007.369159]  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
<Oct/22 02:47 pm>[7263007.376892]  [<ffffffff812c08fe>] __delay+0xa/0xc
<Oct/22 02:47 pm>[7263007.382073]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
<Oct/22 02:47 pm>[7263007.388335]  [<ffffffff8151f193>] _raw_spin_lock+0x34/0x39
<Oct/22 02:47 pm>[7263007.394335]  [<ffffffff8102fb6b>] ? task_rq_lock+0x7e/0x9a
<Oct/22 02:47 pm>[7263007.400343]  [<ffffffff8102fb6b>] task_rq_lock+0x7e/0x9a
<Oct/22 02:47 pm>[7263007.406149]  [<ffffffff81036578>] try_to_wake_up+0x2e/0x342
<Oct/22 02:47 pm>[7263007.412221]  [<ffffffff81036899>] default_wake_function+0xd/0xf
<Oct/22 02:47 pm>[7263007.418669]  [<ffffffff81054b7d>] autoremove_wake_function+0x11/0x38
<Oct/22 02:47 pm>[7263007.425536]  [<ffffffff81054bc8>] wake_bit_function+0x24/0x2a
<Oct/22 02:47 pm>[7263007.431783]  [<ffffffff8102c08d>] __wake_up_common+0x46/0x76
<Oct/22 02:47 pm>[7263007.437981]  [<ffffffff8102faa6>] __wake_up+0x38/0x4f

<Oct/22 02:47 pm>[7263007.443538]  [<ffffffff81054b47>] __wake_up_bit+0x2c/0x2e
<Oct/22 02:47 pm>[7263007.449467]  [<ffffffff810ac9a9>] unlock_page+0x22/0x26
<Oct/22 02:47 pm>[7263007.455199]  [<ffffffff811136b3>] mpage_end_io_read+0x5b/0x72
<Oct/22 02:47 pm>[7263007.461467]  [<ffffffff8110e9e7>] bio_endio+0x2a/0x2c
<Oct/22 02:47 pm>[7263007.467050]  [<ffffffff812a8c54>] req_bio_endio+0x8f/0xaf
<Oct/22 02:47 pm>[7263007.472939]  [<ffffffff812a8e30>] blk_update_request+0x1bc/0x3c6
<Oct/22 02:47 pm>[7263007.479499]  [<ffffffff812a8d44>] ? blk_update_request+0xd0/0x3c6
<Oct/22 02:47 pm>[7263007.486131]  [<ffffffff812a9055>] blk_update_bidi_request+0x1b/0x55
<Oct/22 02:47 pm>[7263007.492910]  [<ffffffff812a9c89>] blk_end_bidi_request+0x1a/0x56
<Oct/22 02:47 pm>[7263007.499427]  [<ffffffff812a9cf7>] blk_end_request+0xb/0xd
<Oct/22 02:47 pm>[7263007.505354]  [<ffffffff813628b9>] scsi_io_completion+0x18c/0x407
<Oct/22 02:47 pm>[7263007.511874]  [<ffffffff8135c93e>] scsi_finish_command+0xad/0xb6
<Oct/22 02:47 pm>[7263007.518305]  [<ffffffff81362c61>] scsi_softirq_done+0x11d/0x125
<Oct/22 02:47 pm>[7263007.524744]  [<ffffffff812aea39>] blk_done_softirq+0x69/0x79
<Oct/22 02:47 pm>[7263007.530891]  [<ffffffff8104103c>] __do_softirq+0xd8/0x194
<Oct/22 02:47 pm>[7263007.536794]  [<ffffffff8100388c>] call_softirq+0x1c/0x28
<Oct/22 02:47 pm>[7263007.542585]  [<ffffffff81004e7f>] do_softirq+0x33/0x68
<Oct/22 02:47 pm>[7263007.548219]  [<ffffffff81040ec2>] irq_exit+0x36/0x75
<Oct/22 02:47 pm>[7263007.553682]  [<ffffffff8100457c>] do_IRQ+0xaa/0xc1
<Oct/22 02:47 pm>[7263007.558966]  [<ffffffff8151f913>] ret_from_intr+0x0/0xa
<Oct/22 02:47 pm>[7263007.564680]  <EOI> 
<Oct/22 02:47 pm>[7263007.567265]  [<ffffffff812734b7>] ? xfs_perag_get+0x29/0x99

<Oct/22 02:47 pm>[7263007.573327]  [<ffffffff812c4e4e>] ? do_raw_spin_lock+0xc7/0x147
<Oct/22 02:47 pm>[7263007.579766]  [<ffffffff8151f193>] _raw_spin_lock+0x34/0x39
<Oct/22 02:47 pm>[7263007.585738]  [<ffffffff812734b7>] ? xfs_perag_get+0x29/0x99
<Oct/22 02:47 pm>[7263007.591824]  [<ffffffff812734b7>] xfs_perag_get+0x29/0x99
<Oct/22 02:47 pm>[7263007.597727]  [<ffffffff8128878f>] xfs_inode_ag_iterator+0x4a/0xce
<Oct/22 02:47 pm>[7263007.604318]  [<ffffffff81287ae3>] ? xfs_reclaim_inode+0x0/0x216
<Oct/22 02:47 pm>[7263007.610740]  [<ffffffff81288874>] xfs_reclaim_inode_shrink+0x61/0x126
<Oct/22 02:47 pm>[7263007.617699]  [<ffffffff810b88e5>] shrink_slab+0xd8/0x148
<Oct/22 02:47 pm>[7263007.623531]  [<ffffffff810b9801>] do_try_to_free_pages+0x246/0x37a
<Oct/22 02:47 pm>[7263007.630243]  [<ffffffff810b9b05>] try_to_free_pages+0x71/0x78
<Oct/22 02:47 pm>[7263007.636473]  [<ffffffff810b6cc0>] ? isolate_pages_global+0x0/0x23f
<Oct/22 02:47 pm>[7263007.643167]  [<ffffffff810b3026>] __alloc_pages_nodemask+0x407/0x671
<Oct/22 02:47 pm>[7263007.650048]  [<ffffffff810da7be>] alloc_pages_current+0x96/0x9f
<Oct/22 02:47 pm>[7263007.656478]  [<ffffffff810acb60>] __page_cache_alloc+0x59/0x5e
<Oct/22 02:47 pm>[7263007.662839]  [<ffffffff810b4860>] __do_page_cache_readahead+0xe5/0x1fc
<Oct/22 02:47 pm>[7263007.669921]  [<ffffffff810b47f6>] ? __do_page_cache_readahead+0x7b/0x1fc
<Oct/22 02:47 pm>[7263007.677147]  [<ffffffff810b4993>] ra_submit+0x1c/0x20
<Oct/22 02:47 pm>[7263007.682710]  [<ffffffff810b4cb7>] ondemand_readahead+0x243/0x256
<Oct/22 02:47 pm>[7263007.689212]  [<ffffffff810b4d47>] page_cache_async_readahead+0x7d/0xa8
<Oct/22 02:47 pm>[7263007.696270]  [<ffffffff81109d21>] __generic_file_splice_re<Oct/22 02:47 pm>
                 <Oct/22 02:47 pm>[7263007.703504]  [<ffffffff8106433a>] ? __lock_acquire+0x995/0x9fc
<Oct/22 02:47 pm>[7263007.709865]  [<ffffffff8106433a>] ? __lock_acquire+0x995/0x9fc

<Oct/22 02:47 pm>[7263007.716183]  [<ffffffff812615b1>] ? xfs_ilock+0x49/0xb2
<Oct/22 02:47 pm>[7263007.721896]  [<ffffffff811086db>] ? spd_release_page+0x0/0x14
<Oct/22 02:47 pm>[7263007.728147]  [<ffffffff81109f57>] generic_file_splice_read+0x43/0x74
<Oct/22 02:47 pm>[7263007.735031]  [<ffffffff8128191a>] xfs_file_splice_read+0xde/0x125
<Oct/22 02:47 pm>[7263007.741634]  [<ffffffff8110875d>] vfs_splice_to+0x6e/0x81
<Oct/22 02:47 pm>[7263007.747553]  [<ffffffff81108837>] splice_direct_to_actor+0xc7/0x19c
<Oct/22 02:47 pm>[7263007.754369]  [<ffffffff811f562c>] ? nfsd_direct_splice_actor+0x0/0x12
<Oct/22 02:47 pm>[7263007.761328]  [<ffffffff811f54ef>] nfsd_vfs_read+0x263/0x3a0
<Oct/22 02:47 pm>[7263007.767401]  [<ffffffff81281760>] ? xfs_file_open+0x0/0x3f
<Oct/22 02:47 pm>[7263007.773409]  [<ffffffff811f5c4e>] nfsd_read+0xa7/0xc3
<Oct/22 02:47 pm>[7263007.778966]  [<ffffffff811fcd79>] nfsd3_proc_read+0xfe/0x142
<Oct/22 02:47 pm>[7263007.785149]  [<ffffffff811f0854>] nfsd_dispatch+0xe9/0x1ca
<Oct/22 02:47 pm>[7263007.791165]  [<ffffffff814f04c5>] svc_process+0x425/0x72a
<Oct/22 02:47 pm>[7263007.797051]  [<ffffffff811f0ccf>] ? nfsd+0x0/0x139
<Oct/22 02:47 pm>[7263007.802339]  [<ffffffff811f0dc2>] nfsd+0xf3/0x139
<Oct/22 02:47 pm>[7263007.807544]  [<ffffffff810546e2>] kthread+0x7d/0x85
<Oct/22 02:47 pm>[7263007.812929]  [<ffffffff81003794>] kernel_thread_helper+0x4/0x10
<Oct/22 02:47 pm>[7263007.819373]  [<ffffffff81054665>] ? kthread+0x0/0x85
<Oct/22 02:47 pm>[7263007.824822]  [<ffffffff81003790>] ? kernel_thread_helper+0x0/0x10
<Oct/22 02:47 pm>[7263007.831446] Code: fb 48 ff c8 c9 c3 55 48 89 e5 48 83 ec 08 65 8b 34 25 f0 d1 00 00 66 66 90 0f ae e8 0f 31 89 c1 41 89 f1 66 66 90 0f ae e8 0f 31 <89> c6 48 89 f0 48 29 c8 48 39 f8 73 25 f3 90 65 44 8b 04 25 f0 
<Oct/22 02:47 pm>[7263007.854713] Call Trace:
<Oct/22 02:47 pm>[7263007.857602]  <IRQ>  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d

<Oct/22 02:47 pm>[7263007.866043]  [<ffffffff812c08fe>] __delay+0xa/0xc
<Oct/22 02:47 pm>[7263007.871260]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
<Oct/22 02:47 pm>[7263007.877507]  [<ffffffff8151f193>] _raw_spin_lock+0x34/0x39
<Oct/22 02:47 pm>[7263007.883504]  [<ffffffff8102fb6b>] ? task_rq_lock+0x7e/0x9a
<Oct/22 02:47 pm>[7263007.889510]  [<ffffffff8102fb6b>] task_rq_lock+0x7e/0x9a
<Oct/22 02:47 pm>[7263007.895337]  [<ffffffff81036578>] try_to_wake_up+0x2e/0x342
<Oct/22 02:47 pm>[7263007.901400]  [<ffffffff81036899>] default_wake_function+0xd/0xf
<Oct/22 02:47 pm>[7263007.907849]  [<ffffffff81054b7d>] autoremove_wake_function+0x11/0x38
<Oct/22 02:47 pm>[7263007.914729]  [<ffffffff81054bc8>] wake_bit_function+0x24/0x2a
<Oct/22 02:47 pm>[7263007.920960]  [<ffffffff8102c08d>] __wake_up_common+0x46/0x<Oct/22 02:47 pm>
                 <Oct/22 02:47 pm>[7263007.927123]  [<ffffffff8102faa6>] __wake_up+0x38/0x4f
<Oct/22 02:47 pm>[7263007.932673]  [<ffffffff81054b47>] __wake_up_bit+0x2c/0x2e
<Oct/22 02:47 pm>[7263007.938569]  [<ffffffff810ac9a9>] unlock_page+0x22/0x26
<Oct/22 02:47 pm>[7263007.944272]  [<ffffffff811136b3>] mpage_end_io_read+0x5b/0x72
<Oct/22 02:47 pm>[7263007.950524]  [<ffffffff8110e9e7>] bio_endio+0x2a/0x2c
<Oct/22 02:47 pm>[7263007.956063]  [<ffffffff812a8c54>] req_bio_endio+0x8f/0xaf
<Oct/22 02:47 pm>[7263007.961978]  [<ffffffff812a8e30>] blk_update_request+0x1bc/0x3c6
<Oct/22 02:47 pm>[7263007.968514]  [<ffffffff812a8d44>] ? blk_update_request+0xd0/0x3c6
<Oct/22 02:47 pm>[7263007.975119]  [<ffffffff812a9055>] blk_update_bidi_request+0x1b/0x55
<Oct/22 02:47 pm>[7263007.981931]  [<ffffffff812a9c89>] blk_end_bidi_request+0x1a/0x56
<Oct/22 02:47 pm>[7263007.988457]  [<ffffffff812a9cf7>] blk_end_request+0xb/0xd
<Oct/22 02:47 pm>[7263007.994376]  [<ffffffff813628b9>] scsi_io_completion+0x18c/0x407

<Oct/22 02:47 pm>[7263008.000905]  [<ffffffff8135c93e>] scsi_finish_command+0xad/0xb6
<Oct/22 02:47 pm>[7263008.007354]  [<ffffffff81362c61>] scsi_softirq_done+0x11d/0x125
<Oct/22 02:47 pm>[7263008.013794]  [<ffffffff812aea39>] blk_done_softirq+0x69/0x79
<Oct/22 02:47 pm>[7263008.019931]  [<ffffffff8104103c>] __do_softirq+0xd8/0x194
<Oct/22 02:47 pm>[7263008.025833]  [<ffffffff8100388c>] call_softirq+0x1c/0x28
<Oct/22 02:47 pm>[7263008.031659]  [<ffffffff81004e7f>] do_softirq+0x33/0x68
<Oct/22 02:47 pm>[7263008.037297]  [<ffffffff81040ec2>] irq_exit+0x36/0x75
<Oct/22 02:47 pm>[7263008.042749]  [<ffffffff8100457c>] do_IRQ+0xaa/0xc1
<Oct/22 02:47 pm>[7263008.048030]  [<ffffffff8151f913>] ret_from_intr+0x0/0xa
<Oct/22 02:47 pm>[7263008.053737]  <EOI>  [<ffffffff812734b7>] ? xfs_perag_get+0x29/0x99
<Oct/22 02:47 pm>[7263008.060485]  [<ffffffff812c4e4e>] ? do_raw_spin_lock+0xc7/0x147
<Oct/22 02:47 pm>[7263008.066931]  [<ffffffff8151f193>] _raw_spin_lock+0x34/0x39
<Oct/22 02:47 pm>[7263008.072956]  [<ffffffff812734b7>] ? xfs_perag_get+0x29/0x99
<Oct/22 02:47 pm>[7263008.079032]  [<ffffffff812734b7>] xfs_perag_get+0x29/0x99
<Oct/22 02:47 pm>[7263008.084945]  [<ffffffff8128878f>] xfs_inode_ag_iterator+0x4a/0xce
<Oct/22 02:47 pm>[7263008.091560]  [<ffffffff81287ae3>] ? xfs_reclaim_inode+0x0/0x216
<Oct/22 02:47 pm>[7263008.097999]  [<ffffffff81288874>] xfs_reclaim_inode_shrink+0x61/0x126
<Oct/22 02:47 pm>[7263008.104951]  [<ffffffff810b88e5>] shrink_slab+0xd8/0x148
<Oct/22 02:47 pm>[7263008.110774]  [<ffffffff810b9801>] do_try_to_free_pages+0x246/0x37a
<Oct/22 02:47 pm>[7263008.117492]  [<ffffffff810b9b05>] try_to_free_pages+0x71/0x78
<Oct/22 02:47 pm>[7263008.123751]  [<ffffffff810b6cc0>] ? isolate_pages_global+0x0/0x23f
<Oct/22 02:47 pm>[7263008.130452]  [<ffffffff810b3026>] __alloc_pages_nodemask+0x407/0x671

<Oct/22 02:47 pm>[7263008.137332]  [<ffffffff810da7be>] alloc_pages_current+0x96/0x9f
<Oct/22 02:47 pm>[7263008.148263]  [<ffffffff810acb60>] __page_cache_alloc+0x59/0x5e
<Oct/22 02:47 pm>[7263008.154619]  [<ffffffff810b4860>] __do_page_cache_readahead+0xe5/0x1fc
<Oct/22 02:47 pm>[7263008.161648]  [<ffffffff810b47f6>] ? __do_page_cache_readahead+0x7b/0x1fc
<Oct/22 02:47 pm>[7263008.168877]  [<ffffffff810b4993>] ra_submit+0x1c/0x20
<Oct/22 02:47 pm>[7263008.174420]  [<ffffffff810b4cb7>] ondemand_readahead+0x243/0x256
<Oct/22 02:47 pm>[7263008.180949]  [<ffffffff810b4d47>] page_cache_async_readahead+0x7d/0xa8
<Oct/22 02:47 pm>[7263008.187989]  [<ffffffff81109d21>] __generic_file_splice_read+0x229/0x41c
<Oct/22 02:47 pm>[7263008.195225]  [<ffffffff8106433a>] ? __lock_acquire+0x995/0x9fc
<Oct/22 02:47 pm>[7263008.201568]  [<ffffffff8106433a>] ? __lock_acquire+0x995/0x9fc
<Oct/22 02:47 pm>[7263008.207912]  [<ffffffff812615b1>] ? xfs_ilock+0x49/0xb2
<Oct/22 02:47 pm>[7263008.213649]  [<ffffffff811086db>] ? spd_release_page+0x0/0x14
<Oct/22 02:47 pm>[7263008.219920]  [<ffffffff81109f57>] generic_file_splice_read+0x43/0x74
<Oct/22 02:47 pm>[7263008.226801]  [<ffffffff8128191a>] xfs_file_splice_read+0xde/0x125
<Oct/22 02:47 pm>[7263008.233423]  [<ffffffff8110875d>] vfs_splice_to+0x6e/0x81
<Oct/22 02:47 pm>[7263008.239323]  [<ffffffff81108837>] splice_direct_to_actor+0xc7/0x19c
<Oct/22 02:47 pm>[7263008.246140]  [<ffffffff811f562c>] ? nfsd_direct_splice_actor+0x0/0x12
<Oct/22 02:47 pm>[7263008.253098]  [<ffffffff811f54ef>] nfsd_vfs_read+0x263/0x3a0
<Oct/22 02:47 pm>[7263008.259198]  [<ffffffff81281760>] ? xfs_file_open+0x0/0x3f
<Oct/22 02:47 pm>[7263008.265204]  [<ffffffff811f5c4e>] nfsd_read+0xa7/0xc3
<Oct/22 02:47 pm>[7263008.270729]  [<ffffffff811fcd79>] nfsd3_proc_read+0xfe/0x142
<Oct/22 02:47 pm>[7263008.276919]  [<ffffffff811f0854>] nfsd_dispatch+0xe9/0x1ca

<Oct/22 02:47 pm>[7263008.282917]  [<ffffffff814f04c5>] svc_process+0x425/0x72a
<Oct/22 02:47 pm>[7263008.288849]  [<ffffffff811f0ccf>] ? nfsd+0x0/0x139
<Oct/22 02:47 pm>[7263008.294111]  [<ffffffff811f0dc2>] nfsd+0xf3/0x139
<Oct/22 02:47 pm>[7263008.299289]  [<ffffffff810546e2>] kthread+0x7d/0x85
<Oct/22 02:47 pm>[7263008.304674]  [<ffffffff81003794>] kernel_thread_helper+0x4/0x10
<Oct/22 02:47 pm>[7263008.311118]  [<ffffffff81054665>] ? kthread+0x0/0x85
<Oct/22 02:47 pm>[7263008.316593]  [<ffffffff81003790>] ? kernel_thread_helper+0x0/0x10
<Oct/22 02:47 pm>[7263008.323212] Pid: 8547, comm: nfsd Tainted: G      D    2.6.34.4 #3
<Oct/22 02:47 pm>[7263008.329927] Call Trace:
<Oct/22 02:47 pm>[7263008.332819]  <NMI>  [<ffffffff81009b2a>] ? show_regs+0x26/0x2a
<Oct/22 02:47 pm>[7263008.339194]  [<ffffffff81520db8>] nmi_watchdog_tick+0xc3/0x1a5
<Oct/22 02:47 pm>[7263008.345531]  [<ffffffff81520360>] do_nmi+0xb2/0x259
<Oct/22 02:47 pm>[7263008.350897]  [<ffffffff8151fdfa>] nmi+0x1a/0x20
<Oct/22 02:47 pm>[7263008.355891]  [<ffffffff812c08af>] ? delay_tsc+0x25/0x59
                 <Oct/22 02:47 pm>[7263008.361623]  <<EOE>>  <IRQ>  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
<Oct/22 02:47 pm>[7263008.370934]  [<ffffffff812c08fe>] __delay+0xa/0xc
<Oct/22 02:47 pm>[7263008.376092]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
<Oct/22 02:47 pm>[7263008.382383]  [<ffffffff8151f193>] _raw_spin_lock+0x34/0x39
<Oct/22 02:47 pm>[7263008.388387]  [<ffffffff8102fb6b>] ? task_rq_lock+0x7e/0x9a
<Oct/22 02:47 pm>[7263008.394397]  [<ffffffff8102fb6b>] task_rq_lock+0x7e/0x9a
<Oct/22 02:47 pm>[7263008.400188]  [<ffffffff81036578>] try_to_wake_up+0x2e/0x342
<Oct/22 02:47 pm>[7263008.406249]  [<ffffffff81036899>] default_wake_function+0xd/0xf

<Oct/22 02:47 pm>[7263008.412665]  [<ffffffff81054b7d>] autoremove_wake_function+0x11/0x38
<Oct/22 02:47 pm>[7263008.419539]  [<ffffffff81054bc8>] wake_bit_function+0x24/0<Oct/22 02:47 pm>
                 <Oct/22 02:47 pm>[7263008.425760]  [<ffffffff8102c08d>] __wake_up_common+0x46/0x76
<Oct/22 02:47 pm>[7263008.431924]  [<ffffffff8102faa6>] __wake_up+0x38/0x4f
<Oct/22 02:47 pm>[7263008.437444]  [<ffffffff81054b47>] __wake_up_bit+0x2c/0x2e
<Oct/22 02:47 pm>[7263008.443349]  [<ffffffff810ac9a9>] unlock_page+0x22/0x26
<Oct/22 02:47 pm>[7263008.449082]  [<ffffffff811136b3>] mpage_end_io_read+0x5b/0x72
<Oct/22 02:47 pm>[7263008.455332]  [<ffffffff8110e9e7>] bio_endio+0x2a/0x2c
<Oct/22 02:47 pm>[7263008.460895]  [<ffffffff812a8c54>] req_bio_endio+0x8f/0xaf
<Oct/22 02:47 pm>[7263008.466793]  [<ffffffff812a8e30>] blk_update_request+0x1bc/0x3c6
<Oct/22 02:47 pm>[7263008.473295]  [<ffffffff812a8d44>] ? blk_update_request+0xd0/0x3c6
<Oct/22 02:47 pm>[7263008.479952]  [<ffffffff812a9055>] blk_update_bidi_request+0x1b/0x55
<Oct/22 02:47 pm>[7263008.486731]  [<ffffffff812a9c89>] blk_end_bidi_request+0x1a/0x56
<Oct/22 02:47 pm>[7263008.493246]  [<ffffffff812a9cf7>] blk_end_request+0xb/0xd
<Oct/22 02:47 pm>[7263008.499142]  [<ffffffff813628b9>] scsi_io_completion+0x18c/0x407
<Oct/22 02:47 pm>[7263008.505618]  [<ffffffff8135c93e>] scsi_finish_command+0xad/0xb6
<Oct/22 02:47 pm>[7263008.512084]  [<ffffffff81362c61>] scsi_softirq_done+0x11d/0x125
<Oct/22 02:47 pm>[7blk_done_softirq+0x69/0x79
<Oct/22 02:47 pm>[7263008.524703]  [<ffffffff8104103c>] __do_softirq+0xd8/0x194
<Oct/22 02:47 pm>[7263008.530615]  [<ffffffff8100388c>] call_softirq+0x1c/0x28
<Oct/22 02:47 pm>[7263008.536416]  [<ffffffff81004e7f>] do_softirq+0x33/0x68
<Oct/22 02:47 pm>[7263008.542043]  [<ffffffff81040ec2>] irq_exit+0x36/0x75

<Oct/22 02:47 pm>[7263008.547488]  [<ffffffff8100457c>] do_IRQ+0xaa/0xc1
<Oct/22 02:47 pm>[7263008.552759]  [<ffffffff8151f913>] ret_from_intr+0x0/0xa
<Oct/22 02:47 pm>[7263008.558448]  <EOI>  [<ffffffff812734b7>] ? xfs_perag_get+0x29/0x99
<Oct/22 02:47 pm>[7263008.565214]  [<ffffffff812c4e4e>] ? do_raw_spin_lock+0xc7/0x147
<Oct/22 02:47 pm>[7263008.571652]  [<ffffffff8151f193>] _raw_spin_lock+0x34/0x39
<Oct/22 02:47 pm>[7263008.577658]  [<ffffffff812734b7>] ? xfs_perag_get+0x29/0x99
<Oct/22 02:47 pm>[7263008.583762]  [<ffffffff812734b7>] xfs_perag_get+0x29/0x99
<Oct/22 02:47 pm>[7263008.589664]  [<ffffffff8128878f>] xfs_inode_ag_iterator+0x4a/0xce
<Oct/22 02:47 pm>[7263008.596255]  [<ffffffff81287ae3>] ? xfs_reclaim_inode+0x0/0x216
<Oct/22 02:47 pm>[7263008.602668]  [<ffffffff81288874>] xfs_reclaim_inode_shrink+0x61/0x126
<Oct/22 02:47 pm>[7263008.609655]  [<ffffffff810b88e5>] shrink_slab+0xd8/0x148
<Oct/22 02:47 pm>[7263008.615477]  [<ffffffff810b9801>] do_try_to_free_pages+0x246/0x37a
<Oct/22 02:47 pm>[7263008.622179]  [<ffffffff810b9b05>] try_to_free_pages+0x71/0x78
<Oct/22 02:47 pm>[7263008.628401]  [<ffffffff810b6cc0>] ? isolate_pages_global+0x0/0x23f
<Oct/22 02:47 pm>[7263008.635103]  [<ffffffff810b3026>] __alloc_pages_nodemask+0x407/0x671
<Oct/22 02:47 pm>[7263008.641958]  [<ffffffff810da7be>] alloc_pages_current+0x96/0x9f
<Oct/22 02:47 pm>[7263008.648396]  [<ffffffff810acb60>] __page_cache_alloc+0x59/0x5e
<Oct/22 02:47 pm>[7263008.654739]  [<ffffffff810b4860>] __do_page_cache_readahea<Oct/22 02:47 pm>
                 <Oct/22 02:47 pm>[7263008.661789]  [<ffffffff810b47f6>] ? __do_page_cache_readahead+0x7b/0x1fc
<Oct/22 02:47 pm>[7263008.669006]  [<ffffffff810b4993>] ra_submit+0x1c/0x20
<Oct/22 02:47 pm>[7263008.674567]  [<ffffffff810b4cb7>] ondemand_readahead+0x243/0x256
<Oct/22 02:47 pm>[7263008.681082]  [<ffffffff810b4d47>] page_cache_async_readahead+0x7d/0xa8

<Oct/22 02:47 pm>[7263008.688155]  [<ffffffff81109d21>] __generic_file_splice_read+0x229/0x41c
<Oct/22 02:47 pm>[7263008.695365]  [<ffffffff8106433a>] ? __lock_acquire+0x995/0x9fc
<Oct/22 02:47 pm>[7263008.701732]  [<ffffffff8106433a>] ? __lock_acquire+0x995/0x9fc
<Oct/22 02:47 pm>[7263008.708070]  [<ffffffff812615b1>] ? xfs_ilock+0x49/0xb2
<Oct/22 02:47 pm>[7263008.713807]  [<ffffffff811086db>] ? spd_release_page+0x0/0x14
<Oct/22 02:47 pm>[7263008.720093]  [<ffffffff81109f57>] generic_file_splice_read+0x43/0x74
<Oct/22 02:47 pm>[7263008.726966]  [<ffffffff8128191a>] xfs_file_splice_read+0xde/0x125
<Oct/22 02:47 pm>[7263008.733572]  [<ffffffff8110875d>] vfs_splice_to+0x6e/0x81
<Oct/22 02:47 pm>[7263008.739463]  [<ffffffff81108837>] splice_direct_to_actor+0xc7/0x19c
<Oct/22 02:47 pm>[7263008.746253]  [<ffffffff811f562c>] ? nfsd_direct_splice_actor+0x0/0x12
<Oct/22 02:47 pm>[7263008.753229]  [<ffffffff811f54ef>] nfsd_vfs_read+0x263/0x3a0
<Oct/22 02:47 pm>[7263008.759295]  [<ffffffff81281760>] ? xfs_file_open+0x0/0x3f
<Oct/22 02:47 pm>[7263008.765303]  [<ffffffff811f5c4e>] nfsd_read+0xa7/0xc3
<Oct/22 02:47 pm>[7263008.770849]  [<ffffffff811fcd79>] nfsd3_proc_read+0xfe/0x142
<Oct/22 02:47 pm>[7263008.777051]  [<ffffffff811f0854>] nfsd_dispatch+0xe9/0x1ca
<Oct/22 02:47 pm>[7263008.783039]  [<ffffffff814f04c5>] svc_process+0x425/0x72a
<Oct/22 02:47 pm>[7263008.788934]  [<ffffffff811f0ccf>] ? nfsd+0x0/0x139
<Oct/22 02:47 pm>[7263008.794214]  [<ffffffff811f0dc2>] nfsd+0xf3/0x139
<Oct/22 02:47 pm>[7263008.799445]  [<ffffffff810546e2>] kthread+0x7d/0x85
<Oct/22 02:47 pm>[7263008.804813]  [<ffffffff81003794>] kernel_thread_helper+0x4/0x10
<Oct/22 02:47 pm>[7263008.811239]  [<ffffffff81054665>] ? kthread+0x0/0x85
                 <Oct/22 02:47 pm>[7263008.816690]  [<ffffffff81003790>] ? kernel_thread_helper+0x0/0x10

<Oct/22 02:47 pm>[7263008.823317] NMI backtrace for cpu 6
<Oct/22 02:47 pm>[7263008.827259] CPU 6 
<Oct/22 02:47 pm>[7263008.829335] Modules linked in: w83793 hwmon_vid autofs4 i2c_i801 i2c_core iTCO_wdt e1000e ioatdma dca rtc_cmos tg3 libphy e1000 fuse dm_snapshot dm_mirror dm_region_hash dm_log scsi_wait_scan qla2xxx megaraid_sas megaraid_mbox megaraid_mm aacraid 3w_9xxx 3w_xxxx arcmsr aic7xxx aic79xx sr_mod sg ata_piix ahci sata_sis sata_nv sata_via pata_sl82c105 pata_sis
<Oct/22 02:47 pm>[7263008.865006] 
<Oct/22 02:47 pm>[7263008.866928] Pid: 8433, comm: nfsd Tainted: G      D    2.6.34.4 #3 S7010/empty
<Oct/22 02:47 pm>[7263008.874859] RIP: 0010:[<ffffffff812c08af>]  [<ffffffff812c08af>] delay_tsc+0x25/0x59
<Oct/22 02:47 pm>[7263008.883404] RSP: 0018:ffff880620c48518  EFLAGS: 00000046
<Oct/22 02:47 pm>[7263008.889227] RAX: 000000007f8d4f64 RBX: 0000000000000000 RCX: 000000007f8d4f1c
<Oct/22 02:47 pm>[7263008.897066] RDX: 000000000044fd59 RSI: 000000007f8d4f38 RDI: 00000000000411b3
<Oct/22 02:47 pm>[7263008.904896] RBP: ffff880620c48520 R08: 0000000000000006 R09: 0000000000000006
<Oct/22 02:47 pm>[7263008.912763] R10: ffff8800000b8640 R11: 0000000000000082 R12: 0000000000001000
<Oct/22 02:47 pm>[7263008.920636] R13: 0000000000000002 R14: 0000000000000086 R15: ffff880621240022
<Oct/22 02:47 pm>[7263008.928460] FS:  0000000000000000(0000) GS:ffff880655200000(0000) knlGS:0000000000000000
<Oct/22 02:47 pm>[7263008.937299] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
<Oct/22 02:47 pm>[7263008.943516] CR2: 00007fe272a95efc CR3: 0000000001a8a000 CR4: 00000000000006e0
<Oct/22 02:47 pm>[7263008.951361] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
<Oct/22 02:47 pm>[7263008.959228] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
<Oct/22 02:47 pm>[7263008.967102] Process nfsd (pid: 8433, threadinfo ffff880620c48000, task ffff88062124a060)
<Oct/22 02:47 pm>[7263008.975886] Stack:
<Oct/22 02:47 pm>[7263008.978323]  ffff880620c482c1 ffff880620c48530 ffffffff812c093d ffff880620c48550
<Oct/22 02:47 pm>[7263008.986272] <0> ffffffff810197e9 0000000000000007 000000000000d200 ffff880620c48590
<Oct/22 02:47 pm>[7263008.994933] <0> ffffffff81019c76 ffffffff81b24210 0000000000000000 ffff880655213c00

<Oct/22 02:47 pm>[7263009.003929] Call Trace:
<Oct/22 02:47 pm>[7263009.006817]  [<ffffffff812c093d>] __const_udelay+0x3d/0x3f
<Oct/22 02:47 pm>[7263009.012801]  [<ffffffff810197e9>] native_safe_apic_wait_icr_idle+0x31/0x48
<Oct/22 02:47 pm>[7263009.020240]  [<ffffffff81019c76>] default_send_IPI_mask_sequence_phys+0x49/0xab
<Oct/22 02:47 pm>[7263009.028254]  [<ffffffff8101c5d8>] physflat_send_IPI_all+0x14/0x16
<Oct/22 02:47 pm>[7263009.034854]  [<ffffffff81019d94>] arch_trigger_all_cpu_backtrace+0x3c/0x5d
<Oct/22 02:47 pm>[7263009.042290]  [<ffffffff812c4ea4>] do_raw_spin_lock+0x11d/0x147
<Oct/22 02:47 pm>[7263009.048641]  [<ffffffff8151f115>] _raw_spin_lock_irq+0x35/0x39
<Oct/22 02:47 pm>[7263009.054978]  [<ffffffff8151cae8>] ? schedule+0x134/0x86a
<Oct/22 02:47 pm>[7263009.060801]  [<ffffffff8151cae8>] schedule+0x134/0x86a
<Oct/22 02:47 pm>[7263009.066421]  [<ffffffff8151d35f>] schedule_timeout+0x28/0x24c
<Oct/22 02:47 pm>[7263009.072706]  [<ffffffff8151c816>] ? wait_for_common+0x26/0x138
<Oct/22 02:47 pm>[7263009.079059]  [<ffffffff8151c8b2>] wait_for_common+0xc2/0x138
<Oct/22 02:47 pm>[7263009.085214]  [<ffffffff8103688c>] ? default_wake_function+<Oct/22 02:47 pm>
                 <Oct/22 02:47 pm>[7263009.091845]  [<ffffffff81280d3e>] ? _xfs_buf_read+0x3f/0x44
<Oct/22 02:47 pm>[7263009.097930]  [<ffffffff81277887>] ? xfs_trans_read_buf+0x238/0x396
<Oct/22 02:47 pm>[7263009.104631]  [<ffffffff8151c9b2>] wait_for_completion+0x18/0x1a
<Oct/22 02:47 pm>[7263009.111063]  [<ffffffff8127f236>] xfs_buf_iowait+0x7e/0xba
<Oct/22 02:47 pm>[7263009.117104]  [<ffffffff81280d3e>] _xfs_buf_read+0x3f/0x44
<Oct/22 02:47 pm>[7263009.123034]  [<ffffffff81281374>] xfs_buf_read+0x8a/0xc6
<Oct/22 02:47 pm>[7263009.128850]  [<ffffffff81277887>] xfs_trans_read_buf+0x238/0x396
<Oct/22 02:47 pm>[7263009.135355]  [<ffffffff8124e176>] xfs_btree_read_buf_block+0x4d/0x91

<Oct/22 02:47 pm>[7263009.142236]  [<ffffffff8124f1dc>] xfs_btree_lookup_get_block+0x88/0xae
<Oct/22 02:47 pm>[7263009.149282]  [<ffffffff8124f7ca>] xfs_btree_lookup+0x138/0x3dc
<Oct/22 02:47 pm>[7263009.155615]  [<ffffffff81239f17>] xfs_alloc_lookup_eq+0x14/0x16
<Oct/22 02:47 pm>[7263009.162039]  [<ffffffff8123a00f>] xfs_alloc_fixup_trees+0x71/0x27d
<Oct/22 02:47 pm>[7263009.168764]  [<ffffffff8123cd84>] ? xfs_allocbt_init_cursor+0x38/0x96
<Oct/22 02:47 pm>[7263009.175742]  [<ffffffff8123b707>] xfs_alloc_ag_vextent_size+0x37d/0x4c1
<Oct/22 02:47 pm>[7263009.187377]  [<ffffffff8123c2a2>] xfs_alloc_ag_vextent+0x27/0xf5
<Oct/22 02:47 pm>[7263009.193885]  [<ffffffff8123cb1b>] xfs_alloc_vextent+0x318/0x4ad
<Oct/22 02:47 pm>[7263009.200306]  [<ffffffff812488c1>] xfs_bmap_btalloc+0x3c2/0x576
<Oct/22 02:47 pm>[7263009.206626]  [<ffffffff81248a98>] xfs_bmap_alloc+0x23/0x25
<Oct/22 02:47 pm>[7263009.212624]  [<ffffffff8124add5>] xfs_bmapi+0x7b5/0xe73
<Oct/22 02:47 pm>[7263009.218363]  [<ffffffff8126c831>] ? xlog_grant_log_space+0x26/0x484
<Oct/22 02:47 pm>[7263009.225136]  [<ffffffff8105861d>] ? down_write_nested+0x2a/0x4a
<Oct/22 02:47 pm>[7263009.231572]  [<ffffffff81267363>] xfs_iomap_write_allocate+0x227/0x353
<Oct/22 02:47 pm>[7263009.238622]  [<ffffffff81267eac>] xfs_iomap+0x318/0x39c
                 <Oct/22 02:47 pm>[7263009.244340]  [<ffffffff810dce68>] ? add_partial+0x61/0x6a
<Oct/22 02:47 pm>[7263009.250236]  [<ffffffff8127d1e5>] xfs_map_blocks+0x27/0x2b
<Oct/22 02:47 pm>[7263009.256244]  [<ffffffff8127e160>] xfs_page_state_convert+0x2d8/0x5b2
<Oct/22 02:47 pm>[7263009.263118]  [<ffffffff8127e71f>] xfs_vm_writepage+0xd9/0x113
<Oct/22 02:47 pm>[7263009.269374]  [<ffffffff810b7612>] shrink_page_list+0x3c2/0x68f
<Oct/22 02:47 pm>[7263009.275730]  [<ffffffff810b8341>] shrink_zone+0x7c2/0xb86
<Oct/22 02:47 pm>[7263009.281658]  [<ffffffff81361d5e>] ? scsi_request_fn+0x39d/0x459

<Oct/22 02:47 pm>[7263009.288117]  [<ffffffff810b97c3>] do_try_to_free_pages+0x208/0x37a
<Oct/22 02:47 pm>[7263009.294826]  [<ffffffff810b9b05>] try_to_free_pages+0x71/0x78
<Oct/22 02:47 pm>[7263009.301108]  [<ffffffff810b6cc0>] ? isolate_pages_global+0x0/0x23f
<Oct/22 02:47 pm>[7263009.307827]  [<ffffffff810b3026>] __alloc_pages_nodemask+0x407/0x671
<Oct/22 02:47 pm>[7263009.314717]  [<ffffffff8127d35c>] ? xfs_get_blocks+0x0/0x14
<Oct/22 02:47 pm>[7263009.320757]  [<ffffffff810da7be>] alloc_pages_current+0x96/0x9f
<Oct/22 02:47 pm>[7263009.327164]  [<ffffffff810acb60>] __page_cache_alloc+0x59/0x5e
<Oct/22 02:47 pm>[7263009.333515]  [<ffffffff810b4860>] __do_page_cache_readahead+0xe5/0x1fc
<Oct/22 02:47 pm>[7263009.340564]  [<ffffffff810b47f6>] ? __do_page_cache_readahead+0x7b/0x1fc
<Oct/22 02:47 pm>[7263009.347791]  [<ffffffff810b4993>] ra_submit+0x1c/0x20
<Oct/22 02:47 pm>[7263009.353344]  [<ffffffff810b4cb7>] ondemand_readahead+0x243/0x256
<Oct/22 02:47 pm>[7263009.359847]  [<ffffffff810b4d47>] page_cache_async_readahead+0x7d/0xa8
<Oct/22 02:47 pm>[7263009.366922]  [<ffffffff81109d21>] __generic_file_splice_read+0x229/0x41c
<Oct/22 02:47 pm>[7263009.374175]  [<ffffffff8106433a>] ? __lock_acquire+0x995/0x9fc
<Oct/22 02:47 pm>[7263009.380524]  [<ffffffff8106433a>] ? __lock_acquire+0x995/0x9fc
<Oct/22 02:47 pm>[7263009.386870]  [<ffffffff812615b1>] ? xfs_ilock+0x49/0xb2
<Oct/22 02:47 pm>[7263009.392565]  [<ffffffff811086db>] ? spd_release_page+0x0/0x14
<Oct/22 02:47 pm>[7263009.398826]  [<ffffffff81109f57>] generic_file_splice_read+0x43/0x74
<Oct/22 02:47 pm>[7263009.405709]  [<ffffffff8128191a>] xfs_file_splice_read+0xde/0x125
<Oct/22 02:47 pm>[7263009.412347]  [<ffffffff8110875d>] vfs_splice_to+0x6e/0x81
<Oct/22 02:47 pm>[7263009.418246]  [<ffffffff81108837>] splice_direct_to_actor+0xc7/0x19c
<Oct/22 02:47 pm>[7263009.425002]  [<ffffffff811f562c>] ? nfsd_direct_splice_actor+0x0/0x12

<Oct/22 02:47 pm>[7263009.432013]  [<ffffffff811f54ef>] nfsd_vfs_read+0x263/0x3a0
<Oct/22 02:47 pm>[7263009.438087]  [<ffffffff81281760>] ? xfs_file_open+0x0/0x3f
<Oct/22 02:47 pm>[7263009.444078]  [<ffffffff811f5c4e>] nfsd_read+0xa7/0xc3
<Oct/22 02:47 pm>[7263009.449634]  [<ffffffff811fcd79>] nfsd3_proc_read+0xfe/0x142
<Oct/22 02:47 pm>[7263009.455783]  [<ffffffff811f0854>] nfsd_dispatch+0xe9/0x1ca
<Oct/22 02:47 pm>[7263009.461781]  [<ffffffff814f04c5>] svc_process+0x425/0x72a
                 <Oct/22 02:47 pm>[7263009.467669]  [<ffffffff811f0ccf>] ? nfsd+0x0/0x139
<Oct/22 02:47 pm>[7263009.472947]  [<ffffffff811f0dc2>] nfsd+0xf3/0x139
<Oct/22 02:47 pm>[7263009.478136]  [<ffffffff810546e2>] kthread+0x7d/0x85
                 <Oct/22 02:47 pm>[7263009.483522]  [<ffffffff81003794>] kernel_thread_helper+0x4/0x10
<Oct/22 02:47 pm>[7263009.489947]  [<ffffffff81054665>] ? kthread+0x0/0x85
<Oct/22 02:47 pm>[7263009.495399]  [<ffffffff81003790>] ? kernel_thread_helper+0x0/0x10
<Oct/22 02:47 pm>[7263009.502014] Code: fb 48 ff c8 c9 c3 55 48 89 e5 48 83 ec 08 65 8b 34 25 f0 d1 00 00 66 66 90 0f ae e8 0f 31 89 c1 41 89 f1 66 66 90 0f ae e8 0f 31 <89> c6 48 89 f0 48 29 c8 48 39 f8 73 25 f3 90 65 44 8b 04 25 f0 
<Oct/22 02:47 pm>[7263009.525290] Call Trace:
<Oct/22 02:47 pm>[7263009.528168]  [<ffffffff812c093d>] __const_udelay+0x3d/0x3f
<Oct/22 02:47 pm>[7263009.534144]  [<ffffffff810197e9>] native_safe_apic_wait_icr_idle+0x31/0x48
<Oct/22 02:47 pm>[7263009.541549]  [<ffffffff81019c76>] default_send_IPI_mask_sequence_phys+0x49/0xab
<Oct/22 02:47 pm>[7263009.549554]  [<ffffffff8101c5d8>] physflat_send_IPI_all+0x14/0x16
<Oct/22 02:47 pm>[7263009.556154]  [<ffffffff81019d94>] arch_trigger_all_cpu_backtrace+0x3c/0x5d
<Oct/22 02:47 pm>[7263009.563565]  [<ffffffff812c4ea4>] do_raw_spin_lock+0x11d/0x147
<Oct/22 02:47 pm>[7263009.569898]  [<ffffffff8151f115>] _raw_spin_lock_irq+0x35/0x39
<Oct/22 02:47 pm>[7263009.576268]  [<ffffffff8151cae8>] ? schedule+0x134/0x86a

<Oct/22 02:47 pm>[7263009.582112]  [<ffffffff8151cae8>] schedule+0x134/0x86a
<Oct/22 02:47 pm>[7263009.587763]  [<ffffffff8151d35f>] schedule_timeout+0x28/0x24c
<Oct/22 02:47 pm>[7263009.594034]  [<ffffffff8151c816>] ? wait_for_common+0x26/0x138
<Oct/22 02:47 pm>[7263009.600414]  [<ffffffff8151c8b2>] wait_for_common+0xc2/0x138
<Oct/22 02:47 pm>[7263009.606595]  [<ffffffff8103688c>] ? default_wake_function+0x0/0xf
<Oct/22 02:47 pm>[7263009.613234]  [<ffffffff81280d3e>] ? _xfs_buf_read+0x3f/0x44
<Oct/22 02:47 pm>[7263009.619309]  [<ffffffff81277887>] ? xfs_trans_read_buf+0x238/0x396
<Oct/22 02:47 pm>[7263009.626019]  [<ffffffff8151c9b2>] wait_for_completion+0x18/0x1a
<Oct/22 02:47 pm>[7263009.632432]  [<ffffffff8127f236>] xfs_buf_iowait+0x7e/0xba
<Oct/22 02:47 pm>[7263009.638447]  [<ffffffff81280d3e>] _xfs_buf_read+0x3f/0x44
<Oct/22 02:47 pm>[7263009.644350]  [<ffffffff81281374>] xfs_buf_read+0x8a/0xc6
<Oct/22 02:47 pm>[7263009.650151]  [<ffffffff81277887>] xfs_trans_read_buf+0x238/0x396
<Oct/22 02:47 pm>[7263009.656680]  [<ffffffff8124e176>] xfs_btree_read_buf_block+0x4d/0x91
<Oct/22 02:47 pm>[7263009.663554]  [<ffffffff8124f1dc>] xfs_btree_lookup_get_blo<Oct/22 02:47 pm>
                 <Oct/22 02:47 pm>[7263009.670598]  [<ffffffff8124f7ca>] xfs_btree_lookup+0x138/0x3dc
<Oct/22 02:47 pm>[7263009.676934]  [<ffffffff81239f17>] xfs_alloc_lookup_eq+0x14/0x16
<Oct/22 02:47 pm>[7263009.683381]  [<ffffffff8123a00f>] xfs_alloc_fixup_trees+0x71/0x27d
<Oct/22 02:47 pm>[7263009.690057]  [<ffffffff8123cd84>] ? xfs_allocbt_init_cursor+0x38/0x96
<Oct/22 02:47 pm>[7263009.697058]  [<ffffffff8123b707>] xfs_alloc_ag_vextent_size+0x37d/0x4c1
<Oct/22 02:47 pm>[7263009.704209]  [<ffffffff8123c2a2>] xfs_alloc_ag_vextent+0x27/0xf5
<Oct/22 02:47 pm>[7263009.710725]  [<ffffffff8123cb1b>] xfs_alloc_vextent+0x318/0x4ad
<Oct/22 02:47 pm>[7263009.717165]  [<ffffffff812488c1>] xfs_bmap_btalloc+0x3c2/0x576

<Oct/22 02:47 pm>[7263009.723518]  [<ffffffff81248a98>] xfs_bmap_alloc+0x23/0x25
<Oct/22 02:47 pm>[7263009.729499]  [<ffffffff8124add5>] xfs_bmapi+0x7b5/0xe73
<Oct/22 02:47 pm>[7263009.735222]  [<ffffffff8126c831>] ? xlog_grant_log_space+0x26/0x484
<Oct/22 02:47 pm>[7263009.742036]  [<ffffffff8105861d>] ? down_write_nested+0x2a/0x4a
<Oct/22 02:47 pm>[7263009.748474]  [<ffffffff81267363>] xfs_iomap_write_allocate+0x227/0x353
<Oct/22 02:47 pm>[7263009.755521]  [<ffffffff81267eac>] xfs_iomap+0x318/0x39c
<Oct/22 02:47 pm>[7263009.761259]  [<ffffffff810dce68>] ? add_partial+0x61/0x6a
<Oct/22 02:47 pm>[7263009.767181]  [<ffffffff8127d1e5>] xfs_map_blocks+0x27/0x2b
<Oct/22 02:47 pm>[7263009.773179]  [<ffffffff8127e160>] xfs_page_state_convert+0x2d8/0x5b2
<Oct/22 02:47 pm>[7263009.780029]  [<ffffffff8127e71f>] xfs_vm_writepage+0xd9/0x113
<Oct/22 02:47 pm>[7263009.786303]  [<ffffffff810b7612>] shrink_page_list+0x3c2/0x68f
<Oct/22 02:47 pm>[7263009.792674]  [<ffffffff810b8341>] shrink_zone+0x7c2/0xb86
<Oct/22 02:47 pm>[7263009.798576]  [<ffffffff81361d5e>] ? scsi_request_fn+0x39d/0x459
<Oct/22 02:47 pm>[7263009.805026]  [<ffffffff810b97c3>] do_try_to_free_pages+0x208/0x37a
<Oct/22 02:47 pm>[7263009.811753]  [<ffffffff810b9b05>] try_to_free_pages+0x71/0x78
<Oct/22 02:47 pm>[7263009.817983]  [<ffffffff810b6cc0>] ? isolate_pages_global+0x0/0x23f
<Oct/22 02:47 pm>[7263009.824669]  [<ffffffff810b3026>] __alloc_pages_nodemask+0x407/0x671
<Oct/22 02:47 pm>[7263009.831532]  [<ffffffff8127d35c>] ? xfs_get_blocks+0x0/0x14
<Oct/22 02:47 pm>[7263009.837616]  [<ffffffff810da7be>] alloc_pages_current+0x96/0x9f
<Oct/22 02:47 pm>[7263009.844064]  [<ffffffff810acb60>] __page_cache_alloc+0x59/0x5e
<Oct/22 02:47 pm>[7263009.850427]  [<ffffffff810b4860>] __do_page_cache_readahead+0xe5/0x1fc
<Oct/22 02:47 pm>[7263009.857465]  [<ffffffff810b47f6>] ? __do_page_cache_readahead+0x7b/0x1fc

<Oct/22 02:47 pm>[7263009.864701]  [<ffffffff810b4993>] ra_submit+0x1c/0x20
<Oct/22 02:47 pm>[7263009.870237]  [<ffffffff810b4cb7>] ondemand_readahead+0x243/0x256
<Oct/22 02:47 pm>[7263009.876775]  [<ffffffff810b4d47>] page_cache_async_readahead+0x7d/0xa8
<Oct/22 02:47 pm>[7263009.883856]  [<ffffffff81109d21>] __generic_file_splice_read+0x229/0x41c
<Oct/22 02:47 pm>[7263009.891102]  [<ffffffff8106433a>] ? __lock_acquire+0x995/0x9fc
<Oct/22 02:47 pm>[7263009.897418]  [<ffffffff8106433a>] ? __lock_acquire+0x995/0x9fc
<Oct/22 02:47 pm>[7263009.903780]  [<ffffffff812615b1>] ? xfs_ilock+0x49/0xb2
<Oct/22 02:47 pm>[7263009.909509]  [<ffffffff811086db>] ? spd_release_page+0x0/0x14
<Oct/22 02:47 pm>[7263009.915778]  [<ffffffff81109f57>] generic_file_splice_read+0x43/0x74
<Oct/22 02:47 pm>[7263009.922644]  [<ffffffff8128191a>] xfs_file_splice_read+0xde/0x125
<Oct/22 02:47 pm>[7263009.929273]  [<ffffffff8110875d>] vfs_splice_to+0x6e/0x81
<Oct/22 02:47 pm>[7263009.935193]  [<ffffffff81108837>] splice_direct_to_actor+0<Oct/22 02:47 pm>
                 <Oct/22 02:47 pm>[7263009.941982]  [<ffffffff811f562c>] ? nfsd_direct_splice_actor+0x0/0x12
<Oct/22 02:47 pm>[7263009.948940]  [<ffffffff811f54ef>] nfsd_vfs_read+0x263/0x3a0
<Oct/22 02:47 pm>[7263009.955023]  [<ffffffff81281760>] ? xfs_file_open+0x0/0x3f
<Oct/22 02:47 pm>[7263009.961004]  [<ffffffff811f5c4e>] nfsd_read+0xa7/0xc3
<Oct/22 02:47 pm>[7263009.966553]  [<ffffffff811fcd79>] nfsd3_proc_read+0xfe/0x142
<Oct/22 02:47 pm>[7263009.972719]  [<ffffffff811f0854>] nfsd_dispatch+0xe9/0x1ca
<Oct/22 02:47 pm>[7263009.978700]  [<ffffffff814f04c5>] svc_process+0x425/0x72a
<Oct/22 02:47 pm>[7263009.984611]  [<ffffffff811f0ccf>] ? nfsd+0x0/0x139
<Oct/22 02:47 pm>[7263009.989882]  [<ffffffff811f0dc2>] nfsd+0xf3/0x139
<Oct/22 02:47 pm>[7263009.995045]  [<ffffffff810546e2>] kthread+0x7d/0x85

<Oct/22 02:47 pm>[7263010.000437]  [<ffffffff81003794>] kernel_thread_helper+0x4/0x10
<Oct/22 02:47 pm>[7263010.006882]  [<ffffffff81054665>] ? kthread+0x0/0x85
<Oct/22 02:47 pm>[7263010.012350]  [<ffffffff81003790>] ? kernel_thread_helper+0x0/0x10
<Oct/22 02:47 pm>[7263010.018976] Pid: 8433, comm: nfsd Tainted: G      D    2.6<Oct/22 02:47 pm>
                 <Oct/22 02:47 pm>[7263010.025675] Call Trace:
<Oct/22 02:47 pm>[7263010.028590]  <NMI>  [<ffffffff81009b2a>] ? show_regs+0x26/0x2a
<Oct/22 02:47 pm>[7263010.034961]  [<ffffffff81520db8>] nmi_watchdog_tick+0xc3/0x1a5
<Oct/22 02:47 pm>[7263010.041311]  [<ffffffff81520360>] do_nmi+0xb2/0x259
<Oct/22 02:47 pm>[7263010.046669]  [<ffffffff8151fdfa>] nmi+0x1a/0x20
<Oct/22 02:47 pm>[7263010.051706]  [<ffffffff812c08af>] ? delay_tsc+0x25/0x59
<Oct/22 02:47 pm>[7263010.057406]  <<EOE>>  [<ffffffff812c093d>] __const_udelay+0x3d/0x3f
<Oct/22 02:47 pm>[7263010.064274]  [<ffffffff810197e9>] native_safe_apic_wait_icr_idle+0x31/0x48
<Oct/22 02:47 pm>[7263010.071674]  [<ffffffff81019c76>] default_send_IPI_mask_sequence_phys+0x49/0xab
<Oct/22 02:47 pm>[7263010.079699]  [<ffffffff8101c5d8>] physflat_send_IPI_all+0x14/0x16
<Oct/22 02:47 pm>[7263010.086317]  [<ffffffff81019d94>] arch_trigger_all_cpu_backtrace+0x3c/0x5d
<Oct/22 02:47 pm>[7263010.093753]  [<ffffffff812c4ea4>] do_raw_spin_lock+0x11d/0x147
<Oct/22 02:47 pm>[7263010.100102]  [<ffffffff8151f115>] _raw_spin_lock_irq+0x35/0x39
<Oct/22 02:47 pm>[7263010.106466]  [<ffffffff8151cae8>] ? schedule+0x134/0x86a
<Oct/22 02:47 pm>[7263010.112290]  [<ffffffff8151cae8>] schedule+0x134/0x86a
<Oct/22 02:47 pm>[7263010.117944]  [<ffffffff8151d35f>] schedule_timeout+0x28/0x24c
<Oct/22 02:47 pm>[7263010.124220]  [<ffffffff8151c816>] ? wait_for_common+0x26/0x138
<Oct/22 02:47 pm>[7263010.130567]  [<ffffffff8151c8b2>] wait_for_common+0xc2/0x138

<Oct/22 02:47 pm>[7263010.136738]  [<ffffffff8103688c>] ? default_wake_function+0x0/0xf
<Oct/22 02:47 pm>[7263010.143377]  [<ffffffff81280d3e>] ? _xfs_buf_read+0x3f/0x4<Oct/22 02:47 pm>
                 <Oct/22 02:47 pm>[7263010.149461]  [<ffffffff81277887>] ? xfs_trans_read_buf+0x238/0x396
<Oct/22 02:47 pm>[7263010.156179]  [<ffffffff8151c9b2>] wait_for_completion+0x18/0x1a
<Oct/22 02:47 pm>[7263010.162628]  [<ffffffff8127f236>] xfs_buf_iowait+0x7e/0xba
<Oct/22 02:47 pm>[7263010.168642]  [<ffffffff81280d3e>] _xfs_buf_read+0x3f/0x44
<Oct/22 02:47 pm>[7263010.174557]  [<ffffffff81281374>] xfs_buf_read+0x8a/0xc6
<Oct/22 02:47 pm>[7263010.180364]  [<ffffffff81277887>] xfs_trans_read_buf+0x238/0x396
<Oct/22 02:47 pm>[7263010.186886]  [<ffffffff8124e176>] xfs_btree_read_buf_block+0x4d/0x91
<Oct/22 02:47 pm>[7263010.193767]  [<ffffffff8124f1dc>] xfs_btree_lookup_get_block+0x88/0xae
<Oct/22 02:47 pm>[7263010.200820]  [<ffffffff8124f7ca>] xfs_btree_lookup+0x138/0x3dc
<Oct/22 02:47 pm>[7263010.207197]  [<ffffffff81239f17>] xfs_alloc_lookup_eq+0x14/0x16
<Oct/22 02:47 pm>[7263010.213648]  [<ffffffff8123a00f>] xfs_alloc_fixup_trees+0x71/0x27d
<Oct/22 02:47 pm>[7263010.220375]  [<ffffffff8123cd84>] ? xfs_allocbt_init_cursor+0x38/0x96
<Oct/22 02:47 pm>[7263010.227333]  [<ffffffff8123b707>] xfs_alloc_ag_vextent_size+0x37d/0x4c1
<Oct/22 02:47 pm>[7263010.234441]  [<ffffffff8123c2a2>] xfs_alloc_ag_vextent+0x27/0xf5
<Oct/22 02:47 pm>[7263010.240945]  [<ffffffff8123cb1b>] xfs_alloc_vextent+0x318/0x4ad
<Oct/22 02:47 pm>[7263010.247397]  [<ffffffff812488c1>] xfs_bmap_btalloc+0x3c2/0x576
<Oct/22 02:47 pm>[7263010.253758]  [<ffffffff81248a98>] xfs_bmap_alloc+0x23/0x25
<Oct/22 02:47 pm>[7263010.259729]  [<ffffffff8124add5>] xfs_bmapi+0x7b5/0xe73
<Oct/22 02:47 pm>[7263010.265468]  [<ffffffff8126c831>] ? xlog_grant_log_space+0x26/0x484
<Oct/22 02:47 pm>[7263010.272232]  [<ffffffff8105861d>] ? down_write_nested+0x2a/0x4a

<Oct/22 02:47 pm>[7263010.278672]  [<ffffffff81267363>] xfs_iomap_write_allocate+0x227/0x353
<Oct/22 02:47 pm>[7263010.285726]  [<ffffffff81267eac>] xfs_iomap+0x318/0x39c
<Oct/22 02:47 pm>[7263010.291453]  [<ffffffff810dce68>] ? add_partial+0x61/0x6a
<Oct/22 02:47 pm>[7263010.297367]  [<ffffffff8127d1e5>] xfs_map_blocks+0x27/0x2b
<Oct/22 02:47 pm>[7263010.303358]  [<ffffffff8127e160>] xfs_page_state_convert+0x2d8/0x5b2
<Oct/22 02:47 pm>[7263010.310260]  [<ffffffff8127e71f>] xfs_vm_writepage+0xd9/0x113
<Oct/22 02:47 pm>[7263010.320991]  [<ffffffff810b7612>] shrink_page_list+0x3c2/0x68f
<Oct/22 02:47 pm>[7263010.327347]  [<ffffffff810b8341>] shrink_zone+0x7c2/0xb86
<Oct/22 02:47 pm>[7263010.333257]  [<ffffffff81361d5e>] ? scsi_request_fn+0x39d/0x459
<Oct/22 02:47 pm>[7263010.339674]  [<ffffffff810b97c3>] do_try_to_free_pages+0x208/0x37a
<Oct/22 02:47 pm>[7263010.346400]  [<ffffffff810b9b05>] try_to_free_pages+0x71/0x78
<Oct/22 02:47 pm>[7263010.352659]  [<ffffffff810b6cc0>] ? isolate_pages_global+0x0/0x23f
<Oct/22 02:47 pm>[7263010.359360]  [<ffffffff810b3026>] __alloc_pages_nodemask+0x407/0x671
<Oct/22 02:47 pm>[7263010.366222]  [<ffffffff8127d35c>] ? xfs_get_blocks+0x0/0x14
<Oct/22 02:47 pm>[7263010.372272]  [<ffffffff810da7be>] alloc_pages_current+0x96/0x9f
<Oct/22 02:47 pm>[7263010.378731]  [<ffffffff810acb60>] __page_cache_alloc+0x59/0x5e
<Oct/22 02:47 pm>[7263010.385102]  [<ffffffff810b4860>] __do_page_cache_readahead+0xe5/0x1fc
<Oct/22 02:47 pm>[7263010.392156]  [<ffffffff810b47f6>] ? __do_page_cache_readahead+0x7b/0x1fc
<Oct/22 02:47 pm>[7263010.399359]  [<ffffffff810b4993>] ra_submit+0x1c/0x20
<Oct/22 02:47 pm>[7263010.404910]  [<ffffffff810b4cb7>] ondemand_readahead+0x243/0x256
<Oct/22 02:47 pm>[7263010.411459]  [<ffffffff810b4d47>] page_cache_async_readahead+0x7d/0xa8
<Oct/22 02:47 pm>[7263010.418479]  [<ffffffff81109d21>] __generic_file_splice_read+0x229/0x41c

<Oct/22 02:47 pm>[7263010.425698]  [<ffffffff8106433a>] ? __lock_acquire+0x995/0x9fc
<Oct/22 02:47 pm>[7263010.432040]  [<ffffffff8106433a>] ? __lock_acquire+0x995/0x9fc
<Oct/22 02:47 pm>[7263010.438400]  [<ffffffff812615b1>] ? xfs_ilock+0x49/0xb2
<Oct/22 02:47 pm>[7263010.444155]  [<ffffffff811086db>] ? spd_release_page+0x0/0x14
<Oct/22 02:47 pm>[7263010.450452]  [<ffffffff81109f57>] generic_file_splice_read+0x43/0x74
<Oct/22 02:47 pm>[7263010.457342]  [<ffffffff8128191a>] xfs_file_splice_read+0xde/0x125
<Oct/22 02:47 pm>[7263010.463955]  [<ffffffff8110875d>] vfs_splice_to+0x6e/0x81
<Oct/22 02:47 pm>[7263010.469821]  [<ffffffff81108837>] splice_direct_to_actor+0<Oct/22 02:47 pm>
                 <Oct/22 02:47 pm>[7263010.476611]  [<ffffffff811f562c>] ? nfsd_direct_splice_actor+0x0/0x12
<Oct/22 02:47 pm>[7263010.483589]  [<ffffffff811f54ef>] nfsd_vfs_read+0x263/0x3a0
<Oct/22 02:47 pm>[7263010.489662]  [<ffffffff81281760>] ? xfs_file_open+0x0/0x3f
<Oct/22 02:47 pm>[7263010.495695]  [<ffffffff811f5c4e>] nfsd_read+0xa7/0xc3
<Oct/22 02:47 pm>[7263010.501244]  [<ffffffff811fcd79>] nfsd3_proc_read+0xfe/0x142
<Oct/22 02:47 pm>[7263010.507426]  [<ffffffff811f0854>] nfsd_dispatch+0xe9/0x1ca
<Oct/22 02:47 pm>[7263010.513443]  [<ffffffff814f04c5>] svc_process+0x425/0x72a
<Oct/22 02:47 pm>[7263010.519371]  [<ffffffff811f0ccf>] ? nfsd+0x0/0x139
<Oct/22 02:47 pm>[7263010.524625]  [<ffffffff811f0dc2>] nfsd+0xf3/0x139
<Oct/22 02:47 pm>[7263010.529819]  [<ffffffff810546e2>] kthread+0x7d/0x85
<Oct/22 02:47 pm>[7263010.535207]  [<ffffffff81003794>] kernel_thread_helper+0x4/0x10
<Oct/22 02:47 pm>[7263010.541633]  [<ffffffff81054665>] ? kthread+0x0/0x85
<Oct/22 02:47 pm>[7263010.547112]  [<ffffffff81003790>] ? kernel_thread_helper+0x0/0x10
<Oct/22 02:47 pm>[7263010.553752] NMI backtrace for cpu 7

<Oct/22 02:47 pm>[7263010.557720] CPU 7 
<Oct/22 02:47 pm>[7263010.559825] Modules linked in: w83793 hwmon_vid autofs4 i2c_i801 i2c_core iTCO_wdt e1000e ioatdma dca rtc_cmos tg3 libphy e1000 fuse dm_snapshot dm_mirror dm_region_hash dm_log scsi_wait_scan qla2xxx megaraid_sas megaraid_mbox megaraid_mm aacraid 3w_9xxx 3w_xxxx arcmsr aic7xxx aic79xx sr_mod sg ata_piix ahci sata_sis sata_nv sata_via pata_sl82c105 pata_sis
<Oct/22 02:47 pm>[7263010.595544] 
<Oct/22 02:47 pm>[7263010.597461] Pid: 8491, comm: nfsd Tainted: G      D    2.6.34.4 #3 S7010/empty
<Oct/22 02:47 pm>[7263010.605398] RIP: 0010:[<ffffffff812c08a2>]  [<ffffffff812c08a2>] delay_tsc+0x18/0x59
<Oct/22 02:47 pm>[7263010.613952] RSP: 0018:ffff880655223dd0  EFLAGS: 00000082
<Oct/22 02:47 pm>[7263010.619759] RAX: 0000000098b94c7c RBX: 0000000065fe0b75 RCX: 0000000098b94c38
<Oct/22 02:47 pm>[7263010.627630] RDX: 000000000044fd5b RSI: 0000000000000007 RDI: 0000000000000001
<Oct/22 02:47 pm>[7263010.635455] RBP: ffff880655223dd8 R08: 0000000000000007 R09: 0000000000000007
<Oct/22 02:47 pm>[7263010.643320] R10: 0000000000000000 R11: ffff880655223c08 R12: ffff880655233c00
<Oct/22 02:47 pm>[7263010.651187] R13: 0000000000000000 R14: ffff88061d4740c0 R15: ffff88061d474548
<Oct/22 02:47 pm>[7263010.659046] FS:  0000000000000000(0000) GS:ffff880655220000(0000) knlGS:0000000000000000
<Oct/22 02:47 pm>[7263010.667839] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
<Oct/22 02:47 pm>[7263010.674127] CR2: 000000006bec3d80 CR3: 0000000623613000 CR4: 00000000000006e0
<Oct/22 02:47 pm>[7263010.681977] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
<Oct/22 02:47 pm>[7263010.689837] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
<Oct/22 02:47 pm>[7263010.697659] Process nfsd (pid: 8491, threadinfo ffff88061d092000, task ffff88061d4740c0)
<Oct/22 02:47 pm>[7263010.706472] Stack:
<Oct/22 02:47 pm>[7263010.708932]  ffffffff81019da9 ffff880655223de8 ffffffff812c08fe ffff880655223e28
<Oct/22 02:47 pm>[7263010.716803] <0> ffffffff812c4e65 000000009ef2fcf8 ffff880655233c00 ffff8800705f6120
<Oct/22 02:47 pm>[7263010.725438] <0> 0000000000013c00 ffff880655223e98 0000000000000007 ffff880655223e48
<Oct/22 02:47 pm>[7263010.734487] Call Trace:

<Oct/22 02:47 pm>[7263010.737355]  <IRQ> 
<Oct/22 02:47 pm>[7263010.739925]  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
<Oct/22 02:47 pm>[7263010.747667]  [<ffffffff812c08fe>] __delay+0xa/0xc
<Oct/22 02:47 pm>[7263010.752847]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
<Oct/22 02:47 pm>[7263010.759119]  [<ffffffff8151f193>] _raw_spin_lock+0x34/0x39
<Oct/22 02:47 pm>[7263010.765133]  [<ffffffff8102fb6b>] ? task_rq_lock+0x7e/0x9a
<Oct/22 02:47 pm>[7263010.771123]  [<ffffffff8102fb6b>] task_rq_lock+0x7e/0x9a
<Oct/22 02:47 pm>[7263010.776967]  [<ffffffff81057842>] ? hrtimer_wakeup+0x0/0x21
<Oct/22 02:47 pm>[7263010.783045]  [<ffffffff81036578>] try_to_wake_up+0x2e/0x342
<Oct/22 02:47 pm>[7263010.789164]  [<ffffffff81057842>] ? hrtimer_wakeup+0x0/0x21
<Oct/22 02:47 pm>[7263010.795232]  [<ffffffff810368b8>] wake_up_process+0x10/0x12
<Oct/22 02:47 pm>[7263010.801294]  [<ffffffff8105785f>] hrtimer_wakeup+0x1d/0x21
<Oct/22 02:47 pm>[7263010.807282]  [<ffffffff81057933>] __run_hrtimer+0xd0/0x12d
<Oct/22 02:47 pm>[7263010.813265]  [<ffffffff81057b81>] hrtimer_interrupt+0xb5/0x19f
<Oct/22 02:47 pm>[7263010.819621]  [<ffffffff810197a5>] smp_apic_timer_interrupt+0x82/0x95
<Oct/22 02:47 pm>[7263010.826502]  [<ffffffff81003353>] apic_timer_interrupt+0x13/0x20
<Oct/22 02:47 pm>[7263010.833018]  <EOI> 
<Oct/22 02:47 pm>[7263010.835200] Code: 2e 0f 1f 84 00 00 00 00 00 48 ff c8 75 fb 48 ff c8 c9 c3 55 48 89 e5 48 83 ec 08 65 8b 34 25 f0 d1 00 00 66 66 90 0f ae e8 0f 31 <89> c1 41 89 f1 66 66 90 0f ae e8 0f 31 89 c6 48 89 f0 48 29 c8 
<Oct/22 02:47 pm>[7263010.858818] Call Trace:
<Oct/22 02:47 pm>[7263010.861689]  <IRQ>  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
<Oct/22 02:47 pm>[7263010.870085]  [<ffffffff812c08fe>] __delay+0xa/0xc
<Oct/22 02:47 pm>[7263010.875294]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147

<Oct/22 02:47 pm>[7263010.881548]  [<ffffffff8151f193>] _raw_spin_lock+0x34/0x39
<Oct/22 02:47 pm>[7263010.887555]  [<ffffffff8102fb6b>] ? task_rq_lock+0x7e/0x9a
<Oct/22 02:47 pm>[7263010.893555]  [<ffffffff8102fb6b>] task_rq_lock+0x7e/0x9a
<Oct/22 02:47 pm>[7263010.899371]  [<ffffffff81057842>] ? hrtimer_wakeup+0x0/0x21
<Oct/22 02:47 pm>[7263010.905449]  [<ffffffff81036578>] try_to_wake_up+0x2e/0x342
<Oct/22 02:47 pm>[7263010.911535]  [<ffffffff81057842>] ? hrtimer_wakeup+0x0/0x21
<Oct/22 02:47 pm>[7263010.917646]  [<ffffffff810368b8>] wake_up_process+0x10/0x12
<Oct/22 02:47 pm>[7263010.923706]  [<ffffffff8105785f>] hrtimer_wakeup+0x1d/0x21
<Oct/22 02:47 pm>[7263010.929679]  [<ffffffff81057933>] __run_hrtimer+0xd0/0x12d
<Oct/22 02:47 pm>[7263010.935688]  [<ffffffff81057b81>] hrtimer_interrupt+0xb5/0x19f
<Oct/22 02:47 pm>[7263010.942042]  [<ffffffff810197a5>] smp_apic_timer_interrupt+0x82/0x95
<Oct/22 02:47 pm>[7263010.948909]  [<ffffffff81003353>] apic_timer_interrupt+0x13/0x20
<Oct/22 02:47 pm>[7263010.955432]  <EOI> Pid: 8491, comm: nfsd Tainted: G      D    2.6.34.4 #3
<Oct/22 02:47 pm>[7263010.962785] Call Trace:
<Oct/22 02:47 pm>[7263010.965646]  <NMI>  [<ffffffff81009b2a>] ? show_regs+0x26/0x2a
<Oct/22 02:47 pm>[7263010.972048]  [<ffffffff81520db8>] nmi_watchdog_tick+0xc3/0x1a5
<Oct/22 02:47 pm>[7263010.978392]  [<ffffffff81520360>] do_nmi+0xb2/0x259
<Oct/22 02:47 pm>[7263010.983765]  [<ffffffff8151fdfa>] nmi+0x1a/0x20
<Oct/22 02:47 pm>[7263010.988768]  [<ffffffff812c08a2>] ? delay_tsc+0x18/0x59
<Oct/22 02:47 pm>[7263010.994485]  <<EOE>>  <IRQ>  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
<Oct/22 02:47 pm>[7263011.003780]  [<ffffffff812c08fe>] __delay+0xa/0xc
<Oct/22 02:47 pm>[7263011.008980]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147

<Oct/22 02:47 pm>[7263011.015244]  [<ffffffff8151f193>] _raw_spin_lock+0x34/0x39
<Oct/22 02:47 pm>[7263011.021257]  [<ffffffff8102fb6b>] ? task_rq_lock+0x7e/0x9a
<Oct/22 02:47 pm>[7263011.027239]  [<ffffffff8102fb6b>] task_rq_lock+0x7e/0x9a
<Oct/22 02:47 pm>[7263011.033029]  [<ffffffff81057842>] ? hrtimer_wakeup+0x0/0x21
<Oct/22 02:47 pm>[7263011.039099]  [<ffffffff81036578>] try_to_wake_up+0x2e/0x342
<Oct/22 02:47 pm>[7263011.045185]  [<ffffffff81057842>] ? hrtimer_wakeup+0x0/0x21
<Oct/22 02:47 pm>[7263011.051263]  [<ffffffff810368b8>] wake_up_process+0x10/0x12
<Oct/22 02:47 pm>[7263011.057341]  [<ffffffff8105785f>] hrtimer_wakeup+0x1d/0x21
<Oct/22 02:47 pm>[7263011.063348]  [<ffffffff81057933>] __run_hrtimer+0xd0/0x12d
<Oct/22 02:47 pm>[7263011.069346]  [<ffffffff81057b81>] hrtimer_interrupt+0xb5/0x19f
<Oct/22 02:47 pm>[7263011.075666]  [<ffffffff810197a5>] smp_apic_timer_interrupt+0x82/0x95
<Oct/22 02:47 pm>[7263011.082559]  [<ffffffff81003353>] apic_timer_interrupt+0x13/0x20
<Oct/22 02:47 pm>[7263011.089075]  <EOI> 
<Oct/22 02:47 pm>[7263011.091266] NMI backtrace for cpu 9
<Oct/22 02:47 pm>[7263011.095619] CPU 9 
<Oct/22 02:47 pm>[7263011.097722] Modules linked in: w83793 hwmon_vid autofs4 i2c_i801 i2c_core iTCO_wdt e1000e ioatdma dca rtc_cmos tg3 libphy e1000 fuse dm_snapshot dm_mirror dm_region_hash dm_log scsi_wait_scan qla2xxx megaraid_sas megaraid_mbox megaraid_mm aacraid 3w_9xxx 3w_xxxx arcmsr aic7xxx aic79xx sr_mod sg ata_piix ahci sata_sis sata_nv sata_via pata_sl82c105 pata_sis
<Oct/22 02:47 pm>[7263011.133364] 
<Oct/22 02:47 pm>[7263011.135281] Pid: 24034, comm: ppImage Tainted: G      D    2.6.34.4 #3 S7010/empty
<Oct/22 02:47 pm>[7263011.143567] RIP: 0010:[<ffffffff812c08af>]  [<ffffffff812c08af>] delay_tsc+0x25/0x59
<Oct/22 02:47 pm>[7263011.152116] RSP: 0018:ffff8806a22f9ac0  EFLAGS: 00000086
<Oct/22 02:47 pm>[7263011.157906] RAX: 0000000098c1724c RBX: 0000000069c8a576 RCX: 0000000098c1722c
<Oct/22 02:47 pm>[7263011.165736] RDX: 000000000044fd5b RSI: 0000000000000009 RDI: 0000000000000001

<Oct/22 02:47 pm>[7263011.173612] RBP: ffff8806a22f9ac8 R08: 0000000000000009 R09: 0000000000000009
<Oct/22 02:47 pm>[7263011.181458] R10: 0000000000000014 R11: ffff8806a22f98f8 R12: ffff880655213c00
<Oct/22 02:47 pm>[7263011.189337] R13: 0000000000000000 R14: ffff88006fd32060 R15: ffff88006fd324e8
<Oct/22 02:47 pm>[7263011.197184] FS:  000000004295f950(0063) GS:ffff880655260000(0000) knlGS:0000000000000000
<Oct/22 02:47 pm>[7263011.205990] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<Oct/22 02:47 pm>[7263011.212231] CR2: 00007f549d296048 CR3: 0000000258458000 CR4: 00000000000006e0
<Oct/22 02:47 pm>[7263011.220093] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
<Oct/22 02:47 pm>[7263011.227943] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
<Oct/22 02:47 pm>[7263011.235817] Process ppImage (pid: 24034, threadinfo ffff8806a22f8000, task ffff88006fd32060)
<Oct/22 02:47 pm>[7263011.244993] Stack:
<Oct/22 02:47 pm>[7263011.247451]  ffffffff81019da9 ffff8806a22f9ad8 ffffffff812c08fe ffff8806a22f9b18
<Oct/22 02:47 pm>[7263011.255351] <0> ffffffff812c4e65 000000009ef2fcf8 ffff880655213c00 ffff880655213c00
<Oct/22 02:47 pm>[7263011.264012] <0> ffff88065526e3f0 0000000000000400 0000000000000800 ffff8806a22f9b38
<Oct/22 02:47 pm>[7263011.277536] Call Trace:
<Oct/22 02:47 pm>[7263011.280399]  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
<Oct/22 02:47 pm>[7263011.288167]  [<ffffffff812c08fe>] __delay+0xa/0xc
<Oct/22 02:47 pm>[7263011.293338]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
<Oct/22 02:47 pm>[7263011.299592]  [<ffffffff8151f193>] _raw_spin_lock+0x34/0x39
<Oct/22 02:47 pm>[7263011.305556]  [<ffffffff81035927>] ? double_rq_lock+0x3d/0x76
<Oct/22 02:47 pm>[7263011.311709]  [<ffffffff81035927>] double_rq_lock+0x3d/0x76
<Oct/22 02:47 pm>[7263011.317727]  [<ffffffff81037672>] load_balance+0xbb6/0xf63
<Oct/22 02:47 pm>[7263011.323724]  [<ffffffff8151f67a>] ? _raw_spin_unlock+0x26/0x2b

<Oct/22 02:47 pm>[7263011.330081]  [<ffffffff81066237>] ? futex_wait_setup+0xac/0x14d
<Oct/22 02:47 pm>[7263011.336563]  [<ffffffff810662c6>] ? futex_wait_setup+0x13b/0x14d
<Oct/22 02:47 pm>[7263011.343107]  [<ffffffff8151cc0e>] schedule+0x25a/0x86a
<Oct/22 02:47 pm>[7263011.348741]  [<ffffffff8151e357>] do_nanosleep+0x73/0xb3
<Oct/22 02:47 pm>[7263011.354551]  [<ffffffff810348d8>] ? finish_task_switch+0x69/0xdd
<Oct/22 02:47 pm>[7263011.361046]  [<ffffffff8103486f>] ? finish_task_switch+0x0/0xdd
<Oct/22 02:47 pm>[7263011.367485]  [<ffffffff81058477>] hrtimer_nanosleep+0x97/0x105
<Oct/22 02:47 pm>[7263011.373847]  [<ffffffff81057842>] ? hrtimer_wakeup+0x0/0x21
<Oct/22 02:47 pm>[7263011.379932]  [<ffffffff810583de>] ? hrtimer_start_range_ns<Oct/22 02:47 pm>
                 <Oct/22 02:47 pm>[7263011.386720]  [<ffffffff81058539>] sys_nanosleep+0x54/0x6c
<Oct/22 02:47 pm>[7263011.392602]  [<ffffffff810029ab>] system_call_fastpath+0x16/0x1b
<Oct/22 02:47 pm>[7263011.399140] Code: fb 48 ff c8 c9 c3 55 48 89 e5 48 83 ec 08 65 8b 34 25 f0 d1 00 00 66 66 90 0f ae e8 0f 31 89 c1 41 89 f1 66 66 90 0f ae <Oct/22 02:47 pm>48 89 f0 48 29 c8 48 39 f8 73 25 f3 90 65 44 8b 04 25 f0 
                 <Oct/22 02:47 pm>[7263011.422382] Call Trace:
<Oct/22 02:47 pm>[7263011.425269]  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
<Oct/22 02:47 pm>[7263011.433029]  [<ffffffff812c08fe>] __delay+0xa/0xc
<Oct/22 02:47 pm>[7263011.438236]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
<Oct/22 02:47 pm>[7263011.444489]  [<ffffffff8151f193>] _raw_spin_lock+0x34/0x39
<Oct/22 02:47 pm>[7263011.450479]  [<ffffffff81035927>] ? double_rq_lock+0x3d/0x76
<Oct/22 02:47 pm>[7263011.456642]  [<ffffffff81035927>] double_rq_lock+0x3d/0x76
<Oct/22 02:47 pm>[7263011.462625]  [<ffffffff81037672>] load_balance+0xbb6/0xf63
<Oct/22 02:47 pm>[7263011.468595]  [<ffffffff8151f67a>] ? _raw_spin_unlock+0x26/0x2b
<Oct/22 02:47 pm>[7263011.474925]  [<ffffffff81066237>] ? futex_wait_setup+0xac/0x14d

<Oct/22 02:47 pm>[7263011.481392]  [<ffffffff810662c6>] ? futex_wait_setup+0x13b/0x14d
<Oct/22 02:47 pm>[7263011.487945]  [<ffffffff8151cc0e>] schedule+0x25a/0x86a
<Oct/22 02:47 pm>[7263011.493587]  [<ffffffff8151e357>] do_nanosleep+0x73/0xb3
<Oct/22 02:47 pm>[7263011.499397]  [<ffffffff810348d8>] ? finish_task_switch+0x69/0xdd
<Oct/22 02:47 pm>[7263011.505927]  [<ffffffff8103486f>] ? finish_task_switch+0x0/0xdd
<Oct/22 02:47 pm>[7263011.512375]  [<ffffffff81058477>] hrtimer_nanosleep+0x97/0x105
<Oct/22 02:47 pm>[7263011.518702]  [<ffffffff81057842>] ? hrtimer_wakeup+0x0/0x21
<Oct/22 02:47 pm>[7263011.524796]  [<ffffffff810583de>] ? hrtimer_start_range_ns+0xf/0x11
<Oct/22 02:47 pm>[7263011.531557]  [<ffffffff81058539>] sys_nanosleep+0x54/0x6c
<Oct/22 02:47 pm>[7263011.537484]  [<ffffffff810029ab>] system_call_fastpath+0x16/0x1b
<Oct/22 02:47 pm>[7263011.543996] Pid: 24034, comm: ppImage Tainted: G      D    2.6.34.4 #3
<Oct/22 02:47 pm>[7263011.551059] Call Trace:
<Oct/22 02:47 pm>[7263011.553965]  <NMI>  [<ffffffff81009b2a>] ? show_regs+0x26/0x2a
<Oct/22 02:47 pm>[7263011.560387]  [<ffffffff81520db8>] nmi_watchdog_tick+0xc3/0x1a5
<Oct/22 02:47 pm>[7263011.566747]  [<ffffffff81520360>] do_nmi+0xb2/0x259
<Oct/22 02:47 pm>[7263011.572111]  [<ffffffff8151fdfa>] nmi+0x1a/0x20
<Oct/22 02:47 pm>[7263011.577125]  [<ffffffff812c08af>] ? delay_tsc+0x25/0x59
<Oct/22 02:47 pm>[7263011.582848]  <<EOE>>  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
<Oct/22 02:47 pm>[7263011.591443]  [<ffffffff812c08fe>] __delay+0xa/0xc
<Oct/22 02:47 pm>[7263011.596618]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
<Oct/22 02:47 pm>[7263011.602865]  [<ffffffff8151f193>] _raw_spin_lock+0x34/0x39
<Oct/22 02:47 pm>[7263011.608869]  [<ffffffff81035927>] ? double_rq_lock+0x3d/0x76

<Oct/22 02:47 pm>[7263011.615026]  [<ffffffff81035927>] double_rq_lock+0x3d/0x76
<Oct/22 02:47 pm>[7263011.621050]  [<ffffffff81037672>] load_balance+0xbb6/0xf63
<Oct/22 02:47 pm>[7263011.627033]  [<ffffffff8151f67a>] ? _raw_spin_unlock+0x26/0x2b
<Oct/22 02:47 pm>[7263011.633371]  [<ffffffff81066237>] ? futex_wait_setup+0xac/0x14d
<Oct/22 02:47 pm>[7263011.639820]  [<ffffffff810662c6>] ? futex_wait_setup+0x13b/0x14d
<Oct/22 02:47 pm>[7263011.646364]  [<ffffffff8151cc0e>] schedule+0x25a/0x86a
<Oct/22 02:47 pm>[7263011.652005]  [<ffffffff8151e357>] do_nanosleep+0x73/0xb3
<Oct/22 02:47 pm>[7263011.657806]  [<ffffffff810348d8>] ? finish_task_switch+0x69/0xdd
<Oct/22 02:47 pm>[7263011.664309]  [<ffffffff8103486f>] ? finish_task_switch+0x0/0xdd
<Oct/22 02:47 pm>[7263011.670764]  [<ffffffff81058477>] hrtimer_nanosleep+0x97/0x105
<Oct/22 02:47 pm>[7263011.677101]  [<ffffffff81057842>] ? hrtimer_wakeup+0x0/0x21
<Oct/22 02:47 pm>[7263011.683194]  [<ffffffff810583de>] ? hrtimer_start_range_ns+0xf/0x11
<Oct/22 02:47 pm>[7263011.689975]  [<ffffffff81058539>] sys_nanosleep+0x54/0x6c
<Oct/22 02:47 pm>[7263011.695866]  [<ffffffff810029ab>] system_call_fastpath+0x16/0x1b
<Oct/22 02:47 pm>[7263011.702395] NMI backtrace for cpu 8
<Oct/22 02:47 pm>[7263011.706371] CPU 8 
<Oct/22 02:47 pm>[7263011.708459] Modules linked in: w83793 hwmon_vid autofs4 i2c_i801 i2c_core iTCO_wdt e1000e ioatdma dca rtc_cmos tg3 libphy e1000 fuse dm_snapshot dm_mirror dm_region_hash dm_log scsi_wait_scan qla2xxx megaraid_sas megaraid_mbox megaraid_mm aacraid 3w_9xxx 3w_xxxx arcmsr aic7xxx aic79xx sr_mod sg ata_piix ahci sata_sis sata_nv sata_via pata_sl82c105 pata_sis
<Oct/22 02:47 pm>[7263011.744100] 
<Oct/22 02:47 pm>[7263011.746024] Pid: 23583, comm: ppStack Tainted: G      D    2.6.34.4 #3 S7010/empty
<Oct/22 02:47 pm>[7263011.754327] RIP: 0010:[<ffffffff812c08af>]  [<ffffffff812c08af>] delay_tsc+0x25/0x59
<Oct/22 02:47 pm>[7263011.762854] RSP: 0018:ffff880205da1420  EFLAGS: 00000082
<Oct/22 02:47 pm>[7263011.768687] RAX: 0000000098bd5fd0 RBX: 000000006a1b7491 RCX: 0000000098bd5fb4

<Oct/22 02:47 pm>[7263011.776559] RDX: 000000000044fd5b RSI: 0000000000000008 RDI: 0000000000000001
<Oct/22 02:47 pm>[7263011.784426] RBP: ffff880205da1428 R08: 0000000000000008 R09: 0000000000000008
<Oct/22 02:47 pm>[7263011.792276] R10: 0000000000000000 R11: ffff880205da1258 R12: ffff8806400216c0
<Oct/22 02:47 pm>[7263011.800116] R13: 0000000000000000 R14: ffff8800704fa060 R15: ffff8800704fa4e8
<Oct/22 02:47 pm>[7263011.807946] FS:  00007fa62fab06f0(0000) GS:ffff880655240000(0000) knlGS:0000000000000000
<Oct/22 02:47 pm>[7263011.816802] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<Oct/22 02:47 pm>[7263011.823071] CR2: 00007fa5f5d6d000 CR3: 00000001e8eff000 CR4: 00000000000006e0
<Oct/22 02:47 pm>[7263011.830940] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
<Oct/22 02:47 pm>[7263011.838798] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
<Oct/22 02:47 pm>[7263011.846656] Process ppStack (pid: 23583, threadinfo ffff880205da0000, task ffff8800704fa060)
<Oct/22 02:47 pm>[7263011.855841] Stack:
<Oct/22 02:47 pm>[7263011.858291]  ffffffff81019da9 ffff880205da1438 ffffffff812c08fe ffff880205da1478
<Oct/22 02:47 pm>[7263011.866234] <0> ffffffff812c4e65 000000009ef2fcf8 ffff8806400216c0 0000000000000286
<Oct/22 02:47 pm>[7263011.874860] <0> 0000000000000001 ffff8809999c4388 0000000000000003 ffff880205da14a8
<Oct/22 02:47 pm>[7263011.883907] Call Trace:
<Oct/22 02:47 pm>[7263011.886787]  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
<Oct/22 02:47 pm>[7263011.894564]  [<ffffffff812c08fe>] __delay+0xa/0xc
<Oct/22 02:47 pm>[7263011.899750]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
<Oct/22 02:47 pm>[7263011.906024]  [<ffffffff8151f153>] _raw_spin_lock_irqsave+0x3a/0x46
<Oct/22 02:47 pm>[7263011.912731]  [<ffffffff8102fa90>] ? __wake_up+0x22/0x4f
<Oct/22 02:47 pm>[7263011.918460]  [<ffffffff8102fa90>] __wake_up+0x22/0x4f
<Oct/22 02:47 pm>[7263011.923992]  [<ffffffff81054b47>] __wake_up_bit+0x2c/0x2e

<Oct/22 02:47 pm>[7263011.929897]  [<ffffffff810ac9a9>] unlock_page+0x22/0x26
<Oct/22 02:47 pm>[7263011.935636]  [<ffffffff8127e73f>] xfs_vm_writepage+0xf9/0x113
<Oct/22 02:47 pm>[7263011.941887]  [<ffffffff810b7612>] shrink_page_list+0x3c2/0x68f
<Oct/22 02:47 pm>[7263011.948251]  [<ffffffff810b8341>] shrink_zone+0x7c2/0xb86
<Oct/22 02:47 pm>[7263011.954189]  [<ffffffff810b97c3>] do_try_to_free_pages+0x2<Oct/22 02:47 pm>
                 <Oct/22 02:47 pm>[7263011.960865]  [<ffffffff810b9b05>] try_to_free_pages+0x71/0x78
<Oct/22 02:47 pm>[7263011.967147]  [<ffffffff810b6cc0>] ? isolate_pages_global+0x0/0x23f
<Oct/22 02:47 pm>[7263011.973848]  [<ffffffff810b3026>] __alloc_pages_nodemask+0x407/0x671
<Oct/22 02:47 pm>[7263011.980766]  [<ffffffff810da7be>] alloc_pages_current+0x96/0x9f
<Oct/22 02:47 pm>[7263011.987220]  [<ffffffff810acb60>] __page_cache_alloc+0x59/0x5e
<Oct/22 02:47 pm>[7263011.993590]  [<ffffffff810acd29>] grab_cache_page_write_begin+0x5c/0xa2
<Oct/22 02:47 pm>[7263012.000718]  [<ffffffff8110d6cd>] block_write_begin+0x3d/0xcf
<Oct/22 02:47 pm>[7263012.006964]  [<ffffffff8127e5c5>] xfs_vm_write_begin+0x25/0x27
<Oct/22 02:47 pm>[7263012.013335]  [<ffffffff8127d35c>] ? xfs_get_blocks+0x0/0x14
<Oct/22 02:47 pm>[7263012.019411]  [<ffffffff810abd26>] generic_file_buffered_write+0x10f/0x233
<Oct/22 02:47 pm>[7263012.026744]  [<ffffffff81288c5e>] ? xfs_xattr_get+0x37/0x40
<Oct/22 02:47 pm>[7263012.032802]  [<ffffffff81282920>] xfs_file_aio_write+0x5be<Oct/22 02:47 pm>
                 <Oct/22 02:47 pm>[7263012.039313]  [<ffffffff8151f67a>] ? _raw_spin_unlock+0x26/0x2b
<Oct/22 02:47 pm>[7263012.045674]  [<ffffffff810ea282>] do_sync_write+0xc7/0x10d
<Oct/22 02:47 pm>[7263012.051655]  [<ffffffff8106433a>] ? __lock_acquire+0x995/0x9fc
<Oct/22 02:47 pm>[7263012.058009]  [<ffffffff810eb427>] ? fget_light+0x4f/0xfb
<Oct/22 02:47 pm>[7263012.063834]  [<ffffffff812937db>] ? security_file_permission+0x11/0x13

<Oct/22 02:47 pm>[7263012.070873]  [<ffffffff810eaba1>] vfs_write+0xae/0x14a
<Oct/22 02:47 pm>[7263012.076549]  [<ffffffff810ead01>] sys_write+0x47/0x6e
<Oct/22 02:47 pm>[7263012.082099]  [<ffffffff810029ab>] system_call_fastpath+0x16/0x1b
<Oct/22 02:47 pm>[7263012.088637] Code: fb 48 ff c8 c9 c3 55 48 89 e5 48 83 ec 08 65 8b 34 25 f0 d1 00 00 66 66 90 0f ae e8 0f 31 89 c1 41 89 f1 66 66 90 0f ae e8 0f 31 <89> c6 48 89 f0 48 29 c8 48 39 f8 73 25 f3 90 65 44 8b 04 25 f0 
<Oct/22 02:47 pm>[7263012.111842] Call Trace:
<Oct/22 02:47 pm>[7263012.114738]  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
<Oct/22 02:47 pm>[7263012.122463]  [<ffffffff812c08fe>] __delay+0xa/0xc
<Oct/22 02:47 pm>[7263012.127644]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
<Oct/22 02:47 pm>[7263012.133907]  [<ffffffff8151f153>] _raw_spin_lock_irqsave+0x3a/0x46
<Oct/22 02:47 pm>[7263012.140590]  [<ffffffff8102fa90>] ? __wake_up+0x22/0x4f
<Oct/22 02:47 pm>[7263012.146316]  [<ffffffff8102fa90>] __wake_up+0x22/0x4f
<Oct/22 02:47 pm>[7263012.151858]  [<ffffffff81054b47>] __wake_up_bit+0x2c/0x2e
<Oct/22 02:47 pm>[7263012.157747]  [<ffffffff810ac9a9>] unlock_page+0x22/0x26
<Oct/22 02:47 pm>[7263012.163460]  [<ffffffff8127e73f>] xfs_vm_writepage+0xf9/0x113
<Oct/22 02:47 pm>[7263012.169745]  [<ffffffff810b7612>] shrink_page_list+0x3c2/0x68f
<Oct/22 02:47 pm>[7263012.176118]  [<ffffffff810b8341>] shrink_zone+0x7c2/0xb86
<Oct/22 02:47 pm>[7263012.182056]  [<ffffffff810b97c3>] do_try_to_free_pages+0x208/0x37a
<Oct/22 02:47 pm>[7263012.188792]  [<ffffffff810b9b05>] try_to_free_pages+0x71/0x78
<Oct/22 02:47 pm>[7263012.195048]  [<ffffffff810b6cc0>] ? isolate_pages_global+0x0/0x23f
<Oct/22 02:47 pm>[7263012.201699]  [<ffffffff810b3026>] __alloc_pages_nodemask+0x407/0x671
<Oct/22 02:47 pm>[7263012.208527]  [<ffffffff810da7be>] alloc_pages_current+0x96/0x9f
<Oct/22 02:47 pm>[7263012.214966]  [<ffffffff810acb60>] __page_cache_alloc+0x59/0x5e

<Oct/22 02:47 pm>[7263012.221319]  [<ffffffff810acd29>] grab_cache_page_write_begin+0x5c/0xa2
<Oct/22 02:47 pm>[7263012.228437]  [<ffffffff8110d6cd>] block_write_begin+0x3d/0xcf
<Oct/22 02:47 pm>[7263012.234700]  [<ffffffff8127e5c5>] xfs_vm_write_begin+0x25/0x27
<Oct/22 02:47 pm>[7263012.241037]  [<ffffffff8127d35c>] ? xfs_get_blocks+0x0/0x14
<Oct/22 02:47 pm>[7263012.247130]  [<ffffffff810abd26>] generic_file_buffered_write+0x10f/0x233
<Oct/22 02:47 pm>[7263012.254440]  [<ffffffff81288c5e>] ? xfs_xattr_get+0x37/0x40
<Oct/22 02:47 pm>[7263012.260503]  [<ffffffff81282920>] xfs_file_aio_write+0x5be/0x806
<Oct/22 02:47 pm>[7263012.267023]  [<ffffffff8151f67a>] ? _raw_spin_unlock+0x26/0x2b
<Oct/22 02:47 pm>[7263012.273402]  [<ffffffff810ea282>] do_sync_write+0xc7/0x10d
<Oct/22 02:47 pm>[7263012.283902]  [<ffffffff8106433a>] ? __lock_acquire+0x995/0x9fc
<Oct/22 02:47 pm>[7263012.290240]  [<ffffffff810eb427>] ? fget_light+0x4f/0xfb
<Oct/22 02:47 pm>[7263012.296031]  [<ffffffff812937db>] ? security_file_permission+0x11/0x13
<Oct/22 02:47 pm>[7263012.303096]  [<ffffffff810eaba1>] vfs_write+0xae/0x14a
<Oct/22 02:47 pm>[7263012.308727]  [<ffffffff810ead01>] sys_write+0x47/0x6e
<Oct/22 02:47 pm>[7263012.314243]  [<ffffffff810029ab>] system_call_fastpath+0x16/0x1b
<Oct/22 02:47 pm>[7263012.320764] Pid: 23583, comm: ppStack Tainted: G      D    2.6.34.4 #3
<Oct/22 02:47 pm>[7263012.327819] Call Trace:
<Oct/22 02:47 pm>[7263012.330702]  <NMI>  [<ffffffff81009b2a>] ? show_regs+0x26/0x2a
<Oct/22 02:47 pm>[7263012.337104]  [<ffffffff81520db8>] nmi_watchdog_tick+0xc3/0x1a5
<Oct/22 02:47 pm>[7263012.343448]  [<ffffffff81520360>] do_nmi+0xb2/0x259
<Oct/22 02:47 pm>[7263012.348829]  [<ffffffff8151fdfa>] nmi+0x1a/0x20
<Oct/22 02:47 pm>[7263012.353851]  [<ffffffff812c08af>] ? delay_tsc+0x25/0x59

<Oct/22 02:47 pm>[7263012.359575]  <<EOE>>  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
<Oct/22 02:47 pm>[7263012.368167]  [<ffffffff812c08fe>] __delay+0xa/0xc
<Oct/22 02:47 pm>[7263012.373361]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
<Oct/22 02:47 pm>[7263012.379632]  [<ffffffff8151f153>] _raw_spin_lock_irqsave+0x3a/0x46
<Oct/22 02:47 pm>[7263012.386349]  [<ffffffff8102fa90>] ? __wake_up+0x22/0x4f
<Oct/22 02:47 pm>[7263012.392085]  [<ffffffff8102fa90>] __wake_up+0x22/0x4f
<Oct/22 02:47 pm>[7263012.397600]  [<ffffffff81054b47>] __wake_up_bit+0x2c/0x2e
<Oct/22 02:47 pm>[7263012.403464]  [<ffffffff810ac9a9>] unlock_page+0x22/0x26
<Oct/22 02:47 pm>[7263012.409203]  [<ffffffff8127e73f>] xfs_vm_writepage+0xf9/0x113
<Oct/22 02:47 pm>[7263012.415471]  [<ffffffff810b7612>] shrink_page_list+0x3c2/0x68f
<Oct/22 02:47 pm>[7263012.421799]  [<ffffffff810b8341>] shrink_zone+0x7c2/0xb86
<Oct/22 02:47 pm>[7263012.427702]  [<ffffffff810b97c3>] do_try_to_free_pages+0x208/0x37a
<Oct/22 02:47 pm>[7263012.434413]  [<ffffffff810b9b05>] try_to_free_pages+0x71/0x78
<Oct/22 02:47 pm>[7263012.440679]  [<ffffffff810b6cc0>] ? isolate_pages_global+0<Oct/22 02:47 pm>
                 <Oct/22 02:47 pm>[7263012.447354]  [<ffffffff810b3026>] __alloc_pages_nodemask+0x407/0x671
<Oct/22 02:47 pm>[7263012.454227]  [<ffffffff810da7be>] alloc_pages_current+0x96/0x9f
<Oct/22 02:47 pm>[7263012.460656]  [<ffffffff810acb60>] __page_cache_alloc+0x59/0x5e
<Oct/22 02:47 pm>[7263012.466966]  [<ffffffff810acd29>] grab_cache_page_write_begin+0x5c/0xa2
<Oct/22 02:47 pm>[7263012.474110]  [<ffffffff8110d6cd>] block_write_begin+0x3d/0xcf
<Oct/22 02:47 pm>[7263012.480364]  [<ffffffff8127e5c5>] xfs_vm_write_begin+0x25/0x27
<Oct/22 02:47 pm>[7263012.486702]  [<ffffffff8127d35c>] ? xfs_get_blocks+0x0/0x14
<Oct/22 02:47 pm>[7263012.492779]  [<ffffffff810abd26>] generic_file_buffered_write+0x10f/0x233

<Oct/22 02:47 pm>[7263012.500123]  [<ffffffff81288c5e>] ? xfs_xattr_get+0x37/0x40
<Oct/22 02:47 pm>[7263012.506177]  [<ffffffff81282920>] xfs_file_aio_write+0x5be/0x806
<Oct/22 02:47 pm>[7263012.512696]  [<ffffffff8151f67a>] ? _raw_spin_unlock+0x26/0x2b
<Oct/22 02:47 pm>[7263012.519033]  [<ffffffff810ea282>] do_sync_write+0xc7/0x10d
<Oct/22 02:47 pm>[7263012.525022]  [<ffffffff8106433a>] ? __lock_acquire+0x995/0x9fc
<Oct/22 02:47 pm>[7263012.531368]  [<ffffffff810eb427>] ? fget_light+0x4f/0xfb
<Oct/22 02:47 pm>[7263012.537176]  [<ffffffff812937db>] ? security_file_permission+0x11/0x13
<Oct/22 02:47 pm>[7263012.544251]  [<ffffffff810eaba1>] vfs_write+0xae/0x14a
<Oct/22 02:47 pm>[7263012.549880]  [<ffffffff810ead01>] sys_write+0x47/0x6e
<Oct/22 02:47 pm>[7263012.555449]  [<ffffffff810029ab>] system_call_fastpath+0x16/0x1b
<Oct/22 02:47 pm>[7263012.561995] NMI backtrace for cpu 11
<Oct/22 02:47 pm>[7263012.566015] CPU 11 
<Oct/22 02:47 pm>[7263012.568206] Modules linked in: w83793 hwmon_vid autofs4 i2c_i801 i2c_core iTCO_wdt e1000e ioatdma dca rtc_cmos tg3 libphy e1000 fuse dm_snapshot dm_mirror dm_region_hash dm_log scsi_wait_scan qla2xxx megaraid_sas megaraid_mbox megaraid_mm aacraid 3w_9xxx 3w_xxxx arcmsr aic7xxx aic79xx sr_mod sg ata_piix ahci sata_sis sata_nv sata_via pata_sl82c105 pata_sis
<Oct/22 02:47 pm>[7263012.603864] 
<Oct/22 02:47 pm>[7263012.605780] Pid: 24145, comm: ppImage Tainted: G      D    2.6.34.4 #3 S7010/empty
<Oct/22 02:47 pm>[7263012.614062] RIP: 0010:[<ffffffff812c08a2>]  [<ffffffff812c08a2>] delay_tsc+0x18/0x59
<Oct/22 02:47 pm>[7263012.622573] RSP: 0018:ffff880028ba9ac0  EFLAGS: 00000086
<Oct/22 02:47 pm>[7263012.628407] RAX: 0000000098c997b4 RBX: 00000000694a7df1 RCX: 0000000098c99770
<Oct/22 02:47 pm>[7263012.636271] RDX: 000000000044fd5b RSI: 000000000000000b RDI: 0000000000000001
<Oct/22 02:47 pm>[7263012.644101] RBP: ffff880028ba9ac8 R08: 000000000000000b R09: 000000000000000b
<Oct/22 02:47 pm>[7263012.651961] R10: 0000000000000000 R11: ffff880028ba98f8 R12: ffff880655213c00
<Oct/22 02:47 pm>[7263012.659802] R13: 0000000000000000 R14: ffff880035eb40c0 R15: ffff880035eb4548

<Oct/22 02:47 pm>[7263012.667642] FS:  0000000043452950(0063) GS:ffff8806552a0000(0000) knlGS:0000000000000000
<Oct/22 02:47 pm>[7263012.676461] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<Oct/22 02:47 pm>[7263012.682712] CR2: 00007f54a459a078 CR3: 000000058ea6f000 CR4: 00000000000006e0
<Oct/22 02:47 pm>[7263012.690557] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
<Oct/22 02:47 pm>[7263012.698390] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
<Oct/22 02:47 pm>[7263012.706193] Process ppImage (pid: 24145, threadinfo ffff880028ba8000, task ffff880035eb40c0)
<Oct/22 02:47 pm>[7263012.715363] Stack:
<Oct/22 02:47 pm>[7263012.717795]  ffffffff81019da9 ffff880028ba9ad8 ffffffff812c08fe ffff880028ba9b18
<Oct/22 02:47 pm>[7263012.725694] <0> ffffffff812c4e65 000000009ef2fcf8 ffff880655213c00 ffff880655213c00
<Oct/22 02:47 pm>[7263012.734314] <0> ffff8806552ae3f0 0000000000000400 0000000000000800 ffff880028ba9b38
<Oct/22 02:47 pm>[7263012.743334] Call Trace:
<Oct/22 02:47 pm>[7263012.746223]  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
<Oct/22 02:47 pm>[7263012.754000]  [<ffffffff812c08fe>] __delay+0xa/0xc
<Oct/22 02:47 pm>[7263012.759186]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
<Oct/22 02:47 pm>[7263012.765449]  [<ffffffff8151f193>] _raw_spin_lock+0x34/0x39
<Oct/22 02:47 pm>[7263012.771440]  [<ffffffff81035927>] ? double_rq_lock+0x3d/0x76
<Oct/22 02:47 pm>[7263012.777612]  [<ffffffff81035927>] double_rq_lock+0x3d/0x76
<Oct/22 02:47 pm>[7263012.783609]  [<ffffffff81037672>] load_balance+0xbb6/0xf63
<Oct/22 02:47 pm>[7263012.789599]  [<ffffffff8106433a>] ? __lock_acquire+0x995/0x9fc
<Oct/22 02:47 pm>[7263012.795963]  [<ffffffff8151cc0e>] schedule+0x25a/0x86a
<Oct/22 02:47 pm>[7263012.801598]  [<ffffffff8151e357>] do_nanosleep+0x73/0xb3
<Oct/22 02:47 pm>[7263012.807431]  [<ffffffff810348d8>] ? finish_task_switch+0x69/0xdd

<Oct/22 02:47 pm>[7263012.813927]  [<ffffffff8103486f>] ? finish_task_switch+0x0/0xdd
<Oct/22 02:47 pm>[7263012.820341]  [<ffffffff81058477>] hrtimer_nanosleep+0x97/0<Oct/22 02:47 pm>
                 <Oct/22 02:47 pm>[7263012.826695]  [<ffffffff81057842>] ? hrtimer_wakeup+0x0/0x21
<Oct/22 02:47 pm>[7263012.832753]  [<ffffffff810583de>] ? hrtimer_start_range_ns+0xf/0x11
<Oct/22 02:47 pm>[7263012.839543]  [<ffffffff81047c8b>] ? run_timer_softirq+0x4d/0x30c
<Oct/22 02:47 pm>[7263012.846057]  [<ffffffff81058539>] sys_nanosleep+0x54/0x6c
<Oct/22 02:47 pm>[7263012.851952]  [<ffffffff810029ab>] system_call_fastpath+0x16/0x1b
<Oct/22 02:47 pm>[7263012.858480] Code: 2e 0f 1f 84 00 00 00 00 00 48 ff c8 75 fb 48 ff c8 c9 c3 55 48 89 e5 48 83 ec 08 65 8b 34 25 f0 d1 00 00 66 66 90 0f ae e8 0f 31 <89> c1 41 89 f1 66 66 90 0f ae e8 0f 31 89 c6 48 89 f0 48 29 c8 
<Oct/22 02:47 pm>[7263012.881688] Call Trace:
<Oct/22 02:47 pm>[7263012.884584]  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
<Oct/22 02:47 pm>[7263012.892354]  [<ffffffff812c08fe>] __delay+0xa/0xc
<Oct/22 02:47 pm>[7263012.897542]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
<Oct/22 02:47 pm>[7263012.903776]  [<ffffffff8151f193>] _raw_spin_lock+0x34/0x39
<Oct/22 02:47 pm>[7263012.909774]  [<ffffffff81035927>] ? double_rq_lock+0x3d/0x76
<Oct/22 02:47 pm>[7263012.915920]  [<ffffffff81035927>] double_rq_lock+0x3d/0x76
<Oct/22 02:47 pm>[7263012.921921]  [<ffffffff81037672>] load_balance+0xbb6/0xf63
<Oct/22 02:47 pm>[7263012.927911]  [<ffffffff8106433a>] ? __lock_acquire+0x995/0x9fc
<Oct/22 02:47 pm>[7263012.934257]  [<ffffffff8151cc0e>] schedule+0x25a/0x86a
<Oct/22 02:47 pm>[7263012.939891]  [<ffffffff8151e357>] do_nanosleep+0x73/0xb3
<Oct/22 02:47 pm>[7263012.945727]  [<ffffffff810348d8>] ? finish_task_switch+0x69/0xdd
<Oct/22 02:47 pm>[7263012.952247]  [<ffffffff8103486f>] ? finish_task_switch+0x0/0xdd
<Oct/22 02:47 pm>[7263012.958669]  [<ffffffff81058477>] hrtimer_nanosleep+0x97/0x105

<Oct/22 02:47 pm>[7263012.965013]  [<ffffffff81057842>] ? hrtimer_wakeup+0x0/0x21
<Oct/22 02:47 pm>[7263012.971081]  [<ffffffff810583de>] ? hrtimer_start_range_ns+0xf/0x11
<Oct/22 02:47 pm>[7263012.977879]  [<ffffffff81047c8b>] ? run_timer_softirq+0x4d/0x30c
<Oct/22 02:47 pm>[7263012.984395]  [<ffffffff81058539>] sys_nanosleep+0x54/0x6c
<Oct/22 02:47 pm>[7263012.990298]  [<ffffffff810029ab>] system_call_fastpath+0x16/0x1b
<Oct/22 02:47 pm>[7263012.996826] Pid: 24145, comm: ppImage Tainted: G      D    2.6.34.4 #3
<Oct/22 02:47 pm>[7263013.003898] Call Trace:
                 <Oct/22 02:47 pm>[7263013.006761]  <NMI>  [<ffffffff81009b2a>] ? show_regs+0x26/0x2a
<Oct/22 02:47 pm>[7263013.013147]  [<ffffffff81520db8>] nmi_watchdog_tick+0xc3/0x1a5
<Oct/22 02:47 pm>[7263013.019491]  [<ffffffff81520360>] do_nmi+0xb2/0x259
<Oct/22 02:47 pm>[7263013.024890]  [<ffffffff8151fdfa>] nmi+0x1a/0x20
                 <Oct/22 02:47 pm>[7263013.029896]  [<ffffffff812c08a2>] ? delay_tsc+0x18/0x59
<Oct/22 02:47 pm>[7263013.035609]  <<EOE>>  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
<Oct/22 02:47 pm>[7263013.044213]  [<ffffffff812c08fe>] __delay+0xa/0xc
<Oct/22 02:47 pm>[7263013.049395]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
<Oct/22 02:47 pm>[7263013.055650]  [<ffffffff8151f193>] _raw_spin_lock+0x34/0x39
<Oct/22 02:47 pm>[7263013.061649]  [<ffffffff81035927>] ? double_rq_lock+0x3d/0x76
<Oct/22 02:47 pm>[7263013.067839]  [<ffffffff81035927>] double_rq_lock+0x3d/0x76
<Oct/22 02:47 pm>[7263013.073839]  [<ffffffff81037672>] load_balance+0xbb6/0xf63
<Oct/22 02:47 pm>[7263013.079863]  [<ffffffff8106433a>] ? __lock_acquire+0x995/0x9fc
<Oct/22 02:47 pm>[7263013.086217]  [<ffffffff8151cc0e>] schedule+0x25a/0x86a
<Oct/22 02:47 pm>[7263013.091833]  [<ffffffff8151e357>] do_nanosleep+0x73/0xb3

<Oct/22 02:47 pm>[7263013.097652]  [<ffffffff810348d8>] ? finish_task_switch+0x69/0xdd
<Oct/22 02:47 pm>[7263013.104154]  [<ffffffff8103486f>] ? finish_task_switch+0x0/0xdd
<Oct/22 02:47 pm>[7263013.110570]  [<ffffffff81058477>] hrtimer_nanosleep+0x97/0x105
<Oct/22 02:47 pm>[7263013.116894]  [<ffffffff81057842>] ? hrtimer_wakeup+0x0/0x21
<Oct/22 02:47 pm>[7263013.122972]  [<ffffffff810583de>] ? hrtimer_start_range_ns+0xf/0x11
<Oct/22 02:47 pm>[7263013.129753]  [<ffffffff81047c8b>] ? run_timer_softirq+0x4d/0x30c
<Oct/22 02:47 pm>[7263013.136250]  [<ffffffff81058539>] sys_nanosleep+0x54/0x6c
<Oct/22 02:47 pm>[7263013.142162]  [<ffffffff810029ab>] system_call_fastpath+0x16/0x1b
<Oct/22 02:47 pm>[7263013.148664] NMI backtrace for cpu 10
<Oct/22 02:47 pm>[7263013.152710] CPU 10 
<Oct/22 02:47 pm>[7263013.154884] Modules linked in: w83793 hwmon_vid autofs4 i2c_i801 i2c_core iTCO_wdt e1000e ioatdma dca rtc_cmos tg3 libphy e1000 fuse dm_snapshot dm_mirror dm_region_hash dm_log scsi_wait_scan qla2xxx megaraid_sas megaraid_mbox megaraid_mm aacraid 3w_9xxx 3w_xxxx arcmsr aic7xxx aic79xx sr_mod sg ata_piix ahci sata_sis sata_nv sata_via pata_sl82c105 pata_sis
<Oct/22 02:47 pm>[7263013.190619] 
<Oct/22 02:47 pm>[7263013.192520] Pid: 23505, comm: ppStack Tainted: G      D    2.6.34.4 #3 S7010/empty
<Oct/22 02:47 pm>[7263013.200787] RIP: 0010:[<ffffffff812c08a4>]  [<ffffffff812c08a4>] delay_tsc+0x1a/0x59
<Oct/22 02:47 pm>[7263013.209313] RSP: 0018:ffff88061fa23530  EFLAGS: 00000086
<Oct/22 02:47 pm>[7263013.215128] RAX: 0000000098c584f0 RBX: 000000006a15780c RCX: 0000000098c584f0
<Oct/22 02:47 pm>[7263013.222967] RDX: 000000000044fd5b RSI: 000000000000000a RDI: 0000000000000001
<Oct/22 02:47 pm>[7263013.230824] RBP: ffff88061fa23538 R08: 000000000000000a R09: 000000000000000a
<Oct/22 02:47 pm>[7263013.238707] R10: 0000000000000000 R11: ffff88061fa23368 R12: ffff880655213c00
<Oct/22 02:47 pm>[7263013.246547] R13: 0000000000000000 R14: ffff8805d0800000 R15: ffff8805d0800488
<Oct/22 02:47 pm>[7263013.254390] FS:  00007fb785c0b6f0(0000) GS:ffff880655280000(0000) knlGS:0000000000000000
<Oct/22 02:47 pm>[7263013.267685] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033

<Oct/22 02:47 pm>[7263013.273947] CR2: 00007fb74dd6d000 CR3: 0000000549bed000 CR4: 00000000000006e0
<Oct/22 02:47 pm>[7263013.281808] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
<Oct/22 02:47 pm>[7263013.289639] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
<Oct/22 02:47 pm>[7263013.297491] Process ppStack (pid: 23505, threadinfo ffff88061fa22000, task ffff8805d0800000)
<Oct/22 02:47 pm>[7263013.306665] Stack:
                 <Oct/22 02:47 pm>[7263013.309107]  ffffffff81019da9 ffff88061fa23548 ffffffff812c08fe ffff88061fa23588
<Oct/22 02:47 pm>[7263013.316989] <0> ffffffff812c4e65 000000009ef2fcf8 ffff880655213c00 ffff880655213c00
<Oct/22 02:47 pm>[7263013.325615] <0> ffff88065528e3f0 0000000000000400 0000000000000800 ffff88061fa235a8
<Oct/22 02:47 pm>[7263013.334695] Call Trace:
                 <Oct/22 02:47 pm>[7263013.337568]  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
<Oct/22 02:47 pm>[7263013.345317]  [<ffffffff812c08fe>] __delay+0xa/0xc
<Oct/22 02:47 pm>[7263013.350516]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
<Oct/22 02:47 pm>[7263013.356735]  [<ffffffff8151f193>] _raw_spin_lock+0x34/0x39
<Oct/22 02:47 pm>[7263013.362698]  [<ffffffff81035927>] ? double_rq_lock+0x3d/0x76
<Oct/22 02:47 pm>[7263013.368835]  [<ffffffff81035927>] double_rq_lock+0x3d/0x76
<Oct/22 02:47 pm>[7263013.374827]  [<ffffffff81037672>] load_balance+0xbb6/0xf63
<Oct/22 02:47 pm>[7263013.380800]  [<ffffffff810b3cfb>] ? get_dirty_limits+0x22/0x258
<Oct/22 02:47 pm>[7263013.387242]  [<ffffffff8151cc0e>] schedule+0x25a/0x86a
<Oct/22 02:47 pm>[7263013.392873]  [<ffffffff810480a2>] ? lock_timer_base+0x26/0x4a
<Oct/22 02:47 pm>[7263013.399136]  [<ffffffff8151d559>] schedule_timeout+0x222/0x24c
<Oct/22 02:47 pm>[7263013.405489]  [<ffffffff810482a5>] ? process_timeout+0x0/0xb
<Oct/22 02:47 pm>[7263013.411557]  [<ffffffff8151c6c5>] io_schedule_timeout+0x45/0x5e

<Oct/22 02:47 pm>[7263013.417981]  [<ffffffff810c0abe>] congestion_wait+0x6b/0x87
<Oct/22 02:47 pm>[7263013.424091]  [<ffffffff81054b6c>] ? autoremove_wake_function+0x0/0x38
<Oct/22 02:47 pm>[7263013.431079]  [<ffffffff810b3279>] __alloc_pages_nodemask+0x65a/0x671
<Oct/22 02:47 pm>[7263013.437985]  [<ffffffff810da7be>] alloc_pages_current+0x96/0x9f
<Oct/22 02:47 pm>[7263013.444433]  [<ffffffff810acb60>] __page_cache_alloc+0x59/0x5e
<Oct/22 02:47 pm>[7263013.450786]  [<ffffffff810acd29>] grab_cache_page_write_begin+0x5c/0xa2
<Oct/22 02:47 pm>[7263013.457912]  [<ffffffff8110d6cd>] block_write_begin+0x3d/0xcf
<Oct/22 02:47 pm>[7263013.464159]  [<ffffffff8127e5c5>] xfs_vm_write_begin+0x25/0x27
<Oct/22 02:47 pm>[7263013.470503]  [<ffffffff8127d35c>] ? xfs_get_blocks+0x0/0x14
<Oct/22 02:47 pm>[7263013.476581]  [<ffffffff810abd26>] generic_file_buffered_write+0x10f/0x233
<Oct/22 02:47 pm>[7263013.483905]  [<ffffffff81288c5e>] ? xfs_xattr_get+0x37/0x40
<Oct/22 02:47 pm>[7263013.489988]  [<ffffffff81282920>] xfs_file_aio_write+0x5be/0x806
<Oct/22 02:47 pm>[7263013.496516]  [<ffffffff8106433a>] ? __lock_acquire+0x995/0x9fc
<Oct/22 02:47 pm>[7263013.502861]  [<ffffffff810ea282>] do_sync_write+0xc7/0x10d
<Oct/22 02:47 pm>[7263013.508866]  [<ffffffff8106433a>] ? __lock_acquire+0x995/0x9fc
<Oct/22 02:47 pm>[7263013.515229]  [<ffffffff810eb427>] ? fget_light+0x4f/0xfb
<Oct/22 02:47 pm>[7263013.521047]  [<ffffffff812937db>] ? security_file_permission+0x11/0x13
<Oct/22 02:47 pm>[7263013.528078]  [<ffffffff810eaba1>] vfs_write+0xae/0x14a
<Oct/22 02:47 pm>[7263013.533692]  [<ffffffff810ead01>] sys_write+0x47/0x6e
<Oct/22 02:47 pm>[7263013.539215]  [<ffffffff810029ab>] system_call_fastpath+0x16/0x1b
<Oct/22 02:47 pm>[7263013.545736] Code: 1f 84 00 00 00 00 00 48 ff c8 75 fb 48 ff c8 c9 c3 55 48 89 e5 48 83 ec 08 65 8b 34 25 f0 d1 00 00 66 66 90 0f ae e8 0f 31 89 c1 <41> 89 f1 66 66 90 0f ae e8 0f 31 89 c6 48 89 f0 48 29 c8 48 39 
<Oct/22 02:47 pm>[7263013.568985] Call Trace:

<Oct/22 02:47 pm>[7263013.571873]  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
<Oct/22 02:47 pm>[7263013.579652]  [<ffffffff812c08fe>] __delay+0xa/0xc
<Oct/22 02:47 pm>[7263013.584847]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
<Oct/22 02:47 pm>[7263013.591102]  [<ffffffff8151f193>] _raw_spin_lock+0x34/0x39
<Oct/22 02:47 pm>[7263013.597093]  [<ffffffff81035927>] ? double_rq_lock+0x3d/0x76
<Oct/22 02:47 pm>[7263013.603255]  [<ffffffff81035927>] double_rq_lock+0x3d/0x76
<Oct/22 02:47 pm>[7263013.609229]  [<ffffffff81037672>] load_balance+0xbb6/0xf63
<Oct/22 02:47 pm>[7263013.615219]  [<ffffffff810b3cfb>] ? get_dirty_limits+0x22/0x258
<Oct/22 02:47 pm>[7263013.621662]  [<ffffffff8151cc0e>] schedule+0x25a/0x86a
<Oct/22 02:47 pm>[7263013.627304]  [<ffffffff810480a2>] ? lock_timer_base+0x26/0x4a
<Oct/22 02:47 pm>[7263013.633545]  [<ffffffff8151d559>] schedule_timeout+0x222/0x24c
<Oct/22 02:47 pm>[7263013.639909]  [<ffffffff810482a5>] ? process_timeout+0x0/0xb
<Oct/22 02:47 pm>[7263013.645984]  [<ffffffff8151c6c5>] io_schedule_timeout+0x45/0x5e
<Oct/22 02:47 pm>[7263013.652408]  [<ffffffff810c0abe>] congestion_wait+0x6b/0x87
<Oct/22 02:47 pm>[7263013.658494]  [<ffffffff81054b6c>] ? autoremove_wake_function+0x0/0x38
<Oct/22 02:47 pm>[7263013.665455]  [<ffffffff810b3279>] __alloc_pages_nodemask+0x65a/0x671
<Oct/22 02:47 pm>[7263013.672328]  [<ffffffff810da7be>] alloc_pages_current+0x96/0x9f
<Oct/22 02:47 pm>[7263013.678765]  [<ffffffff810acb60>] __page_cache_alloc+0x59/0x5e
<Oct/22 02:47 pm>[7263013.685119]  [<ffffffff810acd29>] grab_cache_page_write_begin+0x5c/0xa2
<Oct/22 02:47 pm>[7263013.692271]  [<ffffffff8110d6cd>] block_write_begin+0x3d/0xcf
<Oct/22 02:47 pm>[7263013.698553]  [<ffffffff8127e5c5>] xfs_vm_write_begin+0x25/0x27
<Oct/22 02:47 pm>[7263013.704923]  [<ffffffff8127d35c>] ? xfs_get_blocks+0x0/0x14

<Oct/22 02:47 pm>[7263013.711025]  [<ffffffff810abd26>] generic_file_buffered_write+0x10f/0x233
<Oct/22 02:47 pm>[7263013.718360]  [<ffffffff81288c5e>] ? xfs_xattr_get+0x37/0x40
<Oct/22 02:47 pm>[7263013.724451]  [<ffffffff81282920>] xfs_file_aio_write+0x5be/0x806
<Oct/22 02:47 pm>[7263013.730945]  [<ffffffff8106433a>] ? __lock_acquire+0x995/0x9fc
<Oct/22 02:47 pm>[7263013.737322]  [<ffffffff810ea282>] do_sync_write+0xc7/0x10d
<Oct/22 02:47 pm>[7263013.743312]  [<ffffffff8106433a>] ? __lock_acquire+0x995/0x9fc
<Oct/22 02:47 pm>[7263013.749674]  [<ffffffff810eb427>] ? fget_light+0x4f/0xfb
<Oct/22 02:47 pm>[7263013.755499]  [<ffffffff812937db>] ? security_file_permission+0x11/0x13
<Oct/22 02:47 pm>[7263013.762541]  [<ffffffff810eaba1>] vfs_write+0xae/0x14a
<Oct/22 02:47 pm>[7263013.768189]  [<ffffffff810ead01>] sys_write+0x47/0x6e
<Oct/22 02:47 pm>[7263013.773721]  [<ffffffff810029ab>] system_call_fastpath+0x1<Oct/22 02:47 pm>
                 <Oct/22 02:47 pm>[7263013.780244] Pid: 23505, comm: ppStack Tainted: G      D    2.6.34.4 #3
<Oct/22 02:47 pm>[7263013.787289] Call Trace:
<Oct/22 02:47 pm>[7263013.790188]  <NMI>  [<ffffffff81009b2a>] ? show_regs+0x26/0x2a
<Oct/22 02:47 pm>[7263013.796571]  [<ffffffff81520db8>] nmi_watchdog_tick+0xc3/0x1a5
<Oct/22 02:47 pm>[7263013.802907]  [<ffffffff81520360>] do_nmi+0xb2/0x259
<Oct/22 02:47 pm>[7263013.808290]  [<ffffffff8151fdfa>] nmi+0x1a/0x20
<Oct/22 02:47 pm>[7263013.813286]  [<ffffffff812c08a4>] ? delay_tsc+0x1a/0x59
<Oct/22 02:47 pm>[7263013.819010]  <<EOE>>  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
<Oct/22 02:47 pm>[7263013.827621]  [<ffffffff812c08fe>] __delay+0xa/0xc
<Oct/22 02:47 pm>[7263013.832838]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
<Oct/22 02:47 pm>[7263013.839128]  [<ffffffff8151f193>] _raw_spin_lock+0x34/0x39

<Oct/22 02:47 pm>[7263013.845109]  [<ffffffff81035927>] ? double_rq_lock+0x3d/0x76
<Oct/22 02:47 pm>[7263013.851289]  [<ffffffff81035927>] double_rq_lock+0x3d/0x76
<Oct/22 02:47 pm>[7263013.857315]  [<ffffffff81037672>] load_balance+0xbb6/0xf63
<Oct/22 02:47 pm>[7263013.863287]  [<ffffffff810b3cfb>] ? get_dirty_limits+0x22/0x258
<Oct/22 02:47 pm>[7263013.869756]  [<ffffffff8151cc0e>] schedule+0x25a/0x86a
<Oct/22 02:47 pm>[7263013.875387]  [<ffffffff810480a2>] ? lock_timer_base+0x26/0x4a
<Oct/22 02:47 pm>[7263013.881648]  [<ffffffff8151d559>] schedule_timeout+0x222/0x24c
<Oct/22 02:47 pm>[7263013.887994]  [<ffffffff810482a5>] ? process_timeout+0x0/0xb
<Oct/22 02:47 pm>[7263013.894080]  [<ffffffff8151c6c5>] io_schedule_timeout+0x45/0x5e
<Oct/22 02:47 pm>[7263013.900511]  [<ffffffff810c0abe>] congestion_wait+0x6b/0x87
<Oct/22 02:47 pm>[7263013.906570]  [<ffffffff81054b6c>] ? autoremove_wake_function+0x0/0x38
<Oct/22 02:47 pm>[7263013.913568]  [<ffffffff810b3279>] __alloc_pages_nodemask+0x65a/0x671
<Oct/22 02:47 pm>[7263013.920448]  [<ffffffff810da7be>] alloc_pages_current+0x96/0x9f
<Oct/22 02:47 pm>[7263013.926887]  [<ffffffff810acb60>] __page_cache_alloc+0x59/0x5e
<Oct/22 02:47 pm>[7263013.933248]  [<ffffffff810acd29>] grab_cache_page_write_be<Oct/22 02:47 pm>
                 <Oct/22 02:47 pm>[7263013.940409]  [<ffffffff8110d6cd>] block_write_begin+0x3d/0xcf
<Oct/22 02:47 pm>[7263013.946646]  [<ffffffff8127e5c5>] xfs_vm_write_begin+0x25/0x27
<Oct/22 02:47 pm>[7263013.952992]  [<ffffffff8127d35c>] ? xfs_get_blocks+0x0/0x14
<Oct/22 02:47 pm>[7263013.959041]  [<ffffffff810abd26>] generic_file_buffered_write+0x10f/0x233
<Oct/22 02:47 pm>[7263013.966368]  [<ffffffff81288c5e>] ? xfs_xattr_get+0x37/0x40
<Oct/22 02:47 pm>[7263013.972458]  [<ffffffff81282920>] xfs_file_aio_write+0x5be/0x806
<Oct/22 02:47 pm>[7263013.978995]  [<ffffffff8106433a>] ? __lock_acquire+0x995/0x9fc

<Oct/22 02:47 pm>[7263013.985349]  [<ffffffff810ea282>] do_sync_write+0xc7/0x10d
<Oct/22 02:47 pm>[7263013.991344]  [<ffffffff8106433a>] ? __lock_acquire+0x995/0x9fc
<Oct/22 02:47 pm>[7263013.997710]  [<ffffffff810eb427>] ? fget_light+0x4f/0xfb
<Oct/22 02:47 pm>[7263014.003507]  [<ffffffff812937db>] ? security_file_permission+0x11/0x13
<Oct/22 02:47 pm>[7263014.010574]  [<ffffffff810eaba1>] vfs_write+0xae/0x14a
<Oct/22 02:47 pm>[7263014.016222]  [<ffffffff810ead01>] sys_write+0x47/0x6e
<Oct/22 02:47 pm>[7263014.021763]  [<ffffffff810029ab>] system_call_fastpath+0x16/0x1b



Last modified 13 years ago Last modified on Oct 22, 2013, 3:04:47 PM
Note: See TracWiki for help on using the wiki.