IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changes between Initial Version and Version 1 of ipp061-crash-20131017T153400


Ignore:
Timestamp:
Oct 18, 2013, 10:29:52 AM (13 years ago)
Author:
Mark Huber
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • ipp061-crash-20131017T153400

    v1 v1  
     1from console
     2{{{
     3File content:
     4 ? nfsd+0x0/0x139
     5<Oct/17 03:54 pm>[6853629.759017]  [<ffffffff811f0d78>] nfsd+0xa9/0x139
     6<Oct/17 03:54 pm>[6853629.759019]  [<ffffffff810546e2>] kthread+0x7d/0x85
     7<Oct/17 03:54 pm>[6853629.759021]  [<ffffffff81003794>] kernel_thread_helper+0x4/0x10
     8<Oct/17 03:54 pm>[6853629.759023]  [<ffffffff81054665>] ? kthread+0x0/0x85
     9<Oct/17 03:54 pm>[6853629.759025]  [<ffffffff81003790>] ? kernel_thread_helper+0x0/0x10
     10<Oct/17 03:54 pm>[6853629.759027] NMI backtrace for cpu 11
     11<Oct/17 03:54 pm>[6853629.759027] CPU 11
     12<Oct/17 03:54 pm>[6853629.759028] Modules linked in: w83793 hwmon_vid autofs4 i2c_i801 i2c_core iTCO_wdt e1000e ioatdma dca rtc_cmos tg3 libphy e1000 fuse dm_snapshot dm_mirror dm_region_hash dm_log scsi_wait_scan qla2xxx megaraid_sas megaraid_mbox megaraid_mm aacraid 3w_9xxx 3w_xxxx arcmsr aic7xxx aic79xx sr_mod sg ata_piix ahci sata_sis sata_nv sata_via pata_sl82c105 pata_sis
     13<Oct/17 03:54 pm>[6853629.759042]
     14<Oct/17 03:54 pm>[6853629.759043] Pid: 2921, comm: pclient Tainted: G      D    2.6.34.4 #3 S7010/empty
     15<Oct/17 03:54 pm>[6853629.759045] RIP: 0010:[<ffffffff812c08b7>]  [<ffffffff812c08b7>] delay_tsc+0x2d/0x59
     16<Oct/17 03:54 pm>[6853629.759048] RSP: 0000:ffff8806552a3dd0  EFLAGS: 00000012
     17<Oct/17 03:54 pm>[6853629.759049] RAX: 000000000000001c RBX: 00000000042e42cb RCX: 000000008158fc08
     18<Oct/17 03:54 pm>[6853629.759051] RDX: 000000000040ee78 RSI: 000000008158fc24 RDI: 0000000000000001
     19<Oct/17 03:54 pm>[6853629.759052] RBP: ffff8806552a3dd8 R08: 000000000000000b R09: 000000000000000b
     20<Oct/17 03:54 pm>[6853629.759054] R10: 0000000000000000 R11: ffff8806552a3c08 R12: ffff8806552b3c00
     21<Oct/17 03:54 pm>[6853629.759055] R13: 0000000000000000 R14: ffff8803ce096120 R15: ffff8803ce0965a8
     22<Oct/17 03:54 pm>[6853629.759057] FS:  00007fe0e24916f0(0000) GS:ffff8806552a0000(0000) knlGS:0000000000000000
     23<Oct/17 03:54 pm>[6853629.759059] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
     24<Oct/17 03:54 pm>[6853629.759060] CR2: 000000000186bb18 CR3: 000000062112d000 CR4: 00000000000006e0
     25
     26<Oct/17 03:54 pm>[6853629.759062] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
     27<Oct/17 03:54 pm>[6853629.759063] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
     28<Oct/17 03:54 pm>[6853629.759065] Process pclient (pid: 2921, threadinfo ffff880<Oct/17 03:54 pm>fff8803ce096120)
     29                 <Oct/17 03:54 pm>[6853629.759066] Stack:
     30<Oct/17 03:54 pm>[6853629.759067]  ffffffff81019da9 ffff8806552a3de8 ffffffff812c08fe ffff8806552a3e28
     31<Oct/17 03:54 pm>[6853629.759069] <0> ffffffff812c4e65 000000009ef2e6b4 ffff8806552b3c00 ffff880023799030
     32<Oct/17 03:54 pm>[6853629.759071] <0> 0000000000013c00 ffff8806552a3e98 000000000000000b ffff8806552a3e48
     33<Oct/17 03:54 pm>[6853629.759074] Call Trace:
     34<Oct/17 03:54 pm>[6853629.759075]  <IRQ>
     35<Oct/17 03:54 pm>[6853629.759077]  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
     36<Oct/17 03:54 pm>[6853629.759079]  [<ffffffff812c08fe>] __delay+0xa/0xc
     37<Oct/17 03:54 pm>[6853629.759081]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
     38<Oct/17 03:54 pm>[6853629.759083]  [<ffffffff8151f193>] _raw_spin_lock+0x34/0x39
     39<Oct/17 03:54 pm>[6853629.759085]  [<ffffffff8102fb6b>] ? task_rq_lock+0x7e/0x9a
     40<Oct/17 03:54 pm>[6853629.759087]  [<ffffffff8102fb6b>] task_rq_lock+0x7e/0x9a
     41<Oct/17 03:54 pm>[6853629.759089]  [<ffffffff81057842>] ? hrtimer_wakeup+0x0/0x21
     42<Oct/17 03:54 pm>[6853629.759091]  [<ffffffff81036578>] try_to_wake_up+0x2e/0x342
     43<Oct/17 03:54 pm>[6853629.759093]  [<ffffffff81057842>] ? hrtimer_wakeup+0x0/0x21
     44<Oct/17 03:54 pm>[6853629.759095]  [<ffffffff810368b8>] wake_up_process+0x10/0x12
     45<Oct/17 03:54 pm>[6853629.759097]  [<ffffffff8105785f>] hrtimer_wakeup+0x1d/0x21
     46<Oct/17 03:54 pm>[6853629.759099]  [<ffffffff81057933>] __run_hrtimer+0xd0/0x12d
     47<Oct/17 03:54 pm>[6853629.759101]  [<ffffffff81057b81>] hrtimer_interrupt+0xb5/0x19f
     48
     49<Oct/17 03:54 pm>[6853629.759103]  [<ffffffff810197a5>] smp_apic_timer_interrupt+0x82/0x95
     50<Oct/17 03:54 pm>[6853629.759106]  [<ffffffff81003353>] apic_timer_interrupt+0x13/0x20
     51<Oct/17 03:54 pm>[6853629.759107]  <EOI>
     52<Oct/17 03:54 pm>[6853629.759108] Code: 89 e5 48 83 ec 08 65 8b 34 25 f0 d1 00 00 66 66 90 0f ae e8 0f 31 89 c1 41 89 f1 66 66 90 0f ae e8 0f 31 89 c6 48 89 f0 48 29 c8 <48> 39 f8 73 25 f3 90 65 44 8b 04 25 f0 d1 00 00 45 39 c1 74 db
     53<Oct/17 03:54 pm>[6853629.759124] Call Trace:
     54<Oct/17 03:54 pm>[6853629.759125]  <IRQ>  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
     55<Oct/17 03:54 pm>[6853629.759128]  [<ffffffff812c08fe>] __delay+0xa/0xc
     56<Oct/17 03:54 pm>[6853629.759130]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
     57<Oct/17 03:54 pm>[6853629.759133]  [<ffffffff8151f193>] _raw_spin_lock+0x34/0x39
     58<Oct/17 03:54 pm>[6853629.759135]  [<ffffffff8102fb6b>] ? task_rq_lock+0x7e/0x9a
     59<Oct/17 03:54 pm>[6853629.759136]  [<ffffffff8102fb6b>] task_rq_lock+0x7e/0x9a
     60<Oct/17 03:54 pm>[6853629.759138]  [<ffffffff81057842>] ? hrtimer_wakeup+0x0/0x21
     61<Oct/17 03:54 pm>[6853629.759140]  [<ffffffff81036578>] try_to_wake_up+0x2e/0x342
     62<Oct/17 03:54 pm>[6853629.759142]  [<ffffffff81057842>] ? hrtimer_wakeup+0x0/0x21
     63<Oct/17 03:54 pm>[6853629.759144]  [<ffffffff810368b8>] wake_up_process+0x10/0x12
     64<Oct/17 03:54 pm>[6853629.759146]  [<ffffffff8105785f>] hrtimer_wakeup+0x1d/0x21
     65<Oct/17 03:54 pm>[6853629.759148]  [<ffffffff81057933>] __run_hrtimer+0xd0/0x12d
     66<Oct/17 03:54 pm>[6853629.759150]  [<ffffffff81057b81>] hrtimer_interrupt+0xb5/0x19f
     67<Oct/17 03:54 pm>[6853629.759153]  [<ffffffff810197a5>] smp_apic_timer_interrupt+0x82/0x95
     68<Oct/17 03:54 pm>[6853629.759155]  [<ffffffff81003353>] apic_timer_interrupt+0x13/0x20
     69<Oct/17 03:54 pm>[6853629.759156]  <EOI> Pid: 2921, comm: pclient Tainted: G      D    2.6.34.4 #3
     70<Oct/17 03:54 pm>[6853629.759159] Call Trace:
     71
     72<Oct/17 03:54 pm>[6853629.759160]  <NMI>  [<ffffffff81009b2a>] ? show_regs+0x26/0x2a
     73<Oct/17 03:54 pm>[6853629.759163]  [<ffffffff81520db8>] nmi_watchdog_tick+0xc3/0x1a5
     74<Oct/17 03:54 pm>[6853629.759165]  [<ffffffff81520360>] do_nmi+0xb2/0x259
     75<Oct/17 03:54 pm>[6853629.759167]  [<ffffffff8151fdfa>] nmi+0x1a/0x20
     76<Oct/17 03:54 pm>[6853629.759169]  [<ffffffff812c08b7>] ? delay_tsc+0x2d/0x59
     77<Oct/17 03:54 pm>[6853629.759170]  <<EOE>>  <IRQ>  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
     78<Oct/17 03:54 pm>[6853629.759174]  [<ffffffff812c08fe>] __delay+0xa/0xc
     79<Oct/17 03:54 pm>[6853629.759176]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
     80<Oct/17 03:54 pm>[6853629.759179]  [<ffffffff8151f193>] _raw_spin_lock+0x34/0x39
     81<Oct/17 03:54 pm>[6853629.759181]  [<ffffffff8102fb6b>] ? task_rq_lock+0x7e/0x9a
     82<Oct/17 03:54 pm>[6853629.759182]  [<ffffffff8102fb6b>] task_rq_lock+0x7e/0x9a
     83<Oct/17 03:54 pm>[6853629.759184]  [<ffffffff81057842>] ? hrtimer_wakeup+0x0/0x21
     84<Oct/17 03:54 pm>[6853629.759186]  [<ffffffff81036578>] try_to_wake_up+0x2e/0x34<Oct/17 03:54 pm>
     85                 <Oct/17 03:54 pm>[6853629.759188]  [<ffffffff81057842>] ? hrtimer_wakeup+0x0/0x21
     86<Oct/17 03:54 pm>[6853629.759191]  [<ffffffff810368b8>] wake_up_process+0x10/0x12
     87<Oct/17 03:54 pm>[6853629.759192]  [<ffffffff8105785f>] hrtimer_wakeup+0x1d/0x21
     88<Oct/17 03:54 pm>[6853629.759194]  [<ffffffff81057933>] __run_hrtimer+0xd0/0x12d
     89<Oct/17 03:54 pm>[6853629.759196]  [<ffffffff81057b81>] hrtimer_interrupt+0xb5/0x19f
     90<Oct/17 03:54 pm>[6853629.759199]  [<ffffffff810197a5>] smp_apic_timer_interrupt+0x82/0x95
     91<Oct/17 03:54 pm>[6853629.759201]  [<ffffffff81003353>] apic_timer_interrupt+0x13/0x20
     92<Oct/17 03:54 pm>[6853629.759202]  <EOI>
     93<Oct/17 03:54 pm>[6853629.759203] NMI backtrace for cpu 10
     94
     95<Oct/17 03:54 pm>[6853629.759204] CPU 10
     96<Oct/17 03:54 pm>[6853629.759205] Modules linked in: w83793 hwmon_vid autofs4 i2c_i801 i2c_core iTCO_wdt e1000e ioatdma dca rtc_cmos tg3 libphy e1000 fuse dm_snapshot dm_mirror dm_region_hash dm_log scsi_wait_scan qla2xxx megaraid_sas megaraid_mbox megaraid_mm aacraid 3w_9xxx 3w_xxxx arcmsr aic7xxx aic79xx sr_mod sg ata_piix ahci sata_sis sata_nv sata_via pata_sl82c105 pata_sis
     97<Oct/17 03:54 pm>[6853629.759218]
     98<Oct/17 03:54 pm>[6853629.759220] Pid: 19726, comm: ppImage Tainted: G      D    2.6.34.4 #3 S7010/empty
     99<Oct/17 03:54 pm>[6853629.759221] RIP: 0010:[<ffffffff812c08a2>]  [<ffffffff812c08a2>] delay_tsc+0x18/0x59
     100<Oct/17 03:54 pm>[6853629.759224] RSP: 0000:ffff88002c88b7a0  EFLAGS: 00000086
     101<Oct/17 03:54 pm>[6853629.759225] RAX: 000000008154e97c RBX: 00000000042ec12b RCX: 000000008154e938
     102<Oct/17 03:54 pm>[6853629.759227] RDX: 000000000040ee78 RSI: 000000000000000a RDI: 0000000000000001
     103<Oct/17 03:54 pm>[6853629.759228] RBP: ffff88002c88b7a8 R08: 000000000000000a R09: 000000000000000a
     104<Oct/17 03:54 pm>[6853629.759230] R10: 0000000000000000 R11: ffff88002c88b5d8 R12: ffff8806552b3c00
     105<Oct/17 03:54 pm>[6853629.759231] R13: 0000000000000000 R14: ffff880611553090 R15: ffff880611553518
     106<Oct/17 03:54 pm>[6853629.759233] FS:  000000004243e950(0063) GS:ffff880655280000(0000) knlGS:0000000000000000
     107<Oct/17 03:54 pm>[6853629.759235] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
     108<Oct/17 03:54 pm>[6853629.759236] CR2: 00007fa3e03daab0 CR3: 00000003e2c88000 CR4: 00000000000006e0
     109<Oct/17 03:54 pm>[6853629.759238] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
     110<Oct/17 03:54 pm>[6853629.759239] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
     111<Oct/17 03:54 pm>[6853629.759241] Process ppImage (pid: 19726, threadinfo ffff88002c88a000, task ffff880611553090)
     112<Oct/17 03:54 pm>[6853629.759242] Stack:
     113<Oct/17 03:54 pm>[6853629.759243]  ffffffff81019da9 ffff88002c88b7b8 ffffffff812c08fe ffff88002c88b7f8
     114<Oct/17 03:54 pm>[6853629.759245] <0> ffffffff812c4e65 000000009ef2e6b4 ffff8806552b3c00 ffff8806552b3c00
     115<Oct/17 03:54 pm>[6853629.759248] <0> ffff88065528e3f0 0000000000000400 0000000000000800 ffff88002c88b818
     116<Oct/17 03:54 pm>[6853629.759250] Call Trace:
     117
     118<Oct/17 03:54 pm>[6853629.759252]  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
     119<Oct/17 03:54 pm>[6853629.759254]  [<ffffffff812c08fe>] __delay+0xa/0xc
     120<Oct/17 03:54 pm>[6853629.759256]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
     121<Oct/17 03:54 pm>[6853629.759259]  [<ffffffff8151f0dc>] _raw_spin_lock_nested+0x32/0x36
     122<Oct/17 03:54 pm>[6853629.759261]  [<ffffffff81035934>] ? double_rq_lock+0x4a/0x76
     123<Oct/17 03:54 pm>[6853629.759263]  [<ffffffff81035934>] double_rq_lock+0x4a/0x76
     124<Oct/17 03:54 pm>[6853629.759265]  [<ffffffff81037672>] load_balance+0xbb6/0xf63
     125<Oct/17 03:54 pm>[6853629.759267]  [<ffffffff810b3cfb>] ? get_dirty_limits+0x22/0x258
     126<Oct/17 03:54 pm>[6853629.759270]  [<ffffffff8151cc0e>] schedule+0x25a/0x86a
     127<Oct/17 03:54 pm>[6853629.759272]  [<ffffffff810480a2>] ? lock_timer_base+0x26/0x4a
     128<Oct/17 03:54 pm>[6853629.759275]  [<ffffffff8151d559>] schedule_timeout+0x222/0x24c
     129<Oct/17 03:54 pm>[6853629.759277]  [<ffffffff810482a5>] ? process_timeout+0x0/0xb
     130<Oct/17 03:54 pm>[6853629.759279]  [<ffffffff8151c6c5>] io_schedule_timeout+0x45/0x5e
     131<Oct/17 03:54 pm>[6853629.759281]  [<ffffffff810c0abe>] congestion_wait+0x6b/0x87
     132<Oct/17 03:54 pm>[6853629.759284]  [<ffffffff81054b6c>] ? autoremove_wake_function+0x0/0x38
     133<Oct/17 03:54 pm>[6853629.759286]  [<ffffffff810b3279>] __alloc_pages_nodemask+0x65a/0x671
     134<Oct/17 03:54 pm>[6853629.759289]  [<ffffffff810da90f>] alloc_page_vma+0x148/0x14d
     135<Oct/17 03:54 pm>[6853629.759291]  [<ffffffff810c4d2a>] handle_mm_fault+0x294/0x73e
     136<Oct/17 03:54 pm>[6853629.759294]  [<ffffffff815227e9>] do_page_fault+0x351/0x375
     137<Oct/17 03:54 pm>[6853629.759296]  [<ffffffff8151e35f>] ? do_nanosleep+0x7b/0xb3
     138<Oct/17 03:54 pm>[6853629.759298]  [<ffffffff810348d8>] ? finish_task_switch+0x69/0xdd
     139<Oct/17 03:54 pm>[6853629.759300]  [<ffffffff8103486f>] ? finish_task_switch+0x0/0xdd
     140
     141<Oct/17 03:54 pm>[6853629.759302]  [<ffffffff81058477>] ? hrtimer_nanosleep+0x97/0x105
     142<Oct/17 03:54 pm>[6853629.759304]  [<ffffffff8106472c>] ? lockdep_sys_exit+0x20/0x75
     143<Oct/17 03:54 pm>[6853629.759307]  [<ffffffff8151ef6f>] ? lockdep_sys_exit_thunk+0x35/0x67
     144<Oct/17 03:54 pm>[6853629.759309]  [<ffffffff810c4dda>] ? handle_mm_fault+0x344/0x73e
     145<Oct/17 03:54 pm>[6853629.759311]  [<ffffffff8151fb5f>] page_fault+0x1f/0x30
     146                 <Oct/17 03:54 pm>[6853629.759312] Code: 2e 0f 1f 84 00 00 00 00 00 48 ff c8 75 fb 48 ff c8 c9 c3 55 48 89 e5 48 83 ec 08 65 8b 34 25 f0 d1 00 00 66 66 90 0f ae e8 0f 31 <89> c1 41 89 f1 66 66 90 0f ae e8 0f 31 89 c6 48 89 f0 48 29 c8
     147<Oct/17 03:54 pm>[6853629.759327] Call Trace:
     148<Oct/17 03:54 pm>[6853629.759329]  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
     149<Oct/17 03:54 pm>[6853629.759332]  [<ffffffff812c08fe>] __delay+0xa/0xc
     150<Oct/17 03:54 pm>[6853629.759333]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
     151<Oct/17 03:54 pm>[6853629.759336]  [<ffffffff8151f0dc>] _raw_spin_lock_nested+0x32/0x36
     152<Oct/17 03:54 pm>[6853629.759338]  [<ffffffff81035934>] ? double_rq_lock+0x4a/0x76
     153<Oct/17 03:54 pm>[6853629.759340]  [<ffffffff81035934>] double_rq_lock+0x4a/0x76
     154<Oct/17 03:54 pm>[6853629.759342]  [<ffffffff81037672>] load_balance+0xbb6/0xf63
     155<Oct/17 03:54 pm>[6853629.759344]  [<ffffffff810b3cfb>] ? get_dirty_limits+0x22/0x258
     156<Oct/17 03:54 pm>[6853629.759347]  [<ffffffff8151cc0e>] schedule+0x25a/0x86a
     157<Oct/17 03:54 pm>[6853629.759349]  [<ffffffff810480a2>] ? lock_timer_base+0x26/0x4a
     158<Oct/17 03:54 pm>[6853629.759352]  [<ffffffff8151d559>] schedule_timeout+0x222/0x24c
     159<Oct/17 03:54 pm>[6853629.759354]  [<ffffffff810482a5>] ? process_timeout+0x0/0xb
     160<Oct/17 03:54 pm>[6853629.759356]  [<ffffffff8151c6c5>] io_schedule_timeout+0x45/0x5e
     161<Oct/17 03:54 pm>[6853629.759358]  [<ffffffff810c0abe>] congestion_wait+0x6b/0x87
     162<Oct/17 03:54 pm>[6853629.759361]  [<ffffffff81054b6c>] ? autoremove_wake_function+0x0/0x38
     163
     164<Oct/17 03:54 pm>[6853629.759363]  [<ffffffff810b3279>] __alloc_pages_nodemask+0x65a/0x671
     165<Oct/17 03:54 pm>[6853629.759366]  [<ffffffff810da90f>] alloc_page_vma+0x148/0x14d
     166<Oct/17 03:54 pm>[6853629.759368]  [<ffffffff810c4d2a>] handle_mm_fault+0x294/0x73e
     167<Oct/17 03:54 pm>[6853629.759370]  [<ffffffff815227e9>] do_page_fault+0x351/0x375
     168<Oct/17 03:54 pm>[6853629.759372]  [<ffffffff8151e35f>] ? do_nanosleep+0x7b/0xb3
     169<Oct/17 03:54 pm>[6853629.759375]  [<ffffffff810348d8>] ? finish_task_switch+0x69/0xdd
     170<Oct/17 03:54 pm>[6853629.759377]  [<ffffffff8103486f>] ? finish_task_switch+0x0/0xdd
     171<Oct/17 03:54 pm>[6853629.759379]  [<ffffffff81058477>] ? hrtimer_nanosleep+0x97<Oct/17 03:54 pm>
     172                 <Oct/17 03:54 pm>[6853629.759381]  [<ffffffff8106472c>] ? lockdep_sys_exit+0x20/0x75
     173<Oct/17 03:54 pm>[6853629.759383]  [<ffffffff8151ef6f>] ? lockdep_sys_exit_thunk+0x35/0x67
     174<Oct/17 03:54 pm>[6853629.759385]  [<ffffffff810c4dda>] ? handle_mm_fault+0x344/0x73e
     175<Oct/17 03:54 pm>[6853629.759387]  [<ffffffff8151fb5f>] page_fault+0x1f/0x30
     176<Oct/17 03:54 pm>[6853629.759389] Pid: 19726, comm: ppImage Tainted: G      D    2.6.34.4 #3
     177<Oct/17 03:54 pm>[6853629.759390] Call Trace:
     178<Oct/17 03:54 pm>[6853629.759391]  <NMI>  [<ffffffff81009b2a>] ? show_regs+0x26/0x2a
     179<Oct/17 03:54 pm>[6853629.759395]  [<ffffffff81520db8>] nmi_watchdog_tick+0xc3/0x1a5
     180<Oct/17 03:54 pm>[6853629.759397]  [<ffffffff81520360>] do_nmi+0xb2/0x259
     181<Oct/17 03:54 pm>[6853629.759398]  [<ffffffff8151fdfa>] nmi+0x1a/0x20
     182<Oct/17 03:54 pm>[6853629.759400]  [<ffffffff812c08a2>] ? delay_tsc+0x18/0x59
     183<Oct/17 03:54 pm>[6853629.759402]  <<EOE>>  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
     184<Oct/17 03:54 pm>[6853629.759405]  [<ffffffff812c08fe>] __delay+0xa/0xc
     185<Oct/17 03:54 pm>[6853629.759407]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
     186
     187<Oct/17 03:54 pm>[6853629.759410]  [<ffffffff8151f0dc>] _raw_spin_lock_nested+0x32/0x36
     188<Oct/17 03:54 pm>[6853629.759412]  [<ffffffff81035934>] ? double_rq_lock+0x4a/0x76
     189<Oct/17 03:54 pm>[6853629.759414]  [<ffffffff81035934>] double_rq_lock+0x4a/0x76
     190<Oct/17 03:54 pm>[6853629.759416]  [<ffffffff81037672>] load_balance+0xbb6/0xf63
     191<Oct/17 03:54 pm>[6853629.759418]  [<ffffffff810b3cfb>] ? get_dirty_limits+0x22/0x258
     192<Oct/17 03:54 pm>[6853629.759421]  [<ffffffff8151cc0e>] schedule+0x25a/0x86a
     193<Oct/17 03:54 pm>[6853629.759423]  [<ffffffff810480a2>] ? lock_timer_base+0x26/0x4a
     194<Oct/17 03:54 pm>[6853629.759425]  [<ffffffff8151d559>] schedule_timeout+0x222/0x24c
     195<Oct/17 03:54 pm>[6853629.759428]  [<ffffffff810482a5>] ? process_timeout+0x0/0xb
     196<Oct/17 03:54 pm>[6853629.759430]  [<ffffffff8151c6c5>] io_schedule_timeout+0x45/0x5e
     197<Oct/17 03:54 pm>[6853629.759432]  [<ffffffff810c0abe>] congestion_wait+0x6b/0x87
     198<Oct/17 03:54 pm>[6853629.759435]  [<ffffffff81054b6c>] ? autoremove_wake_function+0x0/0x38
     199<Oct/17 03:54 pm>[6853629.759437]  [<ffffffff810b3279>] __alloc_pages_nodemask+0x65a/0x671
     200<Oct/17 03:54 pm>[6853629.759440]  [<ffffffff810da90f>] alloc_page_vma+0x148/0x14d
     201<Oct/17 03:54 pm>[6853629.759442]  [<ffffffff810c4d2a>] handle_mm_fault+0x294/0x73e
     202<Oct/17 03:54 pm>[6853629.759444]  [<ffffffff815227e9>] do_page_fault+0x351/0x375
     203<Oct/17 03:54 pm>[6853629.759446]  [<ffffffff8151e35f>] ? do_nanosleep+0x7b/0xb3
     204<Oct/17 03:54 pm>[6853629.759448]  [<ffffffff810348d8>] ? finish_task_switch+0x69/0xdd
     205<Oct/17 03:54 pm>[6853629.759451]  [<ffffffff8103486f>] ? finish_task_switch+0x0/0xdd
     206<Oct/17 03:54 pm>[6853629.759453]  [<ffffffff81058477>] ? hrtimer_nanosleep+0x97/0x105
     207<Oct/17 03:54 pm>[6853629.759455]  [<ffffffff8106472c>] ? lockdep_sys_exit+0x20/0x75
     208<Oct/17 03:54 pm>[6853629.759457]  [<ffffffff8151ef6f>] ? lockdep_sys_exit_thunk+0x35/0x67
     209
     210<Oct/17 03:54 pm>[6853629.759459]  [<ffffffff810c4dda>] ? handle_mm_fault+0x344/0x73e
     211<Oct/17 03:54 pm>[6853629.759461]  [<ffffffff8151fb5f>] page_fault+0x1f/0x30
     212<Oct/17 03:54 pm>[6853659.183500] Pid: 5270, comm: sshd Tainted: G      D    2.6.34.4 #3
     213<Oct/17 03:54 pm>[6853659.190210] Call Trace:
     214<Oct/17 03:54 pm>[6853659.193112]  [<ffffffff812c4e9f>] do_raw_spin_lock+0x118/0x147
     215<Oct/17 03:54 pm>[6853659.199477]  [<ffffffff8151f193>] _raw_spin_lock+0x34/0x39
     216<Oct/17 03:54 pm>[6853659.205508]  [<ffffffff8102fb6b>] ? task_rq_lock+0x7e/0x9a
     217<Oct/17 03:54 pm>[6853659.211511]  [<ffffffff8102fb6b>] task_rq_lock+0x7e/0x9a
     218<Oct/17 03:54 pm>[6853659.217311]  [<ffffffff81036578>] try_to_wake_up+0x2e/0x342
     219<Oct/17 03:54 pm>[6853659.223423]  [<ffffffff81036899>] default_wake_function+0xd/0xf
     220<Oct/17 03:54 pm>[6853659.229879]  [<ffffffff810f9aba>] pollwake+0x57/0x59
     221<Oct/17 03:54 pm>[6853659.235372]  [<ffffffff8103688c>] ? default_wake_function+0x0/0xf
     222<Oct/17 03:54 pm>[6853659.241972]  [<ffffffff8102c08d>] __wake_up_common+0x46/0x<Oct/17 03:54 pm>
     223                 <Oct/17 03:54 pm>[6853659.248166]  [<ffffffff8102fa4a>] __wake_up_sync_key+0x43/0x5a
     224<Oct/17 03:54 pm>[6853659.254519]  [<ffffffff8102fa6c>] __wake_up_sync+0xb/0xd
     225<Oct/17 03:54 pm>[6853659.260342]  [<ffffffff810f1b84>] pipe_write+0x4de/0x514
     226<Oct/17 03:54 pm>[6853659.266175]  [<ffffffff810f94de>] ? core_sys_select+0x3d/0x295
     227<Oct/17 03:54 pm>[6853659.272505]  [<ffffffff810ea282>] do_sync_write+0xc7/0x10d
     228<Oct/17 03:54 pm>[6853659.278483]  [<ffffffff8104a535>] ? sigprocmask+0x30/0xc8
     229<Oct/17 03:54 pm>[6853659.284420]  [<ffffffff812937db>] ? security_file_permission+0x11/0x13
     230<Oct/17 03:54 pm>[6853659.291495]  [<ffffffff810eaba1>] vfs_write+0xae/0x14a
     231<Oct/17 03:54 pm>[6853659.297151]  [<ffffffff810ead01>] sys_write+0x47/0x6e
     232
     233<Oct/17 03:54 pm>[6853659.302706]  [<ffffffff810029ab>] system_call_fastpath+0x16/0x1b
     234<Oct/17 03:54 pm>[6853659.309261] sending NMI to all CPUs:
     235<Oct/17 03:54 pm>[6853659.313300] NMI backtrace for cpu 1
     236<Oct/17 03:54 pm>[6853659.317269] CPU 1
     237<Oct/17 03:54 pm>[6853659.319352] Modules linked in: w83793 hwmon_vid autofs4 i2c_i801 i2c_core iTCO_wdt e1000e ioatdma dca rtc_cmos tg3 libphy e1000 fuse dm_snapshot dm_mirror dm_region_hash dm_log scsi_wait_scan qla2xxx megaraid_sas megaraid_mbox megaraid_mm aacraid 3w_9xxx 3w_xxxx arcmsr aic7xxx aic79xx sr_mod sg ata_piix ahci sata_sis sata_nv sata_via pata_sl82c105 pata_sis
     238<Oct/17 03:54 pm>[6853659.355218]
     239<Oct/17 03:54 pm>[6853659.357132] Pid: 8438, comm: nfsd Tainted: G      D    2.6.34.4 #3 S7010/empty
     240<Oct/17 03:54 pm>[6853659.365099] RIP: 0010:[<ffffffff812c08a2>]  [<ffffffff812c08a2>] delay_tsc+0x18/0x59
     241<Oct/17 03:54 pm>[6853659.373623] RSP: 0018:ffff880621efb9a8  EFLAGS: 00000092
     242<Oct/17 03:54 pm>[6853659.379434] RAX: 00000000daed9cc8 RBX: 00000000474a1b11 RCX: 00000000daed9c84
     243<Oct/17 03:54 pm>[6853659.387320] RDX: 000000000040ee8a RSI: 0000000000000001 RDI: 0000000000000001
     244<Oct/17 03:54 pm>[6853659.395179] RBP: ffff880621efb9b0 R08: 0000000000000001 R09: 0000000000000001
     245<Oct/17 03:54 pm>[6853659.403074] R10: 0000000000000000 R11: ffff880621efb7e0 R12: ffff880655253c00
     246<Oct/17 03:54 pm>[6853659.410919] R13: 0000000000000000 R14: ffff880621ef2060 R15: ffff880621ef24e8
     247<Oct/17 03:54 pm>[6853659.418789] FS:  0000000000000000(0000) GS:ffff880002620000(0000) knlGS:0000000000000000
     248<Oct/17 03:54 pm>[6853659.427625] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
     249<Oct/17 03:54 pm>[6853659.433907] CR2: 00007fa3dcdf1330 CR3: 0000000ad0e7b000 CR4: 00000000000006e0
     250<Oct/17 03:54 pm>[6853659.441783] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
     251<Oct/17 03:54 pm>[6853659.449669] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
     252<Oct/17 03:54 pm>[6853659.457522] Process nfsd (pid: 8438, threadinfo ffff880621efa000, task ffff880621ef2060)
     253<Oct/17 03:54 pm>[6853659.466374] Stack:
     254<Oct/17 03:54 pm>[6853659.468814]  ffffffff81019da9 ffff880621efb9c0 ffffffff812c08fe ffff880621efba00
     255
     256<Oct/17 03:54 pm>[6853659.476760] <0> ffffffff812c4e65 000000009ef2e6b4 ffff880655253c00 ffff880621ed8000
     257<Oct/17 03:54 pm>[6853659.485435] <0> 0000000000013c00 ffff880621efba70 0000000000000001 ffff880621efba20
     258<Oct/17 03:54 pm>[6853659.494514] Call Trace:
     259<Oct/17 03:54 pm>[6853659.497391]  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
     260<Oct/17 03:54 pm>[6853659.505138]  [<ffffffff812c08fe>] __delay+0xa/0xc
     261<Oct/17 03:54 pm>[6853659.510364]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
     262<Oct/17 03:54 pm>[6853659.516619]  [<ffffffff8151f193>] _raw_spin_lock+0x34/0x39
     263<Oct/17 03:54 pm>[6853659.522633]  [<ffffffff8102fb6b>] ? task_rq_lock+0x7e/0x9a
     264<Oct/17 03:54 pm>[6853659.528629]  [<ffffffff8102fb6b>] task_rq_lock+0x7e/0x9a
     265<Oct/17 03:54 pm>[6853659.534462]  [<ffffffff81036578>] try_to_wake_up+0x2e/0x342
     266<Oct/17 03:54 pm>[6853659.540530]  [<ffffffff81036899>] default_wake_function+0xd/0xf
     267<Oct/17 03:54 pm>[6853659.546997]  [<ffffffff81054b7d>] autoremove_wake_function+0x11/0x38
     268<Oct/17 03:54 pm>[6853659.553912]  [<ffffffff8102c08d>] __wake_up_common+0x46/0x76
     269<Oct/17 03:54 pm>[6853659.560074]  [<ffffffff8102faa6>] __wake_up+0x38/0x4f
     270<Oct/17 03:54 pm>[6853659.565643]  [<ffffffff8144b2f8>] release_sock+0xd3/0xe4
     271<Oct/17 03:54 pm>[6853659.571470]  [<ffffffff8149c3f8>] udp_sendpage+0x124/0x13c
     272<Oct/17 03:54 pm>[6853659.577511]  [<ffffffff81261435>] ? xfs_iunlock+0x5d/0xb5
     273<Oct/17 03:54 pm>[6853659.583430]  [<ffffffff814a1b41>] inet_sendpage+0x61/0x8e
     274<Oct/17 03:54 pm>[6853659.589375]  [<ffffffff81446e42>] kernel_sendpage+0x16/0x1f
     275<Oct/17 03:54 pm>[6853659.595487]  [<ffffffff814f33b3>] svc_send_common+0xb9/0x11d
     276<Oct/17 03:54 pm>[6853659.601669]  [<ffffffff814f353c>] svc_sendto+0x125/0x17e
     277                 <Oct/17 03:54 pm>[6853659.607507]  [<ffffffff814fc1aa>] ? svc_send+0x56/0xa1
     278
     279<Oct/17 03:54 pm>[6853659.613140]  [<ffffffff8151e1c3>] ? mutex_lock_nested+0x24b/0x25a
     280<Oct/17 03:54 pm>[6853659.619749]  [<ffffffff814f35ae>] svc_udp_sendto+0x19/0x2e
     281<Oct/17 03:54 pm>[6853659.625734]  [<ffffffff814fc1bb>] svc_send+0x67/0xa1
     282<Oct/17 03:54 pm>[6853659.631200]  [<ffffffff814f07bb>] svc_process+0x71b/0x72a
     283<Oct/17 03:54 pm>[6853659.637114]  [<ffffffff811f0ccf>] ? nfsd+0x0/0x139
     284<Oct/17 03:54 pm>[6853659.642406]  [<ffffffff811f0dc2>] nfsd+0xf3/0x139
     285<Oct/17 03:54 pm>[6853659.652141]  [<ffffffff810546e2>] kthread+0x7d/0x85
     286<Oct/17 03:54 pm>[6853659.657530]  [<ffffffff81003794>] kernel_thread_helper+0x4/0x10
     287<Oct/17 03:54 pm>[6853659.663958]  [<ffffffff81054665>] ? kthread+0x0/0x85
     288<Oct/17 03:54 pm>[6853659.669414]  [<ffffffff81003790>] ? kernel_thread_helper+0x0/0x10
     289<Oct/17 03:54 pm>[6853659.676064] Code: 2e 0f 1f 84 00 00 00 00 00 48 ff c8 75 fb 48 ff c8 c9 c3 55 48 89 e5 48 83 ec 08 65 8b 34 25 f0 d1 00 00 66 66 90 0f ae e8 0f 31 <89> c1 41 89 f1 66 66 90 0f ae e8 0f 31 89 c6 48 89 f0 48 29 c8
     290<Oct/17 03:54 pm>[6853659.699375] Call Trace:
     291<Oct/17 03:54 pm>[6853659.702269]  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
     292<Oct/17 03:54 pm>[6853659.710044]  [<ffffffff812c08fe>] __delay+0xa/0xc
     293<Oct/17 03:54 pm>[6853659.715211]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
     294<Oct/17 03:54 pm>[6853659.721480]  [<ffffffff8151f193>] _raw_spin_lock+0x34/0x39
     295<Oct/17 03:54 pm>[6853659.727492]  [<ffffffff8102fb6b>] ? task_rq_lock+0x7e/0x9a
     296<Oct/17 03:54 pm>[6853659.733525]  [<ffffffff8102fb6b>] task_rq_lock+0x7e/0x9a
     297<Oct/17 03:54 pm>[6853659.739357]  [<ffffffff81036578>] try_to_wake_up+0x2e/0x342
     298<Oct/17 03:54 pm>[6853659.745478]  [<ffffffff81036899>] default_wake_function+0xd/0xf
     299<Oct/17 03:54 pm>[6853659.751951]  [<ffffffff81054b7d>] autoremove_wake_function+0x11/0x38
     300<Oct/17 03:54 pm>[6853659.758862]  [<ffffffff8102c08d>] __wake_up_common+0x46/0x76
     301
     302<Oct/17 03:54 pm>[6853659.765029]  [<ffffffff8102faa6>] __wake_up+0x38/0x4f
     303<Oct/17 03:54 pm>[6853659.770601]  [<ffffffff8144b2f8>] release_sock+0xd3/0xe4
     304<Oct/17 03:54 pm>[6853659.776400]  [<ffffffff8149c3f8>] udp_sendpage+0x124/0x13c
     305<Oct/17 03:54 pm>[6853659.782432]  [<ffffffff81261435>] ? xfs_iunlock+0x5d/0xb5
     306<Oct/17 03:54 pm>[6853659.788325]  [<ffffffff814a1b41>] inet_sendpage+0x61/0x8e
     307<Oct/17 03:54 pm>[6853659.794219]  [<ffffffff81446e42>] kernel_sendpage+0x16/0x1f
     308<Oct/17 03:54 pm>[6853659.800304]  [<ffffffff814f33b3>] svc_send_common+0xb9/0x11d
     309<Oct/17 03:54 pm>[6853659.806494]  [<ffffffff814f353c>] svc_sendto+0x125/0x17e
     310<Oct/17 03:54 pm>[6853659.812316]  [<ffffffff814fc1aa>] ? svc_send+0x56/0xa1
     311<Oct/17 03:54 pm>[6853659.817993]  [<ffffffff8151e1c3>] ? mutex_lock_nested+0x24b/0x25a
     312<Oct/17 03:54 pm>[6853659.824625]  [<ffffffff814f35ae>] svc_udp_sendto+0x19/0x2e
     313<Oct/17 03:54 pm>[6853659.830622]  [<ffffffff814fc1bb>] svc_send+0x67/0xa1
     314<Oct/17 03:54 pm>[6853659.836078]  [<ffffffff814f07bb>] svc_process+0x71b/0x72a
     315<Oct/17 03:54 pm>[6853659.841974]  [<ffffffff811f0ccf>] ? nfsd+0x0/0x139<Oct/17 03:54 pm>[6853659.847249]  [<ffffffff811f0dc2>] nfsd+0xf3/0x139
     316<Oct/17 03:54 pm>[6853659.852475]  [<ffffffff810546e2>] kthread+0x7d/0x85
     317<Oct/17 03:54 pm>[6853659.857858]  [<ffffffff81003794>] kernel_thread_helper+0x4/0x10
     318<Oct/17 03:54 pm>[6853659.864318]  [<ffffffff81054665>] ? kthread+0x0/0x85
     319<Oct/17 03:54 pm>[6853659.869820]  [<ffffffff81003790>] ? kernel_thread_helper+0x0/0x10
     320<Oct/17 03:54 pm>[6853659.876454] Pid: 8438, comm: nfsd Tainted: G      D    2.6.34.4 #3
     321<Oct/17 03:54 pm>[6853659.883151] Call Trace:
     322<Oct/17 03:54 pm>[6853659.886062]  <NMI>  [<ffffffff81009b2a>] ? show_regs+0x26/0x2a
     323
     324<Oct/17 03:54 pm>[6853659.892455]  [<ffffffff81520db8>] nmi_watchdog_tick+0xc3/0x1a5
     325<Oct/17 03:54 pm>[6853659.898814]  [<ffffffff81520360>] do_nmi+0xb2/0x259
     326<Oct/17 03:54 pm>[6853659.904192]  [<ffffffff8151fdfa>] nmi+0x1a/0x20
     327<Oct/17 03:54 pm>[6853659.909219]  [<ffffffff812c08a2>] ? delay_tsc+0x18/0x59
     328<Oct/17 03:54 pm>[6853659.914967]  <<EOE>>  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
     329<Oct/17 03:54 pm>[6853659.923603]  [<ffffffff812c08fe>] __delay+0xa/0xc
     330<Oct/17 03:54 pm>[6853659.928841]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
     331<Oct/17 03:54 pm>[6853659.935120]  [<ffffffff8151f193>] _raw_spin_lock+0x34/0x39
     332<Oct/17 03:54 pm>[6853659.941161]  [<ffffffff8102fb6b>] ? task_rq_lock+0x7e/0x9a
     333<Oct/17 03:54 pm>[6853659.947175]  [<ffffffff8102fb6b>] task_rq_lock+0x7e/0x9a
     334<Oct/17 03:54 pm>[6853659.953024]  [<ffffffff81036578>] try_to_wake_up+0x2e/0x342
     335<Oct/17 03:54 pm>[6853659.959126]  [<ffffffff81036899>] default_wake_function+0xd/0xf
     336<Oct/17 03:54 pm>[6853659.965584]  [<ffffffff81054b7d>] autoremove_wake_function+0x11/0x38
     337<Oct/17 03:54 pm>[6853659.972493]  [<ffffffff8102c08d>] __wake_up_common+0x46/0x76
     338<Oct/17 03:54 pm>[6853659.978698]  [<ffffffff8102faa6>] __wake_up+0x38/0x4f
     339<Oct/17 03:54 pm>[6853659.984268]  [<ffffffff8144b2f8>] release_sock+0xd3/0xe4
     340<Oct/17 03:54 pm>[6853659.990102]  [<ffffffff8149c3f8>] udp_sendpage+0x124/0x13c
     341<Oct/17 03:54 pm>[6853659.996092]  [<ffffffff81261435>] ? xfs_iunlock+0x5d/0xb5
     342<Oct/17 03:54 pm>[6853660.002002]  [<ffffffff814a1b41>] inet_sendpage+0x61/0x8e
     343<Oct/17 03:54 pm>[6853660.007930]  [<ffffffff81446e42>] kernel_sendpage+0x16/0x1f
     344<Oct/17 03:54 pm>[6853660.014058]  [<ffffffff814f33b3>] svc_send_common+0xb9/0x11d
     345<Oct/17 03:54 pm>[6853660.020239]  [<ffffffff814f353c>] svc_sendto+0x125/0x17e
     346
     347<Oct/17 03:54 pm>[6853660.026069]  [<ffffffff814fc1aa>] ? svc_send+0x56/0xa1
     348<Oct/17 03:54 pm>[6853660.031713]  [<ffffffff8151e1c3>] ? mutex_lock_nested+0x24b/0x25a
     349<Oct/17 03:54 pm>[6853660.038362]  [<ffffffff814f35ae>] svc_udp_sendto+0x19/0x2e
     350<Oct/17 03:54 pm>[6853660.044376]  [<ffffffff814fc1bb>] svc_send+0x67/0xa1
     351<Oct/17 03:54 pm>[6853660.049877]  [<ffffffff814f07bb>] svc_process+0x71b/0x72a
     352<Oct/17 03:54 pm>[6853660.055798]  [<ffffffff811f0ccf>] ? nfsd+0x0/0x139
     353<Oct/17 03:54 pm>[6853660.061091]  [<ffffffff811f0dc2>] nfsd+0xf3/0x139
     354<Oct/17 03:54 pm>[6853660.066275]  [<ffffffff810546e2>] kthread+0x7d/0x85
     355<Oct/17 03:54 pm>[6853660.071673]  [<ffffffff81003794>] kernel_thread_helper+0x4/0x10
     356<Oct/17 03:54 pm>[6853660.078144]  [<ffffffff81054665>] ? kthread+0x0/0x85
     357<Oct/17 03:54 pm>[6853660.083619]  [<ffffffff81003790>] ? kernel_thread_helper+0x0/0x10
     358<Oct/17 03:54 pm>[6853660.090260] NMI backtrace for cpu 5
     359<Oct/17 03:54 pm>[6853660.094220] CPU 5
     360<Oct/17 03:54 pm>[6853660.096319] Modules linked in: w83793 hwmon_vid autofs4 i2c_i801 i2c_core iTCO_wdt e1000e ioatdma dca rtc_cmos tg3 libphy e1000 fuse dm_snapshot dm_mirror dm_region_hash dm_log scsi_wait_scan qla2xxx megaraid_sas megaraid_mbox megaraid_mm aacraid 3w_9xxx 3w_xxxx arcmsr aic7xxx aic79xx sr_mod sg ata_piix ahci sata_sis sata_nv sata_via pata_sl82c105 pata_sis
     361<Oct/17 03:54 pm>[6853660.132159]
     362<Oct/17 03:54 pm>[6853660.134062] Pid: 5270, comm: sshd Tainted: G      D    2.6.34.4 #3 S7010/empty
     363<Oct/17 03:54 pm>[6853660.142015] RIP: 0010:[<ffffffff812c08af>]  [<ffffffff812c08af>] delay_tsc+0x25/0x59
     364<Oct/17 03:54 pm>[6853660.150563] RSP: 0018:ffff88037e3e1ad0  EFLAGS: 00000046
     365<Oct/17 03:54 pm>[6853660.156376] RAX: 00000000daf1afa4 RBX: 0000000000000000 RCX: 00000000daf1af58
     366<Oct/17 03:54 pm>[6853660.164261] RDX: 000000000040ee8a RSI: 00000000daf1af78 RDI: 00000000000411b2
     367<Oct/17 03:54 pm>[6853660.172123] RBP: ffff88037e3e1ad8 R08: 0000000000000005 R09: 0000000000000005
     368<Oct/17 03:54 pm>[6853660.180001] R10: ffff8800000bc600 R11: 0000000000000082 R12: 0000000000001000
     369
     370<Oct/17 03:54 pm>[6853660.187854] R13: 0000000000000002 R14: 0000000000000096 R15: ffff880372ec0020
     371<Oct/17 03:54 pm>[6853660.195723] FS:  00007fb16effc6f0(0000) GS:ffff8800026a0000(0000) knlGS:0000000000000000
     372<Oct/17 03:54 pm>[6853660.204582] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
     373<Oct/17 03:54 pm>[6853660.210832] CR2: 00007f5ad9eeae87 CR3: 000000050e583000 CR4: 00000000000006e0
     374<Oct/17 03:54 pm>[6853660.218717] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
     375<Oct/17 03:54 pm>[6853660.226593] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
     376<Oct/17 03:54 pm>[6853660.234473] Process sshd (pid: 5270, threadinfo ffff88037e3e0000, task ffff880372ec3090)
     377<Oct/17 03:54 pm>[6853660.243333] Stack:
     378<Oct/17 03:54 pm>[6853660.245781]  ffff88037e3e1879 ffff88037e3e1ae8 ffffffff812c093d ffff88037e3e1b08
     379<Oct/17 03:54 pm>[6853660.253710] <0> ffffffff810197e9 0000000000000006 000000000000d200 ffff88037e3e1b48
     380<Oct/17 03:54 pm>[6853660.262394] <0> ffffffff81019c76 ffffffff81b24210 0000000000000000 ffff8806552b3c00
     381<Oct/17 03:54 pm>[6853660.271483] Call Trace:
     382<Oct/17 03:54 pm>[6853660.274370]  [<ffffffff812c093d>] __const_udelay+0x3d/0x3f
     383<Oct/17 03:54 pm>[6853660.280377]  [<ffffffff810197e9>] native_safe_apic_wait_icr_idle+0x31/0x48
     384<Oct/17 03:54 pm>[6853660.287793]  [<ffffffff81019c76>] default_send_IPI_mask_sequence_phys+0x49/0xab
     385<Oct/17 03:54 pm>[6853660.295879]  [<ffffffff8101c5d8>] physflat_send_IPI_all+0x14/0x16
     386<Oct/17 03:54 pm>[6853660.302488]  [<ffffffff81019d94>] arch_trigger_all_cpu_backtrace+0x3c/0x5d
     387<Oct/17 03:54 pm>[6853660.309934]  [<ffffffff812c4ea4>] do_raw_spin_lock+0x11d/0x147
     388<Oct/17 03:54 pm>[6853660.316286]  [<ffffffff8151f193>] _raw_spin_lock+0x34/0x39
     389<Oct/17 03:54 pm>[6853660.322299]  [<ffffffff8102fb6b>] ? task_rq_lock+0x7e/0x9a
     390<Oct/17 03:54 pm>[6853660.328286]  [<ffffffff8102fb6b>] task_rq_lock+0x7e/0x9a
     391<Oct/17 03:54 pm>[6853660.334103]  [<ffffffff81036578>] try_to_wake_up+0x2e/0x342
     392
     393<Oct/17 03:54 pm>[6853660.340205]  [<ffffffff81036899>] default_wake_function+0xd/0xf
     394<Oct/17 03:54 pm>[6853660.346671]  [<ffffffff810f9aba>] pollwake+0x57/0x59
     395<Oct/17 03:54 pm>[6853660.352163]  [<ffffffff8103688c>] ? default_wake_function+0x0/0xf
     396<Oct/17 03:54 pm>[6853660.358788]  [<ffffffff8102c08d>] __wake_up_common+0x46/0x76
     397<Oct/17 03:54 pm>[6853660.364982]  [<ffffffff8102fa4a>] __wake_up_sync_key+0x43/0x5a
     398<Oct/17 03:54 pm>[6853660.371335]  [<ffffffff8102fa6c>] __wake_up_sync+0xb/0xd
     399<Oct/17 03:54 pm>[6853660.377160]  [<ffffffff810f1b84>] pipe_write+0x4de/0x514
     400<Oct/17 03:54 pm>[6853660.382982]  [<ffffffff810f94de>] ? core_sys_select+0x3d/0x295
     401<Oct/17 03:54 pm>[6853660.389322]  [<ffffffff810ea282>] do_sync_write+0xc7/0x10d
     402<Oct/17 03:54 pm>[6853660.395336]  [<ffffffff8104a535>] ? sigprocmask+0x30/0xc8
     403<Oct/17 03:54 pm>[6853660.401265]  [<ffffffff812937db>] ? security_file_permission+0x11/0x13
     404<Oct/17 03:54 pm>[6853660.408357]  [<ffffffff810eaba1>] vfs_write+0xae/0x14a
     405<Oct/17 03:54 pm>[6853660.414028]  [<ffffffff810ead01>] sys_write+0x47/0x6e
     406<Oct/17 03:54 pm>[6853660.419593]  [<ffffffff810029ab>] system_call_fastpath+0x16/0x1b
     407<Oct/17 03:54 pm>[6853660.426121] Code: fb 48 ff c8 c9 c3 55 48 89 e5 48 83 ec 08 65 8b 34 25 f0 d1 00 00 66 66 90 0f ae e8 0f 31 89 c1 41 89 f1 66 66 90 0f ae e8 0f 31 <89> c6 48 89 f0 48 29 c8 48 39 f8 73 25 f3 90 65 44 8b 04 25 f0
     408<Oct/17 03:54 pm>[6853660.449425] Call Trace:
     409<Oct/17 03:54 pm>[6853660.452319]  [<ffffffff812c093d>] __const_udelay+0x3d/0x3f
     410<Oct/17 03:54 pm>[6853660.458336]  [<ffffffff810197e9>] native_safe_apic_wait_icr_idle+0x31/0x48
     411<Oct/17 03:54 pm>[6853660.465768]  [<ffffffff81019c76>] default_send_IPI_mask_sequence_phys+0x49/0xab
     412<Oct/17 03:54 pm>[6853660.473831]  [<ffffffff8101c5d8>] physflat_send_IPI_all+0x14/0x16
     413<Oct/17 03:54 pm>[6853660.480491]  [<ffffffff81019d94>] arch_trigger_all_cpu_bac<Oct/17 03:54 pm>
     414                 <Oct/17 03:54 pm>[6853660.487947]  [<ffffffff812c4ea4>] do_raw_spin_lock+0x11d/0x147
     415
     416<Oct/17 03:54 pm>[6853660.494287]  [<ffffffff8151f193>] _raw_spin_lock+0x34/0x39
     417<Oct/17 03:54 pm>[6853660.500284]  [<ffffffff8102fb6b>] ? task_rq_lock+0x7e/0x9a
     418<Oct/17 03:54 pm>[6853660.506274]  [<ffffffff8102fb6b>] task_rq_lock+0x7e/0x9a
     419<Oct/17 03:54 pm>[6853660.512097]  [<ffffffff81036578>] try_to_wake_up+0x2e/0x342
     420<Oct/17 03:54 pm>[6853660.518172]  [<ffffffff81036899>] default_wake_function+0xd/0xf
     421<Oct/17 03:54 pm>[6853660.524604]  [<ffffffff810f9aba>] pollwake+0x57/0x59
     422<Oct/17 03:54 pm>[6853660.530113]  [<ffffffff8103688c>] ? default_wake_function+0x0/0xf
     423<Oct/17 03:54 pm>[6853660.536738]  [<ffffffff8102c08d>] __wake_up_common+0x46/0x76
     424<Oct/17 03:54 pm>[6853660.542934]  [<ffffffff8102fa4a>] __wake_up_sync_key+0x43/0x5a
     425<Oct/17 03:54 pm>[6853660.549296]  [<ffffffff8102fa6c>] __wake_up_sync+0xb/0xd
     426<Oct/17 03:54 pm>[6853660.555119]  [<ffffffff810f1b84>] pipe_write+0x4de/0x514
     427<Oct/17 03:54 pm>[6853660.560961]  [<ffffffff810f94de>] ? core_sys_select+0x3d/0x295
     428<Oct/17 03:54 pm>[6853660.567297]  [<ffffffff810ea282>] do_sync_write+0xc7/0x10d
     429<Oct/17 03:54 pm>[6853660.573285]  [<ffffffff8104a535>] ? sigprocmask+0x30/0xc8
     430<Oct/17 03:54 pm>[6853660.579214]  [<ffffffff812937db>] ? security_file_permission+0x11/0x13
     431<Oct/17 03:54 pm>[6853660.586289]  [<ffffffff810eaba1>] vfs_write+0xae/0x14a
     432<Oct/17 03:54 pm>[6853660.591953]  [<ffffffff810ead01>] sys_write+0x47/0x6e
     433<Oct/17 03:54 pm>[6853660.597526]  [<ffffffff810029ab>] system_call_fastpath+0x16/0x1b
     434<Oct/17 03:54 pm>[6853660.604072] Pid: 5270, comm: sshd Tainted: G      D    2.6.34.4 #3
     435<Oct/17 03:54 pm>[6853660.610814] Call Trace:
     436<Oct/17 03:54 pm>[6853660.613715]  <NMI>  [<ffffffff81009b2a>] ? show_regs+0x26/0x2a
     437<Oct/17 03:54 pm>[6853660.620107]  [<ffffffff81520db8>] nmi_watchdog_tick+0xc3/0x1a5
     438
     439<Oct/17 03:54 pm>[6853660.626485]  [<ffffffff81520360>] do_nmi+0xb2/0x259
     440<Oct/17 03:54 pm>[6853660.631862]  [<ffffffff8151fdfa>] nmi+0x1a/0x20
     441<Oct/17 03:54 pm>[6853660.636881]  [<ffffffff812c08af>] ? delay_tsc+0x25/0x59
     442<Oct/17 03:54 pm>[6853660.642601]  <<EOE>>  [<ffffffff812c093d>] __const_udelay+0x3d/0x3f
     443<Oct/17 03:54 pm>[6853660.649446]  [<ffffffff810197e9>] native_safe_apic_wait_icr_idle+0x31/0x48
     444<Oct/17 03:54 pm>[6853660.661397]  [<ffffffff81019c76>] default_send_IPI_mask_sequence_phys+0x49/0xab
     445<Oct/17 03:54 pm>[6853660.669441]  [<ffffffff8101c5d8>] physflat_send_IPI_all+0x14/0x16
     446<Oct/17 03:54 pm>[6853660.676061]  [<ffffffff81019d94>] arch_trigger_all_cpu_backtrace+0x3c/0x5d
     447<Oct/17 03:54 pm>[6853660.683490]  [<ffffffff812c4ea4>] do_raw_spin_lock+0x11d/0x147
     448<Oct/17 03:54 pm>[6853660.689832]  [<ffffffff8151f193>] _raw_spin_lock+0x34/0x39
     449<Oct/17 03:54 pm>[6853660.695845]  [<ffffffff8102fb6b>] ? task_rq_lock+0x7e/0x9a
     450<Oct/17 03:54 pm>[6853660.701868]  [<ffffffff8102fb6b>] task_rq_lock+0x7e/0x9a
     451<Oct/17 03:54 pm>[6853660.707667]  [<ffffffff81036578>] try_to_wake_up+0x2e/0x342
     452<Oct/17 03:54 pm>[6853660.713750]  [<ffffffff81036899>] default_wake_function+0xd/0xf
     453<Oct/17 03:54 pm>[6853660.720166]  [<ffffffff810f9aba>] pollwake+0x57/0x59
     454<Oct/17 03:54 pm>[6853660.725648]  [<ffffffff8103688c>] ? default_wake_function+<Oct/17 03:54 pm>
     455                 <Oct/17 03:54 pm>[6853660.732274]  [<ffffffff8102c08d>] __wake_up_common+0x46/0x76
     456<Oct/17 03:54 pm>[6853660.738495]  [<ffffffff8102fa4a>] __wake_up_sync_key+0x43/0x5a
     457<Oct/17 03:54 pm>[6853660.744847]  [<ffffffff8102fa6c>] __wake_up_sync+0xb/0xd
     458<Oct/17 03:54 pm>[6853660.750646]  [<ffffffff810f1b84>] pipe_write+0x4de/0x514
     459<Oct/17 03:54 pm>[6853660.756469]  [<ffffffff810f94de>] ? core_sys_select+0x3d/0x295
     460<Oct/17 03:54 pm>[6853660.762825]  [<ffffffff810ea282>] do_sync_write+0xc7/0x10d
     461
     462<Oct/17 03:54 pm>[6853660.768846]  [<ffffffff8104a535>] ? sigprocmask+0x30/0xc8
     463<Oct/17 03:54 pm>[6853660.774749]  [<ffffffff812937db>] ? security_file_permission+0x11/0x13
     464<Oct/17 03:54 pm>[6853660.781850]  [<ffffffff810eaba1>] vfs_write+0xae/0x14a
     465<Oct/17 03:54 pm>[6853660.787522]  [<ffffffff810ead01>] sys_write+0x47/0x6e
     466<Oct/17 03:54 pm>[6853660.793095]  [<ffffffff810029ab>] system_call_fastpath+0x16/0x1b
     467<Oct/17 03:54 pm>[6853660.799616] NMI backtrace for cpu 6
     468                 <Oct/17 03:54 pm>[6853660.803575] CPU 6
     469<Oct/17 03:54 pm>[6853660.805669] Modules linked in: w83793 hwmon_vid autofs4 i2c_i801 i2c_core iTCO_wdt e1000e ioatdma dca rtc_cmos tg3 libphy e1000 fuse dm_snapshot dm_mirror dm_region_hash dm_log scsi_wait_scan qla2xxx megaraid_sas megaraid_mbox megaraid_mm aacraid 3w_9xxx 3w_xxxx arcmsr aic7xxx aic79xx sr_mod sg ata_piix ahci sata_sis sata_nv sata_via pata_sl82c105 pata_sis
     470<Oct/17 03:54 pm>[6853660.841447]
     471<Oct/17 03:54 pm>[6853660.843360] Pid: 8402, comm: nfsd Tainted: G      D    2.6.34.4 #3 S7010/empty
     472<Oct/17 03:54 pm>[6853660.851292] RIP: 0010:[<ffffffff812c08a2>]  [<ffffffff812c08a2>] delay_tsc+0x18/0x59
     473<Oct/17 03:54 pm>[6853660.859807] RSP: 0018:ffff880655203ce0  EFLAGS: 00000082
     474<Oct/17 03:54 pm>[6853660.865646] RAX: 00000000c72bf6a8 RBX: 00000000467b1e4c RCX: 00000000c72bf660
     475<Oct/17 03:54 pm>[6853660.873521] RDX: 000000000040ee8b RSI: 0000000000000006 RDI: 0000000000000001
     476<Oct/17 03:54 pm>[6853660.881386] RBP: ffff880655203ce8 R08: 0000000000000006 R09: 0000000000000006
     477<Oct/17 03:54 pm>[6853660.889237] R10: 0000000000000000 R11: ffff880655203b18 R12: ffff880655213c00
     478<Oct/17 03:54 pm>[6853660.897115] R13: 0000000000000000 R14: ffff880621c69030 R15: ffff880621c694b8
     479<Oct/17 03:54 pm>[6853660.904977] FS:  0000000000000000(0000) GS:ffff880655200000(0000) knlGS:0000000000000000
     480<Oct/17 03:54 pm>[6853660.913821] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
     481<Oct/17 03:54 pm>[6853660.920113] CR2: fffffffb9092c200 CR3: 0000000001a8a000 CR4: 00000000000006e0
     482<Oct/17 03:54 pm>[6853660.927969] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
     483<Oct/17 03:54 pm>[6853660.935856] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
     484
     485<Oct/17 03:54 pm>[6853660.943734] Process nfsd (pid: 8402, threadinfo ffff880621c72000, task ffff880621c69030)
     486<Oct/17 03:54 pm>[6853660.952536] Stack:
     487<Oct/17 03:54 pm>[6853660.954983]  ffffffff81019da9 ffff880655203cf8 ffffffff812c08fe ffff880655203d38
     488<Oct/17 03:54 pm>[6853660.962940] <0> ffffffff812c4e65 000000009ef2e6b4 ffff880655213c00 ffff880c2377c0c0
     489<Oct/17 03:54 pm>[6853660.971613] <0> ffff880655213c00 0000000000000000 0000000000000006 ffff880655203d58
     490<Oct/17 03:54 pm>[6853660.980639] Call Trace:
     491                 <Oct/17 03:54 pm>[6853660.983535]  <IRQ>
     492<Oct/17 03:54 pm>[6853660.986137]  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
     493<Oct/17 03:54 pm>[6853660.993907]  [<ffffffff812c08fe>] __delay+0xa/0xc
     494<Oct/17 03:54 pm>[6853660.999127]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
     495<Oct/17 03:54 pm>[6853661.005405]  [<ffffffff8151f193>] _raw_spin_lock+0x34/0x39
     496<Oct/17 03:54 pm>[6853661.011410]  [<ffffffff8103666d>] ? try_to_wake_up+0x123/0x342
     497<Oct/17 03:54 pm>[6853661.017773]  [<ffffffff8103666d>] try_to_wake_up+0x123/0x342
     498<Oct/17 03:54 pm>[6853661.023968]  [<ffffffff81036899>] default_wake_function+0xd/0xf
     499<Oct/17 03:54 pm>[6853661.030444]  [<ffffffff810f9aba>] pollwake+0x57/0x59
     500<Oct/17 03:54 pm>[6853661.035928]  [<ffffffff8103688c>] ? default_wake_function+0x0/0xf
     501<Oct/17 03:54 pm>[6853661.042570]  [<ffffffff8102c08d>] __wake_up_common+0x46/0x76
     502<Oct/17 03:54 pm>[6853661.048765]  [<ffffffff8102faa6>] __wake_up+0x38/0x4f
     503<Oct/17 03:54 pm>[6853661.054326]  [<ffffffff8103b959>] printk_tick+0x39/0x3b
     504<Oct/17 03:54 pm>[6853661.060065]  [<ffffffff810483c7>] update_process_times+0x3f/0x59
     505<Oct/17 03:54 pm>[6853661.066629]  [<ffffffff810610b4>] tick_sched_timer+0x73/0x9d
     506<Oct/17 03:54 pm>[6853661.072816]  [<ffffffff81061041>] ? tick_sched_timer+0x0/0x9d
     507
     508<Oct/17 03:54 pm>[6853661.079091]  [<ffffffff81057933>] __run_hrtimer+0xd0/0x12d
     509<Oct/17 03:54 pm>[6853661.085121]  [<ffffffff81057b81>] hrtimer_interrupt+0xb5/0x19f
     510<Oct/17 03:54 pm>[6853661.091485]  [<ffffffff810197a5>] smp_apic_timer_interrupt+0x82/0x95
     511<Oct/17 03:54 pm>[6853661.098394]  [<ffffffff81003353>] apic_timer_interrupt+0x13/0x20
     512<Oct/17 03:54 pm>[6853661.104934]  <EOI>
     513<Oct/17 03:54 pm>[6853661.107124] Code: 2e 0f 1f 84 00 00 00 00 00 48 ff c8 75 fb 48 ff c8 c9 c3 55 48 89 e5 48 83 ec 08 65 8b 34 25 f0 d1 00 00 66 66 90 0f ae e8 0f 31 <89> c1 41 89 f1 66 66 90 0f ae e8 0f 31 89 c6 48 89 f0 48 29 c8
     514<Oct/17 03:54 pm>[6853661.130831] Call Trace:
     515<Oct/17 03:54 pm>[6853661.133707]  <IRQ>  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
     516<Oct/17 03:54 pm>[6853661.142178]  [<ffffffff812c08fe>] __delay+0xa/0xc
     517<Oct/17 03:54 pm>[6853661.147403]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
     518<Oct/17 03:54 pm>[6853661.153690]  [<ffffffff8151f193>] _raw_spin_lock+0x34/0x39
     519<Oct/17 03:54 pm>[6853661.159704]  [<ffffffff8103666d>] ? try_to_wake_up+0x123/0x342
     520<Oct/17 03:54 pm>[6853661.166057]  [<ffffffff8103666d>] try_to_wake_up+0x123/0x342
     521<Oct/17 03:54 pm>[6853661.172235]  [<ffffffff81036899>] default_wake_function+0xd/0xf
     522<Oct/17 03:54 pm>[6853661.178711]  [<ffffffff810f9aba>] pollwake+0x57/0x59
     523<Oct/17 03:54 pm>[6853661.184210]  [<ffffffff8103688c>] ? default_wake_function+0x0/0xf
     524<Oct/17 03:54 pm>[6853661.190862]  [<ffffffff8102c08d>] __wake_up_common+0x46/0x76
     525<Oct/17 03:54 pm>[6853661.197039]  [<ffffffff8102faa6>] __wake_up+0x38/0x4f
     526<Oct/17 03:54 pm>[6853661.202601]  [<ffffffff8103b959>] printk_tick+0x39/0x3b
     527                 <Oct/17 03:54 pm>[6853661.208349]  [<ffffffff810483c7>] update_process_times+0x3f/0x59
     528<Oct/17 03:54 pm>[6853661.214879]  [<ffffffff810610b4>] tick_sched_timer+0x73/0x9d
     529<Oct/17 03:54 pm>[6853661.221073]  [<ffffffff81061041>] ? tick_sched_timer+0x0/0x9d
     530
     531<Oct/17 03:54 pm>[6853661.227348]  [<ffffffff81057933>] __run_hrtimer+0xd0/0x12d
     532<Oct/17 03:54 pm>[6853661.233344]  [<ffffffff81057b81>] hrtimer_interrupt+0xb5/0x19f
     533<Oct/17 03:54 pm>[6853661.239715]  [<ffffffff810197a5>] smp_apic_timer_interrupt+0x82/0x95
     534<Oct/17 03:54 pm>[6853661.246601]  [<ffffffff81003353>] apic_timer_interrupt+0x13/0x20
     535<Oct/17 03:54 pm>[6853661.253125]  <EOI> Pid: 8402, comm: nfsd Tainted: G      D    2.6.34.4 #3
     536<Oct/17 03:54 pm>[6853661.260521] Call Trace:
     537<Oct/17 03:54 pm>[6853661.263410]  <NMI>  [<ffffffff81009b2a>] ? show_regs+0x26/0x2a
     538<Oct/17 03:54 pm>[6853661.269801]  [<ffffffff81520db8>] nmi_watchdog_tick+0xc3/0x1a5
     539<Oct/17 03:54 pm>[6853661.276153]  [<ffffffff81520360>] do_nmi+0xb2/0x259
     540<Oct/17 03:54 pm>[6853661.281575]  [<ffffffff8151fdfa>] nmi+0x1a/0x20
     541<Oct/17 03:54 pm>[6853661.286592]  [<ffffffff812c08a2>] ? delay_tsc+0x18/0x59
     542<Oct/17 03:54 pm>[6853661.292305]  <<EOE>>  <IRQ>  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
     543<Oct/17 03:54 pm>[6853661.301589]  [<ffffffff812c08fe>] __delay+0xa/0xc
     544<Oct/17 03:54 pm>[6853661.306787]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
     545<Oct/17 03:54 pm>[6853661.313066]  [<ffffffff8151f193>] _raw_spin_lock+0x34/0x39
     546<Oct/17 03:54 pm>[6853661.319097]  [<ffffffff8103666d>] ? try_to_wake_up+0x123/0x342
     547<Oct/17 03:54 pm>[6853661.325458]  [<ffffffff8103666d>] try_to_wake_up+0x123/0x342
     548<Oct/17 03:54 pm>[6853661.331647]  [<ffffffff81036899>] default_wake_function+0xd/0xf
     549<Oct/17 03:54 pm>[6853661.338112]  [<ffffffff810f9aba>] pollwake+0x57/0x59
     550<Oct/17 03:54 pm>[6853661.343596]  [<ffffffff8103688c>] ? default_wake_function+0x0/0xf
     551<Oct/17 03:54 pm>[6853661.350205]  [<ffffffff8102c08d>] __wake_up_common+0x46/0x76
     552<Oct/17 03:54 pm>[6853661.356390]  [<ffffffff8102faa6>] __wake_up+0x38/0x4f
     553
     554<Oct/17 03:54 pm>[6853661.361970]  [<ffffffff8103b959>] printk_tick+0x39/0x3b
     555<Oct/17 03:54 pm>[6853661.367734]  [<ffffffff810483c7>] update_process_times+0x3f/0x59
     556<Oct/17 03:54 pm>[6853661.374254]  [<ffffffff810610b4>] tick_sched_timer+0x73/0x9d
     557<Oct/17 03:54 pm>[6853661.380468]  [<ffffffff81061041>] ? tick_sched_timer+0x0/0x9d
     558<Oct/17 03:54 pm>[6853661.386725]  [<ffffffff81057933>] __run_hrtimer+0xd0/0x12d
     559<Oct/17 03:54 pm>[6853661.392714]  [<ffffffff81057b81>] hrtimer_interrupt+0xb5/0x19f
     560<Oct/17 03:54 pm>[6853661.399068]  [<ffffffff810197a5>] smp_apic_timer_interrupt+0x82/0x95
     561<Oct/17 03:54 pm>[6853661.405934]  [<ffffffff81003353>] apic_timer_interrupt+0x13/0x20
     562<Oct/17 03:54 pm>[6853661.412493]  <EOI>
     563<Oct/17 03:54 pm>[6853661.414689] NMI backtrace for cpu 7
     564<Oct/17 03:54 pm>[6853661.419053] CPU 7
     565<Oct/17 03:54 pm>[6853661.421162] Modules linked in: w83793 hwmon_vid autofs4 i2c_i801 i2c_core iTCO_wdt e1000e ioatdma dca rtc_cmos tg3 libphy e1000 fuse dm_snapshot dm_mirror dm_region_hash dm_log scsi_wait_scan qla2xxx megaraid_sas megaraid_mbox megaraid_mm aacraid 3w_9xxx 3w_xxxx arcmsr aic7xxx aic79xx sr_mod sg ata_piix ahci sata_sis sata_nv sata_via pata_sl82c105 pata_sis
     566<Oct/17 03:54 pm>[6853661.457037]
     567<Oct/17 03:54 pm>[6853661.458949] Pid: 19727, comm: ppImage Tainted: G      D    2.6.34.4 #3 S7010/empty
     568<Oct/17 03:54 pm>[6853661.467292] RIP: 0010:[<ffffffff812c088a>]  [<ffffffff812c088a>] delay_tsc+0x0/0x59
     569<Oct/17 03:54 pm>[6853661.475728] RSP: 0000:ffff880088bb97b0  EFLAGS: 00000002
     570<Oct/17 03:54 pm>[6853661.481575] RAX: 0000000000000000 RBX: 000000004aaa6716 RCX: 00000000c7300a38
     571<Oct/17 03:54 pm>[6853661.489468] RDX: 0000000000001900 RSI: 00000000c7300a54 RDI: 0000000000000001
     572<Oct/17 03:54 pm>[6853661.497363] RBP: ffff880088bb97b8 R08: 0000000000000007 R09: 0000000000000007
     573<Oct/17 03:54 pm>[6853661.505224] R10: 0000000000000000 R11: ffff880088bb95d8 R12: ffff8806552b3c00
     574<Oct/17 03:54 pm>[6853661.513128] R13: 0000000000000000 R14: ffff880611552060 R15: ffff8806115524e8
     575<Oct/17 03:54 pm>[6853661.520991] FS:  0000000041128950(0063) GS:ffff880655220000(0000) knlGS:0000000000000000
     576
     577<Oct/17 03:54 pm>[6853661.529826] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
     578<Oct/17 03:54 pm>[6853661.536091] CR2: 00007fa3df2d2be0 CR3: 00000003e2c88000 CR4: 00000000000006e0
     579<Oct/17 03:54 pm>[6853661.544001] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
     580<Oct/17 03:54 pm>[6853661.551880] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
     581<Oct/17 03:54 pm>[6853661.559712] Process ppImage (pid: 19727, threadinfo ffff880088bb8000, task ffff880611552060)
     582<Oct/17 03:54 pm>[6853661.568930] Stack:
     583<Oct/17 03:54 pm>[6853661.571378]  ffffffff812c08fe ffff880088bb97f8 ffffffff812c4e65 000000009ef2e6b4
     584<Oct/17 03:54 pm>[6853661.579324] <0> ffff8806552b3c00 ffff8806552b3c00 ffff88065522e3f0 0000000000000400
     585<Oct/17 03:54 pm>[6853661.587948] <0> 0000000000000800 ffff880088bb9818 ffffffff8151f0dc ffffffff81035934
     586<Oct/17 03:54 pm>[6853661.601586] Call Trace:
     587<Oct/17 03:54 pm>[6853661.604479]  [<ffffffff812c08fe>] ? __delay+0xa/0xc
     588<Oct/17 03:54 pm>[6853661.609889]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
     589<Oct/17 03:54 pm>[6853661.616168]  [<ffffffff8151f0dc>] _raw_spin_lock_nested+0x32/0x36
     590<Oct/17 03:54 pm>[6853661.622807]  [<ffffffff81035934>] ? double_rq_lock+0x4a/0x76
     591<Oct/17 03:54 pm>[6853661.629011]  [<ffffffff81035934>] double_rq_lock+0x4a/0x76
     592<Oct/17 03:54 pm>[6853661.635024]  [<ffffffff81037672>] load_balance+0xbb6/0xf63
     593<Oct/17 03:54 pm>[6853661.641014]  [<ffffffff810b3cfb>] ? get_dirty_limits+0x22/0x258
     594<Oct/17 03:54 pm>[6853661.647508]  [<ffffffff8151cc0e>] schedule+0x25a/0x86a
     595<Oct/17 03:54 pm>[6853661.653173]  [<ffffffff810480a2>] ? lock_timer_base+0x26/0x4a
     596<Oct/17 03:54 pm>[6853661.659432]  [<ffffffff8151d559>] schedule_timeout+0x222/0x24c
     597<Oct/17 03:54 pm>[6853661.665803]  [<ffffffff810482a5>] ? process_timeout+0x0/0xb
     598<Oct/17 03:54 pm>[6853661.671896]  [<ffffffff8151c6c5>] io_schedule_timeout+0x45/0x5e
     599
     600<Oct/17 03:54 pm>[6853661.678353]  [<ffffffff810c0abe>] congestion_wait+0x6b/0x87
     601<Oct/17 03:54 pm>[6853661.684452]  [<ffffffff81054b6c>] ? autoremove_wake_function+0x0/0x38
     602<Oct/17 03:54 pm>[6853661.691442]  [<ffffffff810b3279>] __alloc_pages_nodemask+0x65a/0x671
     603<Oct/17 03:54 pm>[6853661.698358]  [<ffffffff810da90f>] alloc_page_vma+0x148/0x14d
     604<Oct/17 03:54 pm>[6853661.704552]  [<ffffffff810c4d2a>] handle_mm_fault+0x294/0x73e
     605<Oct/17 03:54 pm>[6853661.710861]  [<ffffffff815227e9>] do_page_fault+0x351/0x375
     606<Oct/17 03:54 pm>[6853661.716980]  [<ffffffff8151e35f>] ? do_nanosleep+0x7b/0xb3
     607<Oct/17 03:54 pm>[6853661.723003]  [<ffffffff810348d8>] ? finish_task_switch+0x69/0xdd
     608<Oct/17 03:54 pm>[6853661.729523]  [<ffffffff8103486f>] ? finish_task_switch+0x0<Oct/17 03:54 pm>
     609                 <Oct/17 03:54 pm>[6853661.735988]  [<ffffffff81058477>] ? hrtimer_nanosleep+0x97/0x105
     610<Oct/17 03:54 pm>[6853661.742539]  [<ffffffff81057842>] ? hrtimer_wakeup+0x0/0x21
     611<Oct/17 03:54 pm>[6853661.748641]  [<ffffffff8151ef6f>] ? lockdep_sys_exit_thunk+0x35/0x67
     612<Oct/17 03:54 pm>[6853661.755568]  [<ffffffff810c4dda>] ? handle_mm_fault+0x344/0x73e
     613<Oct/17 03:54 pm>[6853661.762014]  [<ffffffff8151fb5f>] page_fault+0x1f/0x30
     614<Oct/17 03:54 pm>[6853661.767653] Code: 90 55 48 89 f8 48 89 e5 48 85 c0 74 19 eb 02 66 90 eb 0e 66 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 48 ff c8 75 fb 48 ff c8 c9 c3 <55> 48 89 e5 48 83 ec 08 65 8b 34 25 f0 d1 00 00 66 66 90 0f ae
     615<Oct/17 03:54 pm>[6853661.790940] Call Trace:
     616<Oct/17 03:54 pm>[6853661.793836]  [<ffffffff812c08fe>] ? __delay+0xa/0xc
     617<Oct/17 03:54 pm>[6853661.799191]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
     618<Oct/17 03:54 pm>[6853661.805452]  [<ffffffff8151f0dc>] _raw_spin_lock_nested+0x32/0x36
     619<Oct/17 03:54 pm>[6853661.812084]  [<ffffffff81035934>] ? double_rq_lock+0x4a/0x76
     620<Oct/17 03:54 pm>[6853661.818297]  [<ffffffff81035934>] double_rq_lock+0x4a/0x76
     621                 <Oct/17 03:54 pm>[6853661.824320]  [<ffffffff81037672>] load_balance+0xbb6/0xf63
     622
     623<Oct/17 03:54 pm>[6853661.830317]  [<ffffffff810b3cfb>] ? get_dirty_limits+0x22/0x258
     624<Oct/17 03:54 pm>[6853661.836803]  [<ffffffff8151cc0e>] schedule+0x25a/0x86a
     625<Oct/17 03:54 pm>[6853661.842451]  [<ffffffff810480a2>] ? lock_timer_base+0x26/0x4a
     626<Oct/17 03:54 pm>[6853661.848710]  [<ffffffff8151d559>] schedule_timeout+0x222/0x24c
     627<Oct/17 03:54 pm>[6853661.855071]  [<ffffffff810482a5>] ? process_timeout+0x0/0xb
     628<Oct/17 03:54 pm>[6853661.861172]  [<ffffffff8151c6c5>] io_schedule_timeout+0x45/0x5e
     629<Oct/17 03:54 pm>[6853661.867631]  [<ffffffff810c0abe>] congestion_wait+0x6b/0x87
     630<Oct/17 03:54 pm>[6853661.873758]  [<ffffffff81054b6c>] ? autoremove_wake_function+0x0/0x38
     631<Oct/17 03:54 pm>[6853661.880782]  [<ffffffff810b3279>] __alloc_pages_nodemask+0x65a/0x671
     632<Oct/17 03:54 pm>[6853661.887689]  [<ffffffff810da90f>] alloc_page_vma+0x148/0x14d
     633<Oct/17 03:55 pm>[6853661.893857]  [<ffffffff810c4d2a>] handle_mm_fault+0x294/0x73e
     634<Oct/17 03:55 pm>[6853661.900121]  [<ffffffff815227e9>] do_page_fault+0x351/0x375
     635<Oct/17 03:55 pm>[6853661.906240]  [<ffffffff8151e35f>] ? do_nanosleep+0x7b/0xb3
     636<Oct/17 03:55 pm>[6853661.912247]  [<ffffffff810348d8>] ? finish_task_switch+0x69/0xdd
     637<Oct/17 03:55 pm>[6853661.918792]  [<ffffffff8103486f>] ? finish_task_switch+0x0/0xdd
     638<Oct/17 03:55 pm>[6853661.925249]  [<ffffffff81058477>] ? hrtimer_nanosleep+0x97/0x105
     639<Oct/17 03:55 pm>[6853661.931793]  [<ffffffff81057842>] ? hrtimer_wakeup+0x0/0x21
     640<Oct/17 03:55 pm>[6853661.937902]  [<ffffffff8151ef6f>] ? lockdep_sys_exit_thunk+0x35/0x67
     641<Oct/17 03:55 pm>[6853661.944819]  [<ffffffff810c4dda>] ? handle_mm_fault+0x344/0x73e
     642<Oct/17 03:55 pm>[6853661.951282]  [<ffffffff8151fb5f>] page_fault+0x1f/0x30
     643<Oct/17 03:55 pm>[6853661.956941] Pid: 19727, comm: ppImage Tainted: G      D    2.6.34.4 #3
     644<Oct/17 03:55 pm>[6853661.964042] Call Trace:
     645
     646<Oct/17 03:55 pm>[6853661.966916]  <NMI>  [<ffffffff81009b2a>] ? show_regs+0x26/0x2a
     647<Oct/17 03:55 pm>[6853661.973273]  [<ffffffff81520db8>] nmi_watchdog_tick+0xc3/0x1a5
     648<Oct/17 03:55 pm>[6853661.979668]  [<ffffffff81520360>] do_nmi+0xb2/0x259
     649<Oct/17 03:55 pm>[6853661.985037]  [<ffffffff8151fdfa>] nmi+0x1a/0x20
     650<Oct/17 03:55 pm>[6853661.990047]  [<ffffffff812c088a>] ? delay_tsc+0x0/0x59
     651                 <Oct/17 03:55 pm>[6853661.995715]  <<EOE>>  [<ffffffff812c08fe>] ? __delay+0xa/0xc
     652<Oct/17 03:55 pm>[6853662.001926]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
     653<Oct/17 03:55 pm>[6853662.008192]  [<ffffffff8151f0dc>] _raw_spin_lock_nested+0x32/0x36
     654<Oct/17 03:55 pm>[6853662.014806]  [<ffffffff81035934>] ? double_rq_lock+0x4a/0x76
     655<Oct/17 03:55 pm>[6853662.020984]  [<ffffffff81035934>] double_rq_lock+0x4a/0x76
     656<Oct/17 03:55 pm>[6853662.026962]  [<ffffffff81037672>] load_balance+0xbb6/0xf63
     657<Oct/17 03:55 pm>[6853662.032962]  [<ffffffff810b3cfb>] ? get_dirty_limits+0x22/0x258
     658<Oct/17 03:55 pm>[6853662.039409]  [<ffffffff8151cc0e>] schedule+0x25a/0x86a
     659<Oct/17 03:55 pm>[6853662.045059]  [<ffffffff810480a2>] ? lock_timer_base+0x26/0x4a
     660<Oct/17 03:55 pm>[6853662.051336]  [<ffffffff8151d559>] schedule_timeout+0x222/0x24c
     661<Oct/17 03:55 pm>[6853662.057671]  [<ffffffff810482a5>] ? process_timeout+0x0/0xb
     662<Oct/17 03:55 pm>[6853662.063781]  [<ffffffff8151c6c5>] io_schedule_timeout+0x45/0x5e
     663<Oct/17 03:55 pm>[6853662.070238]  [<ffffffff810c0abe>] congestion_wait+0x6b/0x8<Oct/17 03:55 pm>
     664                 <Oct/17 03:55 pm>[6853662.076340]  [<ffffffff81054b6c>] ? autoremove_wake_function+0x0/0x38
     665<Oct/17 03:55 pm>[6853662.083310]  [<ffffffff810b3279>] __alloc_pages_nodemask+0x65a/0x671
     666<Oct/17 03:55 pm>[6853662.090209]  [<ffffffff810da90f>] alloc_page_vma+0x148/0x14d
     667<Oct/17 03:55 pm>[6853662.096403]  [<ffffffff810c4d2a>] handle_mm_fault+0x294/0x73e
     668
     669<Oct/17 03:55 pm>[6853662.102651]  [<ffffffff815227e9>] do_page_fault+0x351/0x375
     670<Oct/17 03:55 pm>[6853662.108763]  [<ffffffff8151e35f>] ? do_nanosleep+0x7b/0xb3
     671<Oct/17 03:55 pm>[6853662.114784]  [<ffffffff810348d8>] ? finish_task_switch+0x69/0xdd
     672<Oct/17 03:55 pm>[6853662.121331]  [<ffffffff8103486f>] ? finish_task_switch+0x0/0xdd
     673<Oct/17 03:55 pm>[6853662.127832]  [<ffffffff81058477>] ? hrtimer_nanosleep+0x97/0x105
     674<Oct/17 03:55 pm>[6853662.134383]  [<ffffffff81057842>] ? hrtimer_wakeup+0x0/0x21
     675<Oct/17 03:55 pm>[6853662.140499]  [<ffffffff8151ef6f>] ? lockdep_sys_exit_thunk+0x35/0x67
     676<Oct/17 03:55 pm>[6853662.147420]  [<ffffffff810c4dda>] ? handle_mm_fault+0x344/0x73e
     677<Oct/17 03:55 pm>[6853662.153857]  [<ffffffff8151fb5f>] page_fault+0x1f/0x30
     678<Oct/17 03:55 pm>[6853662.159504] NMI backtrace for cpu 8
     679<Oct/17 03:55 pm>[6853662.163453] CPU 8
     680<Oct/17 03:55 pm>[6853662.165551] Modules linked in: w83793 hwmon_vid autofs4 i2c_i801 i2c_core iTCO_wdt e1000e ioatdma dca rtc_cmos tg3 libphy e1000 fuse dm_snapshot dm_mirror dm_region_hash dm_log scsi_wait_scan qla2xxx megaraid_sas megaraid_mbox megaraid_mm aacraid 3w_9xxx 3w_xxxx arcmsr aic7xxx aic79xx sr_mod sg ata_piix ahci sata_sis sata_nv sata_via pata_sl82c105 pata_sis
     681<Oct/17 03:55 pm>[6853662.201375]
     682<Oct/17 03:55 pm>[6853662.203296] Pid: 8429, comm: nfsd Tainted: G      D    2.6.34.4 #3 S7010/empty
     683<Oct/17 03:55 pm>[6853662.211253] RIP: 0010:[<ffffffff812c08a0>]  [<ffffffff812c08a0>] delay_tsc+0x16/0x59
     684<Oct/17 03:55 pm>[6853662.219814] RSP: 0018:ffff880621ee16b8  EFLAGS: 00000096
     685<Oct/17 03:55 pm>[6853662.225660] RAX: 0000000000000000 RBX: 000000004aa9f2fe RCX: 00000000c7341cd8
     686<Oct/17 03:55 pm>[6853662.233511] RDX: 0000000000001900 RSI: 0000000000000008 RDI: 0000000000000001
     687<Oct/17 03:55 pm>[6853662.241412] RBP: ffff880621ee16c0 R08: 0000000000000008 R09: 0000000000000008
     688<Oct/17 03:55 pm>[6853662.249292] R10: 0000000000000000 R11: ffff880621ee14f0 R12: ffff8806552b3c00
     689<Oct/17 03:55 pm>[6853662.257197] R13: 0000000000000000 R14: ffff880621ed8000 R15: ffff880621ed8488
     690<Oct/17 03:55 pm>[6853662.265076] FS:  0000000000000000(0000) GS:ffff880655240000(0000) knlGS:0000000000000000
     691
     692<Oct/17 03:55 pm>[6853662.273954] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
     693<Oct/17 03:55 pm>[6853662.280194] CR2: 0000000003178f50 CR3: 0000000001a8a000 CR4: 00000000000006e0
     694<Oct/17 03:55 pm>[6853662.288087] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
     695<Oct/17 03:55 pm>[6853662.295983] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
     696<Oct/17 03:55 pm>[6853662.303860] Process nfsd (pid: 8429, threadinfo ffff880621ee0000, task ffff880621ed8000)
     697<Oct/17 03:55 pm>[6853662.312703] Stack:
     698<Oct/17 03:55 pm>[6853662.315161]  ffffffff81019da9 ffff880621ee16d0 ffffffff812c08fe ffff880621ee1710
     699<Oct/17 03:55 pm>[6853662.323073] <0> ffffffff812c4e65 000000009ef2e6b4 ffff8806552b3c00 ffff8806552b3c00
     700<Oct/17 03:55 pm>[6853662.331758] <0> ffff88065524e3f0 0000000000000400 0000000000000800 ffff880621ee1730
     701<Oct/17 03:55 pm>[6853662.340852] Call Trace:
     702<Oct/17 03:55 pm>[6853662.343738]  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
     703<Oct/17 03:55 pm>[6853662.351510]  [<ffffffff812c08fe>] __delay+0xa/0xc
     704<Oct/17 03:55 pm>[6853662.356728]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
     705<Oct/17 03:55 pm>[6853662.363026]  [<ffffffff8151f0dc>] _raw_spin_lock_nested+0x32/0x36
     706<Oct/17 03:55 pm>[6853662.369649]  [<ffffffff81035934>] ? double_rq_lock+0x4a/0x76
     707<Oct/17 03:55 pm>[6853662.375834]  [<ffffffff81035934>] double_rq_lock+0x4a/0x76
     708<Oct/17 03:55 pm>[6853662.381874]  [<ffffffff81037672>] load_balance+0xbb6/0xf63
     709<Oct/17 03:55 pm>[6853662.387908]  [<ffffffff810b2173>] ? __pagevec_free+0x70/0x85
     710<Oct/17 03:55 pm>[6853662.394116]  [<ffffffff8151cc0e>] schedule+0x25a/0x86a
     711<Oct/17 03:55 pm>[6853662.399737]  [<ffffffff8144b38b>] lock_sock_nested+0x82/0xe2
     712<Oct/17 03:55 pm>[6853662.405937]  [<ffffffff81054b6c>] ? autoremove_wake_function+0x0/0x38
     713<Oct/17 03:55 pm>[6853662.412941]  [<ffffffff81452976>] skb_free_datagram_locked+0x14/0x2c
     714
     715<Oct/17 03:55 pm>[6853662.419831]  [<ffffffff8149bbfb>] udp_recvmsg+0x1a5/0x209
     716<Oct/17 03:55 pm>[6853662.425730]  [<ffffffff8144a75d>] sock_common_recvmsg+0x32/0x47
     717<Oct/17 03:55 pm>[6853662.432196]  [<ffffffff81448584>] sock_recvmsg+0xc1/0xda
     718<Oct/17 03:55 pm>[6853662.438030]  [<ffffffff810480a2>] ? lock_timer_base+0x26/0x4a
     719<Oct/17 03:55 pm>[6853662.444304]  [<ffffffff810480a2>] ? lock_timer_base+0x26/0x4a
     720<Oct/17 03:55 pm>[6853662.450570]  [<ffffffff81048174>] ? try_to_del_timer_sync+0xae/0xbb
     721<Oct/17 03:55 pm>[6853662.457360]  [<ffffffff814485d2>] kernel_recvmsg+0x35/0x41
     722<Oct/17 03:55 pm>[6853662.463363]  [<ffffffff814f1954>] svc_udp_recvfrom+0xa1/0x2f9
     723<Oct/17 03:55 pm>[6853662.469639]  [<ffffffff814fc980>] svc_recv+0x758/0x7f5
     724<Oct/17 03:55 pm>[6853662.475313]  [<ffffffff814fc1d9>] ? svc_send+0x85/0xa1
     725<Oct/17 03:55 pm>[6853662.480973]  [<ffffffff8103688c>] ? default_wake_function+0x0/0xf
     726<Oct/17 03:55 pm>[6853662.487613]  [<ffffffff811f0ccf>] ? nfsd+0x0/0x139
     727<Oct/17 03:55 pm>[6853662.492922]  [<ffffffff811f0d78>] nfsd+0xa9/0x139
     728<Oct/17 03:55 pm>[6853662.498131]  [<ffffffff810546e2>] kthread+0x7d/0x85
     729<Oct/17 03:55 pm>[6853662.503514]  [<ffffffff81003794>] kernel_thread_helper+0x4/0x10
     730<Oct/17 03:55 pm>[6853662.509966]  [<ffffffff81054665>] ? kthread+0x0/0x85
     731<Oct/17 03:55 pm>[6853662.515457]  [<ffffffff81003790>] ? kernel_thread_helper+0x0/0x10
     732<Oct/17 03:55 pm>[6853662.522075] Code: 66 66 2e 0f 1f 84 00 00 00 00 00 48 ff c8 75 fb 48 ff c8 c9 c3 55 48 89 e5 48 83 ec 08 65 8b 34 25 f0 d1 00 00 66 66 90 0f ae e8 <0f> 31 89 c1 41 89 f1 66 66 90 0f ae e8 0f 31 89 c6 48 89 f0 48
     733<Oct/17 03:55 pm>[6853662.545331] Call Trace:
     734                 <Oct/17 03:55 pm>[6853662.548202]  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
     735<Oct/17 03:55 pm>[6853662.555974]  [<ffffffff812c08fe>] __delay+0xa/0xc
     736<Oct/17 03:55 pm>[6853662.561167]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
     737
     738<Oct/17 03:55 pm>[6853662.567410]  [<ffffffff8151f0dc>] _raw_spin_lock_nested+0x32/0x36
     739<Oct/17 03:55 pm>[6853662.574016]  [<ffffffff81035934>] ? double_rq_lock+0x4a/0x76
     740<Oct/17 03:55 pm>[6853662.580201]  [<ffffffff81035934>] double_rq_lock+0x4a/0x76
     741<Oct/17 03:55 pm>[6853662.586225]  [<ffffffff81037672>] load_balance+0xbb6/0xf63
     742<Oct/17 03:55 pm>[6853662.592259]  [<ffffffff810b2173>] ? __pagevec_free+0x70/0x85
     743<Oct/17 03:55 pm>[6853662.598465]  [<ffffffff8151cc0e>] schedule+0x25a/0x86a
     744<Oct/17 03:55 pm>[6853662.604122]  [<ffffffff8144b38b>] lock_sock_nested+0x82/0xe2
     745<Oct/17 03:55 pm>[6853662.610310]  [<ffffffff81054b6c>] ? autoremove_wake_function+0x0/0x38
     746<Oct/17 03:55 pm>[6853662.617300]  [<ffffffff81452976>] skb_free_datagram_locked<Oct/17 03:55 pm>
     747                 <Oct/17 03:55 pm>[6853662.624207]  [<ffffffff8149bbfb>] udp_recvmsg+0x1a5/0x209
     748<Oct/17 03:55 pm>[6853662.634640]  [<ffffffff8144a75d>] sock_common_recvmsg+0x32/0x47
     749<Oct/17 03:55 pm>[6853662.641107]  [<ffffffff81448584>] sock_recvmsg+0xc1/0xda
     750<Oct/17 03:55 pm>[6853662.646911]  [<ffffffff810480a2>] ? lock_timer_base+0x26/0<Oct/17 03:55 pm>
     751                 <Oct/17 03:55 pm>[6853662.653171]  [<ffffffff810480a2>] ? lock_timer_base+0x26/0x4a
     752<Oct/17 03:55 pm>[6853662.659453]  [<ffffffff81048174>] ? try_to_del_timer_sync+0xae/0xbb
     753<Oct/17 03:55 pm>[6853662.666302]  [<ffffffff814485d2>] kernel_recvmsg+0x35/0x41
     754<Oct/17 03:55 pm>[6853662.672287]  [<ffffffff814f1954>] svc_udp_recvfrom+0xa1/0x2f9
     755<Oct/17 03:55 pm>[6853662.678573]  [<ffffffff814fc980>] svc_recv+0x758/0x7f5
     756<Oct/17 03:55 pm>[6853662.684220]  [<ffffffff814fc1d9>] ? svc_send+0x85/0xa1
     757<Oct/17 03:55 pm>[6853662.689863]  [<ffffffff8103688c>] ? default_wake_function+0x0/0xf
     758<Oct/17 03:55 pm>[6853662.696496]  [<ffffffff811f0ccf>] ? nfsd+0x0/0x139
     759<Oct/17 03:55 pm>[6853662.701796]  [<ffffffff811f0d78>] nfsd+0xa9/0x139
     760
     761<Oct/17 03:55 pm>[6853662.707006]  [<ffffffff810546e2>] kthread+0x7d/0x85
     762<Oct/17 03:55 pm>[6853662.712380]  [<ffffffff81003794>] kernel_thread_helper+0x4/0x10
     763<Oct/17 03:55 pm>[6853662.718841]  [<ffffffff81054665>] ? kthread+0x0/0x85
     764<Oct/17 03:55 pm>[6853662.724331]  [<ffffffff81003790>] ? kernel_thread_helper+0x0/0x10
     765<Oct/17 03:55 pm>[6853662.730965] Pid: 8429, comm: nfsd Tainted: G      D    2.6.34.4 #3
     766<Oct/17 03:55 pm>[6853662.737689] Call Trace:
     767<Oct/17 03:55 pm>[6853662.740581]  <NMI>  [<ffffffff81009b2a>] ? show_regs+0x26/0x2a
     768<Oct/17 03:55 pm>[6853662.747000]  [<ffffffff81520db8>] nmi_watchdog_tick+0xc3/0x1a5
     769<Oct/17 03:55 pm>[6853662.753358]  [<ffffffff81520360>] do_nmi+0xb2/0x259
     770<Oct/17 03:55 pm>[6853662.758721]  [<ffffffff8151fdfa>] nmi+0x1a/0x20
     771<Oct/17 03:55 pm>[6853662.763747]  [<ffffffff812c08a0>] ? delay_tsc+0x16/0x59
     772<Oct/17 03:55 pm>[6853662.769476]  <<EOE>>  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
     773<Oct/17 03:55 pm>[6853662.778122]  [<ffffffff812c08fe>] __delay+0xa/0xc
     774<Oct/17 03:55 pm>[6853662.783317]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
     775<Oct/17 03:55 pm>[6853662.789570]  [<ffffffff8151f0dc>] _raw_spin_lock_nested+0x32/0x36
     776<Oct/17 03:55 pm>[6853662.796193]  [<ffffffff81035934>] ? double_rq_lock+0x4a/0x76
     777<Oct/17 03:55 pm>[6853662.802397]  [<ffffffff81035934>] double_rq_lock+0x4a/0x76
     778<Oct/17 03:55 pm>[6853662.808412]  [<ffffffff81037672>] load_balance+0xbb6/0xf63
     779<Oct/17 03:55 pm>[6853662.814428]  [<ffffffff810b2173>] ? __pagevec_free+0x70/0x85
     780<Oct/17 03:55 pm>[6853662.820606]  [<ffffffff8151cc0e>] schedule+0x25a/0x86a
     781<Oct/17 03:55 pm>[6853662.826256]  [<ffffffff8144b38b>] lock_sock_nested+0x82/0xe2
     782<Oct/17 03:55 pm>[6853662.832446]  [<ffffffff81054b6c>] ? autoremove_wake_function+0x0/0x38
     783
     784<Oct/17 03:55 pm>[6853662.839433]  [<ffffffff81452976>] skb_free_datagram_locked+0x14/0x2c
     785<Oct/17 03:55 pm>[6853662.846315]  [<ffffffff8149bbfb>] udp_recvmsg+0x1a5/0x209
     786<Oct/17 03:55 pm>[6853662.852240]  [<ffffffff8144a75d>] sock_common_recvmsg+0x32/0x47
     787<Oct/17 03:55 pm>[6853662.858698]  [<ffffffff81448584>] sock_recvmsg+0xc1/0xda
     788<Oct/17 03:55 pm>[6853662.864513]  [<ffffffff810480a2>] ? lock_timer_base+0x26/0x4a
     789<Oct/17 03:55 pm>[6853662.870806]  [<ffffffff810480a2>] ? lock_timer_base+0x26/0x4a
     790<Oct/17 03:55 pm>[6853662.877088]  [<ffffffff81048174>] ? try_to_del_timer_sync+0xae/0xbb
     791<Oct/17 03:55 pm>[6853662.883912]  [<ffffffff814485d2>] kernel_recvmsg+0x35/0x41
     792<Oct/17 03:55 pm>[6853662.889907]  [<ffffffff814f1954>] svc_udp_recvfrom+0xa1/0x2f9
     793<Oct/17 03:55 pm>[6853662.896217]  [<ffffffff814fc980>] svc_recv+0x758/0x7f5
     794<Oct/17 03:55 pm>[6853662.901866]  [<ffffffff814fc1d9>] ? svc_send+0x85/0xa1
     795<Oct/17 03:55 pm>[6853662.907543]  [<ffffffff8103688c>] ? default_wake_function+0x0/0xf
     796<Oct/17 03:55 pm>[6853662.914178]  [<ffffffff811f0ccf>] ? nfsd+0x0/0x139
     797<Oct/17 03:55 pm>[6853662.919475]  [<ffffffff811f0d78>] nfsd+0xa9/0x139
     798<Oct/17 03:55 pm>[6853662.924678]  [<ffffffff810546e2>] kthread+0x7d/0x85
     799<Oct/17 03:55 pm>[6853662.930068]  [<ffffffff81003794>] kernel_thread_helper+0x4/0x10
     800<Oct/17 03:55 pm>[6853662.936538]  [<ffffffff81054665>] ? kthread+0x0/0x85
     801<Oct/17 03:55 pm>[6853662.942071]  [<ffffffff81003790>] ? kernel_thread_helper+0x0/0x10
     802<Oct/17 03:55 pm>[6853662.948679] NMI backtrace for cpu 11
     803<Oct/17 03:55 pm>[6853662.952710] CPU 11
     804<Oct/17 03:55 pm>[6853662.954906] Modules linked in: w83793 hwmon_vid autofs4 i2c_i801 i2c_core iTCO_wdt e1000e ioatdma dca rtc_cmos tg3 libphy e1000 fuse dm_snapshot dm_mirror dm_region_hash dm_log scsi_wait_scan qla2xxx megaraid_sas megaraid_mbox megaraid_mm aacraid 3w_9xxx 3w_xxxx arcmsr aic7xxx aic79xx sr_mod sg ata_piix ahci sata_sis sata_nv sata_via pata_sl82c105 pata_sis
     805<Oct/17 03:55 pm>[6853662.990658]
     806
     807<Oct/17 03:55 pm>[6853662.992571] Pid: 2921, comm: pclient Tainted: G      D    2.6.34.4 #3 S7010/empty
     808<Oct/17 03:55 pm>[6853663.000773] RIP: 0010:[<ffffffff812c08af>]  [<ffffffff812c08af>] delay_tsc+0x25/0x59
     809<Oct/17 03:55 pm>[6853663.009330] RSP: 0000:ffff8806552a3dd0  EFLAGS: 00000082
     810<Oct/17 03:55 pm>[6853663.015136] RAX: 00000000c74054ec RBX: 000000004aa9f22b RCX: 00000000c74054d0
     811<Oct/17 03:55 pm>[6853663.023002] RDX: 000000000040ee8b RSI: 000000000000000b RDI: 0000000000000001
     812<Oct/17 03:55 pm>[6853663.030889] RBP: ffff8806552a3dd8 R08: 000000000000000b R09: 000000000000000b
     813<Oct/17 03:55 pm>[6853663.038775] R10: 0000000000000000 R11: ffff8806552a3c08 R12: ffff8806552b3c00
     814<Oct/17 03:55 pm>[6853663.046637] R13: 0000000000000000 R14: ffff8803ce096120 R15: ffff8803ce0965a8
     815<Oct/17 03:55 pm>[6853663.054488] FS:  00007fe0e24916f0(0000) GS:ffff8806552a0000(0000) knlGS:0000000000000000
     816<Oct/17 03:55 pm>[6853663.063349] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
     817<Oct/17 03:55 pm>[6853663.069634] CR2: 000000000186bb18 CR3: 000000062112d000 CR4: 00000000000006e0
     818<Oct/17 03:55 pm>[6853663.077491] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
     819<Oct/17 03:55 pm>[6853663.085315] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
     820<Oct/17 03:55 pm>[6853663.093179] Process pclient (pid: 2921, threadinfo ffff88036c100000, task ffff8803ce096120)
     821<Oct/17 03:55 pm>[6853663.102282] Stack:
     822<Oct/17 03:55 pm>[6853663.104723]  ffffffff81019da9 ffff8806552a3de8 ffffffff812c08fe ffff8806552a3e28
     823<Oct/17 03:55 pm>[6853663.112649] <0> ffffffff812c4e65 000000009ef2e6b4 ffff8806552b3c00 ffff880023799030
     824<Oct/17 03:55 pm>[6853663.121327] <0> 0000000000013c00 ffff8806552a3e98 000000000000000b ffff8806552a3e48
     825<Oct/17 03:55 pm>[6853663.130396] Call Trace:
     826<Oct/17 03:55 pm>[6853663.133273]  <IRQ>
     827<Oct/17 03:55 pm>[6853663.135848]  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
     828<Oct/17 03:55 pm>[6853663.143639]  [<ffffffff812c08fe>] __delay+0xa/0xc
     829
     830<Oct/17 03:55 pm>[6853663.148848]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
     831<Oct/17 03:55 pm>[6853663.155109]  [<ffffffff8151f193>] _raw_spin_lock+0x34/0x39
     832<Oct/17 03:55 pm>[6853663.161123]  [<ffffffff8102fb6b>] ? task_rq_lock+0x7e/0x9a
     833<Oct/17 03:55 pm>[6853663.167129]  [<ffffffff8102fb6b>] task_rq_lock+0x7e/0x9a
     834<Oct/17 03:55 pm>[6853663.172987]  [<ffffffff81057842>] ? hrtimer_wakeup+0x0/0x21
     835<Oct/17 03:55 pm>[6853663.179106]  [<ffffffff81036578>] try_to_wake_up+0x2e/0x342
     836<Oct/17 03:55 pm>[6853663.185183]  [<ffffffff81057842>] ? hrtimer_wakeup+0x0/0x21
     837<Oct/17 03:55 pm>[6853663.191268]  [<ffffffff810368b8>] wake_up_process+0x10/0x12
     838<Oct/17 03:55 pm>[6853663.197333]  [<ffffffff8105785f>] hrtimer_wakeup+0x1d/0x21
     839<Oct/17 03:55 pm>[6853663.203348]  [<ffffffff81057933>] __run_hrtimer+0xd0/0x12d
     840<Oct/17 03:55 pm>[6853663.209372]  [<ffffffff81057b81>] hrtimer_interrupt+0xb5/0<Oct/17 03:55 pm>
     841                 <Oct/17 03:55 pm>[6853663.215734]  [<ffffffff810197a5>] smp_apic_timer_interrupt+0x82/0x95
     842<Oct/17 03:55 pm>[6853663.222636]  [<ffffffff81003353>] apic_timer_interrupt+0x13/0x20
     843<Oct/17 03:55 pm>[6853663.229184]  <EOI>
     844<Oct/17 03:55 pm>[6853663.231373] Code: fb 48 ff c8 c9 c3 55 48 89 e5 48 83 ec 08 65 8b 34 25 f0 d1 00 00 66 66 90 0f ae e8 0f 31 89 c1 41 89 f1 66 66 90 0f ae e8 0f 31 <89> c6 48 89 f0 48 29 c8 48 39 f8 73 25 f3 90 65 44 8b 04 25 f0
     845<Oct/17 03:55 pm>[6853663.255052] Call Trace:
     846<Oct/17 03:55 pm>[6853663.257957]  <IRQ>  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
     847<Oct/17 03:55 pm>[6853663.266410]  [<ffffffff812c08fe>] __delay+0xa/0xc
     848<Oct/17 03:55 pm>[6853663.271625]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
     849<Oct/17 03:55 pm>[6853663.277886]  [<ffffffff8151f193>] _raw_spin_lock+0x34/0x39
     850<Oct/17 03:55 pm>[6853663.283883]  [<ffffffff8102fb6b>] ? task_rq_lock+0x7e/0x9a
     851<Oct/17 03:55 pm>[6853663.289923]  [<ffffffff8102fb6b>] task_rq_lock+0x7e/0x9a
     852
     853<Oct/17 03:55 pm>[6853663.295720]  [<ffffffff81057842>] ? hrtimer_wakeup+0x0/0x21
     854<Oct/17 03:55 pm>[6853663.301839]  [<ffffffff81036578>] try_to_wake_up+0x2e/0x342
     855<Oct/17 03:55 pm>[6853663.307933]  [<ffffffff81057842>] ? hrtimer_wakeup+0x0/0x21
     856<Oct/17 03:55 pm>[6853663.314062]  [<ffffffff810368b8>] wake_up_process+0x10/0x12
     857<Oct/17 03:55 pm>[6853663.320153]  [<ffffffff8105785f>] hrtimer_wakeup+0x1d/0x21
     858<Oct/17 03:55 pm>[6853663.326159]  [<ffffffff81057933>] __run_hrtimer+0xd0/0x12d
     859<Oct/17 03:55 pm>[6853663.332166]  [<ffffffff81057b81>] hrtimer_interrupt+0xb5/0x19f
     860<Oct/17 03:55 pm>[6853663.338545]  [<ffffffff810197a5>] smp_apic_timer_interrupt+0x82/0x95
     861<Oct/17 03:55 pm>[6853663.345447]  [<ffffffff81003353>] apic_timer_interrupt+0x13/0x20
     862<Oct/17 03:55 pm>[6853663.351978]  <EOI> Pid: 2921, comm: pclient Tainted: G      D    2.6.34.4 #3
     863<Oct/17 03:55 pm>[6853663.359785] Call Trace:
     864<Oct/17 03:55 pm>[6853663.362688]  <NMI>  [<ffffffff81009b2a>] ? show_regs+0x26/0x2a
     865<Oct/17 03:55 pm>[6853663.369080]  [<ffffffff81520db8>] nmi_watchdog_tick+0xc3/0x1a5
     866<Oct/17 03:55 pm>[6853663.375441]  [<ffffffff81520360>] do_nmi+0xb2/0x259
     867<Oct/17 03:55 pm>[6853663.380838]  [<ffffffff8151fdfa>] nmi+0x1a/0x20
     868<Oct/17 03:55 pm>[6853663.385880]  [<ffffffff812c08af>] ? delay_tsc+0x25/0x59
     869<Oct/17 03:55 pm>[6853663.391620]  <<EOE>>  <IRQ>  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
     870<Oct/17 03:55 pm>[6853663.400956]  [<ffffffff812c08fe>] __delay+0xa/0xc
     871<Oct/17 03:55 pm>[6853663.406153]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
     872<Oct/17 03:55 pm>[6853663.412415]  [<ffffffff8151f193>] _raw_spin_lock+0x34/0x39
     873<Oct/17 03:55 pm>[6853663.418428]  [<ffffffff8102fb6b>] ? task_rq_lock+0x7e/0x9a
     874<Oct/17 03:55 pm>[6853663.424426]  [<ffffffff8102fb6b>] task_rq_lock+0x7e/0x9a
     875
     876<Oct/17 03:55 pm>[6853663.430250]  [<ffffffff81057842>] ? hrtimer_wakeup+0x0/0x21
     877<Oct/17 03:55 pm>[6853663.436352]  [<ffffffff81036578>] try_to_wake_up+0x2e/0x342
     878<Oct/17 03:55 pm>[6853663.442461]  [<ffffffff81057842>] ? hrtimer_wakeup+0x0/0x21
     879<Oct/17 03:55 pm>[6853663.448562]  [<ffffffff810368b8>] wake_up_process+0x10/0x12
     880<Oct/17 03:55 pm>[6853663.454664]  [<ffffffff8105785f>] hrtimer_wakeup+0x1d/0x21
     881<Oct/17 03:55 pm>[6853663.460688]  [<ffffffff81057933>] __run_hrtimer+0xd0/0x12d
     882<Oct/17 03:55 pm>[6853663.466710]  [<ffffffff81057b81>] hrtimer_interrupt+0xb5/0x19f
     883<Oct/17 03:55 pm>[6853663.473057]  [<ffffffff810197a5>] smp_apic_timer_interrupt+0x82/0x95
     884<Oct/17 03:55 pm>[6853663.479960]  [<ffffffff81003353>] apic_timer_interrupt+0x13/0x20
     885<Oct/17 03:55 pm>[6853663.486507]  <EOI>
     886<Oct/17 03:55 pm>[6853663.488714] NMI backtrace for cpu 10
     887<Oct/17 03:55 pm>[6853663.493165] CPU 10
     888<Oct/17 03:55 pm>[6853663.495378] Modules linked in: w83793 hwmon_vid autofs4 i2c_i801 i2c_core iTCO_wdt e1000e ioatdma dca rtc_cmos tg3 libphy e1000 fuse dm_snapshot dm_mirror dm_region_hash dm_log scsi_wait_scan qla2xxx megaraid_sas megaraid_mbox megaraid_mm aacraid 3w_9xxx 3w_xxxx arcmsr aic7xxx aic79xx sr_mod sg ata_piix ahci sata_sis sata_nv sata_via pata_sl82c105 pata_sis
     889<Oct/17 03:55 pm>[6853663.531191]
     890<Oct/17 03:55 pm>[6853663.533121] Pid: 19726, comm: ppImage Tainted: G      D    2.6.34.4 #3 S7010/empty
     891<Oct/17 03:55 pm>[6853663.541437] RIP: 0010:[<ffffffff812c08a2>]  [<ffffffff812c08a2>] delay_tsc+0x18/0x59
     892<Oct/17 03:55 pm>[6853663.549958] RSP: 0000:ffff88002c88b7a0  EFLAGS: 00000086
     893<Oct/17 03:55 pm>[6853663.555807] RAX: 00000000c73c4240 RBX: 000000004aaa3b0b RCX: 00000000c73c41f8
     894<Oct/17 03:55 pm>[6853663.563691] RDX: 000000000040ee8b RSI: 000000000000000a RDI: 0000000000000001
     895<Oct/17 03:55 pm>[6853663.571570] RBP: ffff88002c88b7a8 R08: 000000000000000a R09: 000000000000000a
     896<Oct/17 03:55 pm>[6853663.579465] R10: 0000000000000000 R11: ffff88002c88b5d8 R12: ffff8806552b3c00
     897<Oct/17 03:55 pm>[6853663.587344] R13: 0000000000000000 R14: ffff880611553090 R15: ffff880611553518
     898
     899<Oct/17 03:55 pm>[6853663.599736] FS:  000000004243e950(0063) GS:ffff880655280000(0000) knlGS:0000000000000000
     900<Oct/17 03:55 pm>[6853663.608579] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
     901<Oct/17 03:55 pm>[6853663.614848] CR2: 00007fa3e03daab0 CR3: 00000003e2c88000 CR4: 00000000000006e0
     902<Oct/17 03:55 pm>[6853663.622703] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
     903<Oct/17 03:55 pm>[6853663.630591] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
     904<Oct/17 03:55 pm>[6853663.638462] Process ppImage (pid: 19726, threadinfo ffff88002c88a000, task ffff880611553090)
     905<Oct/17 03:55 pm>[6853663.647644] Stack:
     906<Oct/17 03:55 pm>[6853663.650083]  ffffffff81019da9 ffff88002c88b7b8 ffffffff812c08fe ffff88002c88b7f8
     907<Oct/17 03:55 pm>[6853663.658037] <0> ffffffff812c4e65 000000009ef2e6b4 ffff8806552b3c00 ffff8806552b3c00
     908<Oct/17 03:55 pm>[6853663.666711] <0> ffff88065528e3f0 0000000000000400 0000000000000800 ffff88002c88b818
     909<Oct/17 03:55 pm>[6853663.675790] Call Trace:
     910<Oct/17 03:55 pm>[6853663.678671]  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
     911<Oct/17 03:55 pm>[6853663.686458]  [<ffffffff812c08fe>] __delay+0xa/0xc
     912<Oct/17 03:55 pm>[6853663.691686]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
     913<Oct/17 03:55 pm>[6853663.697939]  [<ffffffff8151f0dc>] _raw_spin_lock_nested+0x32/0x36
     914<Oct/17 03:55 pm>[6853663.704562]  [<ffffffff81035934>] ? double_rq_lock+0x4a/0x76
     915<Oct/17 03:55 pm>[6853663.710783]  [<ffffffff81035934>] double_rq_lock+0x4a/0x76
     916<Oct/17 03:55 pm>[6853663.716797]  [<ffffffff81037672>] load_balance+0xbb6/0xf63
     917<Oct/17 03:55 pm>[6853663.722819]  [<ffffffff810b3cfb>] ? get_dirty_limits+0x22/0x258
     918<Oct/17 03:55 pm>[6853663.729253]  [<ffffffff8151cc0e>] schedule+0x25a/0x86a
     919<Oct/17 03:55 pm>[6853663.734919]  [<ffffffff810480a2>] ? lock_timer_base+0x26/0x4a
     920<Oct/17 03:55 pm>[6853663.741204]  [<ffffffff8151d559>] schedule_timeout+0x222/0x24c
     921
     922<Oct/17 03:55 pm>[6853663.747600]  [<ffffffff810482a5>] ? process_timeout+0x0/0xb
     923<Oct/17 03:55 pm>[6853663.753683]  [<ffffffff8151c6c5>] io_schedule_timeout+0x45/0x5e
     924<Oct/17 03:55 pm>[6853663.760115]  [<ffffffff810c0abe>] congestion_wait+0x6b/0x87
     925<Oct/17 03:55 pm>[6853663.766223]  [<ffffffff81054b6c>] ? autoremove_wake_function+0x0/0x38
     926<Oct/17 03:55 pm>[6853663.773188]  [<ffffffff810b3279>] __alloc_pages_nodemask+0x65a/0x671
     927<Oct/17 03:55 pm>[6853663.780079]  [<ffffffff810da90f>] alloc_page_vma+0x148/0x14d
     928<Oct/17 03:55 pm>[6853663.786263]  [<ffffffff810c4d2a>] handle_mm_fault+0x294/0x<Oct/17 03:55 pm>
     929                 <Oct/17 03:55 pm>[6853663.792505]  [<ffffffff815227e9>] do_page_fault+0x351/0x375
     930<Oct/17 03:55 pm>[6853663.798588]  [<ffffffff8151e35f>] ? do_nanosleep+0x7b/0xb3
     931<Oct/17 03:55 pm>[6853663.804578]  [<ffffffff810348d8>] ? finish_task_switch+0x69/0xdd
     932<Oct/17 03:55 pm>[6853663.811096]  [<ffffffff8103486f>] ? finish_task_switch+0x0/0xdd
     933<Oct/17 03:55 pm>[6853663.817543]  [<ffffffff81058477>] ? hrtimer_nanosleep+0x97/0x105
     934<Oct/17 03:55 pm>[6853663.824104]  [<ffffffff8106472c>] ? lockdep_sys_exit+0x20/0x75
     935<Oct/17 03:55 pm>[6853663.830492]  [<ffffffff8151ef6f>] ? lockdep_sys_exit_thunk+0x35/0x67
     936<Oct/17 03:55 pm>[6853663.837367]  [<ffffffff810c4dda>] ? handle_mm_fault+0x344/0x73e
     937<Oct/17 03:55 pm>[6853663.843820]  [<ffffffff8151fb5f>] page_fault+0x1f/0x30
     938<Oct/17 03:55 pm>[6853663.849469] Code: 2e 0f 1f 84 00 00 00 00 00 48 ff c8 75 fb 48 ff c8 c9 c3 55 48 89 e5 48 83 ec 08 65 8b 34 25 f0 d1 00 00 66 66 90 0f ae e8 0f 31 <89> c1 41 89 f1 66 66 90 0f ae e8 0f 31 89 c6 48 89 f0 48 29 c8
     939<Oct/17 03:55 pm>[6853663.872747] Call Trace:
     940<Oct/17 03:55 pm>[6853663.875643]  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
     941<Oct/17 03:55 pm>[6853663.883406]  [<ffffffff812c08fe>] __delay+0xa/0xc
     942<Oct/17 03:55 pm>[6853663.888600]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
     943<Oct/17 03:55 pm>[6853663.894878]  [<ffffffff8151f0dc>] _raw_spin_lock_nested+0x32/0x36
     944
     945<Oct/17 03:55 pm>[6853663.901510]  [<ffffffff81035934>] ? double_rq_lock+0x4a/0x76
     946<Oct/17 03:55 pm>[6853663.907704]  [<ffffffff81035934>] double_rq_lock+0x4a/0x76
     947<Oct/17 03:55 pm>[6853663.913720]  [<ffffffff81037672>] load_balance+0xbb6/0xf63
     948<Oct/17 03:55 pm>[6853663.919734]  [<ffffffff810b3cfb>] ? get_dirty_limits+0x22/0x258
     949<Oct/17 03:55 pm>[6853663.926183]  [<ffffffff8151cc0e>] schedule+0x25a/0x86a
     950<Oct/17 03:55 pm>[6853663.931840]  [<ffffffff810480a2>] ? lock_timer_base+0x26/0x4a
     951<Oct/17 03:55 pm>[6853663.938102]  [<ffffffff8151d559>] schedule_timeout+0x222/0<Oct/17 03:55 pm>
     952                 <Oct/17 03:55 pm>[6853663.944472]  [<ffffffff810482a5>] ? process_timeout+0x0/0xb
     953<Oct/17 03:55 pm>[6853663.950545]  [<ffffffff8151c6c5>] io_schedule_timeout+0x45/0x5e
     954<Oct/17 03:55 pm>[6853663.957021]  [<ffffffff810c0abe>] congestion_wait+0x6b/0x87
     955<Oct/17 03:55 pm>[6853663.963131]  [<ffffffff81054b6c>] ? autoremove_wake_function+0x0/0x38
     956<Oct/17 03:55 pm>[6853663.970137]  [<ffffffff810b3279>] __alloc_pages_nodemask+0x65a/0x671
     957<Oct/17 03:55 pm>[6853663.977018]  [<ffffffff810da90f>] alloc_page_vma+0x148/0x14d
     958<Oct/17 03:55 pm>[6853663.983177]  [<ffffffff810c4d2a>] handle_mm_fault+0x294/0x73e
     959<Oct/17 03:55 pm>[6853663.989470]  [<ffffffff815227e9>] do_page_fault+0x351/0x375
     960<Oct/17 03:55 pm>[6853663.995555]  [<ffffffff8151e35f>] ? do_nanosleep+0x7b/0xb3
     961<Oct/17 03:55 pm>[6853664.001586]  [<ffffffff810348d8>] ? finish_task_switch+0x69/0xdd
     962<Oct/17 03:55 pm>[6853664.008130]  [<ffffffff8103486f>] ? finish_task_switch+0x0/0xdd
     963<Oct/17 03:55 pm>[6853664.014623]  [<ffffffff81058477>] ? hrtimer_nanosleep+0x97/0x105
     964<Oct/17 03:55 pm>[6853664.021175]  [<ffffffff8106472c>] ? lockdep_sys_exit+0x20/0x75
     965<Oct/17 03:55 pm>[6853664.027553]  [<ffffffff8151ef6f>] ? lockdep_sys_exit_thunk+0x35/0x67
     966<Oct/17 03:55 pm>[6853664.034454]  [<ffffffff810c4dda>] ? handle_mm_fault+0x344/0x73e
     967
     968<Oct/17 03:55 pm>[6853664.040900]  [<ffffffff8151fb5f>] page_fault+0x1f/0x30
     969<Oct/17 03:55 pm>[6853664.046556] Pid: 19726, comm: ppImage Tainted: G      D    2.6.34.4 #3
     970<Oct/17 03:55 pm>[6853664.053633] Call Trace:
     971                 <Oct/17 03:55 pm>[6853664.056549]  <NMI>  [<ffffffff81009b2a>] ? show_regs+0x26/0x2a
     972<Oct/17 03:55 pm>[6853664.062985]  [<ffffffff81520db8>] nmi_watchdog_tick+0xc3/0x1a5
     973<Oct/17 03:55 pm>[6853664.069319]  [<ffffffff81520360>] do_nmi+0xb2/0x259
     974<Oct/17 03:55 pm>[6853664.074707]  [<ffffffff8151fdfa>] nmi+0x1a/0x20
     975<Oct/17 03:55 pm>[6853664.079741]  [<ffffffff812c08a2>] ? delay_tsc+0x18/0x59
     976<Oct/17 03:55 pm>[6853664.085487]  <<EOE>>  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
     977<Oct/17 03:55 pm>[6853664.094123]  [<ffffffff812c08fe>] __delay+0xa/0xc
     978<Oct/17 03:55 pm>[6853664.099328]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
     979<Oct/17 03:55 pm>[6853664.105592]  [<ffffffff8151f0dc>] _raw_spin_lock_nested+0x32/0x36
     980<Oct/17 03:55 pm>[6853664.112212]  [<ffffffff81035934>] ? double_rq_lock+0x4a/0x76
     981<Oct/17 03:55 pm>[6853664.118373]  [<ffffffff81035934>] double_rq_lock+0x4a/0x76
     982<Oct/17 03:55 pm>[6853664.124387]  [<ffffffff81037672>] load_balance+0xbb6/0xf63
     983<Oct/17 03:55 pm>[6853664.130420]  [<ffffffff810b3cfb>] ? get_dirty_limits+0x22/0x258
     984<Oct/17 03:55 pm>[6853664.136880]  [<ffffffff8151cc0e>] schedule+0x25a/0x86a
     985<Oct/17 03:55 pm>[6853664.142545]  [<ffffffff810480a2>] ? lock_timer_base+0x26/0x4a
     986<Oct/17 03:55 pm>[6853664.148837]  [<ffffffff8151d559>] schedule_timeout+0x222/0x24c
     987<Oct/17 03:55 pm>[6853664.155198]  [<ffffffff810482a5>] ? process_timeout+0x0/0xb
     988<Oct/17 03:55 pm>[6853664.161320]  [<ffffffff8151c6c5>] io_schedule_timeout+0x45/0x5e
     989<Oct/17 03:55 pm>[6853664.167793]  [<ffffffff810c0abe>] congestion_wait+0x6b/0x87
     990
     991<Oct/17 03:55 pm>[6853664.173895]  [<ffffffff81054b6c>] ? autoremove_wake_function+0x0/0x38
     992<Oct/17 03:55 pm>[6853664.180908]  [<ffffffff810b3279>] __alloc_pages_nodemask+0x65a/0x671
     993<Oct/17 03:55 pm>[6853664.187790]  [<ffffffff810da90f>] alloc_page_vma+0x148/0x14d
     994<Oct/17 03:55 pm>[6853664.193958]  [<ffffffff810c4d2a>] handle_mm_fault+0x294/0x73e
     995<Oct/17 03:55 pm>[6853664.200242]  [<ffffffff815227e9>] do_page_fault+0x351/0x375
     996<Oct/17 03:55 pm>[6853664.206360]  [<ffffffff8151e35f>] ? do_nanosleep+0x7b/0xb3
     997<Oct/17 03:55 pm>[6853664.212366]  [<ffffffff810348d8>] ? finish_task_switch+0x69/0xdd
     998<Oct/17 03:55 pm>[6853664.218877]  [<ffffffff8103486f>] ? finish_task_switch+0x0/0xdd
     999<Oct/17 03:55 pm>[6853664.225333]  [<ffffffff81058477>] ? hrtimer_nanosleep+0x97/0x105
     1000<Oct/17 03:55 pm>[6853664.231885]  [<ffffffff8106472c>] ? lockdep_sys_exit+0x20/0x75
     1001<Oct/17 03:55 pm>[6853664.238222]  [<ffffffff8151ef6f>] ? lockdep_sys_exit_thunk+0x35/0x67
     1002<Oct/17 03:55 pm>[6853664.245120]  [<ffffffff810c4dda>] ? handle_mm_fault+0x344/0x73e
     1003<Oct/17 03:55 pm>[6853664.251569]  [<ffffffff8151fb5f>] page_fault+0x1f/0x30
     1004<Oct/17 03:55 pm>[6853664.257242] NMI backtrace for cpu 9
     1005<Oct/17 03:55 pm>[6853664.261224] CPU 9
     1006<Oct/17 03:55 pm>[6853664.263307] Modules linked in: w83793 hwmon_vid autofs4 i2c_i801 i2c_core iTCO_wdt e1000e ioatdma dca rtc_cmos tg3 libphy e1000 fuse dm_snapshot dm_mirror dm_region_hash dm_log scsi_wait_scan qla2xxx megaraid_sas megaraid_mbox megaraid_mm aacraid 3w_9xxx 3w_xxxx arcmsr aic7xxx aic79xx sr_mod sg ata_piix ahci sata_sis sata_nv sata_via pata_sl82c105 pata_sis
     1007<Oct/17 03:55 pm>[6853664.299190]
     1008<Oct/17 03:55 pm>[6853664.301120] Pid: 19611, comm: ppImage Tainted: G      D    2.6.34.4 #3 S7010/empty
     1009<Oct/17 03:55 pm>[6853664.309417] RIP: 0010:[<ffffffff812c08a2>]  [<ffffffff812c08a2>] delay_tsc+0x18/0x59
     1010<Oct/17 03:55 pm>[6853664.317931] RSP: 0000:ffff88050e4897a0  EFLAGS: 00000086
     1011<Oct/17 03:55 pm>[6853664.323761] RAX: 00000000c7382f90 RBX: 000000004aaa1307 RCX: 00000000c7382f48
     1012<Oct/17 03:55 pm>[6853664.331620] RDX: 000000000040ee8b RSI: 0000000000000009 RDI: 0000000000000001
     1013
     1014<Oct/17 03:55 pm>[6853664.339500] RBP: ffff88050e4897a8 R08: 0000000000000009 R09: 0000000000000009
     1015<Oct/17 03:55 pm>[6853664.347375] R10: 0000000000000000 R11: ffff88050e4895d8 R12: ffff8806552b3c00
     1016<Oct/17 03:55 pm>[6853664.355254] R13: 0000000000000000 R14: ffff8805c9192060 R15: ffff8805c91924e8
     1017<Oct/17 03:55 pm>[6853664.363142] FS:  00007f02d54d06f0(0000) GS:ffff880655260000(0000) knlGS:0000000000000000
     1018<Oct/17 03:55 pm>[6853664.371995] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
     1019<Oct/17 03:55 pm>[6853664.378296] CR2: 00007f02c7852068 CR3: 00000001618d6000 CR4: 00000000000006e0
     1020<Oct/17 03:55 pm>[6853664.386146] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
     1021<Oct/17 03:55 pm>[6853664.394005] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
     1022<Oct/17 03:55 pm>[6853664.401909] Process ppImage (pid: 19611, threadinfo ffff88050e488000, task ffff8805c9192060)
     1023<Oct/17 03:55 pm>[6853664.411110] Stack:
     1024<Oct/17 03:55 pm>[6853664.413558]  ffffffff81019da9 ffff88050e4897b8 ffffffff812c08fe ffff88050e4897f8
     1025<Oct/17 03:55 pm>[6853664.421460] <0> ffffffff812c4e65 000000009ef2e6b4 ffff8806552b3c00 ffff8806552b3c00
     1026<Oct/17 03:55 pm>[6853664.430118] <0> ffff88065526e3f0 0000000000000400 0000000000000800 ffff88050e489818
     1027<Oct/17 03:55 pm>[6853664.439196] Call Trace:
     1028<Oct/17 03:55 pm>[6853664.442073]  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
     1029<Oct/17 03:55 pm>[6853664.449871]  [<ffffffff812c08fe>] __delay+0xa/0xc
     1030<Oct/17 03:55 pm>[6853664.455063]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
     1031<Oct/17 03:55 pm>[6853664.461318]  [<ffffffff8151f0dc>] _raw_spin_lock_nested+0x32/0x36
     1032<Oct/17 03:55 pm>[6853664.467941]  [<ffffffff81035934>] ? double_rq_lock+0x4a/0x76
     1033<Oct/17 03:55 pm>[6853664.474092]  [<ffffffff81035934>] double_rq_lock+0x4a/0x76
     1034<Oct/17 03:55 pm>[6853664.480089]  [<ffffffff81037672>] load_balance+0xbb6/0xf63
     1035<Oct/17 03:55 pm>[6853664.486105]  [<ffffffff810b3cfb>] ? get_dirty_limits+0x22/0x258
     1036
     1037<Oct/17 03:55 pm>[6853664.492572]  [<ffffffff8151cc0e>] schedule+0x25a/0x86a
     1038<Oct/17 03:55 pm>[6853664.498209]  [<ffffffff810480a2>] ? lock_timer_base+0x26/0x4a
     1039<Oct/17 03:55 pm>[6853664.504471]  [<ffffffff8151d559>] schedule_timeout+0x222/0x24c
     1040<Oct/17 03:55 pm>[6853664.510868]  [<ffffffff810482a5>] ? process_timeout+0x0/0xb
     1041<Oct/17 03:55 pm>[6853664.516932]  [<ffffffff8151c6c5>] io_schedule_timeout+0x45/0x5e
     1042<Oct/17 03:55 pm>[6853664.523375]  [<ffffffff810c0abe>] congestion_wait+0x6b/0x87
     1043<Oct/17 03:55 pm>[6853664.529459]  [<ffffffff81054b6c>] ? autoremove_wake_function+0x0/0x38
     1044<Oct/17 03:55 pm>[6853664.536454]  [<ffffffff810b3279>] __alloc_pages_nodemask+0x65a/0x671
     1045<Oct/17 03:55 pm>[6853664.543371]  [<ffffffff810da90f>] alloc_page_vma+0x148/0x14d
     1046<Oct/17 03:55 pm>[6853664.549537]  [<ffffffff810c4d2a>] handle_mm_fault+0x294/0x73e
     1047<Oct/17 03:55 pm>[6853664.555796]  [<ffffffff815227e9>] do_page_fault+0x351/0x375
     1048<Oct/17 03:55 pm>[6853664.561896]  [<ffffffff810cab7d>] ? sys_mmap_pgoff+0x107/0x126
     1049<Oct/17 03:55 pm>[6853664.568259]  [<ffffffff8106472c>] ? lockdep_sys_exit+0x20/0x75
     1050<Oct/17 03:55 pm>[6853664.574604]  [<ffffffff8151ef6f>] ? lockdep_sys_exit_thunk+0x35/0x67
     1051<Oct/17 03:55 pm>[6853664.586054]  [<ffffffff810c4dda>] ? handle_mm_fault+0x344/0x73e
     1052<Oct/17 03:55 pm>[6853664.592520]  [<ffffffff8151fb5f>] page_fault+0x1f/0x30
     1053<Oct/17 03:55 pm>[6853664.598173] Code: 2e 0f 1f 84 00 00 00 00 00 48 ff c8 75 fb 48 ff c8 c9 c3 55 48 89 e5 48 83 ec 08 65 8b 34 25 f0 d1 00 00 66 66 90 0f ae e8 0f 31 <89> c1 41 89 f1 66 66 90 0f ae e8 0f 31 89 c6 48 89 f0 48 29 c8
     1054<Oct/17 03:55 pm>[6853664.621402] Call Trace:
     1055<Oct/17 03:55 pm>[6853664.624299]  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
     1056<Oct/17 03:55 pm>[6853664.632095]  [<ffffffff812c08fe>] __delay+0xa/0xc
     1057<Oct/17 03:55 pm>[6853664.637314]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
     1058<Oct/17 03:55 pm>[6853664.643603]  [<ffffffff8151f0dc>] _raw_spin_lock_nested+0x32/0x36
     1059
     1060<Oct/17 03:55 pm>[6853664.650216]  [<ffffffff81035934>] ? double_rq_lock+0x4a/0x76
     1061<Oct/17 03:55 pm>[6853664.656375]  [<ffffffff81035934>] double_rq_lock+0x4a/0x76
     1062<Oct/17 03:55 pm>[6853664.662424]  [<ffffffff81037672>] load_balance+0xbb6/0xf63
     1063<Oct/17 03:55 pm>[6853664.668430]  [<ffffffff810b3cfb>] ? get_dirty_limits+0x22/0x258
     1064<Oct/17 03:55 pm>[6853664.674857]  [<ffffffff8151cc0e>] schedule+0x25a/0x86a
     1065<Oct/17 03:55 pm>[6853664.680468]  [<ffffffff810480a2>] ? lock_timer_base+0x26/0x4a
     1066<Oct/17 03:55 pm>[6853664.686753]  [<ffffffff8151d559>] schedule_timeout+0x222/0x24c
     1067<Oct/17 03:55 pm>[6853664.693116]  [<ffffffff810482a5>] ? process_timeout+0x0/0xb
     1068<Oct/17 03:55 pm>[6853664.699252]  [<ffffffff8151c6c5>] io_schedule_timeout+0x45/0x5e
     1069<Oct/17 03:55 pm>[6853664.705726]  [<ffffffff810c0abe>] congestion_wait+0x6b/0x87
     1070<Oct/17 03:55 pm>[6853664.711819]  [<ffffffff81054b6c>] ? autoremove_wake_function+0x0/0x38
     1071<Oct/17 03:55 pm>[6853664.718816]  [<ffffffff810b3279>] __alloc_pages_nodemask+0x65a/0x671
     1072<Oct/17 03:55 pm>[6853664.725715]  [<ffffffff810da90f>] alloc_page_vma+0x148/0x14d
     1073<Oct/17 03:55 pm>[6853664.731889]  [<ffffffff810c4d2a>] handle_mm_fault+0x294/0x73e
     1074<Oct/17 03:55 pm>[6853664.738166]  [<ffffffff815227e9>] do_page_fault+0x351/0x375
     1075<Oct/17 03:55 pm>[6853664.744268]  [<ffffffff810cab7d>] ? sys_mmap_pgoff+0x107/0x126
     1076<Oct/17 03:55 pm>[6853664.750630]  [<ffffffff8106472c>] ? lockdep_sys_exit+0x20/0x75
     1077<Oct/17 03:55 pm>[6853664.756984]  [<ffffffff8151ef6f>] ? lockdep_sys_exit_thunk+0x35/0x67
     1078<Oct/17 03:55 pm>[6853664.763892]  [<ffffffff810c4dda>] ? handle_mm_fault+0x344/0x73e
     1079<Oct/17 03:55 pm>[6853664.770365]  [<ffffffff8151fb5f>] page_fault+0x1f/0x30
     1080<Oct/17 03:55 pm>[6853664.776014] Pid: 19611, comm: ppImage Tainted: G      D    2.6.34.4 #3
     1081<Oct/17 03:55 pm>[6853664.783097] Call Trace:
     1082
     1083<Oct/17 03:55 pm>[6853664.785994]  <NMI>  [<ffffffff81009b2a>] ? show_regs+0x26/0x2a
     1084<Oct/17 03:55 pm>[6853664.792406]  [<ffffffff81520db8>] nmi_watchdog_tick+0xc3/0x1a5
     1085<Oct/17 03:55 pm>[6853664.798810]  [<ffffffff81520360>] do_nmi+0xb2/0x259
     1086<Oct/17 03:55 pm>[6853664.804198]  [<ffffffff8151fdfa>] nmi+0x1a/0x20
     1087<Oct/17 03:55 pm>[6853664.809241]  [<ffffffff812c08a2>] ? delay_tsc+0x18/0x59
     1088<Oct/17 03:55 pm>[6853664.814961]  <<EOE>>  [<ffffffff81019da9>] ? arch_trigger_all_cpu_backtrace+0x51/0x5d
     1089<Oct/17 03:55 pm>[6853664.823563]  [<ffffffff812c08fe>] __delay+0xa/0xc
     1090<Oct/17 03:55 pm>[6853664.828777]  [<ffffffff812c4e65>] do_raw_spin_lock+0xde/0x147
     1091<Oct/17 03:55 pm>[6853664.835039]  [<ffffffff8151f0dc>] _raw_spin_lock_nested+0x32/0x36
     1092<Oct/17 03:55 pm>[6853664.841669]  [<ffffffff81035934>] ? double_rq_lock+0x4a/0x76
     1093<Oct/17 03:55 pm>[6853664.847855]  [<ffffffff81035934>] double_rq_lock+0x4a/0x76
     1094<Oct/17 03:55 pm>[6853664.853870]  [<ffffffff81037672>] load_balance+0xbb6/0xf63
     1095<Oct/17 03:55 pm>[6853664.859893]  [<ffffffff810b3cfb>] ? get_dirty_limits+0x22/0x258
     1096<Oct/17 03:55 pm>[6853664.866396]  [<ffffffff8151cc0e>] schedule+0x25a/0x86a
     1097<Oct/17 03:55 pm>[6853664.872061]  [<ffffffff810480a2>] ? lock_timer_base+0x26/0x4a
     1098<Oct/17 03:55 pm>[6853664.878347]  [<ffffffff8151d559>] schedule_timeout+0x222/0x24c
     1099<Oct/17 03:55 pm>[6853664.884741]  [<ffffffff810482a5>] ? process_timeout+0x0/0xb
     1100<Oct/17 03:55 pm>[6853664.890818]  [<ffffffff8151c6c5>] io_schedule_timeout+0x45/0x5e
     1101<Oct/17 03:55 pm>[6853664.897277]  [<ffffffff810c0abe>] congestion_wait+0x6b/0x87
     1102<Oct/17 03:55 pm>[6853664.903393]  [<ffffffff81054b6c>] ? autoremove_wake_function+0x0/0x38
     1103<Oct/17 03:55 pm>[6853664.910347]  [<ffffffff810b3279>] __alloc_pages_nodemask+0x65a/0x671
     1104<Oct/17 03:55 pm>[6853664.917237]  [<ffffffff810da90f>] alloc_page_vma+0x148/0x14d
     1105
     1106<Oct/17 03:55 pm>[6853664.923431]  [<ffffffff810c4d2a>] handle_mm_fault+0x294/0x73e
     1107<Oct/17 03:55 pm>[6853664.929680]  [<ffffffff815227e9>] do_page_fault+0x351/0x375
     1108<Oct/17 03:55 pm>[6853664.935789]  [<ffffffff810cab7d>] ? sys_mmap_pgoff+0x107/0x126
     1109<Oct/17 03:55 pm>[6853664.942163]  [<ffffffff8106472c>] ? lockdep_sys_exit+0x20/0x75
     1110<Oct/17 03:55 pm>[6853664.948541]  [<ffffffff8151ef6f>] ? lockdep_sys_exit_thunk+0x35/0x67
     1111<Oct/17 03:55 pm>[6853664.955442]  [<ffffffff810c4dda>] ? handle_mm_fault+0x344/0x73e
     1112<Oct/17 03:55 pm>[6853664.961887]  [<ffffffff8151fb5f>] page_fault+0x1f/0x30
     1113
     1114}}}