IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changes between Initial Version and Version 1 of ipp018-crash-20121206


Ignore:
Timestamp:
Dec 6, 2012, 8:19:31 PM (14 years ago)
Author:
Mark Huber
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • ipp018-crash-20121206

    v1 v1  
     1from console:
     2{{{
     3<Dec/06 07:56 pm>ipp018 login: [1742907.002018] general protection fault: 0000 [#1] SMP
     4<Dec/06 07:56 pm>[1742907.002380] last sysfs file: /sys/class/i2c-adapter/i2c-0/name
     5<Dec/06 07:56 pm>[1742907.002380] CPU 0
     6<Dec/06 07:56 pm>[1742907.002380] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last unloaded: w83793]
     7<Dec/06 07:56 pm>[1742907.002380] Pid: 1524, comm: rpciod/0 Tainted: G        W  2.6.28-rc7-00105-gfeaf384 #4
     8<Dec/06 07:56 pm>[1742907.002380] RIP: 0010:[<ffffffff802488f9>]  [<ffffffff802488f9>] run_workqueue+0x73/0x1ed
     9<Dec/06 07:56 pm>[1742907.002380] RSP: 0018:ffff88033ccdbe80  EFLAGS: 00010087
     10<Dec/06 07:56 pm>[1742907.002380] RAX: 66fbf15517d3a542 RBX: ffff880323904580 RCX: 0000000000000000
     11<Dec/06 07:56 pm>[1742907.002380] RDX: a919dae7eefa4125 RSI: ffff8803239045b0 RDI: ffff88033d201100
     12<Dec/06 07:56 pm>[1742907.002380] RBP: ffff88033d201100 R08: 0000000000000001 R09: 0000000000000001
     13<Dec/06 07:56 pm>[1742907.002380] R10: 0000000000000000 R11: 0000000000000000 R12: ffff880323904578
     14<Dec/06 07:56 pm>[1742907.002380] R13: d6f684b2ef9f442d R14: ffffffff808b85a0 R15: 0000000000000000
     15<Dec/06 07:56 pm>[1742907.002380] FS:  0000000000000000(0000) GS:ffffffff80872d80(0000) knlGS:0000000000000000
     16<Dec/06 07:56 pm>[1742907.002380] CS:  0010 DS: 0018 ES: 0018 CR0: 000000008005003b
     17<Dec/06 07:56 pm>[1742907.002380] CR2: 00007f186495d000 CR3: 00000002994a0000 CR4: 00000000000006e0
     18
     19<Dec/06 07:56 pm>[1742907.002380] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
     20<Dec/06 07:56 pm>[1742907.002380] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
     21<Dec/06 07:56 pm>[1742907.002380] Process rpciod/0 (pid: 1524, threadinfo ffff88033ccda000, task ffff88033cc61e60)
     22<Dec/06 07:56 pm>[1742907.002380] Stack:
     23<Dec/06 07:56 pm>[1742907.002380]  ffff88033d201140 0000000000000046 b0de62e37a334368 d3ead54ec2973d26
     24<Dec/06 07:56 pm>[1742907.002380]  a1768b44857f2f7f ffff88033d201100 ffff88063e43bbf0 ffff88033d201100
     25<Dec/06 07:56 pm>[1742907.002380]  ffff88033d201140 ffff88063e43bbf0 ffffffff808b5d60 ffffffff80249511
     26<Dec/06 07:56 pm>[1742907.002380] Call Trace:
     27<Dec/06 07:56 pm>[1742907.002380]  [<ffffffff80249511>] ? worker_thread+0xd8/0xe3
     28<Dec/06 07:56 pm>[1742907.002380]  [<ffffffff8024bfda>] ? autoremove_wake_function+0x0/0x2e
     29<Dec/06 07:56 pm>[1742907.002380]  [<ffffffff80249439>] ? worker_thread+0x0/0xe3
     30<Dec/06 07:56 pm>[1742907.002380]  [<ffffffff8024becc>] ? kthread+0x47/0x73
     31<Dec/06 07:56 pm>[1742907.002380]  [<ffffffff80234852>] ? schedule_tail+0x27/0x5f
     32<Dec/06 07:56 pm>[1742907.002380]  [<ffffffff8020cd19>] ? child_rip+0xa/0x11
     33<Dec/06 07:56 pm>[1742907.002380]  [<ffffffff804fa23c>] ? menu_reflect+0x0/0x6d
     34<Dec/06 07:56 pm>[1742907.002380]  [<ffffffff8024be85>] ? kthread+0x0/0x73
     35<Dec/06 07:56 pm>[1742907.002380]  [<ffffffff8020cd0f>] ? child_rip+0x0/0x11
     36<Dec/06 07:56 pm>[1742907.002380] Code: 4c 8d 63 f8 48 8d 7c 24 10 48 8d 73 18 fc 4d 8b 6c 24 18 b9 06 00 00 00 f3 a5 4c 89 a5 80 00 00 00 48 89 ef 48 8b 43 08 48 8b 13 <48> 89 42 08 48 89 10 48 89 5b 08 48 89 1b e8 d1 ed 36 00 48 8b
     37<Dec/06 07:56 pm>[1742907.002380] RIP  [<ffffffff802488f9>] run_workqueue+0x73/0x1ed
     38<Dec/06 07:56 pm>[1742907.002380]  RSP <ffff88033ccdbe80>
     39<Dec/06 07:56 pm>[1742907.002380] ---[ end trace 6e4e47cca4dd6312 ]---
     40<Dec/06 07:57 pm>[1742912.482643] BUG: spinlock lockup on CPU#2, lockd/7748, ffff88033d201100
     41
     42<Dec/06 07:57 pm>[1742912.482643] Pid: 7748, comm: lockd Tainted: G      D W  2.6.28-rc7-00105-gfeaf384 #4
     43<Dec/06 07:57 pm>[1742912.482643] Call Trace:
     44<Dec/06 07:57 pm>[1742912.482643]  [<ffffffff803a103f>] _raw_spin_lock+0xfb/0x122
     45<Dec/06 07:57 pm>[1742912.482643]  [<ffffffff8024912b>] __cancel_work_timer+0x120/0x1a3
     46<Dec/06 07:57 pm>[1742912.482643]  [<ffffffff802490a1>] __cancel_work_timer+0x96/0x1a3
     47<Dec/06 07:57 pm>[1742912.482643]  [<ffffffff8058a0f0>] xs_destroy+0x31/0x79
     48<Dec/06 07:57 pm>[1742912.482643]  [<ffffffff80588458>] xprt_destroy+0x0/0x7c
     49<Dec/06 07:57 pm>[1742912.482643]  [<ffffffff803995bf>] kref_put+0x41/0x4c
     50<Dec/06 07:57 pm>[1742912.482643]  [<ffffffff80587073>] rpc_free_client+0x0/0xd1
     51<Dec/06 07:57 pm>[1742912.482643]  [<ffffffff80587136>] rpc_free_client+0xc3/0xd1
     52<Dec/06 07:57 pm>[1742912.482643]  [<ffffffff803995bf>] kref_put+0x41/0x4c
     53<Dec/06 07:57 pm>[1742912.482643]  [<ffffffff80587144>] rpc_free_auth+0x0/0x40
     54<Dec/06 07:57 pm>[1742912.482643]  [<ffffffff803995bf>] kref_put+0x41/0x4c
     55<Dec/06 07:57 pm>[1742912.482643]  [<ffffffff8058724e>] rpc_shutdown_client+0xca/0xd5
     56<Dec/06 07:57 pm>[1742912.482643]  [<ffffffff80586fc6>] rpc_call_sync+0x53/0x5b
     57<Dec/06 07:57 pm>[1742912.482643]  [<ffffffff8037054a>] nsm_mon_unmon+0x158/0x16c
     58<Dec/06 07:57 pm>[1742912.482643]  [<ffffffff803995bf>] kref_put+0x41/0x4c
     59<Dec/06 07:57 pm>[1742912.482643]  [<ffffffff803705c4>] nsm_unmonitor+0x66/0xa2
     60<Dec/06 07:57 pm>[1742912.482643]  [<ffffffff8036c8fa>] nlm_gc_hosts+0x126/0x18d
     61<Dec/06 07:57 pm>[1742912.482643]  [<ffffffff8036d172>] nlm_lookup_host+0x32/0x4f9
     62<Dec/06 07:57 pm>[1742912.482643]  [<ffffffff8036d746>] nlmsvc_lookup_host+0x10d/0x119
     63<Dec/06 07:57 pm>[1742912.482643]  [<ffffffff80372235>] nlm4svc_retrieve_args+0x49/0xe3
     64
     65<Dec/06 07:57 pm>[1742912.482643]  [<ffffffff803a0f26>] __spin_lock_init+0x29/0x47
     66<Dec/06 07:57 pm>[1742912.482643]  [<ffffffff8037272e>] nlm4svc_proc_lock+0x4b/0xda
     67<Dec/06 07:57 pm>[1742912.482643]  [<ffffffff80371d04>] nlm4svc_decode_lockargs+0x37/0x9a
     68<Dec/06 07:57 pm>[1742912.482643]  [<ffffffff8058fe3e>] svc_process+0x38b/0x6e9
     69<Dec/06 07:57 pm>[1742912.482643]  [<ffffffff8036db9d>] lockd+0x12d/0x186
     70<Dec/06 07:57 pm>[1742912.482643]  [<ffffffff8036da70>] lockd+0x0/0x186
     71<Dec/06 07:57 pm>[1742912.482643]  [<ffffffff8024becc>] kthread+0x47/0x73
     72<Dec/06 07:57 pm>[1742912.482643]  [<ffffffff80234852>] schedule_tail+0x27/0x5f
     73<Dec/06 07:57 pm>[1742912.482643]  [<ffffffff8020cd19>] child_rip+0xa/0x11
     74<Dec/06 07:57 pm>[1742912.482643]  [<ffffffff804fa23c>] menu_reflect+0x0/0x6d
     75<Dec/06 07:57 pm>[1742912.482643]  [<ffffffff8024be85>] kthread+0x0/0x73
     76<Dec/06 07:57 pm>[1742912.482643]  [<ffffffff8020cd0f>] child_rip+0x0/0x11
     77<Dec/06 07:57 pm>[1742968.257135] BUG: spinlock lockup on CPU#1, sh/4730, ffffffff80872a80
     78<Dec/06 07:57 pm>[1742968.264097] Pid: 4730, comm: sh Tainted: G      D W  2.6.28-rc7-00105-gfeaf384 #4
     79<Dec/06 07:57 pm>[1742968.272380] Call Trace:
     80<Dec/06 07:57 pm>[1742968.275306]  [<ffffffff803a103f>] _raw_spin_lock+0xfb/0x122
     81<Dec/06 07:57 pm>[1742968.281398]  [<ffffffff805b789b>] lock_kernel+0x1d/0x2b
     82<Dec/06 07:57 pm>[1742968.287123]  [<ffffffff803e36ed>] tty_open+0x1d/0x414
     83<Dec/06 07:57 pm>[1742968.292743]  [<ffffffff802ae8ca>] chrdev_open+0x13c/0x18b
     84<Dec/06 07:57 pm>[1742968.298659]  [<ffffffff802ae78e>] chrdev_open+0x0/0x18b
     85<Dec/06 07:57 pm>[1742968.304397]  [<ffffffff802aa993>] __dentry_open+0x137/0x254
     86<Dec/06 07:57 pm>[1742968.310483]  [<ffffffff802b6829>] do_filp_open+0x439/0x7e1
     87
     88<Dec/06 07:57 pm>[1742968.316497]  [<ffffffff805b795d>] error_exit+0x0/0x9a
     89<Dec/06 07:57 pm>[1742968.322084]  [<ffffffff805b7388>] _spin_unlock+0x17/0x20
     90<Dec/06 07:57 pm>[1742968.327944]  [<ffffffff802be3c9>] alloc_fd+0x103/0x112
     91<Dec/06 07:57 pm>[1742968.333627]  [<ffffffff802aa7b4>] do_sys_open+0x48/0xc5
     92<Dec/06 07:57 pm>[1742968.339383]  [<ffffffff8020bd2b>] system_call_fastpath+0x16/0x1b
     93<Dec/06 07:57 pm>[1742976.112791] BUG: soft lockup - CPU#6 stuck for 61s! [archttp64:8294]
     94<Dec/06 07:57 pm>[1742976.112793] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last unloaded: w83793]
     95<Dec/06 07:57 pm>[1742976.112793] CPU 6:
     96<Dec/06 07:57 pm>[1742976.112793] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last unloaded: w83793]
     97<Dec/06 07:57 pm>[1742976.112793] Pid: 8294, comm: archttp64 Tainted: G      D W  2.6.28-rc7-00105-gfeaf384 #4
     98<Dec/06 07:57 pm>[1742976.112793] RIP: 0010:[<ffffffff8021205f>]  [<ffffffff8021205f>] native_read_tsc+0x2/0xc
     99<Dec/06 07:57 pm>[1742976.112793] RSP: 0018:ffff88063704bdf0  EFLAGS: 00000206
     100<Dec/06 07:57 pm>[1742976.112793] RAX: 0000000001a91236 RBX: 0000000001a91212 RCX: ffffffff802d6972
     101<Dec/06 07:57 pm>[1742976.112793] RDX: 00000000000edd63 RSI: ffff88063cc49960 RDI: 0000000000000001
     102<Dec/06 07:57 pm>[1742976.112793] RBP: 0000000001a91212 R08: ffff88063cc48380 R09: 0000000000000000
     103<Dec/06 07:57 pm>[1742976.112793] R10: 0000000000000000 R11: ffffffff8039d94e R12: 0000000000000000
     104<Dec/06 07:57 pm>[1742976.112793] R13: 0000000000000001 R14: 0000000000000000 R15: 0000000000000001
     105<Dec/06 07:57 pm>[1742976.112793] FS:  00000000006f8ca0(0063) GS:ffff88063e428c00(0000) knlGS:0000000000000000
     106<Dec/06 07:57 pm>[1742976.112793] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
     107<Dec/06 07:57 pm>[1742976.112793] CR2: 00007fab8afdb000 CR3: 000000063c013000 CR4: 00000000000006e0
     108<Dec/06 07:57 pm>[1742976.112793] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
     109<Dec/06 07:57 pm>[1742976.112793] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
     110
     111<Dec/06 07:57 pm>[1742976.112793] Call Trace:
     112<Dec/06 07:57 pm>[1742976.112793]  [<ffffffff8039d96a>] ? delay_tsc+0x1c/0x42
     113<Dec/06 07:57 pm>[1742976.112793]  [<ffffffff803a0ffe>] ? _raw_spin_lock+0xba/0x122
     114<Dec/06 07:57 pm>[1742976.112793]  [<ffffffff805b789b>] ? lock_kernel+0x1d/0x2b
     115<Dec/06 07:57 pm>[1742976.112793]  [<ffffffff802d698f>] ? __posix_lock_file+0x6b/0x437
     116<Dec/06 07:57 pm>[1742976.112793]  [<ffffffff802d77f9>] ? fcntl_setlk+0x11d/0x26c
     117<Dec/06 07:57 pm>[1742976.112793]  [<ffffffff802b7650>] ? sys_fcntl+0x2ef/0x373
     118<Dec/06 07:57 pm>[1742976.112793]  [<ffffffff8020bd2b>] ? system_call_fastpath+0<Dec/06 07:57 pm>
     119                 <Dec/06 07:57 pm>[1742977.185983] BUG: soft lockup - CPU#4 stuck for 61s! [sh:4726]
     120<Dec/06 07:57 pm>[1742977.185986] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last unloaded: w83793]
     121<Dec/06 07:57 pm>[1742977.185986] CPU 4:
     122<Dec/06 07:57 pm>[1742977.185986] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last unloaded: w83793]
     123<Dec/06 07:57 pm>[1742977.185986] Pid: 4726, comm: sh Tainted: G      D W  2.6.28-rc7-00105-gfeaf384 #4
     124<Dec/06 07:57 pm>[1742977.185986] RIP: 0010:[<ffffffff8021205f>]  [<ffffffff8021205f>] native_read_tsc+0x2/0xc
     125<Dec/06 07:57 pm>[1742977.185986] RSP: 0018:ffff8803d97bfcf0  EFLAGS: 00000202
     126<Dec/06 07:57 pm>[1742977.185986] RAX: 000000009b317fbe RBX: 000000007ae93d5d RCX: ffffffff807afb40
     127<Dec/06 07:57 pm>[1742977.185986] RDX: 00000000000edd63 RSI: ffff880456151900 RDI: 0000000000000001
     128<Dec/06 07:57 pm>[1742977.185986] RBP: 000000007ae93d5d R08: 0000000000000001 R09: 0000000000000000
     129<Dec/06 07:57 pm>[1742977.185986] R10: 0000000000000000 R11: ffffffff8039d94e R12: ffff8803d97b41ed
     130<Dec/06 07:57 pm>[1742977.185986] R13: ffff8805d750b005 R14: ffff88063d5c41ed R15: ffffffff802bac90
     131<Dec/06 07:57 pm>[1742977.185986] FS:  00007fedc60b26f0(0000) GS:ffff88063e428300(0000) knlGS:0000000000000000
     132<Dec/06 07:57 pm>[1742977.185986] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
     133
     134<Dec/06 07:57 pm>[1742977.185986] CR2: 00000000004931f8 CR3: 00000004f0345000 CR4: 00000000000006e0
     135<Dec/06 07:57 pm>[1742977.185986] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
     136<Dec/06 07:57 pm>[1742977.185986] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
     137<Dec/06 07:57 pm>[1742977.185986] Call Trace:
     138<Dec/06 07:57 pm>[1742977.185986]  [<ffffffff8039d963>] ? delay_tsc+0x15/0x42
     139<Dec/06 07:57 pm>[1742977.185986]  [<ffffffff803a0ffe>] ? _raw_spin_lock+0xba/0x122
     140<Dec/06 07:57 pm>[1742977.185986]  [<ffffffff805b789b>] ? lock_kernel+0x1d/0x2b
     141<Dec/06 07:57 pm>[1742977.185986]  [<ffffffff803e36ed>] ? tty_open+0x1d/0x414
     142<Dec/06 07:57 pm>[1742977.185986]  [<ffffffff802ae8ca>] ? chrdev_open+0x13c/0x18b
     143<Dec/06 07:57 pm>[1742977.185986]  [<ffffffff802ae78e>] ? chrdev_open+0x0/0x18b
     144<Dec/06 07:57 pm>[1742977.185986]  [<ffffffff802aa993>] ? __dentry_open+0x137/0x254
     145<Dec/06 07:57 pm>[1742977.185986]  [<ffffffff802b6829>] ? do_filp_open+0x439/0x7e1
     146<Dec/06 07:57 pm>[1742977.185986]  [<ffffffff805b795d>] ? error_exit+0x0/0x9a
     147<Dec/06 07:57 pm>[1742977.185986]  [<ffffffff805b7388>] ? _spin_unlock+0x17/0x20
     148<Dec/06 07:57 pm>[1742977.185986]  [<ffffffff802be3c9>] ? alloc_fd+0x103/0x112
     149<Dec/06 07:57 pm>[1742977.185986]  [<ffffffff802aa7b4>] ? do_sys_open+0x48/0xc5
     150<Dec/06 07:57 pm>[1742977.185986]  [<ffffffff8020bd2b>] ? system_call_fastpath+0x16/0x1b
     151<Dec/06 07:57 pm>[1742986.602872] BUG: spinlock lockup on CPU#6, archttp64/8294, ffffffff80872a80
     152<Dec/06 07:57 pm>[1742986.610549] Pid: 8294, comm: archttp64 Tainted: G      D W  2.6.28-rc7-00105-gfeaf384 #4
     153<Dec/06 07:57 pm>[1742986.619579] Call Trace:
     154<Dec/06 07:57 pm>[1742986.622516]  [<ffffffff803a103f>] _raw_spin_lock+0xfb/0x122
     155<Dec/06 07:57 pm>[1742986.628732]  [<ffffffff805b789b>] lock_kernel+0x1d/0x2b
     156
     157<Dec/06 07:57 pm>[1742986.634573]  [<ffffffff802d698f>] __posix_lock_file+0x6b/0x437
     158<Dec/06 07:57 pm>[1742986.641047]  [<ffffffff802d77f9>] fcntl_setlk+0x11d/0x26c
     159<Dec/06 07:57 pm>[1742986.647037]  [<ffffffff802b7650>] sys_fcntl+0x2ef/0x373
     160<Dec/06 07:57 pm>[1742986.652872]  [<ffffffff8020bd2b>] system_call_fastpath+0x16/0x1b
     161<Dec/06 07:57 pm>[1742988.003249] BUG: spinlock lockup on CPU#4, sh/4726, ffffffff80872a80
     162<Dec/06 07:57 pm>[1742988.010244] Pid: 4726, comm: sh Tainted: G      D W  2.6.28-rc7-00105-gfeaf384 #4
     163<Dec/06 07:57 pm>[1742988.018577] Call Trace:
     164<Dec/06 07:57 pm>[1742988.021542]  [<ffffffff803a103f>] _raw_spin_lock+0xfb/0x122
     165<Dec/06 07:57 pm>[1742988.027775]  [<ffffffff805b789b>] lock_kernel+0x1d/0x2b
     166<Dec/06 07:57 pm>[1742988.033606]  [<ffffffff803e36ed>] tty_open+0x1d/0x414
     167<Dec/06 07:57 pm>[1742988.039292]  [<ffffffff802ae8ca>] chrdev_open+0x13c/0x18b
     168<Dec/06 07:57 pm>[1742988.045298]  [<ffffffff802ae78e>] chrdev_open+0x0/0x18b
     169<Dec/06 07:57 pm>[1742988.051181]  [<ffffffff802aa993>] __dentry_open+0x137/0x254
     170<Dec/06 07:57 pm>[1742988.057412]  [<ffffffff802b6829>] do_filp_open+0x439/0x7e1
     171<Dec/06 07:57 pm>[1742988.063514]  [<ffffffff805b795d>] error_exit+0x0/0x9a
     172<Dec/06 07:57 pm>[1742988.069188]  [<ffffffff805b7388>] _spin_unlock+0x17/0x20
     173<Dec/06 07:57 pm>[1742988.075107]  [<ffffffff802be3c9>] alloc_fd+0x103/0x112
     174<Dec/06 07:57 pm>[1742988.080871]  [<ffffffff802aa7b4>] do_sys_open+0x48/0xc5
     175<Dec/06 07:57 pm>[1742988.086713]  [<ffffffff8020bd2b>] system_call_fastpath+0x16/0x1b
     176<Dec/06 07:57 pm>[1742993.292857] BUG: soft lockup - CPU#7 stuck for 61s! [ntpd:5084]
     177<Dec/06 07:57 pm>[1742993.292860] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last unloaded: w83793]
     178<Dec/06 07:57 pm>[1742993.292860] CPU 7:
     179
     180<Dec/06 07:57 pm>[1742993.292860] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last unloaded: w83793]
     181<Dec/06 07:57 pm>[1742993.292860] Pid: 5084, comm: ntpd Tainted: G      D W  2.6.28-rc7-00105-gfeaf384 #4
     182<Dec/06 07:57 pm>[1742993.292860] RIP: 0010:[<ffffffff8021205f>]  [<ffffffff8021205f>] native_read_tsc+0x2/0xc
     183<Dec/06 07:57 pm>[1742993.292860] RSP: 0018:ffff88059f905be0  EFLAGS: 00000202
     184<Dec/06 07:57 pm>[1742993.292860] RAX: 000000009b780f4e RBX: 000000009b780f2a RCX: ffff88033e008370
     185<Dec/06 07:57 pm>[1742993.292860] RDX: 00000000000edd6c RSI: ffff88063e000030 RDI: 0000000000000001
     186<Dec/06 07:57 pm>[1742993.292860] RBP: 000000009b780f2a R08: 0000000000000001 R09: 0000000000000000
     187<Dec/06 07:57 pm>[1742993.292860] R10: 0000000000000000 R11: ffffffff8039d94e R12: ffffffff802327e2
     188<Dec/06 07:57 pm>[1742993.292860] R13: ffff8802552c6a50 R14: 0000000000000000 R15: ffff8803224dcdc0
     189<Dec/06 07:57 pm>[1742993.292860] FS:  00007f838eb366f0(0000) GS:ffff88063e429000(0000) knlGS:0000000000000000
     190<Dec/06 07:57 pm>[1742993.292860] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
     191<Dec/06 07:57 pm>[1742993.292860] CR2: 000000002e4ace40 CR3: 00000004320b7000 CR4: 00000000000006e0
     192<Dec/06 07:57 pm>[1742993.292860] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
     193<Dec/06 07:57 pm>[1742993.292860] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
     194<Dec/06 07:57 pm>[1742993.292860] Call Trace:
     195<Dec/06 07:57 pm>[1742993.292860]  [<ffffffff8039d96a>] ? delay_tsc+0x1c/0x42
     196<Dec/06 07:57 pm>[1742993.292860]  [<ffffffff803a0ffe>] ? _raw_spin_lock+0xba/0x122
     197<Dec/06 07:57 pm>[1742993.292860]  [<ffffffff805b789b>] ? lock_kernel+0x1d/0x2b
     198<Dec/06 07:57 pm>[1742993.292860]  [<ffffffff802ed76d>] ? proc_lookup_de+0x18/0xdd
     199<Dec/06 07:57 pm>[1742993.292860]  [<ffffffff802e950e>] ? proc_root_lookup+0x12/0x30
     200<Dec/06 07:57 pm>[1742993.292860]  [<ffffffff802b30a5>] ? do_lookup+0xd9/0x1c3
     201<Dec/06 07:57 pm>[1742993.292860]  [<ffffffff802b4d63>] ? __link_path_walk+0x36c/0xcc9
     202
     203<Dec/06 07:57 pm>[1742993.292860]  [<ffffffff802b5706>] ? path_walk+0x46/0x8b
     204<Dec/06 07:57 pm>[1742993.292860]  [<ffffffff802b58d4>] ? do_path_lookup+0x10e/0x169
     205<Dec/06 07:57 pm>[1742993.292860]  [<ffffffff802b63af>] ? path_lookup_open+0x54/0x95
     206<Dec/06 07:57 pm>[1742993.292860]  [<ffffffff802b6492>] ? do_filp_open+0xa2/0x7e1
     207<Dec/06 07:57 pm>[1742993.292860]  [<ffffffff805b7388>] ? _spin_unlock+0x17/0x20
     208<Dec/06 07:57 pm>[1742993.292860]  [<ffffffff802be3c9>] ? alloc_fd+0x103/0x112
     209<Dec/06 07:57 pm>[1742993.292860]  [<ffffffff802aa7b4>] ? do_sys_open+0x48/0xc5
     210<Dec/06 07:57 pm>[1742993.292860]  [<ffffffff8020bd2b>] ? system_call_fastpath+0x16/0x1b
     211<Dec/06 07:58 pm>[1742999.923697] BUG: spinlock lockup on CPU#0, rpc.mountd/7611, ffffffff80872a80
     212<Dec/06 07:58 pm>[1742999.931520] Pid: 7611, comm: rpc.mountd Tainted: G      D W  2.6.28-rc7-00105-gfeaf384 #4
     213<Dec/06 07:58 pm>[1742999.940518] Call Trace:
     214<Dec/06 07:58 pm>[1742999.943443]  [<ffffffff803a103f>] _raw_spin_lock+0xfb/0x122
     215<Dec/06 07:58 pm>[1742999.949586]  [<ffffffff805b789b>] lock_kernel+0x1d/0x2b
     216<Dec/06 07:58 pm>[1742999.955326]  [<ffffffff802d698f>] __posix_lock_file+0x6b/0x437
     217<Dec/06 07:58 pm>[1742999.961692]  [<ffffffff802d77f9>] fcntl_setlk+0x11d/0x26c
     218<Dec/06 07:58 pm>[1742999.967634]  [<ffffffff802b7650>] sys_fcntl+0x2ef/0x373
     219<Dec/06 07:58 pm>[1742999.973440]  [<ffffffff8020bd2b>] system_call_fastpath+0x16/0x1b
     220<Dec/06 07:58 pm>[1743003.853302] BUG: spinlock lockup on CPU#7, ntpd/5084, ffffffff80872a80
     221<Dec/06 07:58 pm>[1743003.860504] Pid: 5084, comm: ntpd Tainted: G      D W  2.6.28-rc7-00105-gfeaf384 #4
     222<Dec/06 07:58 pm>[1743003.869045] Call Trace:
     223<Dec/06 07:58 pm>[1743003.872011]  [<ffffffff803a103f>] _raw_spin_lock+0xfb/0x122
     224<Dec/06 07:58 pm>[1743003.878197]  [<ffffffff805b789b>] lock_kernel+0x1d/0x2b
     225
     226<Dec/06 07:58 pm>[1743003.884007]  [<ffffffff802ed76d>] proc_lookup_de+0x18/0xdd
     227<Dec/06 07:58 pm>[1743003.890130]  [<ffffffff802e950e>] proc_root_lookup+0x12/0x30
     228<Dec/06 07:58 pm>[1743003.896448]  [<ffffffff802b30a5>] do_lookup+0xd9/0x1c3
     229<Dec/06 07:58 pm>[1743003.902196]  [<ffffffff802b4d63>] __link_path_walk+0x36c/0xcc9
     230<Dec/06 07:58 pm>[1743003.908660]  [<ffffffff802b5706>] path_walk+0x46/0x8b
     231<Dec/06 07:58 pm>[1743003.914321]  [<ffffffff802b58d4>] do_path_lookup+0x10e/0x169
     232<Dec/06 07:58 pm>[1743003.920627]  [<ffffffff802b63af>] path_lookup_open+0x54/0x95
     233<Dec/06 07:58 pm>[1743003.931580]  [<ffffffff802b6492>] do_filp_open+0xa2/0x7e1
     234<Dec/06 07:58 pm>[1743003.937614]  [<ffffffff805b7388>] _spin_unlock+0x17/0x20
     235<Dec/06 07:58 pm>[1743003.943552]  [<ffffffff802be3c9>] alloc_fd+0x103/0x112
     236<Dec/06 07:58 pm>[1743003.949302]  [<ffffffff802aa7b4>] do_sys_open+0x48/0xc5
     237<Dec/06 07:58 pm>[1743003.955138]  [<ffffffff8020bd2b>] system_call_fastpath+0x16/0x1b
     238<Dec/06 07:58 pm>[1743033.022434] BUG: soft lockup - CPU#1 stuck for 61s! [sh:4730]
     239<Dec/06 07:58 pm>[1743033.022438] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last unloaded: w83793]
     240<Dec/06 07:58 pm>[1743033.022438] CPU 1:
     241<Dec/06 07:58 pm>[1743033.022438] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last unloaded: w83793]
     242<Dec/06 07:58 pm>[1743033.022438] Pid: 4730, comm: sh Tainted: G      D W  2.6.28-rc7-00105-gfeaf384 #4
     243<Dec/06 07:58 pm>[1743033.022438] RIP: 0010:[<ffffffff80212063>]  [<ffffffff80212063>] native_read_tsc+0x6/0xc
     244<Dec/06 07:58 pm>[1743033.022438] RSP: 0018:ffff88011c96bcf0  EFLAGS: 00000206
     245<Dec/06 07:58 pm>[1743033.022438] RAX: 00000000cf3f5ae8 RBX: 00000000cf3f5ad6 RCX: ffffffff80932380
     246<Dec/06 07:58 pm>[1743033.022438] RDX: 000edd8200000000 RSI: 0000000001062560 RDI: 0000000000000001
     247<Dec/06 07:58 pm>[1743033.022438] RBP: 00000000cf3f5ad6 R08: ffffffff80239d5d R09: 0000000000000000
     248
     249<Dec/06 07:58 pm>[1743033.022438] R10: 0000000000000000 R11: ffffffff8039d94e R12: 0000000040850c08
     250<Dec/06 07:58 pm>[1743033.022438] R13: 0000000040850c08 R14: ffffffff8020e25d R15: ffffffff80794266
     251<Dec/06 07:58 pm>[1743033.022438] FS:  00007fb3ffd206f0(0000) GS:ffff88033e44d000(0000) knlGS:0000000000000000
     252<Dec/06 07:58 pm>[1743033.022438] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
     253<Dec/06 07:58 pm>[1743033.022438] CR2: 00000000004931f8 CR3: 0000000146cdd000 CR4: 00000000000006e0
     254<Dec/06 07:58 pm>[1743033.022438] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
     255<Dec/06 07:58 pm>[1743033.022438] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
     256<Dec/06 07:58 pm>[1743033.022438] Call Trace:
     257<Dec/06 07:58 pm>[1743033.022438]  [<ffffffff8039d96a>] ? delay_tsc+0x1c/0x42
     258<Dec/06 07:58 pm>[1743033.022438]  [<ffffffff803a0ffe>] ? _raw_spin_lock+0xba/0x122
     259<Dec/06 07:58 pm>[1743033.022438]  [<ffffffff805b789b>] ? lock_kernel+0x1d/0x2b
     260<Dec/06 07:58 pm>[1743033.022438]  [<ffffffff803e36ed>] ? tty_open+0x1d/0x414
     261<Dec/06 07:58 pm>[1743033.022438]  [<ffffffff802ae8ca>] ? chrdev_open+0x13c/0x18b
     262<Dec/06 07:58 pm>[1743033.022438]  [<ffffffff802ae78e>] ? chrdev_open+0x0/0x18b
     263<Dec/06 07:58 pm>[1743033.022438]  [<ffffffff802aa993>] ? __dentry_open+0x137/0x254
     264<Dec/06 07:58 pm>[1743033.022438]  [<ffffffff802b6829>] ? do_filp_open+0x439/0x7e1
     265<Dec/06 07:58 pm>[1743033.022438]  [<ffffffff805b795d>] ? error_exit+0x0/0x9a
     266                 <Dec/06 07:58 pm>[1743033.022438]  [<ffffffff805b7388>] ? _spin_unlock+0x17/0x20
     267<Dec/06 07:58 pm>[1743033.022438]  [<ffffffff802be3c9>] ? alloc_fd+0x103/0x112
     268<Dec/06 07:58 pm>[1743033.022438]  [<ffffffff802aa7b4>] ? do_sys_open+0x48/0xc5
     269<Dec/06 07:58 pm>[1743033.022438]  [<ffffffff8020bd2b>] ? system_call_fastpath+0x16/0x1b
     270<Dec/06 07:58 pm>[1743051.276115] BUG: soft lockup - CPU#6 stuck for 61s! [archttp64:8294]
     271
     272<Dec/06 07:58 pm>[1743051.276118] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last unloaded: w83793]
     273<Dec/06 07:58 pm>[1743051.276118] CPU 6:
     274<Dec/06 07:58 pm>[1743051.276118] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last unloaded: w83793]
     275<Dec/06 07:58 pm>[1743051.276118] Pid: 8294, comm: archttp64 Tainted: G      D W  2.6.28-rc7-00105-gfeaf384 #4
     276<Dec/06 07:58 pm>[1743051.276118] RIP: 0010:[<ffffffff8021205f>]  [<ffffffff8021205f>] native_read_tsc+0x2/0xc
     277<Dec/06 07:58 pm>[1743051.276118] RSP: 0018:ffff88063704bdf0  EFLAGS: 00000202
     278<Dec/06 07:58 pm>[1743051.276118] RAX: 0000000002a60afa RBX: 0000000002a60ad6 RCX: ffffffff80932380
     279<Dec/06 07:58 pm>[1743051.276118] RDX: 00000000000edd8d RSI: 0000000001062560 RDI: 0000000000000001
     280<Dec/06 07:58 pm>[1743051.276118] RBP: 0000000002a60ad6 R08: ffffffff80239d5d R09: 0000000000000000
     281<Dec/06 07:58 pm>[1743051.276118] R10: 0000000000000000 R11: ffffffff8039d94e R12: 000000007c08d1fa
     282<Dec/06 07:58 pm>[1743051.276118] R13: 000000007c08d1fa R14: ffffffff8020e25d R15: ffffffff80794266
     283<Dec/06 07:58 pm>[1743051.276118] FS:  00000000006f8ca0(0063) GS:ffff88063e428c00(0000) knlGS:0000000000000000
     284<Dec/06 07:58 pm>[1743051.276118] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
     285<Dec/06 07:58 pm>[1743051.276118] CR2: 00007fab8afdb000 CR3: 000000063c013000 CR4: 00000000000006e0
     286<Dec/06 07:58 pm>[1743051.276118] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
     287<Dec/06 07:58 pm>[1743051.276118] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
     288<Dec/06 07:58 pm>[1743051.276118] Call Trace:
     289<Dec/06 07:58 pm>[1743051.276118]  [<ffffffff8039d96a>] ? delay_tsc+0x1c/0x42
     290<Dec/06 07:58 pm>[1743051.276118]  [<ffffffff803a0ffe>] ? _raw_spin_lock+0xba/0x122
     291<Dec/06 07:58 pm>[1743051.276118]  [<ffffffff805b789b>] ? lock_kernel+0x1d/0x2b
     292<Dec/06 07:58 pm>[1743051.276118]  [<ffffffff802d698f>] ? __posix_lock_file+0x6b/0x437
     293<Dec/06 07:58 pm>[1743051.276118]  [<ffffffff802d77f9>] ? fcntl_setlk+0x11d/0x26c
     294
     295<Dec/06 07:58 pm>[1743051.276118]  [<ffffffff802b7650>] ? sys_fcntl+0x2ef/0x373
     296                 <Dec/06 07:58 pm>[1743051.276118]  [<ffffffff8020bd2b>] ? system_call_fastpath+0x16/0x1b
     297<Dec/06 07:58 pm>[1743053.422641] BUG: soft lockup - CPU#4 stuck for 61s! [sh:4726]
     298<Dec/06 07:58 pm>[1743053.422646] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last un<Dec/06 07:58 pm>
     299                 <Dec/06 07:58 pm>[1743053.422646] CPU 4:
     300<Dec/06 07:58 pm>[1743053.422646] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last unloaded: w83793]
     301<Dec/06 07:58 pm>[1743053.422646] Pid: 4726, comm: sh Tainted: G      D W  2.6.28-rc7-00105-gfeaf384 #4
     302<Dec/06 07:58 pm>[1743053.422646] RIP: 0010:[<ffffffff8021205f>]  [<ffffffff8021205f>] native_read_tsc+0x2/0xc
     303<Dec/06 07:58 pm>[1743053.422646] RSP: 0018:ffff8803d97bfcf0  EFLAGS: 00000202
     304<Dec/06 07:58 pm>[1743053.422646] RAX: 0000000035bbfe3e RBX: 0000000035bbfe1a RCX: ffffffff80932380
     305<Dec/06 07:58 pm>[1743053.422646] RDX: 00000000000edd8e RSI: 0000000001062560 RDI: 0000000000000001
     306<Dec/06 07:58 pm>[1743053.422646] RBP: 0000000035bbfe1a R08: ffffffff80239d5d R09: 0000000000000000
     307<Dec/06 07:58 pm>[1743053.422646] R10: 0000000000000000 R11: ffffffff8039d94e R12: 0000000049889ca8
     308<Dec/06 07:58 pm>[1743053.422646] R13: 0000000049889ca8 R14: ffffffff8020e25d R15: ffffffff80794266
     309<Dec/06 07:58 pm>[1743053.422646] FS:  00007fedc60b26f0(0000) GS:ffff88063e428300(0000) knlGS:0000000000000000
     310<Dec/06 07:58 pm>[1743053.422646] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
     311<Dec/06 07:58 pm>[1743053.422646] CR2: 00000000004931f8 CR3: 00000004f0345000 CR4: 00000000000006e0
     312<Dec/06 07:58 pm>[1743053.422646] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
     313<Dec/06 07:58 pm>[1743053.422646] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
     314<Dec/06 07:58 pm>[1743053.422646] Call Trace:
     315<Dec/06 07:58 pm>[1743053.422646]  [<ffffffff8039d96a>] ? delay_tsc+0x1c/0x42
     316<Dec/06 07:58 pm>[1743053.422646]  [<ffffffff803a0ffe>] ? _raw_spin_lock+0xba/0x122
     317
     318<Dec/06 07:58 pm>[1743053.422646]  [<ffffffff805b789b>] ? lock_kernel+0x1d/0x2b
     319<Dec/06 07:58 pm>[1743053.422646]  [<ffffffff803e36ed>] ? tty_open+0x1d/0x414
     320<Dec/06 07:58 pm>[1743053.422646]  [<ffffffff802ae8ca>] ? chrdev_open+0x13c/0x18b
     321<Dec/06 07:58 pm>[1743053.422646]  [<ffffffff802ae78e>] ? chrdev_open+0x0/0x18b
     322<Dec/06 07:58 pm>[1743053.422646]  [<ffffffff802aa993>] ? __dentry_open+0x137/0x254
     323<Dec/06 07:58 pm>[1743053.422646]  [<ffffffff802b6829>] ? do_filp_open+0x439/0x7e1
     324<Dec/06 07:58 pm>[1743053.422646]  [<ffffffff805b795d>] ? error_exit+0x0/0x9a
     325<Dec/06 07:58 pm>[1743053.422646]  [<ffffffff805b7388>] ? _spin_unlock+0x17/0x20
     326<Dec/06 07:58 pm>[1743053.422646]  [<ffffffff802be3c9>] ? alloc_fd+0x103/0x112
     327<Dec/06 07:58 pm>[1743053.422646]  [<ffffffff802aa7b4>] ? do_sys_open+0x48/0xc5
     328<Dec/06 07:58 pm>[1743053.422646]  [<ffffffff8020bd2b>] ? system_call_fastpath+0x16/0x1b
     329<Dec/06 07:59 pm>[1743065.235696] BUG: soft lockup - CPU#0 stuck for 61s! [rpc.mountd:7611]
     330<Dec/06 07:59 pm>[1743065.235699] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last unloaded: w83793]
     331<Dec/06 07:59 pm>[1743065.235699] CPU 0:
     332<Dec/06 07:59 pm>[1743065.235699] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last unloaded: w83793]
     333<Dec/06 07:59 pm>[1743065.235699] Pid: 7611, comm: rpc.mountd Tainted: G      D W  2.6.28-rc7-00105-gfeaf384 #4
     334<Dec/06 07:59 pm>[1743065.235699] RIP: 0010:[<ffffffff8039d963>]  [<ffffffff8039d963>] delay_tsc+0x15/0x42
     335<Dec/06 07:59 pm>[1743065.235699] RSP: 0018:ffff88025ef9fdf8  EFLAGS: 00000202
     336<Dec/06 07:59 pm>[1743065.235699] RAX: 000edd94cfbaaace RBX: 0000000014328127 RCX: ffffffff80932380
     337<Dec/06 07:59 pm>[1743065.235699] RDX: 000edd9400000000 RSI: 0000000001062560 RDI: 0000000000000001
     338<Dec/06 07:59 pm>[1743065.235699] RBP: 0000000014328127 R08: ffffffff80239d5d R09: 0000000000000000
     339<Dec/06 07:59 pm>[1743065.235699] R10: 0000000000000000 R11: ffffffff8039d94e R12: 00000000ee12c1ae
     340
     341<Dec/06 07:59 pm>[1743065.235699] R13: 00000000ee12c1ae R14: ffffffff8020e25d R15: ffffffff80794266
     342<Dec/06 07:59 pm>[1743065.235699] FS:  00007fa53d3b2740(0000) GS:ffffffff80872d80(0000) knlGS:0000000000000000
     343<Dec/06 07:59 pm>[1743065.235699] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
     344<Dec/06 07:59 pm>[1743065.235699] CR2: 00007fa53d3cb000 CR3: 0000000303295000 CR4: 00000000000006e0
     345<Dec/06 07:59 pm>[1743065.235699] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
     346<Dec/06 07:59 pm>[1743065.235699] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
     347<Dec/06 07:59 pm>[1743065.235699] Call Trace:
     348<Dec/06 07:59 pm>[1743065.235699]  [<ffffffff8039d963>] ? delay_tsc+0x15/0x42
     349<Dec/06 07:59 pm>[1743065.235699]  [<ffffffff803a0ffe>] ? _raw_spin_lock+0xba/0x122
     350<Dec/06 07:59 pm>[1743065.235699]  [<ffffffff805b789b>] ? lock_kernel+0x1d/0x2b
     351<Dec/06 07:59 pm>[1743065.235699]  [<ffffffff802d698f>] ? __posix_lock_file+0x6b/0x437
     352<Dec/06 07:59 pm>[1743065.235699]  [<ffffffff802d77f9>] ? fcntl_setlk+0x11d/0x26c
     353<Dec/06 07:59 pm>[1743065.235699]  [<ffffffff802b7650>] ? sys_fcntl+0x2ef/0x373
     354<Dec/06 07:59 pm>[1743065.235699]  [<ffffffff8020bd2b>] ? system_call_fastpath+0x16/0x1b
     355<Dec/06 07:59 pm>[1743068.456182] BUG: soft lockup - CPU#7 stuck for 61s! [ntpd:5084]
     356<Dec/06 07:59 pm>[1743068.456186] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last unloaded: w83793]
     357<Dec/06 07:59 pm>[1743068.456186] CPU 7:
     358<Dec/06 07:59 pm>[1743068.456186] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last unloaded: w83793]
     359<Dec/06 07:59 pm>[1743068.456186] Pid: 5084, comm: ntpd Tainted: G      D W  2.6.28-rc7-00105-gfeaf384 #4
     360<Dec/06 07:59 pm>[1743068.456186] RIP: 0010:[<ffffffff8021205f>]  [<ffffffff8021205f>] native_read_tsc+0x2/0xc
     361<Dec/06 07:59 pm>[1743068.456186] RSP: 0018:ffff88059f905be0  EFLAGS: 00000206
     362<Dec/06 07:59 pm>[1743068.456186] RAX: 000000009c75085a RBX: 000000009c750836 RCX: ffffffff80932380
     363
     364<Dec/06 07:59 pm>[1743068.456186] RDX: 00000000000edd96 RSI: 0000000001062560 RDI: 0000000000000001
     365<Dec/06 07:59 pm>[1743068.456186] RBP: 000000009c750836 R08: ffffffff80239d5d R09: 0000000000000000
     366<Dec/06 07:59 pm>[1743068.456186] R10: 0000000000000000 R11: ffffffff8039d94e R12: 00000000277c3c52
     367<Dec/06 07:59 pm>[1743068.456186] R13: 00000000277c3c52 R14: ffffffff8020e25d R15: ffffffff80794266
     368<Dec/06 07:59 pm>[1743068.456186] FS:  00007f838eb366f0(0000) GS:ffff88063e429000(0000) knlGS:0000000000000000
     369<Dec/06 07:59 pm>[1743068.456186] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
     370<Dec/06 07:59 pm>[1743068.456186] CR2: 000000002e4ace40 CR3: 00000004320b7000 CR4: 00000000000006e0
     371<Dec/06 07:59 pm>[1743068.456186] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
     372<Dec/06 07:59 pm>[1743068.456186] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
     373<Dec/06 07:59 pm>[1743068.456186] Call Trace:
     374<Dec/06 07:59 pm>[1743068.456186]  [<ffffffff8039d96a>] ? delay_tsc+0x1c/0x42
     375<Dec/06 07:59 pm>[1743068.456186]  [<ffffffff803a0ffe>] ? _raw_spin_lock+0xba/0x122
     376<Dec/06 07:59 pm>[1743068.456186]  [<ffffffff805b789b>] ? lock_kernel+0x1d/0x2b
     377<Dec/06 07:59 pm>[1743068.456186]  [<ffffffff802ed76d>] ? proc_lookup_de+0x18/0xdd
     378<Dec/06 07:59 pm>[1743068.456186]  [<ffffffff802e950e>] ? proc_root_lookup+0x12/0x30
     379<Dec/06 07:59 pm>[1743068.456186]  [<ffffffff802b30a5>] ? do_lookup+0xd9/0x1c3
     380<Dec/06 07:59 pm>[1743068.456186]  [<ffffffff802b4d63>] ? __link_path_walk+0x36c/0xcc9
     381<Dec/06 07:59 pm>[1743068.456186]  [<ffffffff802b5706>] ? path_walk+0x46/0x8b
     382<Dec/06 07:59 pm>[1743068.456186]  [<ffffffff802b58d4>] ? do_path_lookup+0x10e/0x169
     383<Dec/06 07:59 pm>[1743068.456186]  [<ffffffff802b63af>] ? path_lookup_open+0x54/0x95
     384<Dec/06 07:59 pm>[1743068.456186]  [<ffffffff802b6492>] ? do_filp_open+0xa2/0x7e1
     385<Dec/06 07:59 pm>[1743068.456186]  [<ffffffff805b7388>] ? _spin_unlock+0x17/0x20
     386
     387<Dec/06 07:59 pm>[1743068.456186]  [<ffffffff802be3c9>] ? alloc_fd+0x103/0x112
     388<Dec/06 07:59 pm>[1743068.456186]  [<ffffffff802aa7b4>] ? do_sys_open+0x48/0xc5
     389<Dec/06 07:59 pm>[1743068.456186]  [<ffffffff8020bd2b>] ? system_call_fastpath+0x16/0x1b
     390<Dec/06 07:59 pm>[1743098.519095] BUG: soft lockup - CPU#1 stuck for 61s! [sh:4730]
     391<Dec/06 07:59 pm>[1743098.519098] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last unloaded: w83793]
     392<Dec/06 07:59 pm>[1743098.519098] CPU 1:
     393<Dec/06 07:59 pm>[1743098.519098] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last unloaded: w83793]
     394<Dec/06 07:59 pm>[1743098.519098] Pid: 4730, comm: sh Tainted: G      D W  2.6.28-rc7-00105-gfeaf384 #4
     395<Dec/06 07:59 pm>[1743098.519098] RIP: 0010:[<ffffffff8039d98b>]  [<ffffffff8039d98b>] delay_tsc+0x3d/0x42
     396<Dec/06 07:59 pm>[1743098.519098] RSP: 0018:ffff88011c96bcf8  EFLAGS: 00000206
     397<Dec/06 07:59 pm>[1743098.519098] RAX: 0000000000000012 RBX: 00000000694e81f9 RCX: ffffffff80932380
     398<Dec/06 07:59 pm>[1743098.519098] RDX: 000edda700000000 RSI: 0000000001062560 RDI: 0000000000000001
     399<Dec/06 07:59 pm>[1743098.519098] RBP: 00000000694e81f9 R08: ffffffff80239d5d R09: 0000000000000000
     400<Dec/06 07:59 pm>[1743098.519098] R10: 0000000000000000 R11: ffffffff8039d94e R12: 0000000040850c08
     401<Dec/06 07:59 pm>[1743098.519098] R13: 0000000040850c08 R14: ffffffff8020e25d R15: ffffffff80794266
     402<Dec/06 07:59 pm>[1743098.519098] FS:  00007fb3ffd206f0(0000) GS:ffff88033e44d000(0000) knlGS:0000000000000000
     403<Dec/06 07:59 pm>[1743098.519098] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
     404<Dec/06 07:59 pm>[1743098.519098] CR2: 00000000004931f8 CR3: 0000000146cdd000 CR4: 00000000000006e0
     405<Dec/06 07:59 pm>[1743098.519098] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
     406<Dec/06 07:59 pm>[1743098.519098] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
     407<Dec/06 07:59 pm>[1743098.519098] Call Trace:
     408<Dec/06 07:59 pm>[1743098.519098]  [<ffffffff8039d96a>] ? delay_tsc+0x1c/0x42
     409
     410<Dec/06 07:59 pm>[1743098.519098]  [<ffffffff803a0ffe>] ? _raw_spin_lock+0xba/0x122
     411<Dec/06 07:59 pm>[1743098.519098]  [<ffffffff805b789b>] ? lock_kernel+0x1d/0x2b
     412<Dec/06 07:59 pm>[1743098.519098]  [<ffffffff803e36ed>] ? tty_open+0x1d/0x414
     413<Dec/06 07:59 pm>[1743098.519098]  [<ffffffff802ae8ca>] ? chrdev_open+0x13c/0x18b
     414<Dec/06 07:59 pm>[1743098.519098]  [<ffffffff802ae78e>] ? chrdev_open+0x0/0x18b
     415<Dec/06 07:59 pm>[1743098.519098]  [<ffffffff802aa993>] ? __dentry_open+0x137/0x254
     416<Dec/06 07:59 pm>[1743098.519098]  [<ffffffff802b6829>] ? do_filp_open+0x439/0x7e1
     417<Dec/06 07:59 pm>[1743098.519098]  [<ffffffff805b795d>] ? error_exit+0x0/0x9a
     418<Dec/06 07:59 pm>[1743098.519098]  [<ffffffff805b7388>] ? _spin_unlock+0x17/0x20
     419<Dec/06 07:59 pm>[1743098.519098]  [<ffffffff802be3c9>] ? alloc_fd+0x103/0x112
     420<Dec/06 07:59 pm>[1743098.519098]  [<ffffffff802aa7b4>] ? do_sys_open+0x48/0xc5
     421<Dec/06 07:59 pm>[1743098.519098]  [<ffffffff8020bd2b>] ? system_call_fastpath+0x16/0x1b
     422<Dec/06 07:59 pm>[1743116.772774] BUG: soft lockup - CPU#6 stuck for 61s! [archttp64:8294]
     423<Dec/06 07:59 pm>[1743116.772778] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last unloaded: w83793]
     424<Dec/06 07:59 pm>[1743116.772778] CPU 6:
     425<Dec/06 07:59 pm>[1743116.772778] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last unloaded: w83793]
     426<Dec/06 07:59 pm>[1743116.772778] Pid: 8294, comm: archttp64 Tainted: G      D W  2.6.28-rc7-00105-gfeaf384 #4
     427<Dec/06 07:59 pm>[1743116.772778] RIP: 0010:[<ffffffff8021205f>]  [<ffffffff8021205f>] native_read_tsc+0x2/0xc
     428<Dec/06 07:59 pm>[1743116.772778] RSP: 0018:ffff88063704bdf0  EFLAGS: 00000206
     429<Dec/06 07:59 pm>[1743116.772778] RAX: 000000009cb531b4 RBX: 0000000055220a3f RCX: ffffffff80932380
     430<Dec/06 07:59 pm>[1743116.772778] RDX: 00000000000eddb1 RSI: 0000000001062560 RDI: 0000000000000001
     431<Dec/06 07:59 pm>[1743116.772778] RBP: 0000000055220a3f R08: ffffffff80239d5d R09: 0000000000000000
     432
     433<Dec/06 07:59 pm>[1743116.772778] R10: 0000000000000000 R11: ffffffff8039d94e R12: 000000007c08d1fa
     434<Dec/06 07:59 pm>[1743116.772778] R13: 000000007c08d1fa R14: ffffffff8020e25d R15: ffffffff80794266
     435<Dec/06 07:59 pm>[1743116.772778] FS:  00000000006f8ca0(0063) GS:ffff88063e428c00(0000) knlGS:0000000000000000
     436<Dec/06 07:59 pm>[1743116.772778] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
     437<Dec/06 07:59 pm>[1743116.772778] CR2: 00007fab8afdb000 CR3: 000000063c013000 CR4: 00000000000006e0
     438<Dec/06 07:59 pm>[1743116.772778] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
     439<Dec/06 07:59 pm>[1743116.772778] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
     440<Dec/06 07:59 pm>[1743116.772778] Call Trace:
     441<Dec/06 07:59 pm>[1743116.772778]  [<ffffffff8039d963>] ? delay_tsc+0x15/0x42
     442<Dec/06 07:59 pm>[1743116.772778]  [<ffffffff803a0ffe>] ? _raw_spin_lock+0xba/0x122
     443<Dec/06 07:59 pm>[1743116.772778]  [<ffffffff805b789b>] ? lock_kernel+0x1d/0x2b
     444<Dec/06 07:59 pm>[1743116.772778]  [<ffffffff802d698f>] ? __posix_lock_file+0x6b/0x437
     445<Dec/06 07:59 pm>[1743116.772778]  [<ffffffff802d77f9>] ? fcntl_setlk+0x11d/0x26c
     446<Dec/06 07:59 pm>[1743116.772778]  [<ffffffff802b7650>] ? sys_fcntl+0x2ef/0x373
     447<Dec/06 07:59 pm>[1743116.772778]  [<ffffffff8020bd2b>] ? system_call_fastpath+0x16/0x1b
     448<Dec/06 08:00 pm>[1743118.922635] BUG: soft lockup - CPU#4 stuck for 61s! [sh:4726]
     449<Dec/06 08:00 pm>[1743118.922639] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last unloaded: w83793]
     450<Dec/06 08:00 pm>[1743118.922639] CPU 4:
     451<Dec/06 08:00 pm>[1743118.922639] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last unloaded: w83793]
     452<Dec/06 08:00 pm>[1743118.922639] Pid: 4726, comm: sh Tainted: G      D W  2.6.28-rc7-00105-gfeaf384 #4
     453<Dec/06 08:00 pm>[1743118.922639] RIP: 0010:[<ffffffff80212063>]  [<ffffffff80212063>] native_read_tsc+0x6/0xc
     454<Dec/06 08:00 pm>[1743118.922639] RSP: 0018:ffff8803d97bfcf0  EFLAGS: 00000206
     455
     456<Dec/06 08:00 pm>[1743118.922639] RAX: 00000000d0453948 RBX: 00000000d0453924 RCX: ffffffff80932380
     457<Dec/06 08:00 pm>[1743118.922639] RDX: 000eddb200000000 RSI: 0000000001062560 RDI: 0000000000000001
     458<Dec/06 08:00 pm>[1743118.922639] RBP: 00000000d0453924 R08: ffffffff80239d5d R09: 0000000000000000
     459<Dec/06 08:00 pm>[1743118.922639] R10: 0000000000000000 R11: ffffffff8039d94e R12: 0000000049889ca8
     460<Dec/06 08:00 pm>[1743118.922639] R13: 0000000049889ca8 R14: ffffffff8020e25d R15: ffffffff80794266
     461<Dec/06 08:00 pm>[1743118.922639] FS:  00007fedc60b26f0(0000) GS:ffff88063e428300(0000) knlGS:0000000000000000
     462<Dec/06 08:00 pm>[1743118.922639] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
     463<Dec/06 08:00 pm>[1743118.922639] CR2: 00000000004931f8 CR3: 00000004f0345000 CR4: 00000000000006e0
     464<Dec/06 08:00 pm>[1743118.922639] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
     465<Dec/06 08:00 pm>[1743118.922639] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
     466<Dec/06 08:00 pm>[1743118.922639] Call Trace:
     467<Dec/06 08:00 pm>[1743118.922639]  [<ffffffff8039d96a>] ? delay_tsc+0x1c/0x42
     468<Dec/06 08:00 pm>[1743118.922639]  [<ffffffff803a0ffe>] ? _raw_spin_lock+0xba/0x122
     469<Dec/06 08:00 pm>[1743118.922639]  [<ffffffff805b789b>] ? lock_kernel+0x1d/0x2b
     470<Dec/06 08:00 pm>[1743118.922639]  [<ffffffff803e36ed>] ? tty_open+0x1d/0x414
     471<Dec/06 08:00 pm>[1743118.922639]  [<ffffffff802ae8ca>] ? chrdev_open+0x13c/0x18b
     472<Dec/06 08:00 pm>[1743118.922639]  [<ffffffff802ae78e>] ? chrdev_open+0x0/0x18b
     473<Dec/06 08:00 pm>[1743118.922639]  [<ffffffff802aa993>] ? __dentry_open+0x137/0x254
     474<Dec/06 08:00 pm>[1743118.922639]  [<ffffffff802b6829>] ? do_filp_open+0x439/0x7e1
     475<Dec/06 08:00 pm>[1743118.922639]  [<ffffffff805b795d>] ? error_exit+0x0/0x9a
     476<Dec/06 08:00 pm>[1743118.922639]  [<ffffffff805b7388>] ? _spin_unlock+0x17/0x20
     477<Dec/06 08:00 pm>[1743118.922639]  [<ffffffff802be3c9>] ? alloc_fd+0x103/0x112
     478
     479<Dec/06 08:00 pm>[1743118.922639]  [<ffffffff802aa7b4>] ? do_sys_open+0x48/0xc5
     480<Dec/06 08:00 pm>[1743118.922639]  [<ffffffff8020bd2b>] ? system_call_fastpath+0x16/0x1b
     481<Dec/06 08:00 pm>[1743130.732357] BUG: soft lockup - CPU#0 stuck for 61s! [rpc.mountd:7611]
     482<Dec/06 08:00 pm>[1743130.732359] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last unloaded: w83793]
     483<Dec/06 08:00 pm>[1743130.732359] CPU 0:
     484                 <Dec/06 08:00 pm>[1743130.732359] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last unloaded: w83793]
     485<Dec/06 08:00 pm>[1743130.732359] Pid: 7611, comm: rpc.mountd Tainted: G      D W  2.6.28-rc7-00105-gfeaf384 #4
     486<Dec/06 08:00 pm>[1743130.732359] RIP: 0010:[<ffffffff8021205f>]  [<ffffffff8021205f>] native_read_tsc+0x2/0xc
     487<Dec/06 08:00 pm>[1743130.732359] RSP: 0018:ffff88025ef9fdf0  EFLAGS: 00000206
     488<Dec/06 08:00 pm>[1743130.732359] RAX: 0000000069c9d2e1 RBX: 0000000069c9d2cf RCX: ffffffff80932380
     489<Dec/06 08:00 pm>[1743130.732359] RDX: 00000000000eddb9 RSI: 0000000001062560 RDI: 0000000000000001
     490<Dec/06 08:00 pm>[1743130.732359] RBP: 0000000069c9d2cf R08: ffffffff80239d5d R09: 0000000000000000
     491<Dec/06 08:00 pm>[1743130.732359] R10: 0000000000000000 R11: ffffffff8039d94e R12: 00000000ee12c1ae
     492<Dec/06 08:00 pm>[1743130.732359] R13: 00000000ee12c1ae R14: ffffffff8020e25d R15: ffffffff80794266
     493<Dec/06 08:00 pm>[1743130.732359] FS:  00007fa53d3b2740(0000) GS:ffffffff80872d80(0000) knlGS:0000000000000000
     494<Dec/06 08:00 pm>[1743130.732359] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
     495<Dec/06 08:00 pm>[1743130.732359] CR2: 00007fa53d3cb000 CR3: 0000000303295000 CR4: 00000000000006e0
     496<Dec/06 08:00 pm>[1743130.732359] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
     497<Dec/06 08:00 pm>[1743130.732359] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
     498<Dec/06 08:00 pm>[1743130.732359] Call Trace:
     499<Dec/06 08:00 pm>[1743130.732359]  [<ffffffff8039d96a>] ? delay_tsc+0x1c/0x42
     500<Dec/06 08:00 pm>[1743130.732359]  [<ffffffff803a0ffe>] ? _raw_spin_lock+0xba/0x122
     501
     502<Dec/06 08:00 pm>[1743130.732359]  [<ffffffff805b789b>] ? lock_kernel+0x1d/0x2b
     503<Dec/06 08:00 pm>[1743130.732359]  [<ffffffff802d698f>] ? __posix_lock_file+0x6b/0x437
     504<Dec/06 08:00 pm>[1743130.732359]  [<ffffffff802d77f9>] ? fcntl_setlk+0x11d/0x26c
     505<Dec/06 08:00 pm>[1743130.732359]  [<ffffffff802b7650>] ? sys_fcntl+0x2ef/0x373
     506<Dec/06 08:00 pm>[1743130.732359]  [<ffffffff8020bd2b>] ? system_call_fastpath+0<Dec/06 08:00 pm>
     507                 <Dec/06 08:00 pm>[1743133.952842] BUG: soft lockup - CPU#7 stuck for 61s! [ntpd:5084]
     508<Dec/06 08:00 pm>[1743133.952846] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last unloaded: w83793]
     509<Dec/06 08:00 pm>[1743133.952846] CPU 7:
     510<Dec/06 08:00 pm>[1743133.952846] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last unloaded: w83793]
     511<Dec/06 08:00 pm>[1743133.952846] Pid: 5084, comm: ntpd Tainted: G      D W  2.6.28-rc7-00105-gfeaf384 #4
     512<Dec/06 08:00 pm>[1743133.952846] RIP: 0010:[<ffffffff8021205f>]  [<ffffffff8021205f>] native_read_tsc+0x2/0xc
     513<Dec/06 08:00 pm>[1743133.952846] RSP: 0018:ffff88059f905be0  EFLAGS: 00000202
     514<Dec/06 08:00 pm>[1743133.952846] RAX: 0000000036842f62 RBX: 0000000036842f3e RCX: ffffffff80932380
     515<Dec/06 08:00 pm>[1743133.952846] RDX: 00000000000eddbb RSI: 0000000001062560 RDI: 0000000000000001
     516<Dec/06 08:00 pm>[1743133.952846] RBP: 0000000036842f3e R08: ffffffff80239d5d R09: 0000000000000000
     517<Dec/06 08:00 pm>[1743133.952846] R10: 0000000000000000 R11: ffffffff8039d94e R12: 00000000277c3c52
     518<Dec/06 08:00 pm>[1743133.952846] R13: 00000000277c3c52 R14: ffffffff8020e25d R15: ffffffff80794266
     519<Dec/06 08:00 pm>[1743133.952846] FS:  00007f838eb366f0(0000) GS:ffff88063e429000(0000) knlGS:0000000000000000
     520<Dec/06 08:00 pm>[1743133.952846] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
     521<Dec/06 08:00 pm>[1743133.952846] CR2: 000000002e4ace40 CR3: 00000004320b7000 CR4: 00000000000006e0
     522<Dec/06 08:00 pm>[1743133.952846] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
     523<Dec/06 08:00 pm>[1743133.952846] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
     524
     525<Dec/06 08:00 pm>[1743133.952846] Call Trace:
     526<Dec/06 08:00 pm>[1743133.952846]  [<ffffffff8039d96a>] ? delay_tsc+0x1c/0x42
     527<Dec/06 08:00 pm>[1743133.952846]  [<ffffffff803a0ffe>] ? _raw_spin_lock+0xba/0x122
     528<Dec/06 08:00 pm>[1743133.952846]  [<ffffffff805b789b>] ? lock_kernel+0x1d/0x2b
     529<Dec/06 08:00 pm>[1743133.952846]  [<ffffffff802ed76d>] ? proc_lookup_de+0x18/0xdd
     530<Dec/06 08:00 pm>[1743133.952846]  [<ffffffff802e950e>] ? proc_root_lookup+0x12/0x30
     531<Dec/06 08:00 pm>[1743133.952846]  [<ffffffff802b30a5>] ? do_lookup+0xd9/0x1c3
     532<Dec/06 08:00 pm>[1743133.952846]  [<ffffffff802b4d63>] ? __link_path_walk+0x36c/0xcc9
     533<Dec/06 08:00 pm>[1743133.952846]  [<ffffffff802b5706>] ? path_walk+0x46/0x8b
     534<Dec/06 08:00 pm>[1743133.952846]  [<ffffffff802b58d4>] ? do_path_lookup+0x10e/0x169
     535<Dec/06 08:00 pm>[1743133.952846]  [<ffffffff802b63af>] ? path_lookup_open+0x54/0x95
     536<Dec/06 08:00 pm>[1743133.952846]  [<ffffffff802b6492>] ? do_filp_open+0xa2/0x7e1
     537<Dec/06 08:00 pm>[1743133.952846]  [<ffffffff805b7388>] ? _spin_unlock+0x17/0x20
     538<Dec/06 08:00 pm>[1743133.952846]  [<ffffffff802be3c9>] ? alloc_fd+0x103/0x112
     539<Dec/06 08:00 pm>[1743133.952846]  [<ffffffff802aa7b4>] ? do_sys_open+0x48/0xc5
     540<Dec/06 08:00 pm>[1743133.952846]  [<ffffffff8020bd2b>] ? system_call_fastpath+0x16/0x1b
     541<Dec/06 08:00 pm>[1743164.019088] BUG: soft lockup - CPU#1 stuck for 61s! [sh:4730]
     542<Dec/06 08:00 pm>[1743164.019091] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last unloaded: w83793]
     543<Dec/06 08:00 pm>[1743164.019091] CPU 1:
     544<Dec/06 08:00 pm>[1743164.019091] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last unloaded: w83793]
     545<Dec/06 08:00 pm>[1743164.019091] Pid: 4730, comm: sh Tainted: G      D W  2.6.28-rc7-00105-gfeaf384 #4
     546<Dec/06 08:00 pm>[1743164.019091] RIP: 0010:[<ffffffff8021205f>]  [<ffffffff8021205f>] native_read_tsc+0x2/0xc
     547
     548<Dec/06 08:00 pm>[1743164.019091] RSP: 0018:ffff88011c96bcf0  EFLAGS: 00000202
     549<Dec/06 08:00 pm>[1743164.019091] RAX: 0000000003d7bc6a RBX: 0000000003d7bc58 RCX: ffffffff80932380
     550<Dec/06 08:00 pm>[1743164.019091] RDX: 00000000000eddcc RSI: 0000000001062560 RDI: 0000000000000001
     551<Dec/06 08:00 pm>[1743164.019091] RBP: 0000000003d7bc58 R08: ffffffff80239d5d R09: 0000000000000000
     552<Dec/06 08:00 pm>[1743164.019091] R10: 0000000000000000 R11: ffffffff8039d94e R12: 0000000040850c08
     553<Dec/06 08:00 pm>[1743164.019091] R13: 0000000040850c08 R14: ffffffff8020e25d R15: ffffffff80794266
     554<Dec/06 08:00 pm>[1743164.019091] FS:  00007fb3ffd206f0(0000) GS:ffff88033e44d000(0000) knlGS:0000000000000000
     555<Dec/06 08:00 pm>[1743164.019091] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
     556<Dec/06 08:00 pm>[1743164.019091] CR2: 00000000004931f8 CR3: 0000000146cdd000 CR4: 00000000000006e0
     557<Dec/06 08:00 pm>[1743164.019091] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
     558<Dec/06 08:00 pm>[1743164.019091] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
     559<Dec/06 08:00 pm>[1743164.019091] Call Trace:
     560<Dec/06 08:00 pm>[1743164.019091]  [<ffffffff8039d96a>] ? delay_tsc+0x1c/0x42
     561<Dec/06 08:00 pm>[1743164.019091]  [<ffffffff803a0ffe>] ? _raw_spin_lock+0xba/0x122
     562<Dec/06 08:00 pm>[1743164.019091]  [<ffffffff805b789b>] ? lock_kernel+0x1d/0x2b
     563<Dec/06 08:00 pm>[1743164.019091]  [<ffffffff803e36ed>] ? tty_open+0x1d/0x414
     564<Dec/06 08:00 pm>[1743164.019091]  [<ffffffff802ae8ca>] ? chrdev_open+0x13c/0x18b
     565<Dec/06 08:00 pm>[1743164.019091]  [<ffffffff802ae78e>] ? chrdev_open+0x0/0x18b
     566<Dec/06 08:00 pm>[1743164.019091]  [<ffffffff802aa993>] ? __dentry_open+0x137/0x254
     567<Dec/06 08:00 pm>[1743164.019091]  [<ffffffff802b6829>] ? do_filp_open+0x439/0x7e1
     568<Dec/06 08:00 pm>[1743164.019091]  [<ffffffff805b795d>] ? error_exit+0x0/0x9a
     569<Dec/06 08:00 pm>[1743164.019091]  [<ffffffff805b7388>] ? _spin_unlock+0x17/0x20
     570
     571<Dec/06 08:00 pm>[1743164.019091]  [<ffffffff802be3c9>] ? alloc_fd+0x103/0x112
     572<Dec/06 08:00 pm>[1743164.019091]  [<ffffffff802aa7b4>] ? do_sys_open+0x48/0xc5
     573<Dec/06 08:00 pm>[1743164.019091]  [<ffffffff8020bd2b>] ? system_call_fastpath+0x16/0x1b
     574<Dec/06 08:01 pm>[1743182.272768] BUG: soft lockup - CPU#6 stuck for 61s! [archttp64:8294]
     575<Dec/06 08:01 pm>[1743182.272773] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last unloaded: w83793]
     576<Dec/06 08:01 pm>[1743182.272773] CPU 6:
     577<Dec/06 08:01 pm>[1743182.272773] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last unloaded: w83793]
     578<Dec/06 08:01 pm>[1743182.272773] Pid: 8294, comm: archttp64 Tainted: G      D W  2.6.28-rc7-00105-gfeaf384 #4
     579<Dec/06 08:01 pm>[1743182.272773] RIP: 0010:[<ffffffff8021205f>]  [<ffffffff8021205f>] native_read_tsc+0x2/0xc
     580<Dec/06 08:01 pm>[1743182.272773] RSP: 0018:ffff88063704bdf0  EFLAGS: 00000202
     581<Dec/06 08:01 pm>[1743182.272773] RAX: 00000000373e6dc6 RBX: 00000000373e6da2 RCX: ffffffff80932380
     582<Dec/06 08:01 pm>[1743182.272773] RDX: 00000000000eddd6 RSI: 0000000001062560 RDI: 0000000000000001
     583<Dec/06 08:01 pm>[1743182.272773] RBP: 00000000373e6da2 R08: ffffffff80239d5d R09: 0000000000000000
     584<Dec/06 08:01 pm>[1743182.272773] R10: 0000000000000000 R11: ffffffff8039d94e R12: 000000007c08d1fa
     585<Dec/06 08:01 pm>[1743182.272773] R13: 000000007c08d1fa R14: ffffffff8020e25d R15: ffffffff80794266
     586<Dec/06 08:01 pm>[1743182.272773] FS:  00000000006f8ca0(0063) GS:ffff88063e428c00(0000) knlGS:0000000000000000
     587<Dec/06 08:01 pm>[1743182.272773] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
     588<Dec/06 08:01 pm>[1743182.272773] CR2: 00007fab8afdb000 CR3: 000000063c013000 CR4: 00000000000006e0
     589<Dec/06 08:01 pm>[1743182.272773] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
     590<Dec/06 08:01 pm>[1743182.272773] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
     591<Dec/06 08:01 pm>[1743182.272773] Call Trace:
     592<Dec/06 08:01 pm>[1743182.272773]  [<ffffffff8039d96a>] ? delay_tsc+0x1c/0x42
     593
     594<Dec/06 08:01 pm>[1743182.272773]  [<ffffffff803a0ffe>] ? _raw_spin_lock+0xba/0x122
     595<Dec/06 08:01 pm>[1743182.272773]  [<ffffffff805b789b>] ? lock_kernel+0x1d/0x2b
     596<Dec/06 08:01 pm>[1743182.272773]  [<ffffffff802d698f>] ? __posix_lock_file+0x6b/0x437
     597<Dec/06 08:01 pm>[1743182.272773]  [<ffffffff802d77f9>] ? fcntl_setlk+0x11d/0x26c
     598<Dec/06 08:01 pm>[1743182.272773]  [<ffffffff802b7650>] ? sys_fcntl+0x2ef/0x373
     599<Dec/06 08:01 pm>[1743182.272773]  [<ffffffff8020bd2b>] ? system_call_fastpath+0x16/0x1b
     600<Dec/06 08:01 pm>[1743184.419296] BUG: soft lockup - CPU#4 stuck for 61s! [sh:4726]
     601<Dec/06 08:01 pm>[1743184.419300] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last unloaded: w83793]
     602<Dec/06 08:01 pm>[1743184.419300] CPU 4:
     603<Dec/06 08:01 pm>[1743184.419300] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last unloaded: w83793]
     604<Dec/06 08:01 pm>[1743184.419300] Pid: 4726, comm: sh Tainted: G      D W  2.6.28-rc7-00105-gfeaf384 #4
     605<Dec/06 08:01 pm>[1743184.419300] RIP: 0010:[<ffffffff8021205f>]  [<ffffffff8021205f>] native_read_tsc+0x2/0xc
     606<Dec/06 08:01 pm>[1743184.419300] RSP: 0018:ffff8803d97bfcf0  EFLAGS: 00000202
     607<Dec/06 08:01 pm>[1743184.419300] RAX: 000000006a54609e RBX: 00000000439484b3 RCX: ffffffff80932380
     608<Dec/06 08:01 pm>[1743184.419300] RDX: 00000000000eddd7 RSI: 0000000001062560 RDI: 0000000000000001
     609<Dec/06 08:01 pm>[1743184.419300] RBP: 00000000439484b3 R08: ffffffff80239d5d R09: 0000000000000000
     610<Dec/06 08:01 pm>[1743184.419300] R10: 0000000000000000 R11: ffffffff8039d94e R12: 0000000049889ca8
     611<Dec/06 08:01 pm>[1743184.419300] R13: 0000000049889ca8 R14: ffffffff8020e25d R15: ffffffff80794266
     612<Dec/06 08:01 pm>[1743184.419300] FS:  00007fedc60b26f0(0000) GS:ffff88063e428300(0000) knlGS:0000000000000000
     613<Dec/06 08:01 pm>[1743184.419300] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
     614<Dec/06 08:01 pm>[1743184.419300] CR2: 00000000004931f8 CR3: 00000004f0345000 CR4: 00000000000006e0
     615<Dec/06 08:01 pm>[1743184.419300] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
     616
     617<Dec/06 08:01 pm>[1743184.419300] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
     618<Dec/06 08:01 pm>[1743184.419300] Call Trace:
     619<Dec/06 08:01 pm>[1743184.419300]  [<ffffffff8039d963>] ? delay_tsc+0x15/0x42
     620<Dec/06 08:01 pm>[1743184.419300]  [<ffffffff803a0ffe>] ? _raw_spin_lock+0xba/0x122
     621<Dec/06 08:01 pm>[1743184.419300]  [<ffffffff805b789b>] ? lock_kernel+0x1d/0x2b
     622<Dec/06 08:01 pm>[1743184.419300]  [<ffffffff803e36ed>] ? tty_open+0x1d/0x414
     623<Dec/06 08:01 pm>[1743184.419300]  [<ffffffff802ae8ca>] ? chrdev_open+0x13c/0x18b
     624<Dec/06 08:01 pm>[1743184.419300]  [<ffffffff802ae78e>] ? chrdev_open+0x0/0x18b
     625<Dec/06 08:01 pm>[1743184.419300]  [<ffffffff802aa993>] ? __dentry_open+0x137/0x254
     626<Dec/06 08:01 pm>[1743184.419300]  [<ffffffff802b6829>] ? do_filp_open+0x439/0x7e1
     627<Dec/06 08:01 pm>[1743184.419300]  [<ffffffff805b795d>] ? error_exit+0x0/0x9a
     628<Dec/06 08:01 pm>[1743184.419300]  [<ffffffff805b7388>] ? _spin_unlock+0x17/0x20
     629<Dec/06 08:01 pm>[1743184.419300]  [<ffffffff802be3c9>] ? alloc_fd+0x103/0x112
     630<Dec/06 08:01 pm>[1743184.419300]  [<ffffffff802aa7b4>] ? do_sys_open+0x48/0xc5
     631<Dec/06 08:01 pm>[1743184.419300]  [<ffffffff8020bd2b>] ? system_call_fastpath+0x16/0x1b
     632<Dec/06 08:01 pm>[1743196.229015] BUG: soft lockup - CPU#0 stuck for 61s! [rpc.mountd:7611]
     633<Dec/06 08:01 pm>[1743196.229019] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last unloaded: w83793]
     634<Dec/06 08:01 pm>[1743196.229019] CPU 0:
     635<Dec/06 08:01 pm>[1743196.229019] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last unloaded: w83793]
     636<Dec/06 08:01 pm>[1743196.229019] Pid: 7611, comm: rpc.mountd Tainted: G      D W  2.6.28-rc7-00105-gfeaf384 #4
     637<Dec/06 08:01 pm>[1743196.229019] RIP: 0010:[<ffffffff8021205f>]  [<ffffffff8021205f>] native_read_tsc+0x2/0xc
     638<Dec/06 08:01 pm>[1743196.229019] RSP: 0018:ffff88025ef9fdf0  EFLAGS: 00000206
     639
     640<Dec/06 08:01 pm>[1743196.229019] RAX: 0000000003d8f90b RBX: 0000000003d8f8f9 RCX: ffffffff80932380
     641<Dec/06 08:01 pm>[1743196.229019] RDX: 00000000000eddde RSI: 0000000001062560 RDI: 0000000000000001
     642<Dec/06 08:01 pm>[1743196.229019] RBP: 0000000003d8f8f9 R08: ffffffff80239d5d R09: 0000000000000000
     643<Dec/06 08:01 pm>[1743196.229019] R10: 0000000000000000 R11: ffffffff8039d94e R12: 00000000ee12c1ae
     644<Dec/06 08:01 pm>[1743196.229019] R13: 00000000ee12c1ae R14: ffffffff8020e25d R15: ffffffff80794266
     645<Dec/06 08:01 pm>[1743196.229019] FS:  00007fa53d3b2740(0000) GS:ffffffff80872d80(0000) knlGS:0000000000000000
     646<Dec/06 08:01 pm>[1743196.229019] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
     647<Dec/06 08:01 pm>[1743196.229019] CR2: 00007fa53d3cb000 CR3: 0000000303295000 CR4: 00000000000006e0
     648<Dec/06 08:01 pm>[1743196.229019] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
     649<Dec/06 08:01 pm>[1743196.229019] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
     650<Dec/06 08:01 pm>[1743196.229019] Call Trace:
     651<Dec/06 08:01 pm>[1743196.229019]  [<ffffffff8039d96a>] ? delay_tsc+0x1c/0x42
     652<Dec/06 08:01 pm>[1743196.229019]  [<ffffffff803a0ffe>] ? _raw_spin_lock+0xba/0x122
     653<Dec/06 08:01 pm>[1743196.229019]  [<ffffffff805b789b>] ? lock_kernel+0x1d/0x2b
     654<Dec/06 08:01 pm>[1743196.229019]  [<ffffffff802d698f>] ? __posix_lock_file+0x6b/0x437
     655<Dec/06 08:01 pm>[1743196.229019]  [<ffffffff802d77f9>] ? fcntl_setlk+0x11d/0x26c
     656<Dec/06 08:01 pm>[1743196.229019]  [<ffffffff802b7650>] ? sys_fcntl+0x2ef/0x373
     657<Dec/06 08:01 pm>[1743196.229019]  [<ffffffff8020bd2b>] ? system_call_fastpath+0x16/0x1b
     658<Dec/06 08:01 pm>[1743199.452836] BUG: soft lockup - CPU#7 stuck for 61s! [ntpd:5084]
     659<Dec/06 08:01 pm>[1743199.452840] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last unloaded: w83793]
     660<Dec/06 08:01 pm>[1743199.452840] CPU 7:
     661<Dec/06 08:01 pm>[1743199.452840] Modules linked in: hwmon_vid autofs4 i2c_i801 iTCO_wdt i2c_core e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [last unloaded: w83793]
     662
     663<Dec/06 08:01 pm>[1743199.452840] Pid: 5084, comm: ntpd Tainted: G      D W  2.6.28-rc7-00105-gfeaf384 #4
     664<Dec/06 08:01 pm>[1743199.452840] RIP: 0010:[<ffffffff803a0fe7>]  [<ffffffff803a0fe7>] _raw_spin_lock+0xa3/0x122
     665<Dec/06 08:01 pm>[1743199.452840] RSP: 0018:ffff88059f905c08  EFLAGS: 00000297
     666<Dec/06 08:01 pm>[1743199.452840] RAX: 000000000000a1a0 RBX: 0000000041ed981e RCX: ffffffff80932380
     667<Dec/06 08:01 pm>[1743199.452840] RDX: 000000000000a2a0 RSI: 0000000001062560 RDI: 0000000000000001
     668<Dec/06 08:01 pm>[1743199.452840] RBP: 0000000041ed981e R08: ffffffff80239d5d R09: 0000000000000000
     669<Dec/06 08:01 pm>[1743199.452840] R10: 0000000000000000 R11: ffffffff8039d94e R12: 0000000000000000
     670<Dec/06 08:01 pm>[1743199.452840] R13: ffffffff8039d94e R14: 00000000d0935724 R15: 00000000d0935724
     671<Dec/06 08:01 pm>[1743199.452840] FS:  00007f838eb366f0(0000) GS:ffff88063e429000(0000) knlGS:0000000000000000
     672<Dec/06 08:01 pm>[1743199.452840] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
     673<Dec/06 08:01 pm>[1743199.452840] CR2: 000000002e4ace40 CR3: 00000004320b7000 CR4: 00000000000006e0
     674<Dec/06 08:01 pm>[1743199.452840] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
     675<Dec/06 08:01 pm>[1743199.452840] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
     676<Dec/06 08:01 pm>[1743199.452840] Call Trace:
     677<Dec/06 08:01 pm>[1743199.452840]  [<ffffffff803a0ffe>] ? _raw_spin_lock+0xba/0x122
     678<Dec/06 08:01 pm>[1743199.452840]  [<ffffffff805b789b>] ? lock_kernel+0x1d/0x2b
     679<Dec/06 08:01 pm>[1743199.452840]  [<ffffffff802ed76d>] ? proc_lookup_de+0x18/0xdd
     680<Dec/06 08:01 pm>[1743199.452840]  [<ffffffff802e950e>] ? proc_root_lookup+0x12/0x30
     681<Dec/06 08:01 pm>[1743199.452840]  [<ffffffff802b30a5>] ? do_lookup+0xd9/0x1c3
     682<Dec/06 08:01 pm>[1743199.452840]  [<ffffffff802b4d63>] ? __link_path_walk+0x36c/0xcc9
     683<Dec/06 08:01 pm>[1743199.452840]  [<ffffffff802b5706>] ? path_walk+0x46/0x8b
     684<Dec/06 08:01 pm>[1743199.452840]  [<ffffffff802b58d4>] ? do_path_lookup+0x10e/0x169
     685
     686<Dec/06 08:01 pm>[1743199.452840]  [<ffffffff802b63af>] ? path_lookup_open+0x54/0x95
     687<Dec/06 08:01 pm>[1743199.452840]  [<ffffffff802b6492>] ? do_filp_open+0xa2/0x7e1
     688<Dec/06 08:01 pm>[1743199.452840]  [<ffffffff805b7388>] ? _spin_unlock+0x17/0x20
     689<Dec/06 08:01 pm>[1743199.452840]  [<ffffffff802be3c9>] ? alloc_fd+0x103/0x112
     690<Dec/06 08:01 pm>[1743199.452840]  [<ffffffff802aa7b4>] ? do_sys_open+0x48/0xc5
     691<Dec/06 08:01 pm>[1743199.452840]  [<ffffffff8020bd2b>] ? system_call_fastpath+0x16/0x1b
     692
     693
     694}}}