IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changes between Initial Version and Version 1 of ipp058-20111231-crash.log


Ignore:
Timestamp:
Dec 31, 2011, 6:25:43 AM (15 years ago)
Author:
eugene
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • ipp058-20111231-crash.log

    v1 v1  
     1{{{
     2
     3<Dec/06 02:26 pm>This is ipp058.ifa.hawaii.edu (Linux x86_64 2.6.34.4) 14:26:19
     4
     5<Dec/31 05:41 am>ipp058 login: [2123812.966167] BUG: unable to handle kernel paging request at 0000000093054080
     6<Dec/31 05:41 am>[2123812.973848] IP: [<ffffffff81031467>] put_prev_task_fair+0x2b/0xf3
     7<Dec/31 05:41 am>[2123812.980445] PGD 0
     8<Dec/31 05:41 am>[2123812.982867] Thread overran stack, or stack corrupted
     9<Dec/31 05:41 am>[2123812.988325] Oops: 0000 [#1] SMP
     10<Dec/31 05:41 am>[2123812.992015] last sysfs file: /sys/devices/pci0000:00/0000:00:1f.3/i2c-0/0-002f/temp6_alarm
     11<Dec/31 05:41 am>[2123813.001025] CPU 7
     12<Dec/31 05:41 am>[2123813.003066] Modules linked in: w83793 hwmon_vid autofs4 i2c_i801 i2c_core iTCO_wdt e1000e ioatdma dca rtc_cmos tg3 libphy e1000 fuse dm_snapshot dm_mirror dm_region_hash dm_log scsi_wait_scan qla2xxx megaraid_sas megaraid_mbox megaraid_mm aacraid 3w_9xxx 3w_xxxx arcmsr aic7xxx aic79xx sr_mod sg ata_piix ahci sata_sis sata_nv sata_via pata_sl82c105 pata_sis
     13<Dec/31 05:41 am>[2123813.037596]
     14<Dec/31 05:41 am>[2123813.039469] Pid: 8411, comm: nfsd Not tainted 2.6.34.4 #3 S7010/empty
     15<Dec/31 05:41 am>[2123813.046392] RIP: 0010:[<ffffffff81031467>]  [<ffffffff81031467>] put_prev_task_fair+0x2b/0xf3
     16<Dec/31 05:41 am>[2123813.055644] RSP: 0000:ffff880c222b43f0  EFLAGS: 00010082
     17<Dec/31 05:41 am>[2123813.061430] RAX: 00000000222a6120 RBX: ffff880c222a6120 RCX: ffff880c222a61c0
     18
     19<Dec/31 05:41 am>[2123813.069258] RDX: ffff880c222a6120 RSI: ffff880c222a6120 RDI: ffff880655233c00
     20<Dec/31 05:41 am>[2123813.077108] RBP: ffff880c222b4410 R08: 0000000000000004 R09: ffff880655233c18
     21<Dec/31 05:41 am>[2123813.084931] R10: ffffffff8151cc4a R11: ffff880655253c18 R12: 0000000000013c00
     22<Dec/31 05:41 am>[2123813.092789] R13: 0000000000000000 R14: 0000000126114a20 R15: ffff880c222a6490
     23<Dec/31 05:41 am>[2123813.100621] FS:  0000000000000000(0000) GS:ffff880655220000(0000) knlGS:0000000000000000
     24<Dec/31 05:41 am>[2123813.109417] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
     25<Dec/31 05:41 am>[2123813.115649] CR2: 0000000093054080 CR3: 0000000001a8a000 CR4: 00000000000006e0
     26<Dec/31 05:41 am>[2123813.123459] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
     27<Dec/31 05:41 am>[2123813.131291] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
     28<Dec/31 05:41 am>[2123813.139099] Process nfsd (pid: 8411, threadinfo ffff880c222b4000, task ffff880c222a6120)
     29<Dec/31 05:41 am>[2123813.147890] Stack:
     30<Dec/31 05:41 am>[2123813.150318]  ffff880c222b4410 ffff880655233c00 0000000000000000 0000000000000000
     31<Dec/31 05:41 am>[2123813.158113] <0> ffff880c222b44d0 ffffffff8151ccb9 0000000000004000 ffff880c222b5fd8
     32<Dec/31 05:41 am>[2123813.166582] <0> 0000000000013c00 ffff880c222b5fd8 ffff880c222a6120 0000000000013c00
     33<Dec/31 05:41 am>[2123813.175430] Call Trace:
     34<Dec/31 05:41 am>[2123813.178307]  [<ffffffff8151ccb9>] schedule+0x305/0x86a
     35<Dec/31 05:41 am>[2123813.183914]  [<ffffffff8106433a>] ? __lock_acquire+0x995/0x9fc
     36<Dec/31 05:41 am>[2123813.190234]  [<ffffffff8151d35f>] schedule_timeout+0x28/0x24c
     37<Dec/31 05:41 am>[2123813.196456]  [<ffffffff8151c8aa>] ? wait_for_common+0xba/0x138
     38<Dec/31 05:41 am>[2123813.202777]  [<ffffffff8151c8b2>] wait_for_common+0xc2/0x138
     39<Dec/31 05:41 am>[2123813.208890]  [<ffffffff8103688c>] ? default_wake_function+0x0/0xf
     40<Dec/31 05:41 am>[2123813.215498]  [<ffffffff81280d3e>] ? _xfs_buf_read+0x3f/0x44
     41
     42<Dec/31 05:41 am>[2123813.221551]  [<ffffffff81277887>] ? xfs_trans_read_buf+0x238/0x396
     43<Dec/31 05:41 am>[2123813.228271]  [<ffffffff8151c9b2>] wait_for_completion+0x18/0x1a
     44<Dec/31 05:41 am>[2123813.234675]  [<ffffffff8127f236>] xfs_buf_iowait+0x7e/0xba
     45                 <Dec/31 05:41 am>[2123813.240628]  [<ffffffff81280d3e>] _xfs_buf_read+0x3f/0x44
     46<Dec/31 05:41 am>[2123813.246480]  [<ffffffff81281374>] xfs_buf_read+0x8a/0xc6
     47<Dec/31 05:41 am>[2123813.252255]  [<ffffffff81277887>] xfs_trans_read_buf+0x238/0x396
     48<Dec/31 05:41 am>[2123813.258778]  [<ffffffff8124e176>] xfs_btree_read_buf_block+0x4d/0x91
     49<Dec/31 05:41 am>[2123813.265614]  [<ffffffff8124f1dc>] xfs_btree_lookup_get_block+0x88/0xae
     50<Dec/31 05:41 am>[2123813.272615]  [<ffffffff8124f7ca>] xfs_btree_lookup+0x138/0x3dc
     51<Dec/31 05:41 am>[2123813.278900]  [<ffffffff8127ca06>] ? kmem_zone_zalloc+0x1f/0x30
     52<Dec/31 05:41 am>[2123813.285200]  [<ffffffff81239f01>] xfs_alloc_lookup_ge+0x17/0x19
     53<Dec/31 05:41 am>[2123813.291633]  [<ffffffff8123b8a1>] xfs_alloc_ag_vextent_near+0x56/0xa30
     54<Dec/31 05:41 am>[2123813.298655]  [<ffffffff812734b7>] ? xfs_perag_get+0x29/0x99
     55<Dec/31 05:41 am>[2123813.304685]  [<ffffffff8123c2a9>] xfs_alloc_ag_vextent+0x2e/0xf5
     56<Dec/31 05:41 am>[2123813.311176]  [<ffffffff8123cb1b>] xfs_alloc_vextent+0x318/0x4ad
     57<Dec/31 05:41 am>[2123813.317584]  [<ffffffff812488c1>] xfs_bmap_btalloc+0x3c2/0x576
     58<Dec/31 05:41 am>[2123813.323911]  [<ffffffff81248a98>] xfs_bmap_alloc+0x23/0x25
     59<Dec/31 05:41 am>[2123813.329866]  [<ffffffff8124add5>] xfs_bmapi+0x7b5/0xe73
     60<Dec/31 05:41 am>[2123813.335570]  [<ffffffff8126cbeb>] ? xlog_grant_log_space+0x3e0/0x484
     61<Dec/31 05:41 am>[2123813.342404]  [<ffffffff812615c9>] ? xfs_ilock+0x61/0xb2
     62<Dec/31 05:41 am>[2123813.348140]  [<ffffffff8105861d>] ? down_write_nested+0x2a/0x4a
     63<Dec/31 05:41 am>[2123813.354564]  [<ffffffff81267363>] xfs_iomap_write_allocate+0x227/0x353
     64
     65<Dec/31 05:41 am>[2123813.361629]  [<ffffffff81267eac>] xfs_iomap+0x318/0x39c
     66<Dec/31 05:41 am>[2123813.367314]  [<ffffffff810dce68>] ? add_partial+0x61/0x6a
     67<Dec/31 05:41 am>[2123813.373199]  [<ffffffff810dce21>] ? add_partial+0x1a/0x6a
     68<Dec/31 05:41 am>[2123813.379085]  [<ffffffff8127d1e5>] xfs_map_blocks+0x27/0x2b
     69<Dec/31 05:41 am>[2123813.385077]  [<ffffffff8127e160>] xfs_page_state_convert+0x2d8/0x5b2
     70<Dec/31 05:41 am>[2123813.391902]  [<ffffffff8127e71f>] xfs_vm_writepage+0xd9/0x113
     71<Dec/31 05:41 am>[2123813.398142]  [<ffffffff810b7612>] shrink_page_list+0x3c2/0x68f
     72<Dec/31 05:41 am>[2123813.404460]  [<ffffffff81048181>] ? del_timer_sync+0x0/0x67
     73<Dec/31 05:41 am>[2123813.410526]  [<ffffffff81054b6c>] ? autoremove_wake_function+0x0/0x38
     74<Dec/31 05:41 am>[2123813.417488]  [<ffffffff810b83e3>] shrink_zone+0x864/0xb86
     75<Dec/31 05:41 am>[2123813.423330]  [<ffffffff8128892e>] ? xfs_reclaim_inode_shrink+0x11b/0x126
     76<Dec/31 05:41 am>[2123813.430550]  [<ffffffff812734b7>] ? xfs_perag_get+0x29/0x99
     77<Dec/31 05:41 am>[2123813.436607]  [<ffffffff810b8943>] ? shrink_slab+0x136/0x148
     78<Dec/31 05:41 am>[2123813.442656]  [<ffffffff81058774>] ? up_read+0x1e/0x36
     79<Dec/31 05:41 am>[2123813.448163]  [<ffffffff810b97c3>] do_try_to_free_pages+0x208/0x37a
     80<Dec/31 05:41 am>[2123813.454823]  [<ffffffff810b9b05>] try_to_free_pages+0x71/0x78
     81<Dec/31 05:41 am>[2123813.461028]  [<ffffffff810b6cc0>] ? isolate_pages_global+0x0/0x23f
     82<Dec/31 05:41 am>[2123813.467686]  [<ffffffff810b3026>] __alloc_pages_nodemask+0x407/0x671
     83<Dec/31 05:41 am>[2123813.474549]  [<ffffffff810da7be>] alloc_pages_current+0x96/0x9f
     84<Dec/31 05:41 am>[2123813.480954]  [<ffffffff810df0c8>] new_slab+0x57/0x26b
     85<Dec/31 05:41 am>[2123813.486458]  [<ffffffff810df4f8>] __slab_alloc+0x21c/0x45f
     86<Dec/31 05:41 am>[2123813.492434]  [<ffffffff812bce33>] ? radix_tree_preload+0x38/0x89
     87
     88<Dec/31 05:41 am>[2123813.498917]  [<ffffffff810e693e>] ? __mem_cgroup_commit_charge+0x91/0x96
     89<Dec/31 05:41 am>[2123813.506094]  [<ffffffff812bce33>] ? radix_tree_preload+0x38/0x89
     90<Dec/31 05:41 am>[2123813.512576]  [<ffffffff810dfb2f>] kmem_cache_alloc+0x6a/0xd2
     91<Dec/31 05:41 am>[2123813.518702]  [<ffffffff812bce33>] radix_tree_preload+0x38/0x89
     92<Dec/31 05:41 am>[2123813.525022]  [<ffffffff810acbb6>] add_to_page_cache_locked+0x51/0x10a
     93<Dec/31 05:41 am>[2123813.531992]  [<ffffffff810acc9b>] add_to_page_cache_lru+0x2c/0x5e
     94<Dec/31 05:41 am>[2123813.538546]  [<ffffffff81113cff>] mpage_readpages+0xa7/0x11c
     95<Dec/31 05:41 am>[2123813.544689]  [<ffffffff8127d35c>] ? xfs_get_blocks+0x0/0x14
     96<Dec/31 05:41 am>[2123813.550738]  [<ffffffff8127d35c>] ? xfs_get_blocks+0x0/0x14
     97<Dec/31 05:41 am>[2123813.556782]  [<ffffffff8127e5e1>] xfs_vm_readpages+0x1a/0x1c
     98<Dec/31 05:41 am>[2123813.562937]  [<ffffffff810b48de>] __do_page_cache_readahead+0x163/0x1fc
     99<Dec/31 05:41 am>[2123813.574576]  [<ffffffff810b47f6>] ? __do_page_cache_readahead+0x7b/0x1fc
     100<Dec/31 05:41 am>[2123813.581774]  [<ffffffff810b4993>] ra_submit+0x1c/0x20
     101                 <Dec/31 05:41 am>[2123813.587284]  [<ffffffff810b4cb7>] ondemand_readahead+0x243/0x256
     102<Dec/31 05:41 am>[2123813.593764]  [<ffffffff810b4d47>] page_cache_async_readahead+0x7d/0xa8
     103<Dec/31 05:41 am>[2123813.600775]  [<ffffffff81109d21>] __generic_file_splice_read+0x229/0x41c
     104<Dec/31 05:41 am>[2123813.607960]  [<ffffffff8106433a>] ? __lock_acquire+0x995/0x9fc
     105<Dec/31 05:41 am>[2123813.614285]  [<ffffffff8106433a>] ? __lock_acquire+0x995/0x9fc
     106<Dec/31 05:41 am>[2123813.620587]  [<ffffffff812615b1>] ? xfs_ilock+0x49/0xb2
     107<Dec/31 05:41 am>[2123813.626298]  [<ffffffff811086db>] ? spd_release_page+0x0/0x14
     108<Dec/31 05:41 am>[2123813.632534]  [<ffffffff81109f57>] generic_file_splice_read+0x43/0x74
     109<Dec/31 05:41 am>[2123813.639388]  [<ffffffff8128191a>] xfs_file_splice_read+0xde/0x125
     110
     111<Dec/31 05:41 am>[2123813.645967]  [<ffffffff8110875d>] vfs_splice_to+0x6e/0x81
     112<Dec/31 05:41 am>[2123813.651834]  [<ffffffff81108837>] splice_direct_to_actor+0xc7/0x19c
     113<Dec/31 05:41 am>[2123813.658573]  [<ffffffff811f562c>] ? nfsd_direct_splice_actor+0x0/0x12
     114<Dec/31 05:41 am>[2123813.665520]  [<ffffffff811f54ef>] nfsd_vfs_read+0x263/0x3a0
     115<Dec/31 05:41 am>[2123813.671596]  [<ffffffff81281760>] ? xfs_file_open+0x0/0x3f
     116<Dec/31 05:41 am>[2123813.677560]  [<ffffffff811f5c4e>] nfsd_read+0xa7/0xc3
     117<Dec/31 05:41 am>[2123813.683064]  [<ffffffff811fcd79>] nfsd3_proc_read+0xfe/0x142
     118<Dec/31 05:41 am>[2123813.689197]  [<ffffffff811f0854>] nfsd_dispatch+0xe9/0x1ca
     119<Dec/31 05:41 am>[2123813.695153]  [<ffffffff814f04c5>] svc_process+0x425/0x72a
     120<Dec/31 05:41 am>[2123813.701046]  [<ffffffff811f0ccf>] ? nfsd+0x0/0x139
     121<Dec/31 05:41 am>[2123813.706283]  [<ffffffff811f0dc2>] nfsd+0xf3/0x139
     122<Dec/31 05:41 am>[2123813.711436]  [<ffffffff810546e2>] kthread+0x7d/0x85
     123<Dec/31 05:41 am>[2123813.716769]  [<ffffffff81003794>] kernel_thread_helper+0x4/0x10
     124<Dec/31 05:41 am>[2123813.723197]  [<ffffffff81054665>] ? kthread+0x0/0x85
     125<Dec/31 05:41 am>[2123813.728638]  [<ffffffff81003790>] ? kernel_thread_helper+0x0/0x10
     126<Dec/31 05:41 am>[2123813.735237] Code: 55 48 89 f0 48 89 e5 41 55 41 54 53 48 89 f3 48 83 ec 08 48 83 c0 38 0f 84 cd 00 00 00 48 8b 40 d0 49 c7 c4 00 3c 01 00 8b 40 18 <4c> 03 24 c5 80 37 b2 81 83 7e 70 00 4d 8d ac 24 88 00 00 00 74
     127<Dec/31 05:41 am>[2123813.756557] RIP  [<ffffffff81031467>] put_prev_task_fair+0x2b/0xf3
     128<Dec/31 05:41 am>[2123813.763256]  RSP <ffff880c222b43f0>
     129<Dec/31 05:41 am>[2123813.767152] CR2: 0000000093054080
     130<Dec/31 05:41 am>[2123813.771145] ---[ end trace a6772965d34f5a00 ]---
     131<Dec/31 05:41 am>[2123813.771147] BUG: unable to handle kernel paging request at 00000000930c3f40
     132<Dec/31 05:41 am>[2123813.771149] IP: [<ffffffff8102fb5b>] task_rq_lock+0x6e/0x9a
     133
     134<Dec/31 05:41 am>[2123813.771153] PGD 0
     135<Dec/31 05:41 am>[2123813.771155] Oops: 0000 [#2] SMP
     136<Dec/31 05:41 am>[2123813.771156] last sysfs file: /sys/devices/pci0000:00/0000:00:1f.3/i2c-0/0-002f/temp6_alarm
     137<Dec/31 05:41 am>[2123813.771158] CPU 6
     138<Dec/31 05:41 am>[2123813.771159] Modules linked in: w83793 hwmon_vid autofs4 i2c_i801 i2c_core iTCO_wdt e1000e ioatdma dca rtc_cmos tg3 libphy e1000 fuse dm_snapshot dm_mirror dm_region_hash dm_log scsi_wait_scan qla2xxx megaraid_sas megaraid_mbox megaraid_mm aacraid 3w_9xxx 3w_xxxx arcmsr aic7xxx aic79xx sr_mod sg ata_piix ahci sata_sis sata_nv sata_via pata_sl82c105 pata_sis
     139<Dec/31 05:41 am>[2123813.771173]
     140<Dec/31 05:41 am>[2123813.771175] Pid: 0, comm: swapper Tainted: G      D    2.6.34.4 #3 S7010/empty
     141<Dec/31 05:41 am>[2123813.771176] RIP: 0010:[<ffffffff8102fb5b>]  [<ffffffff8102fb5b>] task_rq_lock+0x6e/0x9a
     142<Dec/31 05:41 am>[2123813.771179] RSP: 0000:ffff880655203b70  EFLAGS: 00010083
     143<Dec/31 05:41 am>[2123813.771180] RAX: 00000000222b40f8 RBX: 0000000000013c00 RCX: 0000000000000000
     144<Dec/31 05:41 am>[2123813.771182] RDX: 0000000000000000 RSI: ffff880655203bb0 RDI: ffff880c222a6120
     145<Dec/31 05:41 am>[2123813.771183] RBP: ffff880655203b90 R08: ffff880c222b45a0 R09: 0000000000000000
     146<Dec/31 05:41 am>[2123813.771185] R10: 0000000000000005 R11: ffffffff81a9daa0 R12: ffff880c222a6120
     147<Dec/31 05:41 am>[2123813.771187] R13: 0000000000013c00 R14: ffff880655203bb0 R15: 0000000000000006
     148<Dec/31 05:41 am>[2123813.771188] FS:  0000000000000000(0000) GS:ffff880655200000(0000) knlGS:0000000000000000
     149<Dec/31 05:41 am>[2123813.771190] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
     150<Dec/31 05:41 am>[2123813.771192] CR2: 00000000930c3f40 CR3: 0000000001a8a000 CR4: 00000000000006e0
     151<Dec/31 05:41 am>[2123813.771193] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
     152<Dec/31 05:41 am>[2123813.771195] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
     153<Dec/31 05:41 am>[2123813.771196] Process swapper (pid: 0, threadinfo ffff880624d48000, task ffff880c24c88000)
     154<Dec/31 05:41 am>[2123813.771198] Stack:
     155                 <Dec/31 05:41 am>[2123813.771198]  0000000000000003 ffff880c222a6120 0000000000000001 0000000000000000
     156
     157<Dec/31 05:41 am>[2123813.771200] <0> ffff880655203be0 ffffffff81036578 0000000055203c00 0000000000000046
     158                 <Dec/31 05:41 am>[2123813.771203] <0> 0000000000000083 ffff880c23448b78 0000000000000001 0000000000000001
     159<Dec/31 05:41 am>[2123813.771205] Call Trace:
     160<Dec/31 05:41 am>[2123813.771206]  <IRQ>
     161<Dec/31 05:41 am>[2123813.771209]  [<ffffffff81036578>] try_to_wake_up+0x2e/0x342
     162<Dec/31 05:41 am>[2123813.771211]  [<ffffffff81036899>] default_wake_function+0xd/0xf
     163<Dec/31 05:41 am>[2123813.771215]  [<ffffffff8102c08d>] __wake_up_common+0x46/0x76
     164<Dec/31 05:41 am>[2123813.771217]  [<ffffffff8102f9f4>] complete+0x38/0x4b
     165<Dec/31 05:41 am>[2123813.771220]  [<ffffffff812807e2>] ? _xfs_buf_ioend+0x24/0x26
     166<Dec/31 05:41 am>[2123813.771222]  [<ffffffff812807b5>] xfs_buf_ioend+0xf0/0xf9
     167<Dec/31 05:41 am>[2123813.771224]  [<ffffffff812807e2>] _xfs_buf_ioend+0x24/0x26
     168<Dec/31 05:41 am>[2123813.771226]  [<ffffffff81280e0b>] xfs_buf_bio_end_io+0xc8/0xdd
     169<Dec/31 05:41 am>[2123813.771229]  [<ffffffff8110e9e7>] bio_endio+0x2a/0x2c
     170<Dec/31 05:41 am>[2123813.771233]  [<ffffffff812a8c54>] req_bio_endio+0x8f/0xaf
     171<Dec/31 05:41 am>[2123813.771235]  [<ffffffff812a8e30>] blk_update_request+0x1bc/0x3c6
     172<Dec/31 05:41 am>[2123813.771237]  [<ffffffff812a8d44>] ? blk_update_request+0xd0/0x3c6
     173<Dec/31 05:41 am>[2123813.771239]  [<ffffffff812a9055>] blk_update_bidi_request+0x1b/0x55
     174<Dec/31 05:41 am>[2123813.771242]  [<ffffffff812a9c89>] blk_end_bidi_request+0x1a/0x56
     175<Dec/31 05:41 am>[2123813.771244]  [<ffffffff812a9cf7>] blk_end_request+0xb/0xd
     176<Dec/31 05:41 am>[2123813.771248]  [<ffffffff813628b9>] scsi_io_completion+0x18c/0x407
     177<Dec/31 05:41 am>[2123813.771251]  [<ffffffff8135c93e>] scsi_finish_command+0xad/0xb6
     178<Dec/31 05:41 am>[2123813.771253]  [<ffffffff81362c61>] scsi_softirq_done+0x11d/0x125
     179
     180<Dec/31 05:41 am>[2123813.771257]  [<ffffffff812aea39>] blk_done_softirq+0x69/0x79
     181<Dec/31 05:41 am>[2123813.771262]  [<ffffffff8104103c>] __do_softirq+0xd8/0x194
     182<Dec/31 05:41 am>[2123813.771264]  [<ffffffff8100388c>] call_softirq+0x1c/0x28
     183<Dec/31 05:41 am>[2123813.771266]  [<ffffffff81004e7f>] do_softirq+0x33/0x68
     184<Dec/31 05:41 am>[2123813.771268]  [<ffffffff81040ec2>] irq_exit+0x36/0x75
     185<Dec/31 05:41 am>[2123813.771272]  [<ffffffff81018828>] smp_call_function_single_interrupt+0x2f/0x31
     186<Dec/31 05:41 am>[2123813.771277]  [<ffffffff810034f3>] call_function_single_interrupt+0x13/0x20
     187<Dec/31 05:41 am>[2123813.771278]  <EOI>
     188<Dec/31 05:41 am>[2123813.771280]  [<ffffffff8151cc4a>] ? schedule+0x296/0x86a
     189<Dec/31 05:41 am>[2123813.771284]  [<ffffffff81303b36>] ? acpi_idle_enter_bm+0x2ab/0x2d9
     190<Dec/31 05:41 am>[2123813.771286]  [<ffffffff81303b2c>] ? acpi_idle_enter_bm+0x2a1/0x2d9
     191<Dec/31 05:41 am>[2123813.771290]  [<ffffffff81522868>] ? __atomic_notifier_call_chain+0x0/0x86
     192<Dec/31 05:41 am>[2123813.771295]  [<ffffffff81430151>] cpuidle_idle_call+0x95/0xf0
     193<Dec/31 05:41 am>[2123813.771298]  [<ffffffff81001d4b>] cpu_idle+0x55/0x8d
     194<Dec/31 05:41 am>[2123813.771300]  [<ffffffff815191ca>] start_secondary+0x1ae/0x1b2
     195<Dec/31 05:41 am>[2123813.771301] Code: 0c 48 89 d8 5b 41 5c 41 5d 41 5e c9 c3 49 8b 36 48 89 df e8 dd fa 4e 00 eb bb 9c 58 fa 49 89 06 49 8b 44 24 08 4c 89 eb 8b 40 18 <48> 03 1c c5 80 37 b2 81 48 89 df e8 f4 f5 4e 00 49 8b 44 24 08
     196<Dec/31 05:41 am>[2123813.771317] RIP  [<ffffffff8102fb5b>] task_rq_lock+0x6e/0x9a
     197<Dec/31 05:41 am>[2123813.771319]  RSP <ffff880655203b70>
     198<Dec/31 05:41 am>[2123813.771320] CR2: 00000000930c3f40
     199<Dec/31 05:41 am>[2123813.771322] ---[ end trace a6772965d34f5a01 ]---
     200<Dec/31 05:41 am>[2123813.771323] Kernel panic - not syncing: Fatal exception in interrupt
     201<Dec/31 05:41 am>[2123813.771325] Pid: 0, comm: swapper Tainted: G      D    2.6.34.4 #3
     202
     203<Dec/31 05:41 am>[2123813.771326] Call Trace:
     204<Dec/31 05:41 am>[2123813.771327]  <IRQ>  [<ffffffff8151c4a8>] panic+0x9e/0x118
     205<Dec/31 05:41 am>[2123813.771331]  [<ffffffff8103bf8a>] ? kmsg_dump+0xa3/0x12c
     206<Dec/31 05:41 am>[2123813.771334]  [<ffffffff8103bff9>] ? kmsg_dump+0x112/0x12c
     207<Dec/31 05:41 am>[2123813.771336]  [<ffffffff81520698>] oops_end+0xaa/0xba
     208<Dec/31 05:41 am>[2123813.771340]  [<ffffffff81023dbe>] no_context+0x1f3/0x202
     209<Dec/31 05:41 am>[2123813.771343]  [<ffffffff81392ab9>] ? loopback_xmit+0x64/0x85
     210<Dec/31 05:41 am>[2123813.771346]  [<ffffffff81023f87>] __bad_area_nosemaphore+0x1ba/0x1e0
     211                 <Dec/31 05:41 am>[2123813.771348]  [<ffffffff8106433a>] ? __lock_acquire+0x995/0x9fc
     212<Dec/31 05:41 am>[2123813.771350]  [<ffffffff8106433a>] ? __lock_acquire+0x995/0x9fc
     213<Dec/31 05:41 am>[2123813.771352]  [<ffffffff8106433a>] ? __lock_acquire+0x995/0x9fc
     214<Dec/31 05:41 am>[2123813.771355]  [<ffffffff81023fbb>] bad_area_nosemaphore+0xe/0x10
     215<Dec/31 05:41 am>[2123813.771357]  [<ffffffff81522660>] do_page_fault+0x1c8/0x375
     216<Dec/31 05:41 am>[2123813.771359]  [<ffffffff8106433a>] ? __lock_acquire+0x995/0x9fc
     217<Dec/31 05:41 am>[2123813.771361]  [<ffffffff8102fc7b>] ? cpuacct_charge+0x76/0x96
     218<Dec/31 05:41 am>[2123813.771363]  [<ffffffff81030e4c>] ? select_task_rq_fair+0x155/0x745
     219<Dec/31 05:41 am>[2123813.771365]  [<ffffffff8102fc93>] ? cpuacct_charge+0x8e/0x96
     220<Dec/31 05:41 am>[2123813.771367]  [<ffffffff8151fb5f>] page_fault+0x1f/0x30
     221<Dec/31 05:41 am>[2123813.771369]  [<ffffffff8102fb5b>] ? task_rq_lock+0x6e/0x9a
     222<Dec/31 05:41 am>[2123813.771372]  [<ffffffff81036578>] try_to_wake_up+0x2e/0x342
     223<Dec/31 05:41 am>[2123813.771374]  [<ffffffff81036899>] default_wake_function+0xd/0xf
     224<Dec/31 05:41 am>[2123813.771376]  [<ffffffff8102c08d>] __wake_up_common+0x46/0x76
     225
     226<Dec/31 05:41 am>[2123813.771378]  [<ffffffff8102f9f4>] complete+0x38/0x4b
     227<Dec/31 05:41 am>[2123813.771381]  [<ffffffff812807e2>] ? _xfs_buf_ioend+0x24/0x26
     228<Dec/31 05:41 am>[2123813.771383]  [<ffffffff812807b5>] xfs_buf_ioend+0xf0/0xf9
     229<Dec/31 05:41 am>[2123813.771385]  [<ffffffff812807e2>] _xfs_buf_ioend+0x24/0x26
     230<Dec/31 05:41 am>[2123813.771387]  [<ffffffff81280e0b>] xfs_buf_bio_end_io+0xc8/0xdd
     231<Dec/31 05:41 am>[2123813.771389]  [<ffffffff8110e9e7>] bio_endio+0x2a/0x2c
     232<Dec/31 05:41 am>[2123813.771391]  [<ffffffff812a8c54>] req_bio_endio+0x8f/0xaf
     233<Dec/31 05:41 am>[2123813.771393]  [<ffffffff812a8e30>] blk_update_request+0x1bc/0x3c6
     234<Dec/31 05:41 am>[2123813.771395]  [<ffffffff812a8d44>] ? blk_update_request+0xd0/0x3c6
     235<Dec/31 05:41 am>[2123813.771398]  [<ffffffff812a9055>] blk_update_bidi_request+0x1b/0x55
     236<Dec/31 05:41 am>[2123813.771400]  [<ffffffff812a9c89>] blk_end_bidi_request+0x1a/0x56
     237<Dec/31 05:41 am>[2123813.771402]  [<ffffffff812a9cf7>] blk_end_request+0xb/0xd
     238<Dec/31 05:41 am>[2123813.771404]  [<ffffffff813628b9>] scsi_io_completion+0x18c/0x407
     239<Dec/31 05:41 am>[2123813.771406]  [<ffffffff8135c93e>] scsi_finish_command+0xad/0xb6
     240<Dec/31 05:41 am>[2123813.771409]  [<ffffffff81362c61>] scsi_softirq_done+0x11d/0x125
     241<Dec/31 05:41 am>[2123813.771411]  [<ffffffff812aea39>] blk_done_softirq+0x69/0x79
     242<Dec/31 05:41 am>[2123813.771413]  [<ffffffff8104103c>] __do_softirq+0xd8/0x194
     243<Dec/31 05:41 am>[2123813.771415]  [<ffffffff8100388c>] call_softirq+0x1c/0x28
     244<Dec/31 05:41 am>[2123813.771417]  [<ffffffff81004e7f>] do_softirq+0x33/0x68
     245<Dec/31 05:41 am>[2123813.771419]  [<ffffffff81040ec2>] irq_exit+0x36/0x75
     246<Dec/31 05:41 am>[2123813.771421]  [<ffffffff81018828>] smp_call_function_single_interrupt+0x2f/0x31
     247<Dec/31 05:41 am>[2123813.771424]  [<ffffffff810034f3>] call_function_single_interrupt+0x13/0x20
     248
     249<Dec/31 05:41 am>[2123813.771425]  <EOI>  [<ffffffff8151cc4a>] ? schedule+0x296/0x86a
     250<Dec/31 05:41 am>[2123813.771429]  [<ffffffff81303b36>] ? acpi_idle_enter_bm+0x2ab/0x2d9
     251<Dec/31 05:41 am>[2123813.771432]  [<ffffffff81303b2c>] ? acpi_idle_enter_bm+0x2a1/0x2d9
     252<Dec/31 05:41 am>[2123813.771434]  [<ffffffff81522868>] ? __atomic_notifier_call_chain+0x0/0x86
     253<Dec/31 05:41 am>[2123813.771436]  [<ffffffff81430151>] cpuidle_idle_call+0x95/0xf0
     254<Dec/31 05:41 am>[2123813.771438]  [<ffffffff81001d4b>] cpu_idle+0x55/0x8d
     255<Dec/31 05:41 am>[2123813.771440]  [<ffffffff815191ca>] start_secondary+0x1ae/0x1b2
     256<Dec/31 05:41 am>[2123814.555655] Kernel panic - not syncing: Fatal exception in interrupt
     257<Dec/31 05:41 am>[2123814.562531] Pid: 8411, comm: nfsd Tainted: G      D    2.6.34.4 #3
     258<Dec/31 05:41 am>[2123814.569245] Call Trace:
     259
     260
     261}}}