IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changes between Initial Version and Version 1 of ipp006_panic_20101018


Ignore:
Timestamp:
Oct 19, 2010, 7:03:36 AM (16 years ago)
Author:
bills
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • ipp006_panic_20101018

    v1 v1  
     1
     2{{{
     3<Oct/18 02:29 pm>[2166927.212444] eth0: too many iterations (61) in nv_nic_irq.
     4<Oct/18 02:38 pm>[2167453.279670] eth0: too many iterations (61) in nv_nic_irq.
     5<Oct/18 02:44 pm>[2167820.053114] eth0: too many iterations (61) in nv_nic_irq.
     6<Oct/18 02:44 pm>[2167829.825284] eth0: too many iterations (61) in nv_nic_irq.
     7<Oct/18 02:45 pm>[2167843.299182] eth0: too many iterations (61) in nv_nic_irq.
     8
     9<Oct/18 02:49 pm>[2168083.915312] eth0: too many iterations (61) in nv_nic_irq.
     10<Oct/18 02:50 pm>[2168137.272467] eth0: too many iterations (61) in nv_nic_irq.
     11<Oct/18 02:52 pm>[2168268.603536] eth0: too many iterations (61) in nv_nic_irq.
     12<Oct/18 02:53 pm>[2168328.301594] eth0: too many iterations (61) in nv_nic_irq.
     13<Oct/18 02:55 pm>[2168464.712749] eth0: too many iterations (61) in nv_nic_irq.
     14<Oct/18 03:00 pm>[2168767.112347] eth0: too many iterations (61) in nv_nic_irq.
     15<Oct/18 03:01 pm>[2168822.652157] eth0: too many iterations (61) in nv_nic_irq.
     16<Oct/18 03:01 pm>[2168831.937728] eth0: too many iterations (61) in nv_nic_irq.
     17<Oct/18 03:07 pm>[2169186.736898] eth0: too many iterations (61) in nv_nic_irq.
     18<Oct/18 03:07 pm>[2169192.823571] eth0: too many iterations (61) in nv_nic_irq.
     19<Oct/18 03:10 pm>[2169376.933742] eth0: too many iterations (61) in nv_nic_irq.
     20<Oct/18 03:17 pm>[2169780.440498] eth0: too many iterations (61) in nv_nic_irq.
     21<Oct/18 03:19 pm>[2169914.502023] eth0: too many iterations (61) in nv_nic_irq.
     22<Oct/18 03:20 pm>[2169945.596265] eth0: too many iterations (61) in nv_nic_irq.
     23<Oct/18 03:44 pm>[2171427.495663] eth0: too many iterations (61) in nv_nic_irq.
     24<Oct/18 03:44 pm>[2171427.945067] eth0: too many iterations (61) in nv_nic_irq.
     25<Oct/18 03:44 pm>[2171430.046570] eth0: too many iterations (61) in nv_nic_irq.
     26<Oct/18 03:45 pm>[2171441.611634] eth0: too many iterations (61) in nv_nic_irq.
     27<Oct/18 04:00 pm>[2172362.396403] eth0: too many iterations (61) in nv_nic_irq.
     28<Oct/18 04:01 pm>[2172412.597991] eth0: too many iterations (61) in nv_nic_irq.
     29<Oct/18 04:28 pm>[2174016.949615] eth0: too many iterations (61) in nv_nic_irq.
     30<Oct/18 04:28 pm>[2174050.794724] eth0: too many iterations (61) in nv_nic_irq.
     31
     32<Oct/18 04:57 pm>[2175763.346162] eth0: too many iterations (61) in nv_nic_irq.
     33<Oct/18 04:57 pm>[2175804.589231] eth0: too many iterations (61) in nv_nic_irq.
     34<Oct/18 04:58 pm>[2175825.360519] eth0: too many iterations (61) in nv_nic_irq.
     35<Oct/18 04:58 pm>[2175827.874278] eth0: too many iterations (61) in nv_nic_irq.
     36<Oct/18 05:07 pm>[2176394.207316] eth0: too many iterations (61) in nv_nic_irq.
     37<Oct/18 05:07 pm>[2176394.224308] eth0: too many iterations (61) in nv_nic_irq.
     38<Oct/18 05:13 pm>[2176729.665140] eth0: too many iterations (61) in nv_nic_irq.
     39<Oct/18 05:24 pm>[2177413.481094] eth0: too many iterations (61) in nv_nic_irq.
     40<Oct/18 05:26 pm>[2177548.386101] eth0: too many iterations (61) in nv_nic_irq.
     41<Oct/18 06:26 pm>[2181141.574758] eth0: too many iterations (61) in nv_nic_irq.
     42<Oct/18 06:27 pm>[2181165.759276] eth0: too many iterations (61) in nv_nic_irq.
     43<Oct/18 06:58 pm>[2183047.815782] eth0: too many iterations (61) in nv_nic_irq.
     44<Oct/18 07:00 pm>[2183165.908889] eth0: too many iterations (61) in nv_nic_irq.
     45<Oct/18 07:00 pm>[2183181.882869] eth0: too many iterations (61) in nv_nic_irq.
     46<Oct/18 07:01 pm>[2183209.592358] eth0: too many iterations (61) in nv_nic_irq.
     47<Oct/18 07:17 pm>[2184212.086125] eth0: too many iterations (61) in nv_nic_irq.
     48<Oct/18 07:18 pm>[2184269.178471] swapper: page allocation failure. order:0, mod<Oct/18 07:18 pm>
     49                 <Oct/18 07:18 pm>[2184269.181783] Pid: 0, comm: swapper Not tainted 2.6.28-rc7-00105-gfeaf384 #4
     50<Oct/18 07:18 pm>[2184269.188379] Call Trace:
     51<Oct/18 07:18 pm>[2184269.188379]  <IRQ>  [<ffffffff802821c3>] __alloc_pages_internal+0x3ab/0x3c4
     52<Oct/18 07:18 pm>[2184269.202432]  [<ffffffff802a543d>] new_slab+0xbf/0x274
     53<Oct/18 07:18 pm>[2184269.202432]  [<ffffffff802a5875>] __slab_alloc+0x207/0x3ed
     54
     55<Oct/18 07:18 pm>[2184269.212427]  [<ffffffff8052e3d7>] ip_local_deliver+0x15e/0x164
     56<Oct/18 07:18 pm>[2184269.219094]  [<ffffffff80511430>] dev_alloc_skb+0x16/0x2d
     57<Oct/18 07:18 pm>[2184269.219094]  [<ffffffff80251709>] getnstimeofday+0x39/0x98
     58<Oct/18 07:18 pm>[2184269.219094]  [<ffffffff80511430>] dev_alloc_skb+0x16/0x2d
     59<Oct/18 07:18 pm>[2184269.219094]  [<ffffffff802a6c76>] __kmalloc_node_track_cal<Oct/18 07:18 pm>
     60                 <Oct/18 07:18 pm>[2184269.219094]  [<ffffffff805110b6>] __alloc_skb+0x69/0x132
     61<Oct/18 07:18 pm>[2184269.219094]  [<ffffffff80511430>] dev_alloc_skb+0x16/0x2d
     62<Oct/18 07:18 pm>[2184269.255759]  [<ffffffffa016f891>] nv_alloc_rx_optimized+0x53/0x1b8 [forcedeth]
     63<Oct/18 07:18 pm>[2184269.255759]  [<ffffffffa0171087>] nv_nic_irq_optimized+0xa1/0x232 [forcedeth]
     64<Oct/18 07:18 pm>[2184269.255759]  [<ffffffff80277305>] handle_IRQ_event+0x1e/0x4c
     65<Oct/18 07:18 pm>[2184269.255759]  [<ffffffff80278cbb>] handle_fasteoi_irq+0x90/0xcf
     66<Oct/18 07:18 pm>[2184269.255759]  [<ffffffff8020e15b>] do_IRQ+0xf7/0x16c
     67<Oct/18 07:18 pm>[2184269.255759]  [<ffffffff8020c2f6>] ret_from_intr+0x0/0xa
     68<Oct/18 07:18 pm>[2184269.255759]  <EOI>  [<ffffffff80212496>] c1e_idle+0x0/0xe9
     69<Oct/18 07:18 pm>[2184269.305793]  [<ffffffff805b9df2>] __atomic_notifier_call_chain+0x0/0x83
     70<Oct/18 07:18 pm>[2184269.312427]  [<ffffffff8021237c>] default_idle+0x27/0x3b
     71<Oct/18 07:18 pm>[2184269.312427]  [<ffffffff8021257b>] c1e_idle+0xe5/0xe9
     72<Oct/18 07:18 pm>[2184269.312427]  [<ffffffff8020ac41>] cpu_idle+0x4a/0x6d
     73<Oct/18 07:18 pm>[2184269.312427] Mem-Info:
     74<Oct/18 07:18 pm>[2184269.312427] Node 0 DMA per-cpu:
     75<Oct/18 07:18 pm>[2184269.312427] CPU    0: hi:    0, btch:   1 usd:   0
     76<Oct/18 07:18 pm>[2184269.312427] CPU    1: hi:    0, btch:   1 usd:   0
     77
     78<Oct/18 07:18 pm>[2184269.312427] CPU    2: hi:    0, btch:   1 usd:   0
     79<Oct/18 07:18 pm>[2184269.312427] CPU    3: hi:    0, btch:   1 usd:   0
     80<Oct/18 07:18 pm>[2184269.312427] Node 0 DMA32 per-cpu:
     81<Oct/18 07:18 pm>[2184269.312427] CPU    0: hi:  186, btch:  31 usd: 151
     82<Oct/18 07:18 pm>[2184269.312427] CPU    1: hi:  186, btch:  31 usd: 171
     83<Oct/18 07:18 pm>[2184269.312427] CPU    2: hi:  186, btch:  31 usd: 179
     84<Oct/18 07:18 pm>[2184269.312427] CPU    3: hi:  186, btch:  31 usd: 182
     85<Oct/18 07:18 pm>[2184269.312427] Node 0 Normal per-cpu:
     86<Oct/18 07:18 pm>[2184269.312427] CPU    0: hi:  186, btch:  31 usd:  16
     87<Oct/18 07:18 pm>[2184269.312427] CPU    1: hi:  186, btch:  31 usd: 166
     88<Oct/18 07:18 pm>[2184269.312427] CPU    2: hi:  186, btch:  31 usd: 184
     89<Oct/18 07:18 pm>[2184269.312427] CPU    3: hi:  186, btch:  31 usd: 161
     90<Oct/18 07:18 pm>[2184269.312427] Node 1 Normal per-cpu:
     91<Oct/18 07:18 pm>[2184269.312427] CPU    0: hi:  186, btch:  31 usd: 185
     92                 <Oct/18 07:18 pm>[2184269.312427] CPU    1: hi:  186, btch:  31 usd: 156
     93<Oct/18 07:18 pm>[2184269.312427] CPU    2: hi:  186, btch:  31 usd:  49
     94<Oct/18 07:18 pm>[2184269.312427] CPU    3: hi:  186, btch:  31 usd:  42
     95<Oct/18 07:18 pm>[2184269.312427] Active_anon:22076 active_file:11679 inactive_anon:18930
     96<Oct/18 07:18 pm>[2184269.312427]  inactive_file:1844135 unevictable:0 dirty:26247 writeback:37 unstable:0
     97<Oct/18 07:18 pm>[2184269.312427]  free:8542 slab:49168 mapped:1900 pagetables:8256 bounce:0
     98<Oct/18 07:18 pm>[2184269.312427] Node 0 DMA free:2516kB min:0kB low:0kB high:0kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB present:1136kB pages_scanned:0 all_unreclaimable? yes
     99<Oct/18 07:18 pm>[2184269.312427] lowmem_reserve[]: 0 3223 3975 3975
     100
     101<Oct/18 07:18 pm>[2184269.312427] Node 0 DMA32 free:16976kB min:4616kB low:5768kB high:6924kB active_anon:18668kB inactive_anon:13784kB active_file:16328kB inactive_file:3063460kB unevictable:0kB present:3301088kB pages_scanned:0 all_unreclaimable? no
     102<Oct/18 07:18 pm>[2184269.312427] lowmem_reserve[]: 0 0 751 751
     103<Oct/18 07:18 pm>[2184269.312427] Node 0 Normal free:1784kB min:1076kB low:1344kB high:1612kB active_anon:9900kB inactive_anon:36320kB active_file:13452kB inactive_file:681840kB unevictable:0kB present:769536kB pages_scanned:0 all_unreclaim<Oct/18 07:18 pm>
     104                 <Oct/18 07:18 pm>[2184269.312427] lowmem_reserve[]: 0 0 0 0
     105<Oct/18 07:18 pm>[2184269.312427] Node 1 Normal free:12916kB min:5740kB low:7172kB high:8608kB active_anon:59740kB inactive_anon:25616kB active_file:17072kB inactive_file:3631316kB unevictable:0kB present:4104192kB pages_scanned:0 all_unreclaimable? no
     106<Oct/18 07:18 pm>[2184269.312427] lowmem_reserve[]: 0 0 0 0
     107<Oct/18 07:18 pm>[2184269.312427] Node 0 DMA: 3*4kB 3*8kB 3*16kB 4*32kB 6*64kB 3*128kB 2*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 2516kB
     108<Oct/18 07:18 pm>[2184269.312427] Node 0 DMA32: 673*4kB 66*8kB 99*16kB 267*32kB 14*64kB 8*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 17060kB
     109<Oct/18 07:18 pm>[2184269.312427] Node 0 Normal: 188*4kB 16*8kB 6*16kB 8*32kB 3*64kB 1*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 1808kB
     110<Oct/18 07:18 pm>[2184269.312427] Node 1 Normal: 225*4kB 3*8kB 101*16kB 223*32kB 20*64kB 4*128kB 2*256kB 2*512kB 0*1024kB 0*2048kB 0*4096kB = 13004kB
     111<Oct/18 07:18 pm>[2184269.312427] 1857164 total pagecache pages
     112<Oct/18 07:18 pm>[2184269.312427] 1326 pages in swap cache
     113<Oct/18 07:18 pm>[2184269.312427] Swap cache stats: add 422665, delete 421339, find 29972534/30003223
     114<Oct/18 07:18 pm>[2184269.312427] Free swap  = 31168016kB
     115<Oct/18 07:18 pm>[2184269.312427] Total swap = 31999992kB
     116<Oct/18 07:18 pm>[2184269.312427] 2097136 pages RAM
     117<Oct/18 07:18 pm>[2184269.312427] 86330 pages reserved
     118<Oct/18 07:18 pm>[2184269.312427] 1006061 pages shared
     119<Oct/18 07:18 pm>[2184269.312427] 1023918 pages non-shared
     120<Oct/18 07:22 pm>[2184425.056152] BUG: spinlock lockup on CPU#3, xfslogd/3/3168, ffff88000ccd8458
     121<Oct/18 07:22 pm>[2184425.056152] Pid: 3168, comm: xfslogd/3 Not tainted 2.6.28-rc7-00105-gfeaf384 #4
     122<Oct/18 07:22 pm>[2184425.056152] Call Trace:
     123
     124<Oct/18 07:22 pm>[2184425.056152]  [<ffffffff803a103f>] _raw_spin_lock+0xfb/0x122
     125<Oct/18 07:22 pm>[2184425.056152]  [<ffffffff805b7758>] _spin_lock_irqsave+0x37/0x3f
     126<Oct/18 07:22 pm>[2184425.056152]  [<ffffffff8022f028>] __wake_up+0x22/0x4e
     127<Oct/18 07:22 pm>[2184425.056152]  [<ffffffff8022f028>] __wake_up+0x22/0x4e
     128<Oct/18 07:22 pm>[2184425.056152]  [<ffffffffa00b042f>] xfs_buf_item_unpin+0x25/0xa4 [xfs]
     129<Oct/18 07:22 pm>[2184425.056152]  [<ffffffffa00d50d3>] xfs_trans_chunk_committed+0xba/0xf0 [xfs]
     130<Oct/18 07:22 pm>[2184425.056152]  [<ffffffffa00d514d>] xfs_trans_committed+0x44/0xd2 [xfs]
     131<Oct/18 07:22 pm>[2184425.056152]  [<ffffffffa00ca407>] xlog_state_do_callback+0x169/0x281 [xfs]
     132<Oct/18 07:22 pm>[2184425.056152]  [<ffffffffa00e079c>] xfs_buf_iodone_work+0x0/0x74 [xfs]
     133<Oct/18 07:22 pm>[2184425.056152]  [<ffffffff80248973>] run_workqueue+0xed/0x1ed
     134<Oct/18 07:22 pm>[2184425.056152]  [<ffffffff8024891d>] run_workqueue+0x97/0x1ed
     135<Oct/18 07:22 pm>[2184425.056152]  [<ffffffff80249511>] worker_thread+0xd8/0xe3
     136<Oct/18 07:22 pm>[2184425.056152]  [<ffffffff8024bfda>] autoremove_wake_function+0x0/0x2e
     137<Oct/18 07:22 pm>[2184425.056152]  [<ffffffff80249439>] worker_thread+0x0/0xe3
     138<Oct/18 07:22 pm>[2184425.056152]  [<ffffffff8024becc>] kthread+0x47/0x73
     139<Oct/18 07:22 pm>[2184425.056152]  [<ffffffff80234852>] schedule_tail+0x27/0x5f
     140<Oct/18 07:22 pm>[2184425.056152]  [<ffffffff8020cd19>] child_rip+0xa/0x11
     141<Oct/18 07:22 pm>[2184425.056152]  [<ffffffff80212496>] c1e_idle+0x0/0xe9
     142<Oct/18 07:22 pm>[2184425.056152]  [<ffffffff8024be85>] kthread+0x0/0x73
     143<Oct/18 07:22 pm>[2184425.056152]  [<ffffffff8020cd0f>] child_rip+0x0/0x11
     144<Oct/18 07:24 pm>[2184595.389048] BUG: soft lockup - CPU#2 stuck for 61s! [sshd:23859]
     145<Oct/18 07:24 pm>[2184595.389048] Modules linked in: w83627hf hwmon_vid autofs4 smsc37b787_wdt k8temp forcedeth i2c_nforce2 i2c_core tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan
     146
     147<Oct/18 07:24 pm>[2184595.389048] CPU 2:
     148<Oct/18 07:24 pm>[2184595.389048] Modules linked in: w83627hf hwmon_vid autofs4 smsc37b787_wdt k8temp forcedeth i2c_nforce2 i2c_core tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan
     149<Oct/18 07:24 pm>[2184595.389048] Pid: 23859, comm: sshd Not tainted 2.6.28-rc7-00105-gfeaf384 #4
     150<Oct/18 07:24 pm>[2184595.389048] RIP: 0010:[<ffffffff8021d9cd>]  [<ffffffff8021d9cd>] native_flush_tlb_others+0x8e/0xb6
     151<Oct/18 07:24 pm>[2184595.389048] RSP: 0000:ffff8801a0c01da8  EFLAGS: 00000202
     152<Oct/18 07:24 pm>[2184595.389048] RAX: 00000000000008f2 RBX: 0000000000000002 RCX: ffff880135a43198
     153<Oct/18 07:24 pm>[2184595.389048] RDX: 00000000000008f2 RSI: 00000000000000f2 RDI: 0000000000000008
     154<Oct/18 07:24 pm>[2184595.389048] RBP: 0000000000000002 R08: 0000000000000001 R09: 0000000000000000
     155<Oct/18 07:24 pm>[2184595.389048] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000058
     156<Oct/18 07:24 pm>[2184595.389048] R13: ffffe2000842b3a0 R14: 0000000000000246 R15: ffff88017096f680
     157<Oct/18 07:24 pm>[2184595.389048] FS:  00007f79506856f0(0000) GS:ffff88022fa0d300(0000) knlGS:000000005978eb90
     158<Oct/18 07:24 pm>[2184595.389048] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
     159<Oct/18 07:24 pm>[2184595.389048] CR2: 00007fff586a2fe8 CR3: 0000000187b58000 CR4: 00000000000006e0
     160<Oct/18 07:24 pm>[2184595.389048] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
     161<Oct/18 07:24 pm>[2184595.389048] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
     162<Oct/18 07:24 pm>[2184595.389048] Call Trace:
     163<Oct/18 07:24 pm>[2184595.389048]  [<ffffffff8021d9c9>] ? native_flush_tlb_others+0x8a/0xb6
     164<Oct/18 07:24 pm>[2184595.389048]  [<ffffffff8021dabd>] ? flush_tlb_page+0x5e/0x65
     165<Oct/18 07:24 pm>[2184595.389048]  [<ffffffff802299c3>] ? ptep_set_access_flags+0x1b/0x1f
     166<Oct/18 07:24 pm>[2184595.389048]  [<ffffffff8028ad20>] ? do_wp_page+0x4c8/0x55b
     167<Oct/18 07:24 pm>[2184595.389048]  [<ffffffff8028c4fa>] ? handle_mm_fault+0x6ca/0x728
     168<Oct/18 07:24 pm>[2184595.389048]  [<ffffffff805b99e1>] ? do_page_fault+0x424/0x7df
     169
     170<Oct/18 07:24 pm>[2184595.389048]  [<ffffffff805b7141>] ? lockdep_sys_exit_thunk+0x35/0x67
     171<Oct/18 07:24 pm>[2184595.389048]  [<ffffffff805b795d>] ? error_exit+0x0/0x9a
     172
     173File erased !
     174
     175}}}