ipp014 became unresponsive with ramping load. The following was on the console. {{{ [2039834.057468] burntool[24771]: segfault at 7f4291404150 ip 000000000040acc8 sp 00007fff9941ef10 error 4 in burntool[400000+1a000] [2040021.686312] w83793 0-002f: set bank to 2 failed, fall back to bank 0, read reg 0x201 error [2040734.545943] nfs: server ipp008 not responding, still trying [2040741.933544] nfs: server ipp008 OK [2041844.945835] lockd: server ipp009 not responding, still trying [2041880.900253] lockd: server ipp009 OK [2042154.555887] lockd: server ipp009 not responding, still trying [2042194.559362] lockd: server ipp009 not responding, still trying [2042371.708094] lockd: server ipp009 OK [2042371.712437] lockd: server ipp009 OK [2042829.049117] lockd: server ipp009 not responding, still trying [2043069.059356] lockd: server ipp009 not responding, still trying [2043151.429837] lockd: server ipp009 OK [2043153.980385] lockd: server ipp009 OK [2043791.426853] burntool[3569]: segfault at 7fb990fcf150 ip 000000000040acc8 sp 00007fff98fe8ad0 error 4 in burntool[400000+1a000] [2043985.125630] lockd: server ipp009 not responding, still trying [2044011.026558] lockd: server ipp009 OK [2044397.882252] lockd: server ipp009 not responding, still trying [2044397.890795] lockd: server ipp009 OK [2044804.615559] nfs: server ipp009 not responding, still trying [2044806.812658] nfs: server ipp009 not responding, still trying [2044806.916741] nfs: server ipp009 OK [2044806.920685] nfs: server ipp009 OK [2045404.972359] lockd: server ipp009 not responding, still trying [2045444.975686] lockd: server ipp009 not responding, still trying [2045652.641752] lockd: server ipp009 OK [2045652.645778] lockd: server ipp009 OK [2046092.528737] lockd: server ipp009 not responding, still trying [2046144.050026] lockd: server ipp009 OK [2046489.760351] nfs: server ipp015 not responding, still trying [2046489.767052] nfs: server ipp015 not responding, still trying [2046489.773859] nfs: server ipp015 OK [2046489.778345] nfs: server ipp015 OK [2046569.385443] lockd: server ipp008 not responding, still trying [2046584.860384] burntool[11693]: segfault at 7f2604675150 ip 000000000040acc8 sp 00007fff0c68e180 error 4 in burntool[400000+1a000] [2046591.902133] lockd: server ipp009 not responding, still trying [2046714.437289] lockd: server ipp009 OK [2046742.605939] lockd: server ipp008 OK [2047019.472659] lockd: server ipp009 not responding, still trying [2047068.842140] lockd: server ipp009 OK [2049902.026193] burntool[17541]: segfault at 7fb860e4c150 ip 000000000040acc8 sp 00007fff68e65950 error 4 in burntool[400000+1a000] [2053401.048609] burntool[22815]: segfault at 7ffcc5643150 ip 000000000040acc8 sp 00007fffcd65e150 error 4 in burntool[400000+1a000] [2056452.322252] burntool[27240]: segfault at 7f6434b23150 ip 000000000040acc8 sp 00007fff3cb3c630 error 4 in burntool[400000+1a000] [2059455.129657] burntool[31353]: segfault at 7fc625234150 ip 000000000040acc8 sp 00007fff2d24ed40 error 4 in burntool[400000+1a000] [2063506.595390] burntool[5285]: segfault at 7f57df248150 ip 000000000040acc8 sp 00007fffe7262d50 error 4 in burntool[400000+1a000] [2066690.493896] burntool[9761]: segfault at 7fef540e5150 ip 000000000040acc8 sp 00007fff5c0fdbf0 error 4 in burntool[400000+1a000] [2070125.905056] burntool[14723]: segfault at 7f8d9fb45150 ip 000000000040acc8 sp 00007fffa7b60650 error 4 in burntool[400000+1a000] [2073223.362867] lockd: server ipp009 not responding, still trying [2073336.126094] lockd: server ipp009 OK [2073518.497426] burntool[20652]: segfault at 7fcf3d875150 ip 000000000040acc8 sp 00007fff45890380 error 4 in burntool[400000+1a000] [2074305.919359] lockd: server ipp009 not responding, still trying [2074446.655081] BUG: unable to handle kernel paging request at ffffffff800073d4 [2074446.655894] IP: [] xprt_autoclose+0x19/0x4c [2074446.655894] PGD 203067 PUD 207063 PMD 0 [2074446.655894] Oops: 0000 [#1] SMP [2074446.655894] last sysfs file: /sys/class/i2c-adapter/i2c-0/0-002f/temp6_alarm [2074446.655894] CPU 0 [2074446.655894] Modules linked in: w83793 hwmon_vid autofs4 i2c_i801 i2c_core iTCO_wdt e1000e tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan [2074446.655894] Pid: 1515, comm: rpciod/0 Not tainted 2.6.28-rc7-00105-gfeaf384 #4 [2074446.655894] RIP: 0010:[] [] xprt_autoclose+0x19/0x4c [2074446.655894] RSP: 0018:ffff88033d367e60 EFLAGS: 00010246 [2074446.655894] RAX: ffffffff80007374 RBX: ffff88010001a578 RCX: 0000000000000000 [2074446.655894] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff88010001a000 [2074446.655894] RBP: ffff88033d365a00 R08: 0000000000000001 R09: 0000000000000000 [2074446.655894] R10: 0000000000000000 R11: ffffffff8050a1ce R12: ffff88010001a578 [2074446.655894] R13: ffff88010001a000 R14: ffffffff808b85a0 R15: 0000000000000000 [2074446.655894] FS: 0000000000000000(0000) GS:ffffffff80872d80(0000) knlGS:0000000000000000 [2074446.655894] CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b [2074446.655894] CR2: ffffffff800073d4 CR3: 000000033e52f000 CR4: 00000000000006e0 [2074446.655894] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [2074446.655894] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [2074446.655894] Process rpciod/0 (pid: 1515, threadinfo ffff88033d366000, task ffff88033d1fcbf0) [2074446.655894] Stack: [2074446.655894] ffff88033d367e90 ffff88010001a578 ffffffff805895f9 ffffffff80248973 [2074446.655894] ffffffff8024891d 0000000000000046 0000000000000000 0000000000000000 [2074446.655894] 0000000000000000 ffff88033d365a00 ffff88063e443bf0 ffff88033d365a00 [2074446.655894] Call Trace: [2074446.655894] [] ? xprt_autoclose+0x0/0x4c [2074446.655894] [] ? run_workqueue+0xed/0x1ed [2074446.655894] [] ? run_workqueue+0x97/0x1 [2074446.655894] [] ? worker_thread+0xd8/0xe3 [2074446.655894] [] ? autoremove_wake_function+0x0/0x2e [2074446.655894] [] ? worker_thread+0x0/0xe3 [2074446.655894] [] ? kthread+0x47/0x73 [2074446.655894] [] ? schedule_tail+0x27/0x5f [2074446.655894] [] ? child_rip+0xa/0x11 [2074446.655894] [] ? menu_reflect+0x0/0x6d [2074446.655894] [] ? kthread+0x0/0x73 [2074446.655894] [] ? child_rip+0x0/0x11 [2074446.655894] Code: 89 f7 e8 59 dd 02 00 89 d8 5b 5d 41 5c 41 5d 41 5e c3 41 55 4c 8d af 88 fa ff ff 41 54 53 48 8b 87 90 fa ff ff 48 89 fb 4c 89 ef 50 60 f0 80 63 d0 f7 4c 8d a3 98 00 00 00 4c 89 e7 e8 43 de [2074446.655894] RIP [] xprt_autoclose+0x19/0x4c [2074446.655894] RSP [2074446.655894] CR2: ffffffff800073d4 [2074446.655894] ---[ end trace 8a138b265fc38a3c ]--- [2074508.862741] lockd: cannot unmonitor ipp065 [2074572.829332] lockd: cannot monitor ipp049 [2074632.832642] lockd: cannot monitor ippc28 [2074692.835977] lockd: cannot unmonitor ippc07 [2074752.839315] lockd: cannot unmonitor ipp059 [2074812.842692] lockd: cannot unmonitor ippc47 [2074872.845991] lockd: cannot unmonitor ippc02 [2074932.849349] lockd: cannot unmonitor ippc49 [2074979.992601] nfs: server ipp047 not responding, still trying [2074992.852678] lockd: cannot unmonitor ippc03 [2075052.859339] lockd: cannot unmonitor ippc50 [2075112.862661] lockd: cannot unmonitor ippc04 [2075172.865939] lockd: cannot unmonitor ipp055 [2075232.869312] lockd: cannot unmonitor ippc59 [2075292.872596] lockd: cannot unmonitor ippc14 [2075352.875919] lockd: cannot unmonitor ipp066 [2075412.879260] lockd: cannot unmonitor ippc09 [2075472.882577] lockd: cannot unmonitor ipp031 [2075532.885955] lockd: cannot unmonitor ipp033 [2075592.889281] lockd: cannot unmonitor ippc57 [2075652.892636] lockd: cannot unmonitor ippc58 [2075712.895961] lockd: cannot unmonitor ippc21 [2075772.899213] lockd: cannot unmonitor ipp010 [2075832.902624] lockd: cannot unmonitor ippc22 [2075892.905865] lockd: cannot unmonitor ippc36 [2075952.909192] lockd: cannot unmonitor ipp011 [2076012.912566] lockd: cannot unmonitor ippc23 [2076076.715871] lockd: cannot unmonitor ipp039 [2076136.719171] lockd: cannot unmonitor ipp040 [2076202.732481] lockd: cannot unmonitor ippc43 [2076262.735867] lockd: cannot unmonitor ippc44 [2076322.739173] lockd: cannot unmonitor stare01 [2076382.742470] lockd: cannot unmonitor ippc45 [2076442.745826] lockd: cannot unmonitor ippc46 [2076502.749207] lockd: cannot unmonitor stare02 [2076562.752491] lockd: cannot unmonitor ippc25 [2076622.755774] lockd: cannot unmonitor ippc26 [2076683.785866] lockd: cannot monitor ippc20 [2076743.789209] lockd: cannot monitor ippc10 [2076803.792460] lockd: cannot unmonitor ippc06 [2076863.795773] lockd: cannot unmonitor ipp057 [2076923.799100] lockd: cannot unmonitor ippc53 [2076988.135760] lockd: cannot unmonitor ipp054 [2077048.139132] lockd: cannot unmonitor ipp061 [2077108.142416] lockd: cannot unmonitor ipp062 [2077168.145747] lockd: cannot unmonitor ipp034 [2077228.149083] lockd: cannot unmonitor ipp043 [2077288.152376] lockd: cannot unmonitor ipp044 [2077348.155761] lockd: cannot unmonitor ipp046 [2077408.159048] lockd: cannot unmonitor ipp006 [2077468.162373] lockd: cannot unmonitor ipp007 [2077528.165702] lockd: cannot unmonitor ipp042 [2077588.169030] lockd: cannot unmonitor ipp051 [2077648.172356] lockd: cannot unmonitor ipp052 [2077708.179012] lockd: cannot unmonitor ipp053 [2077768.182346] lockd: cannot unmonitor ipp021 [2077828.185683] lockd: cannot unmonitor ipp015 [2077888.189000] lockd: cannot unmonitor ipp050 [2077948.192358] lockd: cannot monitor ippc41 [2078008.195721] lockd: cannot monitor ippc20 [2078068.199012] lockd: cannot unmonitor ipp028 [2078128.202308] lockd: cannot unmonitor ipp030 [2078188.205639] lockd: cannot unmonitor ipp023 [2078248.209007] lockd: cannot unmonitor ipp035 [2078308.212341] lockd: cannot unmonitor ipp036 [2078368.215659] lockd: cannot unmonitor ipp038 [2078428.218919] lockd: cannot monitor ippc28 [2078488.222272] lockd: cannot monitor ipp049 [2078548.225600] lockd: cannot monitor ippc41 [2078608.228926] lockd: cannot monitor ippc10 [2078668.232258] lockd: cannot monitor ipp040 [2078728.235584] lockd: cannot monitor ipp040 [2078788.238955] lockd: cannot monitor ipp049 [2078848.242274] lockd: cannot monitor ipp063 [2078908.245565] lockd: cannot monitor ippc28 [2078968.248962] lockd: cannot monitor ippc20 [2079028.252294] lockd: cannot monitor ippc10 [2079088.255651] lockd: cannot monitor ippc41 [2079148.962286] lockd: cannot monitor ipp063 [2079208.965538] lockd: cannot monitor ipp040 [2079268.968833] lockd: cannot monitor ipp063 [2079328.972194] lockd: cannot monitor ipp049 [2079385.498847] w83793 0-002f: set bank to 0 failed, fall back to bank 2, read reg 0xb2 error [2079388.975520] lockd: cannot monitor ipp059 [2079448.978901] lockd: cannot monitor ipp059 [2079508.982141] lockd: cannot monitor ippc28 [2079568.985505] lockd: cannot monitor ippc20 [2079628.988804] lockd: cannot unmonitor ippc51 [2079688.992157] lockd: cannot unmonitor ippc13 [2079748.995490] lockd: cannot unmonitor ipp060 [2079808.998807] lockd: cannot unmonitor ippc63 [2079869.002198] lockd: cannot unmonitor ippc29 [2079929.005463] lockd: cannot monitor ippc10 [2079989.008832] lockd: cannot monitor ippc41 [2080049.012123] lockd: cannot monitor ipp059 [2080109.015525] lockd: cannot monitor ipp049 [2080169.018844] lockd: cannot monitor ippc28 [2080229.022098] lockd: cannot monitor ippc20 [2080289.025501] lockd: cannot monitor ippc10 [2080349.028796] lockd: cannot monitor ippc41 }}}