IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changes between Version 20 and Version 21 of PS1_IPP_Czarlog_20140915


Ignore:
Timestamp:
Sep 16, 2014, 9:58:54 AM (12 years ago)
Author:
Mark Huber
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • PS1_IPP_Czarlog_20140915

    v20 v21  
    3737 * 22:10 MEH: stdsci having timeout flurry for chiptool -pendingimfile.. ippdb01 has load ~13 -- taking out all extra labels (CNP,STD,PI,ps_ud_*) -- seems improved
    3838 * 22:30 MEH: even large load on apache servers (ippc0x), lanl stdlocal stop for now until nightly starts moving along faster
    39  * 23:10 MEH: no access to ganglia -- looks like ippops2 rebooted, forget if know how to restart
    40   * ipp svn/wiki also down -- wasn't ippops2 but ipp022 crashed?
     39 * 23:10 MEH: no access to ganglia -- looks like ippops2 rebooted, forget if know how to restart -- Gavin notes
     40{{{
     41# restart ganglia monitor
     42/etc/init.d/gmond restart
     43# restart gmetad web frontend
     44/etc/init.d/gmetad restart
     45}}}
     46  * ipp svn/wiki also down -- wasn't ippops2 but ipp002 crashed -- back up once Gavin rebooted. Will look at possible UPS/PDU issues since it wasn't under any load
     47 * 23:50 MEH: lanl stdlocal set to run but w/ only ~100 nodes -- nightly processing is slower than normal and possible hampered by lanl stdlocal, but if weather comes in at leas some processing done
    4148=== Tuesday : 2014.09.16 ===
    4249 * 06:30 MEH: ipp036 crash, nothing on console -- power cycled