IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changes between Version 79 and Version 80 of PS1_IPP_Czarlog_20120917


Ignore:
Timestamp:
Sep 22, 2012, 3:15:58 PM (14 years ago)
Author:
Mark Huber
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • PS1_IPP_Czarlog_20120917

    v79 v80  
    6464 * 18:10 MEH: will stop processing in ~30 min to shuffle load a bit again. stare and compute/2 nodes get hammered with stacks at times.
    6565  * memory usage summary
    66   * Manual plan after restart
     66   * stack: ~10-20%/24 typical, can peak 30-50% --> 2.4-5GB, peak 7-15GB+ (dangerous even on wave4)
     67   * ppImage: ~10%/24, peak ~20%
     68   * psastro: ~10-20%/24, peak 35%
     69   * pswarp: ~10%/24, peak ~20%
     70  * Manual host plan after restart
    6771   * stare: -2 stk +2 stdsci
    6872   * c: -1 stk
    69    * c2: -1 stk (instead of stdsci), still overloading so -2 now
     73   * c2: -1 stk (instead of stdsci), still overloading so made later in night -2
    7074   * w4: -1 stk (maybe +1 stdsci)
    7175   * c3(deep): +1 stdsci (as before, but if stk becomes underpowered, switch to there but stks can clear during nightly science time)
     
    7579  * took a while to reboot (3-5 min), raid spin-up?
    7680  * restarted registration and something is borked.. going again after ran {{{ regtool -revertprocessedimfile -dbname gpc1 }}}
    77  * 20:30 compute2 overloaded, by stack still. -1 added above list for total of 2.
     81 * 20:30 compute2 overloaded, by stack still. -1 added above list for total of 2 above
    7882=== Saturday : 2012-09-22 ===
    7983 * 01:30 current allocations are slightly under powered, but still at ~50/hr stdsci, ~200/hr stk without much swapping for LAP w/o nightly science. durning the little nightly science, reached ~100/hr (~60 LAP, ~40 nightly)