IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changes between Version 11 and Version 12 of PS1_IPP_Czarlog_20180827


Ignore:
Timestamp:
Sep 1, 2018, 6:18:52 AM (8 years ago)
Author:
Mark Huber
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • PS1_IPP_Czarlog_20180827

    v11 v12  
    88 * 10:15 EAM : ippb04 and ippb05 are up allowing us to have a b-node replication target.  I've set them up for now and am re-running the MOPS dailytestset ~~chunk~~ quad, which now seems to be succeeding.
    99 * MEH: summitcopy & registration getting allocation of 1x s4 (ipp067-70) to substitute for down compute nodes and test data node use there
    10  * MEH: updating stdscience, pstamp, ippqub:stdscience_ws in master ~ippitc/ippconfig/pantasks_hosts.input now from their input files
     10 * MEH: updating stdscience, pstamp, ippqub:stdscience_ws in master ~ippitc/ippconfig/pantasks_hosts.input now from their input files -- no allocation changes other than removing ipps from pstamp now
    1111 * MEH: ippb06-b15 to repair to allow chips to be updated for stamps -- due to there being replicated products having copies only on the backup nodes still...
    1212 * MEH: more test reprocessing for MOPS without masks with label/data_group mehtest.nomask
     
    1717  * no apparent ssh interruptions/faults however (extra loadings of ipp123-126 in pstamp)
    1818 * MEH: Weryk starting nice'd processing again -- ipps nodes to begin with then move on to ippx and ippc30-63 as before
     19  * pstamp on ippc33 with Weryk nice'd processing seems fine
    1920
    2021=== Wednesday : 2018.08.30 ===
     
    2930=== Thursday : YYYY.MM.DD ===
    3031
    31 === Friday : YYYY.MM.DD ===
     32=== Friday : 2018.08.31 ===
     33 * MEH: ipp032 with Weryk processing providing the nagios addition for load >50/5 min a good test -- all other nodes except a few of the older ipp054-066 data nodes also triggering
     34 * MEH: ippc88 back up for a bit now, put back into nightly processing group
     35 * MEH: ippb18 down again, console shows root disk check problem -- unknown if crash/rebooted itself and stalled or if someone powercycled -- leaving in halted state from root disk error until can be looked at
    3236
    3337=== Saturday : YYYY.MM.DD ===