== PS1 IPP Czar Logs for the week 2015.12.28 - 2016.01.03 == 
[[PageOutline]]

(Up to [wiki:PS1_IPP_CzarLogs PS1 IPP Czar Logs])

=== Monday : 2015.12.28 ===
  * 06:28 Bill: pstamp server was idle, so set all ps_ud% chip, warp, and diff data to be cleaned. Restarted pstamp server pantasks since it was using cpu time for now apparent reason.
  * 16:45 EAM: restarting pantasks to be ready for the night.
    * everything is up and running, ready for the night.

=== Tuesday : 2015.12.29 ===
 * 07:00 MEH: QUB processing still running, setting up MOPS diffims using the QUB data -- probably finish by ~1100
 * 09:26 MEH: clearing some OSS/3PI fault 5 WSdiffs
{{{
difftool -dbname gpc1  -updatediffskyfile -fault 0 -set_quality 42 -diff_id 1297397  -skycell_id skycell.2193.048
difftool -dbname gpc1  -updatediffskyfile -fault 0 -set_quality 42 -diff_id 1297561 -skycell_id skycell.0756.084
difftool -dbname gpc1  -updatediffskyfile -fault 0 -set_quality 42 -diff_id 1297564 -skycell_id skycell.0840.017
difftool -dbname gpc1  -updatediffskyfile -fault 0 -set_quality 42 -diff_id 1297601 -skycell_id skycell.0838.020
}}}
 * 10:16 MEH: looking at some common fault nodes -- ippc54 looks like /export/ippc54.1 isn't mounted and tmp dir not available for processing there
 * 17:22 MEH: restarting all pantasks to clear changes from last night and auto-remove ippc54 from processing until time to get ippc54.1 issue resolved
 * 19:51 MEH: many faults w/ error: mkdir /data/ipp024.0/nebulous: No such file or directory -- set neb-host repair
=== Wednesday : 2015.12.30 ===
  * 12:25 MEH: test boosting pstamp pantasks to increase the rate QUB stamps are provided from last night
=== Thursday : YYYY.MM.DD ===

=== Friday : YYYY.MM.DD ===

=== Saturday : YYYY.MM.DD ===

=== Sunday : YYYY.MM.DD ===