== PS1 IPP Czar Logs for the week 2014.11.24 - 2014.11.30 == 
[[PageOutline]]

(Up to [wiki:PS1_IPP_CzarLogs PS1 IPP Czar Logs])

=== Monday : 2014.11.24 ===

 * 04:05 : ipp034 was down, rebooting
 * 05:02 Bill: Restarted registration pantasks lots of timeouts and errors in the counts hard to follow
  * burntool process 23811 on ipp004 is stuck trying to process o6985g0360o.ota14 don't know what to do 
  * 05:15 restarted stdscience pantasks which has the effect of turning on update labels. They have been off and there are several pstamp jobs waiting for a few files
  * 05:45 stopped registration
    * killed stuck burntool process
    * regtool -dbname gpc1 -updateprocessedimfile -exp_id 823590 -class_id XY14 -set_ignored -set_state full -burntool_state -14
    * set pantasks to run and now burntool is moving along
=== Tuesday : 2014.11.25 ===
 * 06:10 MEH: ipp036 unresponsive, taking out of processing and power cycle (nothing on console) -- 
  * all but a job in summitcopy cleared.. restarting summitcopy to clear
 * 06:15 MEH: looks like registration has a long running burntool, may be the one Bill fixed earlier??
{{{
  0    ipp004    RESP  87573.44 0.0.0.495  0 ipp_apply_burntool_single.pl --camera GPC1 --exp_id 823627 --class_id XY14 --this_uri neb://ipp058.0/gpc1/20141124/o6985g0397d/o6985g0397d.ota14.fits --continue 10 --previous_uri neb://ipp058.0/gpc1/20141124/o6985g0396d/o6985g0396d.ota14.fits --dbname gpc1 --verbose 
}}}
 * 16:07 CZW: restarted stdlanl, as it was cranky (and hadn't been restarted in a long time).
 * 23:41 HAF: I hate burntool, xy14 is stuck , per bill's instructions regtool -dbname gpc1 -updateprocessedimfile -exp_id 824673 -class_id XY14 -set_ignored -set_state full -burntool_state -14 to see if I can unstick..
 * 1:46 HAF: burntool stuck again, but while investigating it unstuck itself... ok.
 * 1:54 HAF: regtool -updateprocessedimfile -exp_id 824781 -class_id XY64 -set_state pending_burntool -dbname gpc1
 * 1:58 HAF: regtool -updateprocessedimfile -exp_id 824794 -class_id XY64 -set_state pending_burntool -dbname gpc1
 * 2:04 HAF: regtool -updateprocessedimfile -exp_id 824807 -class_id XY64 -set_state pending_burntool -dbname gpc1
 * 2:04 HAF:regtool -updateprocessedimfile -exp_id 824795 -class_id XY64 -set_state pending_burntool -dbname gpc1
 * 2:22 HAF: regtool -revertprocessedimfile -dbname gpc1 -exp_id 824846
 * 2:22 HAF: regtool -revertprocessedimfile -dbname gpc1 -exp_id 824855
 * 2:22 HAF: regtool -revertprocessedimfile -dbname gpc1 -exp_id 824866
=== Wednesday : YYYY.MM.DD ===

=== Thursday : YYYY.MM.DD ===

=== Friday : YYYY.MM.DD ===

=== Saturday : YYYY.MM.DD ===

=== Sunday : YYYY.MM.DD ===