== PS1 IPP Czar Logs for the week 2011.08.08 - 2011.08.14 == 
[[PageOutline]]

(Up to [wiki:PS1_IPP_CzarLogs PS1 IPP Czar Logs])

=== Monday : 2011.08.08 ===
  
=== Tuesday : 2011.08.09 ===

 * 08:00: Roy: Registration stuck as usual. {{{regpeek}}} tells me offending exposure is {{{o5782g0063o}}}
 * 08:10: Bill and Heather: stopped {{{summitcopy}}} pantasks, waited for {{{Nrun}}} column to reach zero then ran:

{{{
copy.reset
}}}

this reset the book with

{{{
book init pzPendingImfile
}}}
 * 10:38 Serge: Reverted failed publishing exposures
 * 11:40 Bill: changed label on runs with data_group STS.201104rerun from STS.nightlyscience to 201104rerun. (Added the label to the usual places.
 * 12:03 Bill: queued STS diffs from 2011-08-06. I really need to automate this.
 * 14:19 Bill: reverted cam_id 245246 which has faulted twice for "unable to access file on ipp020"  for two different files. There are diff faults for files on that node as well.
 * 14:25: Roy: processing slow, so stopping {{{stdscience}}} and...
 * 14:40: Roy: ...restarted again
 * 15:20: Roy: reverted stuck chips with:

{{{
camtool -revertprocessedexp -fault 3 -label ThreePi.nightlyscience -dbname gpc1
}}}

 * 15:40: Roy: {{{ippc11}}} is down. Tried to reboot with serial console:

{{{
 ssh rhenders:ippdb03@cab6con.ipp.ifa.hawaii.edu
}}}

but blocked by another user
=== Wednesday : YYYY.MM.DD ===

=== Thursday : YYYY.MM.DD ===

=== Friday : YYYY.MM.DD ===

=== Saturday : YYYY.MM.DD ===

=== Sunday : YYYY.MM.DD ===