== PS1 IPP Czar Logs for the week 2014.04.28 - 2014.05.04 == 
[[PageOutline]]

(Up to [wiki:PS1_IPP_CzarLogs PS1 IPP Czar Logs])

=== Monday : 2014.04.28 ===
mark is czar
 * 07:00 MEH: chip.off to push remaining night warp+diffim through (lots of LAP chips..). two fault 5 OSS diffim cleared, small stamp poor stats robustness (543558 skycell.1014.058; 543560 skycell.1014.001)
 * 08:10 MEH: stdsci poll underloaded, nightly finished, regular restart of pantasks to begin
  * have to cycle chip.off to mostly push backlog of LAP warps out, seems mixed and need all out to start making stacks..
 * 10:20 MEH: LAP stacks now loading, will need to throw stdsci nodes into stack -- if like yesterday ~3500 stacks/400hr then mostly finished by nightly obs, but if normal night processing then leaving ~1k keeps the few stack nodes busy all night
 * 10:40 MEH: ipp053 was never put back into processing after the mobo was replaced on 3/20..
 * 18:40 MEH: ~800 LAP stacks remain, returning power to stdsci for nightly (after pantasks restart)
=== Tuesday : 2014.04.29 ===
 * 10:04 Bill: staticsky memory use is mostly staying around 30G peak. Set one set of c2 notes to on in stack.
 * 11:22 Bill: ganglia reports that ippc13 has been down for 6 1/3 hours. I set the power to off and notified Haydn.
 * 15:30 CZW: I've restarted the replication pantasks, pointing it at the new permcheck.pl script and the PV1 stacks.  This will shuffle the backup image copy to the b storage nodes.
=== Wednesday : 2014.04.30 ===

=== Thursday : 2014.05.01 ===

=== Friday : 2014.05.02 ===

=== Saturday : 2014.05.03 ===

=== Sunday : 2014.05.04 ===