PS1 IPP Czar Logs for the week 2017-04-24 - 2017-04-30

(Up to PS1 IPP Czar Logs)

Monday : 2017-04-24

• 16:00 CZW: Restarting ippitc pantasks.

Tuesday : 2017-04-24

• 16:15 CZW: Restarting ippitc pantasks.

Wednesday : YYYY.MM.DD

Thursday : YYYY.MM.DD

Friday : 2017.04.28

• MEH: HVAC work through 4/30 @IfA Manoa -- ipp001,ipp003,ipp022,ippb04,ippb05 shutdown to reduce thermal load in mez so ipp002,ippops1,ippops2 can remain up for processing
  • ipp001,ipp003 need mysql shutdown cleanly before halting the machines
  • power off all machines once halted -- Gavin fixed remote power management on ippb04,b05
• MEH: ippc121 has been stalling processing @camera stage -- out of normal nightly processing for now
• 15:45 CZW: Restarted retired host reinsertion as ipptest in screen session on stare02. The check to confirm hosts can be retired is running slowly, as it is scanning for the existence of all files that have database entries on the retired hosts. Reinserting will reduce the number of these that need to be checked, and the check can be resumed post-reinsertion at the point it was stopped. This should have minimal impact, but feel free to control-C if ipp118-ipp122 loads are too high/slows down processing.

Saturday : YYYY.MM.DD

Sunday : YYYY.MM.DD