== PS1 IPP Czar Logs for the week YYYY.MM.DD - YYYY.MM.DD == [[PageOutline]] (Up to [wiki:PS1_IPP_CzarLogs PS1 IPP Czar Logs]) === Monday : 2014.08.11 === * HAF czar : restarted summitcopy,registration,distribution,stdscience,stack (cluster was off this weekend due to hurricane) * HAF czar : ippb00, 01, 03, 04 are set to repair, 02 is set to up * HAF czar : restarted czartool/roboczar on c18 === Tuesday : 2014.08.12 === * 07:30 MEH: LAP stacks needed to be reverted so some runs now clearing, one had stack label LAP.PV3.20140730.local * 08:30 MEH: probably need to do a regular restart of the LAP pantasks as well -- will do tonight if have to reallocate for normal nightly * 10:30 MEH: restarted pstamp -- '''pstamp must run from ipptest for now''' -- often running out of space, need to change PSTAMP_PRESERVE_DAYS 14->7d or so or doc for doing manually? * suspect stamp cleanup not happening because cleanup pantasks not running? starting now -- or does this just cleanup the updated products and not the stamp bundles, need to cleanup stack bundles for space.. and some more doc on this * to try and clean up more space for pstamp, as ipptest ran: pstamp_queue_cleanup.pl --preserve-days=12 * clearing >200G now.. * 11:00 MEH: LAP pole stdsci poll was set too low for number of nodes available if run out of chips etc. bumped up * 12:00 MEH: don't see nebdiskd on ippdb00, needs to be started === Wednesday : YYYY.MM.DD === === Thursday : YYYY.MM.DD === === Friday : YYYY.MM.DD === === Saturday : YYYY.MM.DD === === Sunday : YYYY.MM.DD ===