IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links
wiki:PS1_IPP_Czarlog_20131104

Version 12 (modified by Mark Huber, 13 years ago) ( diff )

--

PS1 IPP Czar Logs for the week 2013.11.04 - 2013.11.10

(Up to PS1 IPP Czar Logs)

Monday : 2013.11.04

  • 12:20 Set stdscience and pstamp to stop in preparation for daily restart.
  • 12:43 stdscience, pstamp and update restarted
  • 15:00 just noticed stdscience has been running with a poll limit of 30 instead of 300. Not sure why
    • MEH: clearing out final MD02.pv2 issues -- thanks for resetting (have actually also bumped to 500 since update processes continuing with MD10.pv2

Tuesday : 2013.11.05

  • 09:17 restarted stdscience
  • Cleared three chips which had fault = 26. I thought that I'd cleared all of those but there are 1414 of them with nonzero quality. Most are from 2011 lap and test runs.
    • MEH: have been fixing misc ones etc with MD, if possible, please don't bulk repair any related to MD.
  • 18:22 restarted stdscience (twice a day seems good) set poll back to 500 (which I think causes pcontrol to back up sooner but that's anecdotal)
    • yes if update processing, then before+after nightly is pretty much necessary. 500 is more to help when things get into warp only case and to keep the queue full but also can help dump more into the pool/book when it gets >100k Njobs and keeping that > available nodes...

Wednesday : 2013.11.06

  • 15:00 MEH: manually managing c3 stack and deepstack allocation -- current cut deep stacks are low enough ram use to run normal stacks but not enough for 2x deep stack and LAP could use the extra stack nodes

Thursday : 2013.11.07

Friday : 2013.11.08

Saturday : 2013.11.09

Sunday : 2013.11.10

Note: See TracWiki for help on using the wiki.