PS1 IPP Czar Logs for the week 2014-03-31 - 2014-04-06

(Up to PS1 IPP Czar Logs)

Monday : 2014-03-31

Tuesday : 2014-04-01

• 12:30 CZW: restarted stdscience
• 14:00 CZW: resumed replication processing with test.40 macro. This should be the optimum value of number of simultaneous replications/md5sum disk wait on ippb03.

Wednesday : 2014-04-02

• 13:25 Bill: restarted postage stamp pantasks adding a task that queues requests older than 14 days to be cleaned.

Thursday : 2014-04-03

• 12:13 Bill: restarted postage stamp pantasks with an optimization that should speed up request parsing somewhat.
• 21:05 MEH: stdsci way way way past regular restart, polls barely loaded.. restarting so nightly doesn't get backed up...

Friday : 2014-04-04

Bill is czar today

• 10:28 The postage stamp jobs are taking too long to process. Ran the macro hosts.detrend to add storage nodes to the list of pstamp hosts.
• 14:07 restarted stdscience, pstamp, summitcopy, distribution and registration pantasks.
• 14:15 started up pantasks ~ippsky/sas-pantasks using 2 x hosts.detrend. Set 2 sets of s0, s1, s2, and s3 to off in stdscience
• 20:07 pstamp processing is overloading ippc30 (8 x finish running together). Turned dependency checking off for now. Removed the storage nodes as well.

Saturday : 2014-04-05

Sunday : 2014-04-06