IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changes between Version 10 and Version 11 of IPP_Progress_Report_20111003


Ignore:
Timestamp:
Oct 10, 2011, 3:32:09 PM (15 years ago)
Author:
watersc1
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • IPP_Progress_Report_20111003

    v10 v11  
    5757
    5858=== Chris Waters ===
    59 
     59 * SAS: distribute SAS2 z-band synthetic reference catalog.  This was forgotten before.
     60 * Offnight diffs: correct data_group for offnight diffs, and implement minimum time difference check to force offnight diffs to truly come from different nights.
     61 * Diskspace:
     62   * Implement neb-repair to attempt to repair a nebulous object that has inconsistent md5sums.  Added this to chip_imfile.pl to allow the script to attempt to fix problems internally without faulting.  This seems to have been largely successful, and has decreased the number of times manual intervention is needed to keep LAP processing moving.
     63   * Confirmed that the targetting shuffle is working correctly, and is freeing space on the wave2/wave3 storage nodes.  Reworked shuffle to enhance the amount of free space created on these nodes by preventing the targetting from moving new imfiles to these nodes and instead focus on moving to the upgraded wave1 nodes.  Added calls to neb-repair to increase the success rate at the shuffle, as it corrects missing copies and forces the ATRC computers to respond correctly.
     64   * The combination of these two improvements has filled ippb02, so steps need to be taken to resolve this.
     65 * Processing:
     66   * Transferred processing power between distribution and stack to allow the number of stacks completed per hour to match the number of stacks LAP processing seems to be capable of generating.  This has had minimal effect on the distribution stage processing, as that still shows a plateauing in the number of runs completed.  We are probably therefore still overpowered in distribution, but this allows us to catch up after it falls behind.
     67 * LAP:
     68   * Defined new regions for LAP to work on when the current set is finished.
     69   * Increased the number of LAP runs processing at the same time.  This increases the disk footprint somewhat, but allows runs to get stuck without stopping all LAP processing.