IPP Progress Report for the week 2010.03.29 - 2010.04.02

(Up to IPP Progress Reports)

Eugene Magnier

Heather Flewelling

Bill Giebink

Roy Henderson

• PSPS
  • Loaded yet more simulation data to Maui cluster after changes by Sue at JHU
  • Committed schema changes: some merge issues which took a little time
  • Loaded data on JHU sandbox with new schema: dealing with inevitable issues
  • PSPS meeting regarding PSI interface

• IPP
  • Learned about role of processing czar
  • Finished changes to ippToPsps after PSPS schema change

• Other stuff
  • Root canal surgery on Tuesday
  • Power cut on Wednesday

Paul Price

• SMF file corruption:
  • Sifting through SMF files to identify bad files.
  • Discovered new destreaking bug: some exposures have more than 50 chips masked in SMF, not due to NFS glitches. Occurs when skycell to chip mapping isn't identical between diff inputs. Fixed magicdstool.
• Added code for automated deletion of diff convolved images
• Shepherding M31 and STS data through the pipeline
• Added extra fields to MOPS product
• Chasing down pipeline bugs
  • Discovered pole bug in getstar or astrometric reference catalogue --> Gene
  • Changed psastro to flag exposure as bad quality when astrometry fails (since this will generally be due to there being insufficient stars), to prevent these from being reverted and repeated forever.
  • Marked SweetSpot.nightlyscience chip/cam/warp on TJD5269 as dropped because the camera warmed up (30 degrees!) and some exposures were making psphot go crazy. We need protection in the pipeline against this sort of thing!
  • Little fixes to prevent aborts and assertion failures all over
  • Newton-Raphson method for radius determination in pmModel_PS1_V1.c is failing and producing aborts; fixed by Gene
• Bundled Microtest magic clusters from 2010-03-26 and sent to Camera team
• Queued 4045 gri 3pi exposures from Demo Month for reprocessing; mainly for MOPS
• Discovered that at least some 3pi warp-warp diffs are being done against themselves. These are identifiable by fault=1, due to out-of-bounds variance renormalisation (factors ranging from 0.14 to 0.0003).

Bill Sweeney

• Most of the week was spent being processing shepherd.
  • Recovered STS template warps that were destreaked by mistake.
  • searched for data that can be cleaned up to make room for new processing
  • debugged causes of processing failures and had Paul fix them
  • managed labels and survey task inputs to match the ever changing priorities
  • various changes to the ippTools to help manage data flow.
• Reorganized the way the distribution bundles are distributed over the cluster to avoid uneven use of space.
• Installed test postage stamp server and data store to avoid debugging on the live system.
• Modified the stub detectability query implementation to be compatible with current workflow.
• Half a holiday on Friday.

Chris Waters