IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changes between Version 64 and Version 65 of IPP_Current_Tasks


Ignore:
Timestamp:
Apr 12, 2010, 8:52:18 AM (16 years ago)
Author:
eugene
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • IPP_Current_Tasks

    v64 v65  
    33
    44(Up to [wiki:WikiStart Main Page])
     5
    56([wiki:IPP_Completed_Tasks] Recently completed tasks)
     7
     8([wiki:DRAVG_Concerns DRAVG Issues and Concerns)
    69
    710== Notes from WBS entries ==
     
    6265   * better targeting of data to nodes
    6366   * more regular operations schedule - procesing czar
    64    * better tolls for examining current state (more ippMon? more other tools?)
    65 
    66  * current operations tasks
    67    * nightly processing
    68    * Run 5c
    69    * M31
    70      * make uncorrected deep stack
    71      * diffs relative to deep stack (needs to update magic)
    72      * restored warps
     67   * better tools for examining current state (more ippMon? more other tools?)
    7368
    7469 * current dev tasks
    7570   * addstar imports from UKIDSS & SDSS
    76    * optmize dvo image lookups
     71   * optimize dvo image lookups
    7772
    7873 * cluster management
    79    * automate deletion of extra diff images
    8074   * automate cleanups of un-destreaked images
    8175   * define reboot procedure
    8276 
    8377 * psphot work:
    84   * update the CR masking code
    85   * add psphot stats on for dipoles
    8678  * 'scale error' in stacks
    87   * limit max source detections is psphot
     79  * limit max source detections in psphot
    8880
    8981 * write ups
     
    9486
    9587 * email regarding data requests
    96  * DVO image indexes / relastro optimization
     88
    9789 * binned 4x4 mask for ken
    9890 * extended sources
     
    10597=== Heather Flewelling ===
    10698
    107  * more tests of ISP photometry and astrometry
    10899 * set up ISP nightly processing (to camera stage only)
    109100 * double-check output headers (try Chris' script)
     
    122113=== Paul Price ===
    123114
    124  1. send email about SAS stack reprocessed stack
    125  1. investigate camera-failure reprocessing needs
    126  1. Automated deletion of diff convolved images
     115 1. missing MOPS detections
     116 1. update publish for MOPS (use PS1_DV1 CMF format and include moments)
     117 1. Pipeline for uncorrected data
    127118 1. Implement ippdb/ippTools/ippTasks for stackphot
    128  1. Pipeline for uncorrected data
    129119
    130120 * pay attention to stack, diff, warps failures
     
    136126
    137127 * fix warptool blockage
    138  * processing czar
    139128 * postage stamp server
    140129  * stamps from cleaned runs - write tasks for detecting update completion - 1 week
     
    149138=== Chris Waters ===
    150139
    151  * post detrend bundles
    152140 * finish the pstamp integration of detectability
    153141 * queue rawExp compressions -- need more rawExp to compress
     
    163151 * try neb-hosts with Chris
    164152 * work with Bill Sweeney to get otis
    165 
    166 == KPAT / DRAVG Priority Issues (+ Notes) ==
    167 
    168  * latency
    169   * we have performed a [wiki:ThroughputDemo_20091104 throughput demonstration] which meets requirements.
    170 
    171  * magic masking
    172   * the latest large-scale run had a median streak count of 8.
    173   * we need to make an assessment of the current state of masking by masking bit (both warp and chip)
    174     * Heather has made an initial assessment of the masking using ~100 individual chips and warps.  '''If this was done for 100 chip Files (not chip Runs) and equivalently for warps, then we need more statistics to say something useful.'''
    175 
    176  * stacking: noise correlation
    177   * we believe this has been addressed by Paul's recent work
    178     * '''we need an independent assessment if this is still an issue'''
    179   * Nigel is concerned about the photometry of psfs in the stacks
    180     * Nigel and Paul have both been investigating the situation.  Some conclusions:
    181       1. the latest version of the code (eg, stack_id 25532) results in scatter in psf magnitudes which are larger than the warp-warp photometry (0.04 vs 0.03).
    182       2. the aperture magnitudes seem to be in better agreement, which says the pixels are probably OK
    183       3. Paul started to use simtest to verify the quality of the pixel photometry
    184 
    185  * diff images: residuals and noise correlation
    186   * we have made some good progress on this with the dual convolution technique, and will generate a set of test images this week.
    187     * ''' this is critical''' : as of 2009/11/23 this has not been done
    188   * another significant source of residuals comes from poor astrometry
    189     * Gene has investigated the astrometry failures and improved the analysis (outlier clipping).  Also, several cases of poor astrometry resulted from stars being falsely identified as cosmic rays and the wings being used in the fit instead.  this should now be fixed in psphot.
    190   * we also also working on improving the quality of the detection analysis and the associated photometry in the diff images
    191     * Gene will be making this top priority again week of 2009/11/23 (this has been on the back burner while the astrometry issues were studied)
    192 
    193  * astrometry: some catastrophic failures (offsets>3")
    194   * some progress made in some extreme fields (M42). this may also result in improvements in other poor situations.  otherwise under investigation.
    195   * Gene has included a number of fixes.  there is a bit more work to make sure the warps do not use poor astrometry results.
    196 
    197  * xtalk artifacts.
    198   * for the near term, we will address this by masking the worst offenders in the camera masking stage.
    199   * still need to pin down the xtalk rules, but we can implement the xtalk we know.
    200   * as of 2009/11/23, this xtalk masking has been implemented by Chris, but with only limited testing to date.
    201   * Mark Huber says (preliminarily) it is looking '''good'''
    202  
    203  * other image artifacts.
    204 
    205  * photometric calibration
    206    * the zero point is now being calculated from the 'blue edge' of the ref - raw magnitude distribution to reduce the impact of halo stars.  The error analysis is now done using bootstrap-resampling, but this can only tell us about the random errors, not the systematic errors from field-to-field.
    207 
    208  * star/galaxy separation
    209    * Eddie has made some plots of the quality of the current S/G flag: [wiki:PS1_rates].  The rules still need to be tweaked.
    210 
    211 == Other Near-Term Goals ==
    212 
    213  * address warp failures (photometry problem on 3 warps in throughput test)
    214  * someone needs to put together code that feeds back quality info to summit
    215 
    216  * make white light dome flats (including w)
    217  * make new flat-field corrections
    218  * make new masks
    219  * iterate on the darks