IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changes between Version 32 and Version 33 of IPP_Current_Tasks


Ignore:
Timestamp:
Jan 19, 2010, 9:00:07 AM (16 years ago)
Author:
eugene
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • IPP_Current_Tasks

    v32 v33  
    44(Up to [wiki:WikiStart Main Page])
    55
    6 == KPAT / DRAVG Priority Issues (+ Notes) ==
     6== Tasks for the Immediate Future ==
    77
    8  * latency
    9   * we have performed a [wiki:ThroughputDemo_20091104 throughput demonstration] which meets requirements.
    10 
    11  * magic masking
    12   * the latest large-scale run had a median streak count of 8.
    13   * we need to make an assessment of the current state of masking by masking bit (both warp and chip)
    14     * Heather has made an initial assessment of the masking using ~100 individual chips and warps.  '''If this was done for 100 chip Files (not chip Runs) and equivalently for warps, then we need more statistics to say something useful.'''
    15 
    16  * stacking: noise correlation
    17   * we believe this has been addressed by Paul's recent work
    18     * '''we need an independent assessment if this is still an issue'''
    19   * Nigel is concerned about the photometry of psfs in the stacks
    20     * Nigel and Paul have both been investigating the situation.  Some conclusions:
    21       1. the latest version of the code (eg, stack_id 25532) results in scatter in psf magnitudes which are larger than the warp-warp photometry (0.04 vs 0.03).
    22       2. the aperture magnitudes seem to be in better agreement, which says the pixels are probably OK
    23       3. Paul started to use simtest to verify the quality of the pixel photometry
    24 
    25  * diff images: residuals and noise correlation
    26   * we have made some good progress on this with the dual convolution technique, and will generate a set of test images this week.
    27     * ''' this is critical''' : as of 2009/11/23 this has not been done
    28   * another significant source of residuals comes from poor astrometry
    29     * Gene has investigated the astrometry failures and improved the analysis (outlier clipping).  Also, several cases of poor astrometry resulted from stars being falsely identified as cosmic rays and the wings being used in the fit instead.  this should now be fixed in psphot.
    30   * we also also working on improving the quality of the detection analysis and the associated photometry in the diff images
    31     * Gene will be making this top priority again week of 2009/11/23 (this has been on the back burner while the astrometry issues were studied)
    32 
    33  * astrometry: some catastrophic failures (offsets>3")
    34   * some progress made in some extreme fields (M42). this may also result in improvements in other poor situations.  otherwise under investigation.
    35   * Gene has included a number of fixes.  there is a bit more work to make sure the warps do not use poor astrometry results.
    36 
    37  * xtalk artifacts.
    38   * for the near term, we will address this by masking the worst offenders in the camera masking stage.
    39   * still need to pin down the xtalk rules, but we can implement the xtalk we know.
    40   * as of 2009/11/23, this xtalk masking has been implemented by Chris, but with only limited testing to date.
    41   * Mark Huber says (preliminarily) it is looking '''good'''
    42  
    43  * other image artifacts.
    44 
    45  * photometric calibration
    46    * the zero point is now being calculated from the 'blue edge' of the ref - raw magnitude distribution to reduce the impact of halo stars.  The error analysis is now done using bootstrap-resampling, but this can only tell us about the random errors, not the systematic errors from field-to-field.
    47 
    48  * star/galaxy separation
    49    * Eddie has made some plots of the quality of the current S/G flag: [wiki:PS1_rates].  The rules still need to be tweaked.
    50 
    51 == Other Near-Term Goals ==
    52 
    53  * address warp failures (photometry problem on 3 warps in throughput test)
    54  * someone needs to put together code that feeds back quality info to summit
    55 
    56  * make white light dome flats (including w)
    57  * make new flat-field corrections
    58  * make new masks
    59  * iterate on the darks
     8 * update pmFPAGenerateMasks to treat a missing GAIN as 1.0, not nan.
     9 * re-run dark analysis
     10 * generate master flats from new flat data
     11 * run darkmask and flatmask
     12 * update masks manually (all hands on deck)
     13 * commit psphot changes fixing CR masking segfaults
     14 * tweak source size parameters
     15 * merge branches/eam_branch/20091201 into trunk
    6016
    6117=== Eugene Magnier ===
     
    13086 * move homedirs to ippc18
    13187 * areca scripts for automatic verify
     88
     89== KPAT / DRAVG Priority Issues (+ Notes) ==
     90
     91 * latency
     92  * we have performed a [wiki:ThroughputDemo_20091104 throughput demonstration] which meets requirements.
     93
     94 * magic masking
     95  * the latest large-scale run had a median streak count of 8.
     96  * we need to make an assessment of the current state of masking by masking bit (both warp and chip)
     97    * Heather has made an initial assessment of the masking using ~100 individual chips and warps.  '''If this was done for 100 chip Files (not chip Runs) and equivalently for warps, then we need more statistics to say something useful.'''
     98
     99 * stacking: noise correlation
     100  * we believe this has been addressed by Paul's recent work
     101    * '''we need an independent assessment if this is still an issue'''
     102  * Nigel is concerned about the photometry of psfs in the stacks
     103    * Nigel and Paul have both been investigating the situation.  Some conclusions:
     104      1. the latest version of the code (eg, stack_id 25532) results in scatter in psf magnitudes which are larger than the warp-warp photometry (0.04 vs 0.03).
     105      2. the aperture magnitudes seem to be in better agreement, which says the pixels are probably OK
     106      3. Paul started to use simtest to verify the quality of the pixel photometry
     107
     108 * diff images: residuals and noise correlation
     109  * we have made some good progress on this with the dual convolution technique, and will generate a set of test images this week.
     110    * ''' this is critical''' : as of 2009/11/23 this has not been done
     111  * another significant source of residuals comes from poor astrometry
     112    * Gene has investigated the astrometry failures and improved the analysis (outlier clipping).  Also, several cases of poor astrometry resulted from stars being falsely identified as cosmic rays and the wings being used in the fit instead.  this should now be fixed in psphot.
     113  * we also also working on improving the quality of the detection analysis and the associated photometry in the diff images
     114    * Gene will be making this top priority again week of 2009/11/23 (this has been on the back burner while the astrometry issues were studied)
     115
     116 * astrometry: some catastrophic failures (offsets>3")
     117  * some progress made in some extreme fields (M42). this may also result in improvements in other poor situations.  otherwise under investigation.
     118  * Gene has included a number of fixes.  there is a bit more work to make sure the warps do not use poor astrometry results.
     119
     120 * xtalk artifacts.
     121  * for the near term, we will address this by masking the worst offenders in the camera masking stage.
     122  * still need to pin down the xtalk rules, but we can implement the xtalk we know.
     123  * as of 2009/11/23, this xtalk masking has been implemented by Chris, but with only limited testing to date.
     124  * Mark Huber says (preliminarily) it is looking '''good'''
     125 
     126 * other image artifacts.
     127
     128 * photometric calibration
     129   * the zero point is now being calculated from the 'blue edge' of the ref - raw magnitude distribution to reduce the impact of halo stars.  The error analysis is now done using bootstrap-resampling, but this can only tell us about the random errors, not the systematic errors from field-to-field.
     130
     131 * star/galaxy separation
     132   * Eddie has made some plots of the quality of the current S/G flag: [wiki:PS1_rates].  The rules still need to be tweaked.
     133
     134== Other Near-Term Goals ==
     135
     136 * address warp failures (photometry problem on 3 warps in throughput test)
     137 * someone needs to put together code that feeds back quality info to summit
     138
     139 * make white light dome flats (including w)
     140 * make new flat-field corrections
     141 * make new masks
     142 * iterate on the darks