Changes between Version 34 and Version 35 of MD.PV3

Timestamp:

Jan 28, 2015, 6:39:27 PM (12 years ago)

Author:

Mark Huber

Comment:

--

MD.PV3

@@ -5 +5 @@
  * [wiki:MD.GR0] summary page -- summary of all reprocessing details and 2011/2012 refstack and some deepstack samples 
  * [wiki:MD.PV1] summary page -- the data set that PV2 update reprocessing is based on
- * [wiki:MD.PV2] summary page -- update type reprocessing
+ * [wiki:MD.PV2] summary page -- update type reprocessing version (pixels remade, PV1 camera detections used), stack photometry on new stacks
+ * [wiki:MD_stack_types] summary page -- general guidelines for the stack types
+ * [wiki:MD.pv2.iqdeepNtest.20140720] data sample page -- two skycells (edge, center annulus) in MD04 in grizy as a test case for stacks spanning ~15 input stack through an all exposure input stack
 
 This is a summary of the MD.PV3 full pixel reprocessing. Start date and schedule a mess with the unstable processing 12/01/2014. 
 
-This processing will also involve other MD-like fields, including CNP (M31 and STS if time allows). Each field can be similar and different to the typical MD criteria for the stacks and diffims, summary '''TBD'''.
+This processing will also involve other MD-like fields, including CNP (M31 and STS if time allows). Each field can be similar and different to the typical MD criteria for the stacks and diffims, summaries 
+ * [wiki:MD.PV3-MDnotes]
+ * [wiki:MD.PV3-CNPnotes]
 
 ___General Summary Status:___
@@ -189 +193 @@
  * config reorganization or specific PV3 named ones to create -- all configs must have PV3 to avoid confusion
  * chip-camera-warp:
-  * check if refcat oddities in field is a problem -- Eddie and Doug catalogs to compare still
+  * check if refcat oddities in field is a problem -- Eddie and Doug catalogs to compare to
   * new refcat astrometry and zeropoint verification tests -- 
   * CNP tessellation check -- 
+  * MD as a targeted and utilized throughout the survey needs to have a summary of exposures changed/lost in PV3
   * background restore M31 and masking for M31/STS -- test samples to be run and verified for final version
  * stack  
   * stack quality fault -- sometime edge skycells fault w/ internal photometry/PSF error on the convolved stack and do not want to lose for staticsky or diffims -- 
-  * night stack config, refstack edge loss -- see diffim as well -- 
-  * ref+deep stack input cuts -- need feedback on if 2009 and or early 2010 data is okay to use -- 2009 is not great data so not to be used, Jan/June 2010 is still under consideration if the baffle is critical or not.
-  * iq+ref+deep test stacks for CNP,M31,STS and to verify Nin, input cuts, pixel rejection and minimum pixel limits -- 
+  * night stack config, refstack edge loss -- see diffim for as well -- comparison to PV2 and earlier datasets
+  * reference, deep stack input cuts -- need feedback on if 2009 and or early 2010 data is okay to use -- 2009 is not great data so not to be used, Jan/June 2010 is still under consideration if the baffle is critical or not.
+  * iq, reference, deep test stacks for CNP (M31,STS) and to verify Nin, input cuts, pixel rejection and minimum pixel limits -- 
  * staticsky/skycal
   * stack photometry sky oddities -- 
-  * check refcat oddities in the MD fields --
-  * zeropt recalib in skycal improvement and characterization (y-band at least needs own config) -- 
-  * test samples for CNP,M31,STS -- equivalent stacks in available filters vs deeper in primary filter, single filter only for STS/M31 so no extended source fits?
+  * check refcat oddities in the MD fields for skycal re-zeropointing
+  * zeropt recalibration in skycal improvement and characterization (y-band at least may need own config) -- 
+  * evaluate test samples for CNP (M31,STS) -- equivalent stacks in available filters vs deeper in primary filter, single filter only for STS/M31 so no extended source fits?
  * diffim
   * verify similar photometry to previous reductions -- 
-  * verify similar detections/coverage (no sig loss on edges) -- really a key point for reference stack creation above as well
-  * test samples for CNP,M31,STS -- 
+  * verify similar detections/coverage (no sig loss on edges) -- a key point for reference stack creation above 
+  * evaluate test samples for CNP (M31,STS) -- 
  * full-forced photometry -- unknown, untested still for any MD type field
 
@@ -215 +220 @@
 
 === chip--camera--warp ===
-Should be started ASAP, so that the warps are available for some early testing of the stacks and diffims.
-
-Testing necessary for the M31, STS and CNP processing still -- priority for CNP as last reprocessing was ~2011
+
+Should be started ASAP, so that the warps are available for some early testing of the stacks and diffim processing.
+
+Testing necessary for the M31, STS and CNP processing still -- priority for CNP as last reprocessing was ~2011. 
 
 ----
@@ -254 +260 @@
  * ipps03 -- ~ippmd/stack -- lower memory, faster running iq, night and probably reference stacks 
 
-host groups --
+host groups -- nodes that specifically have to be used for deep stack processing
  * m0 = ipps00--s04 (12 core, 144G, very efficient machines)
  * m1 = ipps05--s14 ((12 core, 96G, very efficient machines)