Changes between Version 623 and Version 624 of MD.GR0

Timestamp:

Feb 6, 2013, 2:40:11 PM (13 years ago)

Author:

Mark Huber

Comment:

--

MD.GR0

@@ -275 +275 @@
 || '''MD''' || '''Reference Stack''' || '''Deep Stack''' || '''Night Stack''' || '''Refstack Phot''' || '''Deep Phot''' || '''Night Phot''' || '''Camera/SMFs'''  || '''for PSPS''' || 
 || || || || || || || || || || 
-|| 01 || 20110820 (U) || X || done (mixed) || MD01.refstack.20120803.Nx20130115, .cal20130128 || x || x || done (mixed) || SMF+ref phot ''TBD'' ||
-|| 02 || 20110907 (U) || X || done (mixed) || staticsky+skycal 20120805 || x || x || done (mixed) || SMF+ref phot ''TBD'' ||
-|| 03 || 20111010 (U) || X || done (mixed) || staticsky+skycal 20120805 || x || x || done (mixed) || SMF+ref phot ''TBD'' ||
-|| 04 || 20111012 (U) || deeptest.20120727 || done || staticsky+skycal 20120805 || staticsky+skycal 20120806  || ''TBD'' || done || SMF+ref+deep+night phot ''TBD'' (secondary) ||
-|| 05 || 20111014 (U) || X || done (mixed+full) || staticsky+skycal 20120805 || x || x || done (mixed) || SMF+ref phot ''TBD'' ||
-|| 06 || 20111122 (U) || X || done || staticsky+skycal 20120805 || x || x || done || SMF+ref phot ''TBD'' ||
-|| 07 || 20111106 (U) || X || done || staticsky+skycal 20120805 || x || x || done || SMF+ref phot ''TBD'' ||
-|| 08 || 20120422 || X || done || staticsky+skycal 20120805 || x || x || done || SMF+ref phot ''TBD'' ||
-|| 09 || 20120831 (R) || deeptest.20120727 || done  || staticsky+skycal 20120805 || staticsky+skycal 20120806  || done || done || SMF+ref+deep+night phot  (primary) ||
-|| 10 || 20110821 (U) || X || done || staticsky+skycal 20120805 || x || x || done || SMF+ref phot ''TBD'' ||
+|| 01 || 20110820 (U) || X || done (mixed) || .20120803.Nx20130115, .cal20130128 || x || x || done (mixed) || SMF+ref phot ''TBD'' ||
+|| 02 || 20110907 (U) || X || done (mixed) || .20120927.Nx20130115,.cal20130128 || x || x || done (mixed) || SMF+ref phot ''TBD'' ||
+|| 03 || 20111010 (U) || X || done (mixed) || .20111010.Nx20130115,.cal20130128 (I) || x || x || done (mixed) || SMF+ref phot ''TBD'' ||
+|| 04 || 20111012 (U) || deeptest.20120727 || done || .20111012.Nx20130115,.cal20130128  || Nx20130114.cal20130128  || ''TBD'' || done || SMF+ref+deep+night phot ''TBD'' (secondary) ||
+|| 05 || 20111014 (U) || X || done (mixed+full) || .20111014.Nx20130115,.cal20130128 (I) || x || x || done (mixed) || SMF+ref phot ''TBD'' ||
+|| 06 || 20111122 (U) || X || done || .20111122.Nx20130115,.cal20130128 || x || x || done || SMF+ref phot ''TBD'' ||
+|| 07 || 20111106 (U) || X || done || .20111106.Nx20130115,.cal20130128 || x || x || done || SMF+ref phot ''TBD'' ||
+|| 08 || 20120422 || X || done || .20120422.Nx20130115,.cal20130128 || x || x || done || SMF+ref phot ''TBD'' ||
+|| 09 || 20120831 (R) || deeptest.20120727 || done  || .20120831.Nx20130115,.cal20130128 || Nx20130114.cal20130128  || .1x20120926rawtest, .cal20130128  || done || SMF+ref+deep+night phot  (primary) ||
+|| 10 || 20110821 (U) || X || done || .20120804.Nx20130115,.cal20130128  || x || x || done || SMF+ref phot ''TBD'' ||
 || 11 || not reprocessed in MD.GR0
 || || || || || || || || || || 
@@ -297 +297 @@
  * 20YYMMDD date entries are part of the data_group name to access via the PSS or Datastore, i.e., 
   * stacks -- MD01.refstack.20110820, MD09.deeptest.20120727 
-  * night stacks a mix of label, data_group formats -- see specific section
-  * stack photometry -- originally the same date 20120805, but revised runs now have dates for each in the form staticsky x20YYMMMDD and skycal cal20YYMMDD
- * (U) updated -- new 2012/2013 versions exist for these refstack now (see [wiki:MediumDeepFields] but not necessarily used with staticsky/skycal for loading into PSPS (original MD.GR0 may be deeper and better to use). Newer refstack used is indicated in the Stack Photometry column
+  * night stacks -- a mix of label, data_group formats, see specific section
+  * stack photometry -- originally the same date 20120805, but revised runs now have dates for each in the form adding for staticsky .<#>x20YYMMMDD and skycal .cal20YYMMDD.
+ * (U) updated -- new 2012/2013 versions exist for these refstack now (see [wiki:MediumDeepFields]) but not necessarily used for stack photometry (staticsky/skycal) for loading into PSPS (original MD.GR0 may be deeper and better to use). The refstack used is indicated in the Stack Photometry column. All updated refstacks of course use the ubercal catalog for calibration.
  * (R) replaced -- MD09.refstack.20120603 replaced by 20120831 due to variance problems.
- * (mixed), (full)
+ * (I) incomplete -- for MD03, 05 stack photometry stalled while data disks being shuffled..
+ * (mixed)
   * finish reprocessing all exposures to V3 for warp/nightly stack for MD01+02+03+05 =840+609+1286+1115 = 3850 (2-3 full days of --only-- MD processing) -- finished 12/30/13
   * (mixed) -- both camera/SMF and night stacks can have calibrations based on the synthetic catalogs (initial sample run) and ubercal catalogs (finish V3 run).  See specific section for detail.
-  * MD05 (mixed+full) -- some older and newer processing, so mix of magic and photometry catalog used and then a re-reprocessing of MD05 was done on the exposures originally processed with synthetic catalog. See [wiki:MD.GR0#MD05.GR0extrareprocessedsetwithallubercalcatalog]
+  * (mixed+full) -- MD05 -- some older and newer processing, so mix of magic and photometry catalog used and then a re-reprocessing of MD05 was done on the exposures originally processed with synthetic catalog. See [wiki:MD.GR0#MD05.GR0extrareprocessedsetwithallubercalcatalog]
  * stacks
   * out-of-season/anti-yearly refstacks, yearly refstack: on hold for MD.GR1 (would need to update/reprocess large numbers of exposures to do).
   * iq/psf stack on hold until MD.GR1 (like out-of-season, would required many updates) -- should do for MD04,MD09 and requires development/code time.
-  * deep stack for MD04,09 for MD.GR0 only, all others on hold until MD.GR1 (many many updates..).
+  * deep stack for MD04,09 for MD.GR0 only, all others on hold until MD.GR1 (many many updates would be necessary..).
  * reminder that ubercal of pixels start with MD08 in the date sequence, finished processing of MD01,02,03,05 exposures into V3 will also be ubercal'd (including reprocessing of any needed to make the complete nightly stacks)
  
@@ -315 +316 @@
 __Questions__:
  * background restored warps/stacks?
- * SMF loaded into PSPS limited to just the ones used in the refstack (or deepstack if available) or all SMF?
+ * SMF loaded into PSPS limited to just the ones used in the refstack (or deepstack if available) or all available exposures Camera/SMFs?
  * MD01,10 have new refstack for this season, need to decide if using for phot+PSPS (limited set of exposures reprocessed recently to make)?  Or use as update test for PSPS?
- * MD09.refstack.20120603 suffers from the weight image problem making an arc of lower sensitivity, but warps are still available for doing the deep stacks.  4-6 hrs/skycell to run, ~300 skycells, deepstack pantasks typically has 30 nodes, so ~2-3 days processing time, redo? -- yes, since MD09 is a new test/comparison set with SAS -- done and date updated under refstack
+ * MD09.refstack.20120603 suffers from the weight image problem making an arc of lower sensitivity, but warps are still available for doing the deep stacks.  4-6 hrs/skycell to run, ~300 skycells, deepstack pantasks typically has 30 nodes, so ~2-3 days processing time, then redo? -- yes, since MD09 is a new test/comparison set with SAS -- done and date updated under refstack as MD09.refstack.20120831