| | 62 | = Summary plan for finishing MD.GR0 through end of 2012 = |
| | 63 | (last update Jan. 30, 2013) |
| | 64 | |
| | 65 | || '''MD''' || '''Reference Stack''' || '''Deep Stack''' || '''Night Stack''' || '''Refstack Phot''' || '''Deep Phot''' || '''Night Phot''' || '''Camera/SMFs''' || '''for PSPS''' || |
| | 66 | || || || || || || || || || || |
| | 67 | || 01 || 20110820 (U) || X || done (mixed) || .20120803.Nx20130115, .cal20130128 || x || x || done (mixed) || SMF+ref phot ''TBD'' || |
| | 68 | || 02 || 20110907 (U) || X || done (mixed) || .20120927.Nx20130115, .cal20130128 || x || x || done (mixed) || SMF+ref phot ''TBD'' || |
| | 69 | || 03 || 20111010 (U) || X || done (mixed) || .20111010.Nx20130115, .cal20130128 (I) || x || x || done (mixed) || SMF+ref phot ''TBD'' || |
| | 70 | || 04 || 20111012 (U) || deeptest.20120727 || done || .20111012.Nx20130115, .cal20130128 || .Nx20130114, .cal20130128 || ''TBD'' || done || SMF+ref+deep+night phot ''TBD'' (secondary) || |
| | 71 | || 05 || 20111014 (U) || X || done (mixed+full) || .20111014.Nx20130115, .cal20130128 (I) || x || x || done (mixed) || SMF+ref phot ''TBD'' || |
| | 72 | || 06 || 20111122 (U) || X || done || .20111122.Nx20130115, .cal20130128 || x || x || done || SMF+ref phot ''TBD'' || |
| | 73 | || 07 || 20111106 (U) || X || done || .20111106.Nx20130115, .cal20130128 || x || x || done || SMF+ref phot ''TBD'' || |
| | 74 | || 08 || 20120422 || X || done || .20120422.Nx20130115, .cal20130128 || x || x || done || SMF+ref phot ''TBD'' || |
| | 75 | || 09 || 20120831 (R) || deeptest.20120727 || done || .20120831.Nx20130115, .cal20130128 || .Nx20130114, .cal20130128 || .1x20120926rawtest, .cal20130128 || done || SMF+ref+deep+night phot (primary) || |
| | 76 | || 10 || 20110821 (U) || X || done || .20120804.Nx20130115, .cal20130128 || x || x || done || SMF+ref phot ''TBD'' || |
| | 77 | || 11 || not reprocessed in MD.GR0 |
| | 78 | || || || || || || || || || || |
| | 79 | || || || || || || || || || || |
| | 80 | || || || || || || || || || || |
| | 81 | || M31 || briefly discussed, but likely no |
| | 82 | || STS also likely no || 20120531 (MOPS needs revision) || X || ? || ? || ? || ? || ? || ? || |
| | 83 | || || || || || || || || || |
| | 84 | |
| | 85 | __Notes__: |
| | 86 | * TBD=To Be Decided/Done by priority, X=not planned, ?=unknown at this time |
| | 87 | * 20YYMMDD date entries are part of the data_group name to access via the PSS or Datastore, i.e., |
| | 88 | * stacks -- MD01.refstack.20110820, MD09.deeptest.20120727 |
| | 89 | * night stacks -- a mix of label, data_group formats, see specific section |
| | 90 | * stack photometry -- originally the same date 20120805, but revised runs now have dates for each in the form adding for staticsky .<#>x20YYMMMDD and skycal .cal20YYMMDD. |
| | 91 | * (U) updated -- new 2012/2013 versions exist for these refstack now (see [wiki:MediumDeepFields]) but not necessarily used for stack photometry (staticsky/skycal) for loading into PSPS (original MD.GR0 may be deeper and better to use). The refstack used is indicated in the Stack Photometry column. All updated refstacks of course use the ubercal catalog for calibration. |
| | 92 | * (R) replaced -- MD09.refstack.20120603 replaced by 20120831 due to variance problems. |
| | 93 | * (I) incomplete -- for MD03, 05 stack photometry stalled while data disks being shuffled.. |
| | 94 | * (mixed) |
| | 95 | * finish reprocessing all exposures to V3 for warp/night stack for MD01+02+03+05 =840+609+1286+1115 = 3850 (2-3 full days of --only-- MD processing) -- finished 12/30/13 |
| | 96 | * (mixed) -- both camera/SMF and night stacks can have calibrations based on the synthetic catalogs (initial sample run) and ubercal catalogs (finish V3 run). See specific section for detail. |
| | 97 | * (mixed+full) -- MD05 -- some older and newer processing, so mix of magic and photometry catalog used and then a re-reprocessing of MD05 was done on the exposures originally processed with synthetic catalog. See [wiki:MD.GR0#MD05.GR0extrareprocessedsetwithallubercalcatalog] |
| | 98 | * stacks |
| | 99 | * out-of-season/anti-yearly refstacks, yearly refstack: on hold for MD.GR1 (would need to update/reprocess large numbers of exposures to do). |
| | 100 | * iq/psf stack on hold until MD.GR1 (like out-of-season, would required many updates) -- should do for MD04,MD09 and requires development/code time. |
| | 101 | * deep stack for MD04,09 for MD.GR0 only, all others on hold until MD.GR1 (many many updates would be necessary..). |
| | 102 | * reminder that ubercal of pixels start with MD08 in the date sequence, finished processing of MD01,02,03,05 exposures into V3 will also be ubercal'd (including reprocessing of any needed to make the complete night stacks) |
| | 103 | |
| | 104 | |
| | 105 | |
| | 106 | __Questions__: |
| | 107 | * background restored warps/stacks? |
| | 108 | * SMF loaded into PSPS limited to just the ones used in the refstack (or deepstack if available) or all available exposures Camera/SMFs? |
| | 109 | * MD01,10 have new refstack for this season, need to decide if using for phot+PSPS (limited set of exposures reprocessed recently to make)? Or use as update test for PSPS? |
| | 110 | * MD09.refstack.20120603 suffers from the weight image problem making an arc of lower sensitivity, but warps are still available for doing the deep stacks. 4-6 hrs/skycell to run, ~300 skycells, deepstack pantasks typically has 30 nodes, so ~2-3 days processing time, then redo? -- yes, since MD09 is a new test/comparison set with SAS -- done and date updated under refstack as MD09.refstack.20120831 |
| | 111 | |
| | 112 | |
| 271 | | |
| 272 | | = Summary plan for finishing MD.GR0 through end of 2012 = |
| 273 | | (last update Jan. 30, 2013) |
| 274 | | |
| 275 | | || '''MD''' || '''Reference Stack''' || '''Deep Stack''' || '''Night Stack''' || '''Refstack Phot''' || '''Deep Phot''' || '''Night Phot''' || '''Camera/SMFs''' || '''for PSPS''' || |
| 276 | | || || || || || || || || || || |
| 277 | | || 01 || 20110820 (U) || X || done (mixed) || .20120803.Nx20130115, .cal20130128 || x || x || done (mixed) || SMF+ref phot ''TBD'' || |
| 278 | | || 02 || 20110907 (U) || X || done (mixed) || .20120927.Nx20130115, .cal20130128 || x || x || done (mixed) || SMF+ref phot ''TBD'' || |
| 279 | | || 03 || 20111010 (U) || X || done (mixed) || .20111010.Nx20130115, .cal20130128 (I) || x || x || done (mixed) || SMF+ref phot ''TBD'' || |
| 280 | | || 04 || 20111012 (U) || deeptest.20120727 || done || .20111012.Nx20130115, .cal20130128 || .Nx20130114, .cal20130128 || ''TBD'' || done || SMF+ref+deep+night phot ''TBD'' (secondary) || |
| 281 | | || 05 || 20111014 (U) || X || done (mixed+full) || .20111014.Nx20130115, .cal20130128 (I) || x || x || done (mixed) || SMF+ref phot ''TBD'' || |
| 282 | | || 06 || 20111122 (U) || X || done || .20111122.Nx20130115, .cal20130128 || x || x || done || SMF+ref phot ''TBD'' || |
| 283 | | || 07 || 20111106 (U) || X || done || .20111106.Nx20130115, .cal20130128 || x || x || done || SMF+ref phot ''TBD'' || |
| 284 | | || 08 || 20120422 || X || done || .20120422.Nx20130115, .cal20130128 || x || x || done || SMF+ref phot ''TBD'' || |
| 285 | | || 09 || 20120831 (R) || deeptest.20120727 || done || .20120831.Nx20130115, .cal20130128 || .Nx20130114, .cal20130128 || .1x20120926rawtest, .cal20130128 || done || SMF+ref+deep+night phot (primary) || |
| 286 | | || 10 || 20110821 (U) || X || done || .20120804.Nx20130115, .cal20130128 || x || x || done || SMF+ref phot ''TBD'' || |
| 287 | | || 11 || not reprocessed in MD.GR0 |
| 288 | | || || || || || || || || || || |
| 289 | | || || || || || || || || || || |
| 290 | | || || || || || || || || || || |
| 291 | | || M31 || briefly discussed, but likely no |
| 292 | | || STS also likely no || 20120531 (MOPS needs revision) || X || ? || ? || ? || ? || ? || ? || |
| 293 | | || || || || || || || || || |
| 294 | | |
| 295 | | __Notes__: |
| 296 | | * TBD=To Be Decided/Done by priority, X=not planned, ?=unknown at this time |
| 297 | | * 20YYMMDD date entries are part of the data_group name to access via the PSS or Datastore, i.e., |
| 298 | | * stacks -- MD01.refstack.20110820, MD09.deeptest.20120727 |
| 299 | | * night stacks -- a mix of label, data_group formats, see specific section |
| 300 | | * stack photometry -- originally the same date 20120805, but revised runs now have dates for each in the form adding for staticsky .<#>x20YYMMMDD and skycal .cal20YYMMDD. |
| 301 | | * (U) updated -- new 2012/2013 versions exist for these refstack now (see [wiki:MediumDeepFields]) but not necessarily used for stack photometry (staticsky/skycal) for loading into PSPS (original MD.GR0 may be deeper and better to use). The refstack used is indicated in the Stack Photometry column. All updated refstacks of course use the ubercal catalog for calibration. |
| 302 | | * (R) replaced -- MD09.refstack.20120603 replaced by 20120831 due to variance problems. |
| 303 | | * (I) incomplete -- for MD03, 05 stack photometry stalled while data disks being shuffled.. |
| 304 | | * (mixed) |
| 305 | | * finish reprocessing all exposures to V3 for warp/night stack for MD01+02+03+05 =840+609+1286+1115 = 3850 (2-3 full days of --only-- MD processing) -- finished 12/30/13 |
| 306 | | * (mixed) -- both camera/SMF and night stacks can have calibrations based on the synthetic catalogs (initial sample run) and ubercal catalogs (finish V3 run). See specific section for detail. |
| 307 | | * (mixed+full) -- MD05 -- some older and newer processing, so mix of magic and photometry catalog used and then a re-reprocessing of MD05 was done on the exposures originally processed with synthetic catalog. See [wiki:MD.GR0#MD05.GR0extrareprocessedsetwithallubercalcatalog] |
| 308 | | * stacks |
| 309 | | * out-of-season/anti-yearly refstacks, yearly refstack: on hold for MD.GR1 (would need to update/reprocess large numbers of exposures to do). |
| 310 | | * iq/psf stack on hold until MD.GR1 (like out-of-season, would required many updates) -- should do for MD04,MD09 and requires development/code time. |
| 311 | | * deep stack for MD04,09 for MD.GR0 only, all others on hold until MD.GR1 (many many updates would be necessary..). |
| 312 | | * reminder that ubercal of pixels start with MD08 in the date sequence, finished processing of MD01,02,03,05 exposures into V3 will also be ubercal'd (including reprocessing of any needed to make the complete night stacks) |
| 313 | | |
| 314 | | |
| 315 | | |
| 316 | | __Questions__: |
| 317 | | * background restored warps/stacks? |
| 318 | | * SMF loaded into PSPS limited to just the ones used in the refstack (or deepstack if available) or all available exposures Camera/SMFs? |
| 319 | | * MD01,10 have new refstack for this season, need to decide if using for phot+PSPS (limited set of exposures reprocessed recently to make)? Or use as update test for PSPS? |
| 320 | | * MD09.refstack.20120603 suffers from the weight image problem making an arc of lower sensitivity, but warps are still available for doing the deep stacks. 4-6 hrs/skycell to run, ~300 skycells, deepstack pantasks typically has 30 nodes, so ~2-3 days processing time, then redo? -- yes, since MD09 is a new test/comparison set with SAS -- done and date updated under refstack as MD09.refstack.20120831 |
