Changes between Version 2 and Version 3 of PS1_Science_Processing_Status_20090705

Timestamp:

Jul 7, 2009, 11:58:58 AM (17 years ago)

Author:

eugene

Comment:

--

PS1_Science_Processing_Status_20090705

@@ -2 +2 @@
 
 The PS1 Science Consortium has directed us to process a substantial amount of data for fast release, regardless of the data loss rate due to Magic mask.  We have started with the 3 Medium Deep fields observed heavily since April: MD06, MD07, and MD08.
+
+== Data in First Release ==
+
+The first big batch of data from 3 Medium Deep fields should be available for download a bit later today (2009.07.07).  This first set will consist of the
+June exposures from MD06, MD07, and MD08 (raw, chip, warp, diff) and the stacks used to generate the diffs.  For this set of data,
+Paul Sydney has examined the magic results and certified the data to be released.  There is a small number of images (7 or 8) which did not
+pass -- streaks leaked through -- and we will hold off on those until we can understand what happened (and mask them).  The April and May
+data for these fields will be available soon -- the data has been processed, but we need a pass from Paul Sydney.
+
+The June data consists of about 420 exposures.  April and May together add up to about 300 more exposures.
+
+For the purpose of managing the data transfer, Consortium sites need to register with the IPP team what portions of the data they would like to download.  
+
+Consortium sites may request data from  people request any of the
+following 4 image sets, with the given typical sizes for the image and
+variance (does not exist for the raw data, of course):
+
+|| Processing Stage    || Image Data per Exposure     || Download Options  ||
+|| Raw Data            || ~1.5GB                      || Images or DB Tables Only ||
+|| Chip (Detrended)    || ~3.6GB (images + variance)  || Images or DB Tables Only ||
+|| Camera (Calibrated) || ~0.0GB (masks only)         || Detection files, logs ||
+|| Warp                || ~6.0GB (images + variance)  || ||
+|| Diff                || ~5.6GB (images + variance)  || || 
+|| Stack               || ~6.0GB per field per filter || ||
+
+Except for the images and the variance images, the other data products (including the masks) are a small fraction of the image data value (< 5%). 
+
+The full June data set is about 420*(1.8 + 3.6 + 6 + 5.6) = 7TB. April + May will be another 5TB.
+
+Institutions may register for subsets of the data, and may request
+(for example) to receive the detection files from the detrend chip
+stage, but no pixels, and all detections and pixels for the difference
+stage.
+
 
 == Summary of Data ==