Changes between Version 2 and Version 3 of 3pi.pv1.calibrationextraction

Timestamp:

Aug 9, 2013, 10:53:59 AM (13 years ago)

Author:

bills

Comment:

--

3pi.pv1.calibrationextraction

@@ -3 +3 @@
 The IPP now contains tables for tracking the data is contained in each "release" of IPP data. 
 This process is described [wiki:ippReleaseManagement here]
+
+This system includes a place to record the results of the photometric calibration for individual
+exposures in the GPC1 database. This is used by the IPP postage stamp server to find these
+data for inclusion in the fits headers for single frame images.
+
+The process for updating the database includes a few manual steps that are described in this note.
+
+== DVO calibration ==
+The release is calibrated using the DVO programs setphot, relphot, and relastro.
+
+ * setphot takes the zero points and flat field corrections measured in the ubercal process and updates the DVO Images table.
+ * relphot does the photometric calibration
+ * relastro performs the astrometric calibration
+
+Once this is is done all of the exposure level calibration is saved in the DVO fits table Images.dat. For single frame
+images there is one entry for each chip. Up to 60 per exposure. The exposure level zero points are saved in all of the
+chips for a given exposure.
+
+For 3PI.PV1 the DVO used for calibration was LAP.ThreePi.20120706.v2. The data was extracted on 2013-07-31 using ftlist into the files in
+/data/ippc30.1/bills/3pi.pv1.calibration. The scripts used have been saved in the ipp trunk in the directory releasecalib/scripts.
+
+{{{
+ftlist columns=NAME,MCAL,DMCAL,SECZ,EXPTIME,TZERO,PHOTCO,FLAGS,UBERCAL_DIST /data/ipp060.0/gpc1/catdir/LAP.ThreePi.20120706.v2/Images.working.dat T > Images.working.txt
+}}}
+
+The resulting file has a row for each image. The extractinfo was used to skip stacks and select a single row for each exposure. The row used was the first one
+found with flags & 0x62 XXX list flags, if any. If no images had zero values for these flags the last image was used. (Subsequently it was verified that all rows
+have the same values for the paramters except for FLAGS).
+
+
+{{{
+perl extractinfo < Images.working.txt > 3pi.pv1.calibration.txt
+}}}
+
+The output file contained 1 row for each exposure with the follwoing columns 
+{{{
+exp_name     exp_id  cam_id    zpcalib      zpcalerr        mcal     filter     flags   ubercal_dist
+}}}
+
+Finally these data were saved in the gpc1 database using 
+
+{{{
+perl updatecalib 3pi.pv1.calibration.txt >& updatecalib.log
+}}}
+
+Exposure Counts for 3PI.PV1 (relExp.rel_id = 2)
+
+{{{
+Total Rows          224597
+Calibrated          211793
+
+Not Calibrated       12804
+Towards Pole          3492
+Galactic Center       8250
+
+}}}
+