| | 1 | This note describes the IPP video cell photometry pipeline or "VP stage". |
| | 2 | |
| | 3 | == VP Run == |
| | 4 | vpRun is the table in the IPP database that is used to manage video cell photometry (VP) processing. When a run is processed all OTAs that contain video cells are processed. A new IPP tool program vptool was written to manage the database operations. Exposures are selected for processing using the command "vptool -definebyquery". The selectors are the same as used for chip processing so a wide range of options is available. |
| | 5 | |
| | 6 | {{{ |
| | 7 | Usage: vptool -definebyquery [<options>] |
| | 8 | |
| | 9 | -definebyquery: |
| | 10 | -exp_id search by exp_id |
| | 11 | -exp_name search by exp_name |
| | 12 | -inst search for camera |
| | 13 | -telescope search for telescope |
| | 14 | -dateobs_begin search for exposures by time (>=) |
| | 15 | -dateobs_end search for exposures by time (<=) |
| | 16 | -exp_tag search by exp_tag |
| | 17 | -exp_type search by exp_type |
| | 18 | -filelevel search by filelevel |
| | 19 | -filter search for filter |
| | 20 | -airmass_min search by min airmass |
| | 21 | -airmass_max search by max airmass |
| | 22 | -ra_min search by min RA (degrees) |
| | 23 | -ra_max search by max RA (degrees) |
| | 24 | -decl_min search by min DEC (degrees) |
| | 25 | -decl_max search by max DEC (degrees) |
| | 26 | -exp_time_min search by min exposure time |
| | 27 | -exp_time_max search by max exposure time |
| | 28 | -sat_pixel_frac_min search by min fraction of saturated pixels |
| | 29 | -sat_pixel_frac_max search by max fraction of saturated pixels |
| | 30 | -bg_min search by min background |
| | 31 | -bg_max search by max background |
| | 32 | -bg_stdev_min search by min background standard deviation |
| | 33 | -bg_stdev_max search by max background standard deviation |
| | 34 | -bg_mean_stdev_min search by min background mean standard deviation (across imfiles) |
| | 35 | -bg_mean_stdev_max search by max background mean standard deviation (across imfiles) |
| | 36 | -alt_min search by min altitude |
| | 37 | -alt_max search by max altitude |
| | 38 | -az_min search by min azimuth |
| | 39 | -az_max search by max azimuth |
| | 40 | -ccd_temp_min search by min ccd tempature |
| | 41 | -ccd_temp_max search by max ccd tempature |
| | 42 | -posang_min search by min rotator position angle |
| | 43 | -posang_max search by max rotator position angle |
| | 44 | -sun_angle_min search by min solar angle |
| | 45 | -sun_angle_max search by max solar angle |
| | 46 | -object search by exposure object |
| | 47 | -comment search by comment field (LIKE comparison) |
| | 48 | -obs_mode search by observation mode |
| | 49 | -label search by newExp label (LIKE comparison) |
| | 50 | -set_label define label |
| | 51 | -set_data_group define data group |
| | 52 | -set_workdir define workdir (required) |
| | 53 | -set_note define note |
| | 54 | -set_dest_id define destination |
| | 55 | -pretend do not actually modify the database |
| | 56 | -unique only queue exposures that have no previous vpRun |
| | 57 | -simple use the simple output format |
| | 58 | |
| | 59 | }}} |
| | 60 | |
| | 61 | |
| | 62 | == videophot_process.pl == |
| | 63 | The ippScript videophot_process.pl processes an entire vpRun. That is all OTAS are processed by a single job. This may be contrasted with chip processing where each OTA is processed separately. Since each video cell only takes a few seconds to process this is a reasonable choice. |
| | 64 | |
| | 65 | The actual processing is performed by the program psvideophot. The output for each video cell is a FITS table (file extension vpt). |
| | 66 | |
| | 67 | A second fits file is created which contains the original video cell data that has been extracted from the raw data. TODO: we should make creation of this file optional since it takes up ~4MB per cell (3pi) |
| | 68 | |
| | 69 | == vpt table == |
| | 70 | Each row in the vpt table contains the data for a frame. The data in the columns have 2 sources: |
| | 71 | * The video_table extension created by the GPC1 camera software |
| | 72 | * The results of the psvideophot analysis. These columns have names that begin with vp_ |
| | 73 | |
| | 74 | {{{ |
| | 75 | TTYPE1 = 'frame_start_time' / label for field 1 |
| | 76 | TFORM1 = '1D ' / data format of field: 8-byte DOUBLE |
| | 77 | TTYPE2 = 'frame_complete_time' / label for field 2 |
| | 78 | TFORM2 = '1D ' / data format of field: 8-byte DOUBLE |
| | 79 | TTYPE3 = 'centroid_x' / label for field 3 |
| | 80 | TFORM3 = '1D ' / data format of field: 8-byte DOUBLE |
| | 81 | TTYPE4 = 'centroid_y' / label for field 4 |
| | 82 | TFORM4 = '1D ' / data format of field: 8-byte DOUBLE |
| | 83 | TTYPE5 = 'fwhm ' / label for field 5 |
| | 84 | TFORM5 = '1D ' / data format of field: 8-byte DOUBLE |
| | 85 | TTYPE6 = 'fwhm_x ' / label for field 6 |
| | 86 | TFORM6 = '1D ' / data format of field: 8-byte DOUBLE |
| | 87 | TTYPE7 = 'fwhm_y ' / label for field 7 |
| | 88 | TFORM7 = '1D ' / data format of field: 8-byte DOUBLE |
| | 89 | TTYPE8 = 'sky ' / label for field 8 |
| | 90 | TFORM8 = '1D ' / data format of field: 8-byte DOUBLE |
| | 91 | TTYPE9 = 'flux ' / label for field 9 |
| | 92 | TFORM9 = '1D ' / data format of field: 8-byte DOUBLE |
| | 93 | TTYPE10 = 'snr ' / label for field 10 |
| | 94 | TFORM10 = '1D ' / data format of field: 8-byte DOUBLE |
| | 95 | TTYPE11 = 'rowpre ' / label for field 11 |
| | 96 | TFORM11 = '1J ' / data format of field: 4-byte INTEGER |
| | 97 | TTYPE12 = 'cnpix1 ' / label for field 12 |
| | 98 | TFORM12 = '1J ' / data format of field: 4-byte INTEGER |
| | 99 | TTYPE13 = 'cnpix2 ' / label for field 13 |
| | 100 | TFORM13 = '1J ' / data format of field: 4-byte INTEGER |
| | 101 | TTYPE14 = 'vp_flux ' / label for field 14 |
| | 102 | TFORM14 = '1E ' / data format of field: 4-byte REAL |
| | 103 | TTYPE15 = 'vp_median' / label for field 15 |
| | 104 | TFORM15 = '1E ' / data format of field: 4-byte REAL |
| | 105 | TTYPE16 = 'vp_stddev' / label for field 16 |
| | 106 | TFORM16 = '1E ' / data format of field: 4-byte REAL |
| | 107 | TTYPE17 = 'vp_sum ' / label for field 17 |
| | 108 | TFORM17 = '1E ' / data format of field: 4-byte REAL |
| | 109 | TTYPE18 = 'vp_x ' / label for field 18 |
| | 110 | TFORM18 = '1E ' / data format of field: 4-byte REAL |
| | 111 | TTYPE19 = 'vp_y ' / label for field 19 |
| | 112 | TFORM19 = '1E ' / data format of field: 4-byte REAL |
| | 113 | |
| | 114 | }}} |
| | 115 | |
| | 116 | == Results Data Store == |
| | 117 | When a run is queued it may optionally be assigned a data store product where results filesets will be posted. See for example http://datastore.ipp.ifa.hawaii.edu/ps1-vp/o5769g0314o.369032.vp.1 |
