IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changes between Version 6 and Version 7 of ippReleaseManagement


Ignore:
Timestamp:
Sep 20, 2012, 4:07:42 PM (14 years ago)
Author:
bills
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • ippReleaseManagement

    v6 v7  
    142142 * state - current status of the release. Several values have been identified
    143143   * active - results for the release are currently available to the community
    144    * pending - release identified, construction may have begun, but the data is not yet ready to be available by default
     144   * pending - release identified, construction may have begun, but the results not yet ready to be available by default
    145145   * archive - the release contains the results of a previous processing of the data that has been superseded.
     146   * drop - the results of the release have been abandoned and should be ignored
    146147 * dataRelease - If not null, the dataRelease value in the corresponding PSPS tables.
    147148
     
    166167corresponding to that release is identified by dataRelease 0, while 3PI.GR1 refers to the future
    167168LAP release which will begin construction soon. Once that release gets under way it's state will be set
    168 to active while 3PI.GR0 will be set to "archive"
     169to active while 3PI.GR0 will be set to "archive". XXX: insure that PSPS uses a different dataRelease ...
    169170
    170171The two SAS entries refer to PS1_SAS_08 and PS1_SAS_09.
    171172
    172173Now we turn our attention to tables that record the actual contents of a release. Single frame results
    173 are represented by the table relExp (released exposure) and relSkycell (released skycell). (Similar table
    174 will be defined for difference data products in the future).
     174are represented by the table relExp (released exposure) while stacks are represented by relSkycell
     175(released skycell). (We expect that in the future a similar table will be defined for difference stage
     176data products).
    175177
    176178== Released Exposure ==
     
    200202| time_stamp | datetime         | YES  |     | NULL    |                | time of last update to row
    201203+------------+------------------+------+-----+---------+----------------+
     204Note: this is a prototype. The actual table will use foreign key constraints where appropriate.
    202205}}}
    203206
    204207This table will allow us to easily identify for a given exposure and release the derived data products that were used
    205 to construct the results for the exposure. Here are a couple of examples
    206 
    207 
     208to construct the results for the exposure.
     209
     210Each time an exposure is released a new row will be added to the table.
     211
     212Here are a couple of examples showing the releases for one of the SAS exposures:
    208213{{{
    209214mysql> mysql> select ippRelease.releaseName, relExp.* from ippRelease join relExp using(rel_id) where exp_id = 356773;
     
    219224
    220225
    221 
    222 
    223 
    224 
    225 
     226Note that the list of ids are the same except for the add_id. This is because SAS_v9 was constructed
     227using the SAS_v8 pixels. For single frame exposures only the DVO injest and calibration was redone. This is
     228indicated by the change in add_id.
     229
     230==== state / data_state / flags ====
     231There are three columns related to the state of the released exposure. We haven't yet settled on which of
     232these data are required to manage the releases. Information that we might want to record include
     233 * state - active, drop, archive (note that the release state
     234 * has the released exposure been imported into PSPS
     235 * did the calibration apply ubercal. Perhaps: if so which version?
     236 * was the data the result of a recalibration, relphot, relastro, something else ...
     237
     238=== Life cycle of a relExp ===
     239We envision the following potential events in the history of a released exposure for the nightly science
     240releases
     241 * created during nightly science processing once the warp has been completed before the addRun is processed. State active.
     242 * updated to include the add_id of the addRun
     243
     244For a "GR" release
     245 * row is created when addstar is performed. State set to pending.
     246 * row is updated when ipptoPSPS is run. At that time the calibration data is updated with the resulting values and the state is changed to reflect the PSPS export.
     247
     248
     249