Changes between Version 6 and Version 7 of ippReleaseManagement
- Timestamp:
- Sep 20, 2012, 4:07:42 PM (14 years ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
ippReleaseManagement
v6 v7 142 142 * state - current status of the release. Several values have been identified 143 143 * active - results for the release are currently available to the community 144 * pending - release identified, construction may have begun, but the data is not yet ready to be available by default144 * pending - release identified, construction may have begun, but the results not yet ready to be available by default 145 145 * archive - the release contains the results of a previous processing of the data that has been superseded. 146 * drop - the results of the release have been abandoned and should be ignored 146 147 * dataRelease - If not null, the dataRelease value in the corresponding PSPS tables. 147 148 … … 166 167 corresponding to that release is identified by dataRelease 0, while 3PI.GR1 refers to the future 167 168 LAP release which will begin construction soon. Once that release gets under way it's state will be set 168 to active while 3PI.GR0 will be set to "archive" 169 to active while 3PI.GR0 will be set to "archive". XXX: insure that PSPS uses a different dataRelease ... 169 170 170 171 The two SAS entries refer to PS1_SAS_08 and PS1_SAS_09. 171 172 172 173 Now we turn our attention to tables that record the actual contents of a release. Single frame results 173 are represented by the table relExp (released exposure) and relSkycell (released skycell). (Similar table 174 will be defined for difference data products in the future). 174 are represented by the table relExp (released exposure) while stacks are represented by relSkycell 175 (released skycell). (We expect that in the future a similar table will be defined for difference stage 176 data products). 175 177 176 178 == Released Exposure == … … 200 202 | time_stamp | datetime | YES | | NULL | | time of last update to row 201 203 +------------+------------------+------+-----+---------+----------------+ 204 Note: this is a prototype. The actual table will use foreign key constraints where appropriate. 202 205 }}} 203 206 204 207 This table will allow us to easily identify for a given exposure and release the derived data products that were used 205 to construct the results for the exposure. Here are a couple of examples 206 207 208 to construct the results for the exposure. 209 210 Each time an exposure is released a new row will be added to the table. 211 212 Here are a couple of examples showing the releases for one of the SAS exposures: 208 213 {{{ 209 214 mysql> mysql> select ippRelease.releaseName, relExp.* from ippRelease join relExp using(rel_id) where exp_id = 356773; … … 219 224 220 225 221 222 223 224 225 226 Note that the list of ids are the same except for the add_id. This is because SAS_v9 was constructed 227 using the SAS_v8 pixels. For single frame exposures only the DVO injest and calibration was redone. This is 228 indicated by the change in add_id. 229 230 ==== state / data_state / flags ==== 231 There are three columns related to the state of the released exposure. We haven't yet settled on which of 232 these data are required to manage the releases. Information that we might want to record include 233 * state - active, drop, archive (note that the release state 234 * has the released exposure been imported into PSPS 235 * did the calibration apply ubercal. Perhaps: if so which version? 236 * was the data the result of a recalibration, relphot, relastro, something else ... 237 238 === Life cycle of a relExp === 239 We envision the following potential events in the history of a released exposure for the nightly science 240 releases 241 * created during nightly science processing once the warp has been completed before the addRun is processed. State active. 242 * updated to include the add_id of the addRun 243 244 For a "GR" release 245 * row is created when addstar is performed. State set to pending. 246 * row is updated when ipptoPSPS is run. At that time the calibration data is updated with the resulting values and the state is changed to reflect the PSPS export. 247 248 249
