| | 41 | |
| | 42 | == First iteration of new schema and loading == |
| | 43 | |
| | 44 | First iteration is loading, these are the following datastores: |
| | 45 | |
| | 46 | * PSPS_SAS_NEW_IN |
| | 47 | * PSPS_SAS_NEW_OB |
| | 48 | * PSPS_SAS_NEW_P2 |
| | 49 | * PSPS_SAS_NEW_ST |
| | 50 | |
| | 51 | The idea is to make it easy for Conrad/Thomas to work on one type of batch at a time, and also to be able to easily remove/replace the batches as they are improved. The current SAS we are loading is the dvo for SAS32 - because of this, we are unable to add the new tables related to diffs and forcedwarps. |
| | 52 | |
| | 53 | === Init Batch === |
| | 54 | |
| | 55 | * should be unchanged ( I think?) |
| | 56 | |
| | 57 | === Object Batches === |
| | 58 | |
| | 59 | * currently loaded on the datastore with these missing: |
| | 60 | |
| | 61 | * ObjectThin |
| | 62 | * new and unfilled objName, dvoRegionID |
| | 63 | * new and unfillable gcobjid, raStack, decStack, raStackErr, decStackErr, raMeanStd, decMeanStd, nStackDetections, nStackObjectRows |
| | 64 | * remove? skycellID |
| | 65 | * ObjectMean |
| | 66 | * new and unfillable gcobjid, ()qfPerfect, ()nIncKronMag, MeanPSFMagStd, MinPSFMag,MaxPSFMag,MeanKronMag,nIncKronMag,MeanKronMagStd,MeanApMag,MeanApMagErr,nIncApMag,MeanApMagStd |
| | 67 | |
| | 68 | === P2 Batches === |
| | 69 | |
| | 70 | * FrameMeta |
| | 71 | * no changes from previous schema, all columns filled |
| | 72 | * ImageMeta |
| | 73 | * new (unfilled) columns - momentXX, momentXY, momentYY, momentM3C, momentM3S, momentM4C, momentM4S, momentR1, momentRH |
| | 74 | * Detection |
| | 75 | * new and unfillable - gcobjID (requires new dvo), dvoRegionID (impossible, mark for deletion?) |
| | 76 | * new and unfilled - momentM3C, momentM3S, momentM4C, momentM4S, momentR1, momentRH, telluricExt, pltScale, posAngle (all from smf file?) |
| | 77 | * needs to be filled - randomDetID |
| | 78 | * unfilled on both new and old - kronRad, kronRadErr, apFluxErr |
| | 79 | |
| | 80 | === Stack Batches === |
| | 81 | |
| | 82 | * StackMeta |
| | 83 | * filterID needs to be filled |
| | 84 | * unfilled on both new and old - magSat, analVer, completMag, astroScat, photoScat, nAstroRef, nPhref, photoColor, calibModNum |
| | 85 | * StackToImage |
| | 86 | * no changes from previous schema, all columns filled |
| | 87 | * StackObject (formerly StackDetection) |
| | 88 | * ippObjID - needs to be dropped, exploded to 5 filters, and filled. |
| | 89 | * unfilled on both new and old - ()apFluxErr |
| | 90 | * needs to be filled - skyCellID, randomStackObjID, |
| | 91 | * needs to be filled but needs verification from Gene: ()ApMagErr, ()KronMag, ()KronMagErr |
| | 92 | * new and unfillable (needs new dvo or something in cmf file): gcobjID, stackDetectRowID, primaryDetection, bestDetection, ()psfCore, ()ApFillFac |
| | 93 | * unfillable (dvoRegionID) - mark for deletion? |
| | 94 | * StackApFlx |
| | 95 | * ippObjID - needs to be dropped, exploded to 5 filters, and filled. |
| | 96 | * needs to be filled - skyCellID, randomStackObjID, surveyID |
| | 97 | * new and unfillable (needs new dvo or something in cmf file): gcobjID, stackDetectRowID, primaryDetection, bestDetection |
| | 98 | * unfillable (dvoRegionID) - mark for deletion? |
| | 99 | * StackModelFit |
| | 100 | * ippObjID - needs to be dropped, exploded to 5 filters, and filled. |
| | 101 | * needs to be filled - skyCellID, randomStackObjID, surveyID |
| | 102 | * new and unfillable (needs new dvo or something in cmf file): gcobjID, stackDetectRowID, primaryDetection, bestDetection |
| | 103 | * unfillable (dvoRegionID) - mark for deletion? |
| | 104 | * StackModelFit |
| | 105 | * null and unfillable - gcobjid, stackdetectRowID |
| | 106 | * unfilled () logC, ()logA, ()clump |
| | 107 | * unfilled filter (grizy), model (deV,ser,exp) |
| | 108 | * (filter)(model)RadiusErr, (filter)(model)AbErr, (filter)(model)PhiErr, (filter)ra(model)Off, (filter)dec(model)Off, (filter)ra(model)OffErr, (filter)dec(model)OffErr,(filter)(model)Cf, (filter)(model)likelihood |
| | 109 | * unfilled (filter)serNuErr |
| | 110 | * unfillable (dvoRegionID) - mark for deletion? |
