| 16 | | a) Tasks required before the start of the survey: |
| 17 | | |
| 18 | | || '''Task''' || '''Due''' || '''Who''' || '''State''' || '''Notes''' || |
| 19 | | || IPP to OTIS interface || 3/12 || CZW || DONE || we now need to iterate with OTIS || |
| 20 | | || Detectability Server : psphotDetect || 3/19 || CZW || DONE || output values must be double-checked || |
| 21 | | || Detectability Server : pstamp integration || 3/26 || CZW || DONE || Tested and Committed. || |
| 22 | | || Raw Distribution || 3/12 || WS || DONE || || |
| 23 | | || DVO large-file upgrade || 3/21 || EAM || DONE || || |
| 24 | | || DVO merge catalogs || 3/25 || EAM || DONE || || |
| 25 | | || DVO Image-indexing || 3/27 || EAM || DONE || || |
| 26 | | |
| 27 | | b) Tasks not required for the survey start: |
| 28 | | |
| 29 | | || '''Task''' || '''Due''' || '''Who''' || '''State''' || '''Notes''' || |
| 30 | | || Finish Extended Source Analysis Code || 3/31 || EAM || || petrosians, surface brightness profile done || |
| 31 | | || Stack Photometry Process || 4/30 || EAM || || Initial version of the code is now working || |
| 32 | | || Stacks : example PS1 astrometry || 3/19 || PAP || DONE || this led to discovery of a 1/2 pixel error which caused many problems || |
| 33 | | || Stacks : masking strategy || 3/26 || PAP || DONE || || |
| 34 | | || Plan for 3pi re-processing for stacks || 4/30 || PAP || || || |
| 35 | | || Full-Scale Photometry & Astrometry Relative Calibration Demo || 3/31 || EAM || DONE || once with SAS, again with 3pi yz data || |
| 36 | | || IPP->PSPS : missing detection fields || 4/31 || RH || || requires input from EAM?|| |
| 37 | | || IPP->PSPS : missing difference fields || 4/31 || RH || || requires input from EAM? || |
| 38 | | || IPP->PSPS : stack tables || 4/31 || RH || || blocked by 'extended source' task above || |
| 39 | | || IPP->PSPS : finalize recalibration process || 4/31 || RH || || blocked by 'Full-Scale Photometry.. Demo' || |
| 40 | | || ISP automation : create detrends || 3/31 || HAF || DONE || || |
| 41 | | || ISP automation : update recipes || 4/7 || HAF || DONE || || |
| 42 | | || Distribution of Detrend Images || 3/31 || CZW || DONE || || |
| 43 | | || Integrated Release of Uncorrected Data || 4/30 || PAP || || || |
| 44 | | |
| 45 | | == Tasks for the Immediate Future (these overlap the above) == |
| 46 | | |
| 47 | | * major missing features : required for the start of the survey |
| 48 | | * detectability server ('''integration with postage stamp server in progress''') |
| 49 | | |
| 50 | | * major missing features : important, but not blocking start of the survey |
| 51 | | * extended source analysis |
| 52 | | * stack photometry |
| 53 | | * ipp->psps interface |
| 54 | | * integrated release of uncorrected data |
| 55 | | * processing recipe for final stacks |
| 56 | | |
| 57 | | * major demo month lessons to be addressed |
| 58 | | * keeping the pantasks queues filled |
| 59 | | * address large load spikes |
| 60 | | * operational rigidity |
| 61 | | * how to deal with down machines (on-the-fly replication?) |
| 62 | | * address real vs nfs failures |
| 63 | | * address real failures |
| 64 | | * more load and disk space balancing (machine limits by job?) |
| 65 | | * better targeting of data to nodes |
| 66 | | * more regular operations schedule - procesing czar |
| 67 | | * better tools for examining current state (more ippMon? more other tools?) |
| 68 | | |
| 69 | | * current dev tasks |
| 70 | | * addstar imports from UKIDSS & SDSS |
| 71 | | * optimize dvo image lookups |
| 72 | | |
| 73 | | * cluster management |
| 74 | | * automate cleanups of un-destreaked images |
| 75 | | * define reboot procedure |
| 76 | | |
| 77 | | * psphot work: |
| 78 | | * 'scale error' in stacks |
| 79 | | * limit max source detections in psphot |
| 80 | | |
| 81 | | * write ups |
| 82 | | * ppSub updates |
| 83 | | * DVO usage |
| 84 | | |
| 153 | | * look into importing UKIDS data into dvo catalogs |
| 154 | | * make sure SDSS import to DVO is working properly |
| 155 | | * postage stamp server |
| 156 | | * automate handling of 'unable to update' errors |
| 157 | | * enhance web interface with new features especially parse results file and display |
| 158 | | * improve access control add quotas |
| 159 | | * update user documentation |
| 160 | | * meet with NCU folks on pstamp web interface |
| 161 | | * update database tables to support automatic cleanup |
| 162 | | * automate distribution cleanup |
| 163 | | * data store work |
| | 54 | * raw data to STS (started) |
| | 55 | * detrends to STS |
| | 56 | * more robust cleanup processing |
| | 57 | * stuck pstamp requests / updates |
| | 58 | * pstamp storage / cleanup |
| | 59 | * track chip, warp, diff, stack events |
| | 60 | |
| 166 | | * TESTING: Look into the detector linearity of odd features, and implement a software correction in ppImage |
| 167 | | * DONE: Speed up code to delete old destreak diff data to free up disk space. |
| 168 | | * Track down ghosts identified at QUB transient meeting. |
| 169 | | * Nightly science: |
| 170 | | * Ensure nightly science code properly handles OSS diff pairs. |
| 171 | | * Implement a real-time burntool correction, add to image registration task |
| 172 | | * Nebulous: |
| 173 | | * Rework neb-shift to handle load balancing. |
| 174 | | * Redesign replication server to cull duplicate copies as well. |
| 175 | | * Figure out why a down host prompts so many neb-replicate requests it swamps the database server. |
| 176 | | * Miscellaneous: |
| 177 | | * Fix WCS in summary stage output fits images. |
| 178 | | * integrate CON_VSUM information into the headers of new detrends |
| 179 | | * integrate tools/ directory |
| 180 | | * sas relphot & relastro |
| 181 | | * DONE: |
| 182 | | * probably not tested: Add SweetSpot lunation-based processing to nightly science code. |
| 183 | | * TEST: Fix the detectability server bug that seems to drop rows, #1420. Fix my fix that I fixed from Belfast. |
| 184 | | * Speed up code to delete old destreak diff data to free up disk space. |
| 185 | | === Cindy Giebink & Steph Mohr === |
| 186 | | |
| 187 | | * ipp005 bios needs to be reset (wait for Gavin) |
| 188 | | * debug hardware problems on ipp008, 9, 14, 16, 18 |
| 189 | | * move homedirs to ippc18 |
| 190 | | * areca scripts for automatic verify |
| 191 | | * try neb-hosts with Chris |
| 192 | | * work with Bill Sweeney to get otis |
| | 63 | * diff spikes (more tests) |
| | 64 | * otis interface (new deteff cdf) |
| | 65 | * merge time-dep format code |
| | 66 | * MD04 tests |
| | 67 | * bin by 8 laser flats (still running) |
| | 68 | * old burntool is blocked by funpack errors (mostly fixed, but a few |
| | 69 | funpack failures still exist) |
