| | 7 | |
| | 8 | I spent most of the week continuing work on the formerly-corrupted ThreePi database. I finished the repair of the database, and then merged in the subset merged database of the images taken since the corruption occurred (up through the end of October). I copied this database back to the operational location so we can continue forward with that database. I am going to use this database for the reference astrometry & photometry catalog for the Grand Reprocessing. To that end, I merged in the full 2MASS database, which allows me to have astrometric ties across the sky even so the image edges are constrained. I also merged in some of the pre-DemoMonth data to fill out the coverage somewhat. |
| | 9 | |
| | 10 | The database manipulation above is now getting to be somewhat slow: the full database is 2TB, and any operations which require a full database scan (re-indexing with addstar -resort; average updates with relphot -average; large-scale dvomerges) can take many hours. I spent part of last week adding multithreading capability to addstar -resort and dvomerge. This speeds up the processing because the threads can share the cpu-intensive portion of the work and intersperse the disk I/O intensive portions. |
| | 11 | |
| | 12 | I also added compression support to the IPP metadata file I/O. These files are getting to be a significant portion of our storage, and they compress well. |
