| | 22 | * ippToPsps loading: |
| | 23 | * some minor troubleshooting, eg missing IQ_FW1, FW2 values in psf header causing problems for moments in ImageMeta |
| | 24 | * some dxlayer issues: |
| | 25 | * lost config used for Boston loading, csv path for loader was wrong |
| | 26 | * daemon quitting after a single batch. Had to keep restarting |
| | 27 | * Conrad to the rescue: tested and working now |
| | 28 | * issues finding the correct stack cmfs to load: |
| | 29 | * apparently we make two cmfs per stack_id. Changed SQL accordingly |
| | 30 | * impossible to find the full path for a given stack from GPC1, so wrote code to read all cmf headers at a given path_base until correct one is located |
| | 31 | * issue with skycell ID: we need a schema change, as we store as an int, but format is eg 0683.043. Mangled to 0683043 for now |
| | 32 | * loaded all stacks, not that there were many |
| | 33 | |
| | 34 | * ippToPsps coding: |
| | 35 | * started work on some loading metrics code including: |
| | 36 | * queries to find numbers for pending batches, processed batches, faults etc |
| | 37 | * queries to monitor speed of loading, time of last published |
| | 38 | * sub-classed python Logger class in order to add some convenience methods, like printing separators, value pairs |
| | 39 | * improved a lot of the logging messages for consistency |
| | 40 | * code changes, as well as changes to ipptopsps Db, mean different batch types are handled polymorphically. Much cleaner |
| | 41 | * added a warning prompt if 'force' and 'publish' options are both enabled |
| | 42 | * encapsulated FITS reading code into a class. Constructor now copies file to the local file-system first to speed-up access |
| | 43 | * started work on jython code to query ODM via SOAP for batch status. |
