Changes between Version 7 and Version 8 of ippToPspsOrr

Timestamp:

Feb 16, 2012, 4:03:31 PM (14 years ago)

Author:

rhenders

Comment:

--

ippToPspsOrr

@@ -35 +35 @@
 === Pre-ingesting DVO into MySQL ===
 
-When a DVO database was provided to PSPS for MD04 prior to the Boston meeting we encountered an unforeseen speed issue. DVO stores data in FITS files, each one representing an area on the sky. For regions where we have high coverage, eg medium deep fields, the FITS files are orders of magnitude larger than those for the 3PI survey. This means that they are extremely slow to access. It was taking about 40 minutes to access one frame of data from the MD04 DVO database provided prior to the Boston meeting. By writing code that ingested this entire DVO database into a MySQL database this 40 minute access time dropped to 30 seconds. The full ingest took approximately 24 hours.
+When a DVO database was provided to PSPS for MD04 prior to the Boston meeting we encountered an unforeseen speed issue. DVO stores data in FITS files, each one representing an area on the sky. For regions where we have high coverage, eg medium deep fields, the FITS files can be orders-of-magnitude larger than those for the 3PI survey. This means that they are extremely slow to access. For the MD04 DVO it was taking about 40 minutes to access one frame of data. By writing code that ingested this entire DVO database into a MySQL database this 40 minute access time dropped to 30 seconds. The full ingest took approximately 24 hours.
 
 === Multiple clients ===
 
-With the promise of a high throughput of new 'LAP' data from the IPP we needed to speed up ippToPsps so a multi-client version was developed. Multiple instances of ippToPsps can be run on the same machine, or multiple machines, so that batches can be loaded in parallel. The use of a secure critical section makes it impossible for different clients to attempt to load the same batch.
+With the promise of a high throughput of new 'LAP' data from the IPP we needed to speed up loading, so a multi-client version of ippToPsps was developed. Multiple instances of ippToPsps can be run on the same machine, or multiple machines, so that batches can be loaded in parallel. The use of a secure critical section makes it impossible for different clients to attempt to load the same batch.
 
 === Stored procedure to calculate likelihoods ===