Changes between Version 188 and Version 189 of ippToPsps

Timestamp:

Mar 9, 2012, 12:35:32 PM (14 years ago)

Author:

rhenders

Comment:

--

ippToPsps

@@ -101 +101 @@
 [[Image(new3pi_P2_2012_0308_135938.png)]]
 == loader.py ==
+
+{{{loader.py}}} programs actually process the data and upload it to the datastore for PSPS. They look to the queue tables in the {{{ippToPsps}}} database for a list of items to process. They first attempt to process a stripe of RA (from the [wiki:ippToPsps_Database#Thestripetable stripe table]) that is not being processed by any other {{{loader.py}}} client. If all available stripes have already been reserved, then it chooses the stripe with the largest number of pending items.
+
+With a stripe chosen, {{{loader.py}}} obtains a list of box_ids (each stripe is sub-divided into boxes). It works its way through each box, processing all pending items.
 == metrics.py ==
 == cleanup.py ==