| 101 | | * {{{queue.py}}} - for queueing up data to process for a given config |
| 102 | | * {{{loader.py}}} - to actually process and load the queued data in the form of ''batches'' |
| 103 | | * {{{pollodm.py}}} - to poll the PSPS ODM to gather information about the process of each batch |
| 104 | | * {{{cleanup.py}}} - to cleanup batches from the datastore, DXLayer and local disk based on batch status acquired by {{{pollodm.py}}} |
| 105 | | * {{{metrics.py}}} - for monitoring processing. Vital statistics are stored in the czartool database |
| 106 | | * {{{plotter.py}}} - for generating density plots of pending data for a given config |
| | 101 | * '''{{{queue.py}}}''' - for queueing up data to process for a given config |
| | 102 | * '''{{{loader.py}}}''' - to actually process and load the queued data in the form of ''batches'' |
| | 103 | * '''{{{pollodm.py}}}''' - to poll the PSPS ODM to gather information about the process of each batch |
| | 104 | * '''{{{cleanup.py}}}''' - to cleanup batches from the datastore, DXLayer and local disk based on batch status acquired by {{{pollodm.py}}} |
| | 105 | * '''{{{metrics.py}}}''' - for monitoring processing. Vital statistics are stored in the czartool database |
| | 106 | * '''{{{plotter.py}}}''' - for generating density plots of pending data for a given config |