Changes between Version 3 and Version 4 of FilesMonitoring

Timestamp:

Dec 11, 2012, 12:27:51 PM (14 years ago)

Author:

Serge CHASTEL

Comment:

--

FilesMonitoring

@@ -38 +38 @@
 TODO: 
 
+= {{{NodeRelated/update_table_undefined.py}}} Details =
+ * The script depends on {{{ipp.lifetime_templates}}} (hence the PYTHONPATH line in the crontab script)
+ * This script can be run independently (and in parallel of the other scripts: {{{-h}}} for help)
+ * The objective of this script is to classify "undefined" files in one of the categories defined in the {{{ipp.lifetime_templates}}} (see related paragraph TODO: Add link)
+ * Its parameters are: the maximum number of undefined files to be classified (default: 10), the disk partition (default: 0), and the directory.
+ * Whatever the value of the maximum number of undefined files to be classified, the files are classified by batches of 2500: we don't want to overwhelm the local mysql database / host. Therefore if you specify a maximum of 11000 files, there will be 5 iterations.
+ * In each batch, 2500 undefined entries, that is, entries having an {{{undefined}}} status from the neb_<disk>_<directory name> table are selected, classified according to the rules defined in {{{ipp.lifetime_templates}}}, and then updated.
+
+Note: The classifier defined {{{ipp.lifetime_templates}}} is dynamically imported: this means that there is no need to stop-and-restart the {{{NodeRelated/refresh_table.py}}} script to modify its behavior. It is the only reason why the {{{NodeRelated/update_table_undefined.py}}} is called as a script by {{{NodeRelated/refresh_table.py}}} and not as a class/function.
+
 = {{{NodeRelated/update_table.py}}} Details =
- * The script depends on {{{ipp.lifetime_templates}}}
+ * This script is exactly the same as the {{{NodeRelated/update_table_undefined.py}}} script except that the condition to select entries is bases on their analysis date: the older are selected.
+ * Since the same dynamic importation mechanism, this means that after some time any file will have its classification updated (patience...)
 
+TODO: We don't like duplicate code, do we?
 = {{{~schastel/local/share/python/ipp/lifetime_templates.py}}} Details =