IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changes between Version 13 and Version 14 of AlternateDistributionClient


Ignore:
Timestamp:
Nov 18, 2009, 1:31:20 PM (16 years ago)
Author:
welling
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • AlternateDistributionClient

    v13 v14  
    77 * The script is not intended to serve as a distribution server in its own right, so it cannot form part of a distribution chain using the IPP distribution mechanism.  The mirrored files can be redistributed using rsync, however.
    88 * The distribution protocol is pretty stable, but it may change at some future time.  That change will break the script until a corresponding update can be made.
    9  
     9
     10== Recent Changes ==
     11
     12 1. Added the --groupwrite option for the convenience of research groups that can all write each other's files.
     13 1. Made allowances for the change in the distribution system column name formerly known as 'label', briefly known as
     14'dist_group' and now known as 'data_group'.
     15 1. Moved the .mdc files that used to appear in the top level directory to the new subdirectory 'metadata'.
     16
    1017== Installation Instructions ==
    1118
     
    4956This is the result of doing './update_mirror.py --help'.  Specific default paths are those for Odyssey.
    5057{{{
    51     usage: update_mirror.py [-v][-d][--mirrorroot RootDir]
     58    usage: update_mirror.py [-v][-d][--groupwrite][--mirrorroot RootDir]
    5259                [--statusfile Filename][--failurefile Filename]
    5360                [--pipecrash Filename][--logfile Filename]
     
    5562                [--select_targetid Regex][--select_stage Regex]
    5663                [--select_fstag Regex][--select_label Regex]
    57                 [--select_filter Regex]
     64                [--select_filter Regex][--select_distgroup Regex]
     65                [--select_datagroup Regex]
    5866
    5967          where:
    6068          -v requests verbose output
    6169          -d requests debugging output
     70          --groupwrite requests that the imported files be made
     71            group writable.  The algorithm isn't terribly efficient
     72            but can be convenient.
    6273          --mirrorroot specifies the directory to store the incoming
    63             distribution (default /panstarrs/data/MIRROR)
     74            distribution (default /Volumes/data/PS1/data/MIRROR)
    6475          --statusfile specifies the name of the .csv file storing
    6576            information about the last downloaded fileset in each
     
    7889            index.  The options correspond to the following columns:
    7990
    80                 ..._fsid     filesetID
    81                 ..._targetid target_id
    82                 ..._stage    stage
    83                 ..._fstag    fs_tag
    84                 ..._label    label
    85                 ..._filter   filter
     91                ..._fsid      filesetID
     92                ..._targetid  target_id
     93                ..._stage     stage
     94                ..._fstag     fs_tag
     95                ..._filter    filter
     96                ..._label     label or dist_group or data_group
     97                ..._distgroup dist_group or label or data_group
     98                ..._datagroup data_group or dist_group or label
    8699
    87100            Any index entry for which a regex is specified must match that
    88             regex to be downloaded.
     101            regex to be downloaded.  The options which come in multiple
     102            versions arise because of a backward compatibility issue.
    89103
    90104    NOTE: if you 'kill' this script (with SIGTERM, the default) it will