Changes between Version 3 and Version 4 of AlternateDistClientQuickstart

Timestamp:

Feb 26, 2010, 1:23:10 PM (16 years ago)

Author:

welling

Comment:

--

AlternateDistClientQuickstart

@@ -5 +5 @@
 To get started using update-mirror, take the following steps:
 
-* Save update_mirror.py and parse_config.py somewhere in your PATH.  I keep
+ * Save update_mirror.py and parse_config.py somewhere in your PATH.  I keep
   my copy in ~/bin, since I added my ~/bin directory to my PATH long ago.
 
-* Edit update_mirror.py to set two things:
+ * Edit update_mirror.py to set two things:
 
    1. Change mirrorRootDir to be the path to the directory where
@@ -16 +16 @@
       want ps1-md; if you only want medium deep catalogs you want ps1-md-cat.
 
-* Run it.  A good format for the command is:
-
+ * Run it.  A good format for the command is:
+{{{
    nice nohup update_mirror.py >& update_mirror_stdout.log &
-
+}}}
 That will run update_mirror.py in such a way that you can log out and
 it will keep going.  If you like, you can watch its progress with:
-
+{{{
    tail -f update_mirror.log
-
+}}}
 Note that you are not watching update_mirror_stdout.log- that file is
 only there to catch unexpected error messages.
@@ -36 +36 @@
 however.  There are command line options to update_mirror to let you
 do that.  Some examples are below, but you can see all the options if you do:
-
+{{{
    update_mirror.py --help
-
+}}}
 To understand how to select datasets you need to understand the keys
 that specify datasets.  The easiest way to do that is to look at the
@@ -51 +51 @@
 Selecting a particular skycell is a special case; see below.
 
--To get only stacks, do:
-
+ * To get only stacks, do:
+{{{
   update_mirror.py --select_stage stack
-
--To select only MD04, do:
-
+}}}
+ * To select only MD04, do:
+{{{
   update_mirror.py --select_datagroup 'MD04.*'
-
--You can combine terms.  For example, to select only stack-stack diffs
- done with the g.00000 filter for MD06, use:
-
+}}}
+ * You can combine terms.  For example, to select only stack-stack diffs
+   done with the g.00000 filter for MD06, use:
+{{{
   update_mirror.py --select_datagroup 'MD06.*' --select_filter g.00000
            --select_stage SSdiff
-
+}}}
 Caution: the rules specifying what words mean what in the different
 columns of the datastore table seem to change occasionally, so it's
@@ -75 +75 @@
 the actual files that get downloaded for that fileset.  At least one
 of them will be a .tgz file, with a name like:
-
+{{{
   MD04.skycell.068.stk.52993.skycell.068.tgz
-
+}}}
 The --select_tarball option to update_mirror lets you specify a
 regular expression for the tarball name, so that option can be used to
@@ -84 +84 @@
 file. 
 
-  For example, to select only warps from MD04 for skycell 040, do:
-
+For example, to select only warps from MD04 for skycell 040, do:
+{{{
   update_mirror.py --select_stage warp --select_datagroup 'MD04.*'
           --select_tarball '.*skycell\.040\.tgz'
-
+}}}
 This can get tedius if you actually want several skycells, so here is
 a useful trick with regular expressions.  If you want skycells 038,
 053, 061 and 074 from that stage and group, try:
-
+{{{
   update_mirror.py --select_stage warp --select_datagroup 'MD04.*'
           --select_tarball '.*skycell\.((038)|(053)|(061)|(074))\.tgz'
+}}}