IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changes between Version 70 and Version 71 of Processing


Ignore:
Timestamp:
Jul 2, 2010, 8:23:36 AM (16 years ago)
Author:
rhenders
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • Processing

    v70 v71  
    2020= Using {{{pantasks}}} =
    2121
    22 There are numerous {{{pantasks}}} servers. Their status can be checked with [http://ipp004.ifa.hawaii.edu/ippMonitor/czartool_labels.php Czartool], but it is often necessary to use a client directly. To do this {{pantasks_client}}, first move to the directory corresponding to the server of interest, which are all under {{{~ipp}}} on any cluster machine, for example {{{~ipp/stdscience/}}}, then run
     22There are numerous {{{pantasks}}} servers. Their status can be checked with [http://ipp004.ifa.hawaii.edu/ippMonitor/czartool_labels.php Czartool], but it is often necessary to use a client directly. To do this, first move to the directory corresponding to the server of interest, which are all under {{{~ipp}}} on any cluster machine. For example, go to {{{~ipp/stdscience/}}}, then run
    2323
    2424{{{
     
    5959}}}
    6060   
    61 The first column, 'AV', translates to Active and Valid, i.e. whether a process is running and whether it is valid at this point in time. For example, above, {{{+- ns.initday.load}}} is active, but is not valid at present since it is scheduled to run only once per day (to initialize the {{{nightlyscience}}} automation).
     61The first column, 'AV', translates to '''A'''ctive and '''V'''alid, i.e. whether a process is running and whether it is valid at this point in time. For example, above, {{{+- ns.initday.load}}} is active, but is not valid at present since it is scheduled to run only once per day (to initialize the {{{nightlyscience}}} automation).
    6262
    6363The key thing to monitor here is the {{{Nfail}}} column. Depending on the process, different numbers of Nfail as a proportion of Njobs are deemed acceptable.
     
    6565= Morning duties: checking {{{summitcopy}}} and {{{burntool}}} =
    6666
    67 There is nothing to be processed if data has not been copied from the telescope. This is the job of {{{summitcopy}}}, which runs TODO every day. You can check that it has successfully copies files by TODO
    68 
    69 
    70 {{{burntool}}} is the next stage. Easiest way to check is to run the following in the stdscience {{{pantasks_client}}}
    71 
    72 
     67There is nothing to be processed if data has not been copied from the telescope. This is the job of {{{summitcopy}}}, which runs slowly through night, then speeds once observations are complete every day. You can check that it has successfully copies files using [http://ipp004.ifa.hawaii.edu/ippMonitor/czartool_labels.php Czartool].
     68
     69After {{{summitcopy}}} comes {{{burntool}}}. Easiest way to check this is to run the following in the stdscience {{{pantasks_client}}}
    7370
    7471{{{
     
    7875You should see a 'book' entry with today's date, like
    7976
    80 
    8177{{{
    82782010-05-27 BURNING
    8379}}}
    84 
    8580
    8681If not, something is wrong.
     
    354349Running {{{neb-host}}} with no arguments gives you a summary of the above for all hosts.
    355350
    356 = Rebuilding the IPP code =
    357 
    358 The IPP in use presently is located at
    359 
    360 {{{
    361 ~ipp/ipp-20100211
    362 }}}
    363 
    364 If the code needs an update and rebuild, then:
    365 
    366  * stop pantasks (as above)
    367  * {{{cd ~ipp/ipp-20100211}}}
    368  * {{{svn update}}}
    369  * {{{psbuild -dev -optimize}}}
    370  * restart pantasks (as above)
     351= Changing the code =
     352
     353This might mean rebuilding the current 'tag' (reflected in the directory name) or actually installing a new tag.
     354
     355== Rebuilding the current tag ==
     356
     357We will use the example of tag 20100701 which is store under
     358
     359{{{
     360~ipp/src/ipp-20100701
     361}}}
     362
     363To update the code and rebuild, shutdown all {{{pantasks}}} (as shown above) then do the following.
     364
     365{{{
     366cd ~ipp/src/ipp-20100701
     367svn update
     368psbuild -dev -optimize
     369}}}
     370
     371
     372Now restart all {{{pantasks}}} (as above).
     373
     374== Installing a new tag ==
     375
     376
     377* shutdown all {{{pantasks}}} (as shown above)
     378* change {{{~ipp/.tcshrc}}} to point at the new tag (it is good to confirm by logging out and in again)
     379* fix the files which are still installation specific:
     380 * edit {{{~ipp/.ptolemyrc}}  and change {{{CONFDIR}}} to point at the new location
     381 * copy {{{nebulous.site.pro}}} to the working location (for now, just use the last installation version) eg
     382
     383{{{
     384cp psconfig/ipp-20100623.lin64/share/pantasks/modules/nebulous.site.pro psconfig/ipp-20100701.lin64/share/pantasks/modules/nebulous.site.pro
     385}}}
     386
     387
     388* restart all {{{pantasks}}} (as above)
    371389
    372390= Who to contact =