IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changes between Version 67 and Version 68 of Processing


Ignore:
Timestamp:
Jun 24, 2010, 11:01:25 AM (16 years ago)
Author:
rhenders
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • Processing

    v67 v68  
    131131== Starting ==
    132132
    133 To start a single pantasks server do
    134 
    135 {{{
    136 pantasks: run
    137 }}}
    138 
    139133Each {{{pantasks_server}}} uses the {{{input}}} file located in the directory where is in instantiated. It also uses the local {{{ptolemy.rc}}} file (this file details the machine where the server is to run).
    140134
    141 To restart all the {{{pantasks_server}}} instances, you need to {{{ssh}}} to each relevant machine, which are found using {{{check_system.sh}}}. For each server do the following:
    142 
    143 {{{
    144 ssh ipp@ippXXX
    145 cd <serverName>
    146 pantasks_server &
    147 pantasks_client
    148 pantasks: server input input
    149 pantasks: setup
    150 }}}
    151 
    152 So, for example for {{{stdscience}}}
    153 
    154 {{{
    155 ssh ippc16
    156 cd ~stdscience
    157 pantasks_server &
    158 pantasks_client
    159 pantasks: server input input
    160 pantasks: setup
    161 }}}
    162 
    163 Each server then needs to be handled differently for setup.
    164 
    165 === stdscience ===
    166 
    167 Add surveys
    168 
    169 {{{
    170 pantasks: add.surveys
    171 }}}
    172 
    173 This adds the surveys defined in the 'input' file. Now show labels with
    174 
    175 {{{
    176 pantasks: show.labels
    177 }}}
    178 
    179 Working from this list, add and remove labels with {{{del.label}}} and {{{add.label}}}, eg
    180 
    181 {{{
    182 pantasks: del.label M31.nightlyscience
    183 pantasks: add.label ThreePi.DM.20100401
    184 }}}
    185 
    186 Now add some hosts. Since {{{stdscience}}} is the most intensive server, it requires more hosts than the others. The configuration below is a good guide.
    187 
    188 {{{
    189 pantasks: hosts add wave1
    190 pantasks: hosts add wave2
    191 pantasks: hosts add wave2
    192 pantasks: hosts add wave3
    193 pantasks: hosts add wave3
    194 pantasks: hosts add compute
    195 pantasks: hosts add compute
    196 }}}
    197 
    198 However
    199 
    200 1 x wave1[[BR]]
    201 4 x wave2[[BR]]
    202 4 x wave3[[BR]]
    203 4 x compute[[BR]]
    204 
    205 is probably needed for full-scale operations.
    206 
    207 Now we are ready to run the server
    208 
    209 {{{
    210 pantasks: run
    211 }}}
    212 
    213 === summitcopy, registration, replication ===
    214 
    215 These are the easy ones, just
    216 
    217 {{{
    218 pantasks: run
    219 }}}
    220 
    221 === publishing ===
    222 
    223 This server is specifically for publishing data to MOPS.
    224 
    225 add labels? TODO
    226 
    227 === pstamp ===
    228 
    229 The postage stamp server.
    230 
    231 {{{
    232 pantasks: add.hosts
    233 pantasks: run
    234 }}}
    235 
    236 === distribution ===
    237 
    238 {{{distribution}}} runs the destreaking (magic) then bundles up available data for the datastore. In terms of labels, {{{distribution}}} roughly mirrors {{{stdscience}}}.
    239 
    240 {{{
    241 pantasks: add.surveys
    242 }}}
    243 
    244 same labels as stdscience? TODO
    245 
    246 Add hosts
    247 
    248 {{{
    249 pantasks: hosts add wave1
    250 pantasks: hosts add wave2
    251 pantasks: hosts add wave3
    252 pantasks: hosts add compute
    253 }}}
    254 
    255 Check processing is running smoothly in {{{stdscience}}} using {{{pantasks: status}}}. If all is okay, then
    256 
    257 {{{
    258 pantasks: run
    259 }}}
    260 
    261 === cleanup ===
    262 
    263 {{{
    264 pantasks: hosts add wave2
    265 pantasks: hosts add wave3
    266 pantasks: hosts add compute
    267 pantasks: run
    268 }}}
    269 
    270 === detrend, addstar ===
    271 
    272 TODO
     135For already-running servers, {{{pantasks}}} should be started with the following commands only:
     136
     137{{{
     138
     139pantasks_client: server input input
     140pantasks_client: setup
     141pantasks_client: run
     142}}}
     143
     144This loads the hosts and labels needed and starts the processing running. See {{{~ipp/stdscience/input}}} if this is not clear.
     145
     146If everything has been shut down, you can start all {{{pantasks}}} with the following in {{{~ipp}}}:
     147
     148{{{
     149
     150check_system start.server
     151check_system start
     152}}}
     153
     154
     155The first command launches the {{{pantasks_servers}}} on the correct hosts the second calls the three commands listed above ({{{server input input;
     156setup; run}}}).
    273157
    274158= Queuing data =