IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changes between Version 36 and Version 37 of PS1_IPP_Czarlog_20190510


Ignore:
Timestamp:
May 16, 2019, 4:36:37 PM (7 years ago)
Author:
tdeboer
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • PS1_IPP_Czarlog_20190510

    v36 v37  
    12051205  * ...
    12061206  *
    1207  * PS2 test quad 3 -- MOPS.ps2testquad3.20190516ops
    1208 {{{
    1209 o8507h0371o
    1210 o8507h0389o
    1211 o8507h0407o
    1212 o8507h0425o
    1213 }}}
    1214 
    12151207 * TdB: More x nodes testing. No spontaneous reboots overnight, so the nodes are stable in that respect. This time, we will run updates on them for 4 hours and keep nodes ippx029-36 off from the start, and will monitor power draw more often
    12161208{{{
     
    13491341}}}
    13501342 It contains 1667 exps, all of which I sent to clean-up, and finished cleaning just fine.
    1351 
    1352 
    1353 
     1343 
     1344 -----------------
     1345
     1346 '''PS2 prep work'''
     1347 Before PS2 comes back online, we want to test if the system works. So, we looked at a few things:
     1348
     1349 hosts:
     1350 We modified the x node host groups in the ~ippps2/stdscience/pantasks_host.input file and made sure the c2 is there (and up to date), so it can be added in case extra processing power is needed
     1351
     1352 data targetting:
     1353 This is governed by ~/psconfig/default.lin64/share/pantasks/modules/ipphosts.mhpcc.config file. We changed the skycell product targetting to machines ipp127-139 since they have lots of free space
     1354
     1355 Is the ps2 datastore accessible. It is located on http://dsmaster.ps2.ifa.hawaii.edu/ds/gpc2  (see the pzDataStore table in the gpc2 mysql). try a wget http://dsmaster.ps2.ifa.hawaii.edu/ds/gpc2/index.txt
     1356 ->It finds it and downloads just fine. So, the data store is accesible
     1357 
     1358 PS2 test quad:
     1359 We had a look at the PS2 test quad
     1360{{{
     1361o8507h0371o
     1362o8507h0389o
     1363o8507h0407o
     1364o8507h0425o
     1365}}}
     1366 And ran it through a typical reduction:
     1367{{{
     1368chiptool -dbname gpc2 -definebyquery -set_label MOPS.ps2testquad3.20190516ops -set_workdir neb://@HOST@.0/gpc2/MOPS.ps2testquad3.20190516ops -set_data_group MOPS.ps2testquad3.20190516ops -set_dist_group NULL -set_tess_id RINGS.V3 -set_end_stage warp -set_reduction SWEETSPOT -simple -exp_name o8507h0371o -pretend
     1369chiptool -dbname gpc2 -definebyquery -set_label MOPS.ps2testquad3.20190516ops -set_workdir neb://@HOST@.0/gpc2/MOPS.ps2testquad3.20190516ops -set_data_group MOPS.ps2testquad3.20190516ops -set_dist_group NULL -set_tess_id RINGS.V3 -set_end_stage warp -set_reduction SWEETSPOT -simple -exp_name o8507h0389o  -pretend
     1370chiptool -dbname gpc2 -definebyquery -set_label MOPS.ps2testquad3.20190516ops -set_workdir neb://@HOST@.0/gpc2/MOPS.ps2testquad3.20190516ops -set_data_group MOPS.ps2testquad3.20190516ops -set_dist_group NULL -set_tess_id RINGS.V3 -set_end_stage warp -set_reduction SWEETSPOT -simple -exp_name o8507h0407o  -pretend
     1371chiptool -dbname gpc2 -definebyquery -set_label MOPS.ps2testquad3.20190516ops -set_workdir neb://@HOST@.0/gpc2/MOPS.ps2testquad3.20190516ops -set_data_group MOPS.ps2testquad3.20190516ops -set_dist_group NULL -set_tess_id RINGS.V3 -set_end_stage warp -set_reduction SWEETSPOT -simple -exp_name o8507h0425o  -pretend
     1372
     1373difftool -dbname gpc2 -definewarpwarp -warp_id 33935 -template_warp_id 33933 -backwards  -set_workdir neb://@HOST@.0/gpc2/MOPS.ps2testquad3.20190516ops -set_dist_group NULL -set_label MOPS.ps2testquad3.20190516ops -set_data_group MOPS.ps2testquad3.20190516ops -set_reduction SWEETSPOT -simple -rerun -pretend
     1374difftool -dbname gpc2 -definewarpwarp -warp_id 33934 -template_warp_id 33936 -backwards  -set_workdir neb://@HOST@.0/gpc2/MOPS.ps2testquad3.20190516ops -set_dist_group NULL -set_label MOPS.ps2testquad3.20190516ops -set_data_group MOPS.ps2testquad3.20190516ops -set_reduction SWEETSPOT -simple -rerun -pretend
     1375
     1376pubtool -dbname gpc2 -definerun -set_label MOPS.ps2testquad3.20190516ops -data_group MOPS.ps2testquad3.20190516ops -client_id 5 -simple -pretend
     1377
     1378mysql -hippdb08 -uippuser -pippuser gpc2 -B -e ' select path_base from publishRun join publishDone using (pub_id) join diffRun where publishRun.label like "MOPS.ps2testquad3.20190516ops" and stage_id=diff_id and diffRun.data_group like "MOPS.ps2testquad3.20190516ops"; ' | grep -v path_base | awk '{print "neb-ls -p "$1"%.mops"}' | tcsh
     1379}}
     1380 Things worked fine, so the system is able to handle and reduce the PS2 data.
     1381
     1382
     1383
     1384