Changes between Version 11 and Version 12 of PS1_IPP_Czarlog_20190408

Timestamp:

Apr 11, 2019, 4:16:41 PM (7 years ago)

Author:

fairlamb

Comment:

--

PS1_IPP_Czarlog_20190408

@@ -83 +83 @@
 === Wednesday : 2019.MM.DD ===
 
-'''Root partition is critical ippc72''' by JRF
+'''Root partition is critical ippc71''' by JRF
 
-  TODO: tomorrow This is one of the apache nodes, so the logs will need to be archived.Check out the czar log from (SOME DATE). And see this page for how to clear them:
+    Check the /tmp/nebulous_server.log size
+    The root partition is getting pretty full on ippc71
+    {{{
+    71 - 71GB
+    72 - 67GB
+    73 - 63GB
+    74 - 70GB
+    75 - 60GB
+    }}}
+    It's also getting pretty large of the other apache servers too.
+
+    Follow the procedure from Wednesday : 2019.02.06 , see: https://svn.pan-starrs.ifa.hawaii.edu/trac/ipp/wiki/PS1_IPP_Czarlog_20190204
+    I first shutdown all the pantasks, then on each machine, stopped apaches, removed the log, replaced it with a fresh empty log with the correct permissions and started apache again.
+
+JRF: ipp112.1 is getting pretty full on data so I've moved it into repair
+
+'''No Mask for MOPS''' by JRF
+
+chiptool -definebyquery -set_label mops.nomasktest  -set_workdir neb://@HOST@.0/gpc1/mops.nomasktest -set_data_group mops.nomasktest -set_dist_group NULL -set_tess_id RINGS.V3 -set_end_stage warp -set_reduction NOMASKTEST -dbname gpc1 -exp_name o8582g0236o
+chiptool -definebyquery -set_label mops.nomasktest  -set_workdir neb://@HOST@.0/gpc1/mops.nomasktest -set_data_group mops.nomasktest -set_dist_group NULL -set_tess_id RINGS.V3 -set_end_stage warp -set_reduction NOMASKTEST -dbname gpc1 -exp_name o8582g0219o
+chiptool -definebyquery -set_label mops.nomasktest  -set_workdir neb://@HOST@.0/gpc1/mops.nomasktest -set_data_group mops.nomasktest -set_dist_group NULL -set_tess_id RINGS.V3 -set_end_stage warp -set_reduction NOMASKTEST -dbname gpc1 -exp_name o8582g0202o
+chiptool -definebyquery -set_label mops.nomasktest  -set_workdir neb://@HOST@.0/gpc1/mops.nomasktest -set_data_group mops.nomasktest -set_dist_group NULL -set_tess_id RINGS.V3 -set_end_stage warp -set_reduction NOMASKTEST -dbname gpc1 -exp_name o8582g0185o
+
+SELECT rawExp.exp_name, rawExp.exp_id, chipRun.chip_id, chipRun.label chip_label, chipRun.state chip_state, warpRun.warp_id, warpRun.state warp_state FROM rawExp JOIN chipRun USING (exp_id) JOIN camRun USING (chip_id) JOIN fakeRun USING (cam_id) JOIN warpRun USING (fake_id) WHERE exp_name IN 
+("o8582g0236o","o8582g0219o","o8582g0202o","o8582g0185o");
 
 === Thursday : 2019.MM.DD ===