Changes between Version 32 and Version 33 of PS1_IPP_Czarlog_20190510

Timestamp:

May 16, 2019, 1:51:08 PM (7 years ago)

Author:

tdeboer

Comment:

--

PS1_IPP_Czarlog_20190510

@@ -1297 +1297 @@
  --------------
 
- I got fed up with wait states still appearing in the update.LAP.PV3 label, due to the data_group of the chipRun exp that corresponds to the most recent processing of that particular warp being in wait state. We have been cleaning up wait states by data_group, but if there is exps that come from data_groups that have not been cleaned yet, they can still be in wait. In this case, the update batch looks for warp exps in the cleaned state from data_group="LAP.PV3.20140730.20150%" but there was a batch of chip exps that was most recently reprocessed
-from a data_group that was not cleaned yet. To avoid these situations in the future, I decided to run my query that find most recent reprocessings and limit that to the wait state (but expanded it to cover every data_group)
+ I got fed up with wait states still appearing in the update.LAP.PV3 label, due to the data_group of the chipRun exp that corresponds to the most recent processing of that particular warp being in wait state. We have been cleaning up wait states by data_group, but if there is exps that come from data_groups that have not been cleaned yet, they can still be in wait. In this case, the update batch looks for warp exps in the cleaned state from data_group="LAP.PV3.20140730.20150%" but there was a batch of chip exps that was most recently reprocessed from a data_group that was not cleaned yet. To avoid these situations in the future, I decided to run my query that find most recent reprocessings and limit that to the wait state (but expanded it to cover every data_group)
 {{{
 mysql -hscidbm -uX -pX gpc1 -B -e 'SELECT suba.exp_id,subb.warp_id,subb.chip_id,subb.maxstate,subb.data_group,subb.label,subb.maxchipstate FROM (SELECT exp_id FROM warpRun JOIN fakeRun USING (fake_id) JOIN camRun USING (cam_id) JOIN chipRun USING (chip_id) JOIN rawExp USING (exp_id) WHERE warpRun.state NOT LIKE "%full%" AND rawExp.camera LIKE "%GPC1%" GROUP BY exp_id) as suba INNER JOIN (SELECT * FROM (SELECT warp_id,chipRun.exp_id,chipRun.chip_id,warpRun.state as maxstate,warpRun.data_group,camRun.label,chipRun.state as maxchipstate FROM warpRun JOIN fakeRun USING (fake_id) JOIN camRun USING (cam_id) JOIN chipRun USING (chip_id) JOIN rawExp USING (exp_id) WHERE rawExp.camera LIKE "%GPC1%" ORDER BY warp_id DESC) as od GROUP BY od.exp_id) AS subb ON (subb.exp_id = suba.exp_id) WHERE subb.maxstate LIKE "cleaned" and subb.maxchipstate LIKE "wait" group by subb.data_group;' | grep -v data_group | awk '{print "chiptool -dbname gpc1 -updaterun -set_state goto_cleaned -set_label goto_cleaned -chip_id  "$3}' > todo