Changes between Initial Version and Version 1 of SA9ndetections

Timestamp:

Sep 28, 2012, 1:48:06 PM (14 years ago)

Author:

heather

Comment:

--

SA9ndetections

@@ +1 @@
+== PSPS SA9 objects/ndetections investigations ==
+
+There are problems with ndetections in objects table in PSPS, there are several varieties of problems:
+
+=== ndetections = -999 ===
+
+How to find:
+{{{
+select count(*) from object where ndetections = -999
+}}}
+
+Heather did a slightly different version, to try to figure out where these things live:
+
+{{{
+select (ippobjid/1000000000), count (*) as n from objects where ndetections = -999 group by (ippobjid/1000000000) order by n desc
+}}}
+
+This gives the following ( there are a lot of them these are only the top 'interesting' ones):
+
+|| ippobjid thing || count(*) || batch ||
+||93293 ||      12300 || 360500 -- this is the failed ob batch  why do these go into the db?||
+||93096 ||      7398 ||   no batch ||
+||18740 ||      6601||  ... ||
+||93092||       6577||
+||18744 ||6351||
+||93116 ||5752||
+||93120||       5657||
+||93088||       3902||
+||93100||       3866||
+||18768||       3552||
+||18748||       3463||
+||93112||       3323||
+||18756||       3205||
+||18764||       231||
+||18986||       213 ||
+||etc   ||   ||
+
+The first one is interesting - it is the OB batch that failed to load. That should not be put into PSPS (heather thinks)
+
+The others, what are they?  The ippobjid/1000000000 corresponds to the 'stage_id', but according to ipptopsps.batch, there is no batch with those stage ids.. I grabbed one of the fault ones:
+ * objid = 104073276979184735   
+ * ippobjid = 93096000007333
+ * ra = 327.697918
+ * dec = -3.27140108245
+
+and asked which batches it could live in (based on min/max obj id). I get the following 20 batches which I downloaded:
+{{{
+mysql> select batch_id, stage_id from batch where min_obj_id < 104073276979184735 and
+ max_obj_id > 104073276979184735 and dvo_db = 'SAS.20120905' and batch_type = 'OB';
++----------+----------+
+| batch_id | stage_id |
++----------+----------+
+|   359431 |    93354 | 
+|   359433 |    93355 | 
+|   359614 |    93157 | 
+|   359615 |    93158 | 
+|   359616 |    93159 | 
+|   359617 |    93160 | 
+|   360325 |    93259 | 
+|   360332 |    93260 | 
+|   360367 |    93305 | 
+|   360373 |    93306 | 
+|   361579 |    93307 | 
+|   361582 |    93308 | 
+|   361595 |    93353 | 
+|   361676 |    93209 | 
+|   361762 |    93257 | 
+|   361781 |    93258 | 
+|   362277 |    93356 | 
+|   362355 |    93210 | 
+|   362356 |    93211 | 
+|   362362 |    93212 | 
++----------+----------+
+20 rows in set (0.14 sec)
+}}}
+
+
+
+=== ndetections = very large number ===
+
+
+
+=== ndetections != ng + nr + ni + nz + ny ===
+
+