Changes between Version 16 and Version 17 of MDdeeptest_pixrej_20140403

Timestamp:

May 7, 2014, 9:00:50 PM (12 years ago)

Author:

Mark Huber

Comment:

--

MDdeeptest_pixrej_20140403

@@ -19 +19 @@
 = Example Junk and Bugs = 
 
-Large regions of high level, bad pixels (s065i -- diffract spike chunks [1129,4256], the moth []) -- bug
+Large regions of high level, bad pixels ( md04s065i -- diffract spike chunks (1129,4256), the moth () ) -- bug
 
 || img || mk || wt || num || exp || expwt || 
@@ -29 +29 @@
  
 
-Excess hot pixels/CR-like (s065i [4099,4651],[4752,4853]) -- bug 
+Excess hot pixels/CR-like ( md04s065i (4099,4651),(4752,4853) ) -- bug 
 
 || img || 
@@ -37 +37 @@
 [[Image(md04s065i_stackjunk_crlike_2_ds9.jpg,300px)]]
 
- * due to bug shown after NAN/0 bug fixed, sigma sometimes being set to a negative value resulting in final mean and sigma going NAN (then all inputs used...)
-
-
-Large region of low level, bad pixels (s013g []) -- bug? much can be reduced by config mods
+ * due to bug, showing up after NAN/0 bug fixed, sigma sometimes being set to a negative value resulting in final mean and sigma going NAN (then all inputs again used...)
+
+
+Large region of low level, poor/bad pixels ( md04s013g () ) -- bug? much can be reduced by config mods
 
 || img || mk || num || wt || 
@@ -49 +49 @@
 
 
-Edge ''pomegranate-like webbing'' (s013g [], md09s012g extensive) -- bug? much can be reduced by config mods
+Edge junk and ''pomegranate-like webbing'' ( md04s013g (), md09s012g extensive () ) -- bug? much can be reduced by config mods and added N input minimum per pixel (NMINPIX)
 
 || img || mk || num || wt || 
@@ -55 +55 @@
 [[Image(md04s013g_stackjunk_edgepom_2_ds9.jpg,600px)]]
 
- * greatly reduced by lowering THRESHOLD.MASK 0.5->0.3 (may need further modifications, to 0.01 even better) 
+ * webbing greatly reduced by lowering THRESHOLD.MASK 0.5->0.3 (may need further modifications, 0.01 even better) 
+ * edge junk also cleaned up by rejecting pixels with <20 inputs (NMINPIX 20)
 
 [[Image(md04s013g_stackjunk_edgepom_2_n20thr03_ds9.jpg,600px)]]
 
- * md09s12g example -- similar or different case?
-
-
-Misc edge junk -- add 3PI or impose a Nin miminum per pixel?
-
-
-Specially skipped edge junk -- strip along skycell with fair amount of junk ignored, 2*kernel size..
- * 2*kernel=20 pixels, MD.V3 skycell overlap is 320 pixels -- this should just be entirely MASKED
+
+
+
+Other case of ''pomegranate-like webbing'' (md09s ) -- different cause, appears to be incomplete rejection of bright, scattered light. Bug? Lower threshold (THRESHOLD.MASK) helps, but likely need to reject a set of entire inputs as poor/bad.
+
+[[Image(.jpg,600px)]]
+
+
+Setting SUSPECT input pixels as bad -- 
+
+[[Image(.jpg,600px)]]
+
+Other streak-like features still (md09s00g () ) -- another bug? Lower threshold (THRESHOLD.MASK) helps but not always.
+
+
+Edge of skycell junk -- strip along skycell with fair amount of junk ignored, kernel size (all stacks have this problem)
+ * KERNEL.SIZE=20 pixels, MD.V3 skycell overlap is 320 pixels -- this area should just be entirely MASKED
+
+[[Image(.jpg,600px)]]
+
+
+Concern with lower threshold (THRESHOLD.MASK 0.5 to 0.3 to 0.1) will over-clip input pixels particularly in brighter sources -- 
+
+[[Image(.jpg,600px)]]
 
 
@@ -72 +89 @@
 
 
-= Test Samples = 
-
-All stacks should be available via the Postage Stamp Server (PSS), if large or full sets are desired then they can be found as usual on the datastore under ps1-deeptest with the data_group name the same as the label. Warp examples should be obtainable via the PSS but will not be pushed to the distribution server.
+= Full Field Test Samples = 
+
+All stacks should be available via the Postage Stamp Server (PSS), if large or full sets are desired then they can be found as usual on the datastore under ps1-deeptest with the data_group name the same as the label. Warp examples should be obtainable via the PSS and will not be pushed to the distribution server.
 
 __MD04 PV2 warps__ -- the full test runs below used all available PV2 through the end of the survey ([wiki:MD.PV2])