| | 1 | = Summary of MD09.PV1_deepstack_tests = |
| | 2 | [[PageOutline]] |
| | 3 | |
| | 4 | ([wiki:MediumDeepFields] summary page) |
| | 5 | |
| | 6 | Recent deep stacks test include (label/data_group) |
| | 7 | * __MD09.deeptest.20120727__: best attempt to make a 3x input stack over the refstacks with constrained PSF on the convolved stacks for staticsky stack photometry and to avoid critical failures in order to produce a full field stack in each filter. As part of the initial MD.GR0 reprocessing, details can be found at [wiki:MD.GR0#MD09deepstacktest20120727], and only uses available exposures from 2009-2011 reprocessing (also PV1 class). |
| | 8 | * __stack-o-stacks__: an idea to try stacking night stacks in order to reduce the large processing time required in deepstacks. Local tests were run -- while the code seems to make them and in significantly less time, it is unclear how good the result is and does break some of the extra output products such as the .num.fits and .exp.fits without a good amount of development work. |
| | 9 | * __MD09.deeptest.20130330__: mostly failed attempt at increasing the input number from 20120727 due to bugs in ppStack |
| | 10 | * __MD09.alldeeptest.20130507__: a sub-field set of skycells with everything going in, only failed PSF matching rejected. (using improved ppStack version, see [wiki:stacking_coverage.20130307]) |
| | 11 | * __MD09.cutdeeptest.20130508__: a sub-field set of skycells using exposures from 2010-2012 with modest FWHM, background, ZPT cuts (see section below) |
| | 12 | * __MD09.deeptest.20130509__: full field set of all 2009-2012 exposures with modest FWHM, background, ZPT cuts. |
| | 13 | |
| | 14 | Exposures from 2012 by default are PV1, 2009-2011 are GR0 reprocessing that are also PV1 class. |
| | 15 | |
| | 16 | |
| | 17 | |
| | 18 | |
| | 19 | |
| | 20 | = MD09.alldeeptest.20130507 = |
| | 21 | Include all MD09 data from 2009-04 through end of last season Dec. 2012. |
| | 22 | |
| | 23 | Test skycells: |
| | 24 | * 027 (past problem edge mix of old 2009 and newer dither data, 1 galaxy from Thilker list) |
| | 25 | * 045 (2 galaxies) |
| | 26 | * 055 (common test skycell, center with PSF issues, 1 galaxy) |
| | 27 | * 068 (another near edge, 2 galaxies) |
| | 28 | |
| | 29 | N input and rejected warps: |
| | 30 | {{{ |
| | 31 | | stack_id | label | skycell_id | filter | fault | quality | reject_images | dtime_script | count(warp_id) | |
| | 32 | +----------+---------------------------+-------------+---------+-------+---------+---------------+--------------+----------------+ |
| | 33 | | 2237787 | MD09.alldeeptest.20130507 | skycell.027 | g.00000 | 0 | 0 | 35 | 44117 | 577 | |
| | 34 | | 2237788 | MD09.alldeeptest.20130507 | skycell.027 | i.00000 | 0 | 0 | 36 | 44957 | 583 | |
| | 35 | | 2237789 | MD09.alldeeptest.20130507 | skycell.027 | r.00000 | 0 | 0 | 259 | 40616 | 567 | |
| | 36 | | 2237790 | MD09.alldeeptest.20130507 | skycell.027 | y.00000 | 0 | 0 | 388 | 33102 | 562 | |
| | 37 | | 2237791 | MD09.alldeeptest.20130507 | skycell.027 | z.00000 | 0 | 0 | 317 | 51544 | 654 | |
| | 38 | | 2237792 | MD09.alldeeptest.20130507 | skycell.045 | g.00000 | 0 | 0 | 22 | 82983 | 578 | |
| | 39 | | 2237793 | MD09.alldeeptest.20130507 | skycell.045 | i.00000 | 0 | 0 | 38 | 83354 | 584 | |
| | 40 | | 2237794 | MD09.alldeeptest.20130507 | skycell.045 | r.00000 | 0 | 0 | 24 | 75814 | 567 | |
| | 41 | | 2237795 | MD09.alldeeptest.20130507 | skycell.045 | y.00000 | 0 | 0 | 249 | 66896 | 568 | |
| | 42 | | 2237796 | MD09.alldeeptest.20130507 | skycell.045 | z.00000 | NULL | NULL | NULL | NULL | 657 | |
| | 43 | | 2237797 | MD09.alldeeptest.20130507 | skycell.055 | g.00000 | 0 | 0 | 14 | 78568 | 578 | |
| | 44 | | 2237798 | MD09.alldeeptest.20130507 | skycell.055 | i.00000 | 0 | 0 | 33 | 83524 | 584 | |
| | 45 | | 2237799 | MD09.alldeeptest.20130507 | skycell.055 | r.00000 | 0 | 0 | 17 | 76823 | 567 | |
| | 46 | | 2237800 | MD09.alldeeptest.20130507 | skycell.055 | y.00000 | 0 | 0 | 96 | 82326 | 566 | |
| | 47 | | 2237801 | MD09.alldeeptest.20130507 | skycell.055 | z.00000 | NULL | NULL | NULL | NULL | 657 | |
| | 48 | | 2237802 | MD09.alldeeptest.20130507 | skycell.068 | g.00000 | 0 | 0 | 67 | 18716 | 338 | |
| | 49 | | 2237803 | MD09.alldeeptest.20130507 | skycell.068 | i.00000 | 0 | 0 | 54 | 20887 | 328 | |
| | 50 | | 2237804 | MD09.alldeeptest.20130507 | skycell.068 | r.00000 | 0 | 0 | 84 | 20893 | 327 | |
| | 51 | | 2237805 | MD09.alldeeptest.20130507 | skycell.068 | y.00000 | 0 | 0 | 288 | 6864 | 301 | |
| | 52 | | 2237806 | MD09.alldeeptest.20130507 | skycell.068 | z.00000 | 0 | 0 | 115 | 19176 | 353 | |
| | 53 | }}} |
| | 54 | * label=data_group on datastore and postage stamp server. If dtime_script NULL, then the stack is still running. |
| | 55 | * stack pixels to the datastore under [http://datastore.ipp.ifa.hawaii.edu/ps1-deeptest/ ps1-deeptest] |
| | 56 | |
| | 57 | |
| | 58 | = MD09.cutdeeptest.20130508 = |
| | 59 | Include all MD09 data from April 2009 through end of last season Dec. 2012, but impose exposure level cuts as suggested by Ken Chambers: |
| | 60 | * FWHM<=10 pixels (2.5") is ~9.77 pixel in exposure stats (table numbers using iq_fwhm_major) |
| | 61 | * elong<=1.5 |
| | 62 | * dZPT<=0.33 mag, so using mean ZPT grizy >= 24.09, 24.32, 24.23, 23.85, 22.89 |
| | 63 | * background grizy <= 600, 800, 2500, 4000, 6000 |
| | 64 | * drop 2009 data as may have a variety of issues |
| | 65 | * using '''2010+cuts''' in table below for cutdeeptest.20130508. 2010+ is all data 2010-2012, cuts is all data 2009-2012 with the input cuts applied (numbers for edge skycells can be greatly less). |
| | 66 | |
| | 67 | || filter || all || 2010+ || cuts || '''2010+cuts''' || comment || |
| | 68 | || || || || || || || |
| | 69 | || g || 584 || 545 || 500 || 464 || lose ~120|| |
| | 70 | || r || 571 || 530 || 498 || 457 || lose ~110 || |
| | 71 | || i || 599 || 525 || 526 || 462 || lose ~140, driven by what appears evenly by all cuts.. || |
| | 72 | || z || 660 || 599 || 598 || 539 || lose ~120 ok || |
| | 73 | || y || 575 || 552 || 421 || 401 || lose ~170, seem a problem mainly with many of poorer ZPT from marginal weather observations || |
| | 74 | || || || || || || || |
| | 75 | |
| | 76 | Test skycells (same set): |
| | 77 | * 027 (past problem edge mix of old 2009 and newer dither data, 1 galaxy) |
| | 78 | * 045 (2 galaxies) |
| | 79 | * 055 (common test skycell, center with PSF issues, 1 galaxy) |
| | 80 | * 068 (another near edge, 2 galaxies) |
| | 81 | |
| | 82 | |
| | 83 | {{{ |
| | 84 | | stack_id | label | skycell_id | filter | fault | quality | reject_images | dtime_script | count(warp_id) | |
| | 85 | +----------+---------------------------+-------------+---------+-------+---------+---------------+--------------+----------------+ |
| | 86 | | 2237807 | MD09.cutdeeptest.20130508 | skycell.027 | g.00000 | 0 | 0 | 71 | 26885 | 472 | |
| | 87 | | 2237808 | MD09.cutdeeptest.20130508 | skycell.027 | r.00000 | 0 | 0 | 132 | 35485 | 462 | |
| | 88 | | 2237809 | MD09.cutdeeptest.20130508 | skycell.027 | i.00000 | 0 | 0 | 43 | 31509 | 470 | |
| | 89 | | 2237810 | MD09.cutdeeptest.20130508 | skycell.027 | z.00000 | 0 | 0 | 56 | 34626 | 531 | |
| | 90 | | 2237811 | MD09.cutdeeptest.20130508 | skycell.027 | y.00000 | 0 | 0 | 124 | 22651 | 405 | |
| | 91 | | 2237812 | MD09.cutdeeptest.20130508 | skycell.045 | g.00000 | 0 | 0 | 45 | 55381 | 473 | |
| | 92 | | 2237813 | MD09.cutdeeptest.20130508 | skycell.045 | r.00000 | 0 | 0 | 35 | 63818 | 462 | |
| | 93 | | 2237814 | MD09.cutdeeptest.20130508 | skycell.045 | i.00000 | 0 | 0 | 30 | 61355 | 471 | |
| | 94 | | 2237815 | MD09.cutdeeptest.20130508 | skycell.045 | z.00000 | 0 | 0 | 39 | 73388 | 532 | |
| | 95 | | 2237816 | MD09.cutdeeptest.20130508 | skycell.045 | y.00000 | 0 | 0 | 63 | 169391 | 405 | |
| | 96 | | 2237817 | MD09.cutdeeptest.20130508 | skycell.055 | g.00000 | 0 | 0 | 37 | 54054 | 473 | |
| | 97 | | 2237818 | MD09.cutdeeptest.20130508 | skycell.055 | r.00000 | 0 | 0 | 44 | 65216 | 462 | |
| | 98 | | 2237819 | MD09.cutdeeptest.20130508 | skycell.055 | i.00000 | 0 | 0 | 22 | 63907 | 471 | |
| | 99 | | 2237820 | MD09.cutdeeptest.20130508 | skycell.055 | z.00000 | 0 | 0 | 38 | 72188 | 532 | |
| | 100 | | 2237821 | MD09.cutdeeptest.20130508 | skycell.055 | y.00000 | 0 | 0 | 44 | 50172 | 405 | |
| | 101 | | 2237822 | MD09.cutdeeptest.20130508 | skycell.068 | g.00000 | 0 | 0 | 50 | 11495 | 262 | |
| | 102 | | 2237823 | MD09.cutdeeptest.20130508 | skycell.068 | r.00000 | 0 | 0 | 50 | 10491 | 247 | |
| | 103 | | 2237824 | MD09.cutdeeptest.20130508 | skycell.068 | i.00000 | 0 | 0 | 47 | 9472 | 234 | |
| | 104 | | 2237825 | MD09.cutdeeptest.20130508 | skycell.068 | z.00000 | 0 | 0 | 74 | 9465 | 261 | |
| | 105 | | 2237826 | MD09.cutdeeptest.20130508 | skycell.068 | y.00000 | 0 | 0 | 121 | 5533 | 205 | |
| | 106 | }}} |
| | 107 | * label=data_group on datastore and postage stamp server |
| | 108 | * stack pixels to the datastore under [http://datastore.ipp.ifa.hawaii.edu/ps1-deeptest/ ps1-deeptest] |
| | 109 | |
| | 110 | = MD09.deeptest.20130509 = |
| | 111 | |
| | 112 | Setup with same cuts as above in MD09.cutdeeptest.20130508, but includes 2009-2012 ('''cuts''' in table). |
| | 113 | * running -- status as of 5/12 |
| | 114 | {{{ |
| | 115 | | label | filter | avg(reject_images) | avg(dtime_script) | count(stack_id) | |
| | 116 | +------------------------+---------+--------------------+-------------------+-----------------+ |
| | 117 | | MD09.deeptest.20130509 | g.00000 | 54.9254 | 38529.208954996 | 67 | /73 |
| | 118 | | MD09.deeptest.20130509 | r.00000 | 32.1538 | 12320.846153846 | 13 | /73 |
| | 119 | }}} |
| | 120 | |
