PSNSC_NCU requirements and notes (draft) -- 


NCU observations -- processing needs to be finished by early morning for MOPS to use for NEO
 * obs_mode NCU -- new, possibly start end Oct 2016 
  * 4 chunks (returns) -- NCU1B...NCU4B; NCU1A...NCU4A -- see night sequence below
     * B=color set, sequence wgwrwiwz per chunk (8 targets each)
     * A=w-band only, wwwwwwww (8 targets each) 
  * 8 targets (fields) --   NCU1.1...NCU1.8; NCU2.1...NCU2.8; NCU3.1...NCU3.8 ; NCU4.1...NCU4.8 (chunk#.target#)
   * 4 above, 4 below ecliptic centered around opposition
  * no dither in a night (no rotation like MD/QUB/FSS) -- offset done each night mean motion retrograde (W along ecliptic, ~0.3 degrees?)
  * exposures per field -- 
   * griz -- 
    A: 1/chunk * 4 chunks = 4
   * w -- 
    * B: 4/chunk * 4 chunks = 16
    * A: 8/chunk * 4 chunk = 32
  * 4 sequential nights, ~6 hr/night?
  * exptimes wgriz: 60,120,120,120,180s
  * run queue sequence then 
   * night 1: NCU1B, NCU2B, NCU3B, NCU4B -- only color queue -- return to exact position, no dither 
   * night 2: NCU1A, NCU2A, NCU3A, NCU4A -- only w queue -- return each time to position (no dither), but has target/field center motion shift from previous night
   * night 3: NCU1A, NCU2A, NCU3A, NCU4A -- only w queue -- return each time to position (no dither), but has target/field center motion shift from previous night
   * night 4: NCU1A, NCU2A, NCU3A, NCU4A -- only w queue -- return each time to position (no dither), but has target/field center motion shift from previous night
  * chunk name (QUEUEID keyword in headers) -- may want to add filter here like in comment string below
  * target name (OBJECT keyword in headers) -- NCU(chunk#.target#) -- may be enough to trigger for WW per chunk (8 visits) rather than all night (32 visits), may also trigger .multi case too over the multiple nights...
  * comment string -- needs to be descriptive and easily parsed, need to check with MOPS for WS grouping/parsing issues (spaces) -- 
   * B: old format: NCU1B w4 NCU1.1 -- (chunk) (filter)(visit# for w only) NCU(chunk#.target#) -- want to add "visit #" at end of comment (1-4), move filter to chunk name
   * B: new format: (chunk).(filter) NCU(chunk#.target#) (visit # in chunk)
{{{
NCU1B.w NCU1.1 visit 1
NCU1B.w NCU1.2 visit 1
...
NCU1B.g NCU1.1 visit 1
NCU1B.g NCU1.2 visit 1
...
NCU1B.w NCU1.1 visit 2
NCU1B.w NCU1.2 visit 2
...
NCU1B.r NCU1.1 visit 1
...
NCU1B.r NCU1.8 visit 1


NCU2B.w NCU2.1 visit 1
NCU2B.w NCU2.2 visit 1
...
NCU2B.g NCU2.1 visit 1
NCU2B.g NCU2.2 visit 1
...
NCU2B.w NCU2.1 visit 2
NCU2B.w NCU2.2 visit 2
...
NCU2B.r NCU2.1 visit 1
...
NCU2B.w NCU2.1 visit 4
...
NCU2B.z NCU2.8 visit 1


NCU3B.w NCU3.1 visit 1
...
NCU3B.w NCU3.8 visit 1


NCU4B.w NCU4.1 visit 1
...
NCU4B.w NCU4.8 visit 4

}}}
   * A: old format: NCU1A NCU1.1 -- (chunk) NCU(chunk#.target#) -- add "w" so similar format for B and "visit #" at end of comment (1-8), move filter to chunk name
   * A: new format make similar: (chunk).(filter) NCU(chunk#.target#) (visit # in chunk)
{{{
NCU1A.w NCU1.1 visit 1
NCU1A.w NCU1.2 visit 1
NCU1A.w NCU1.3 visit 1
...
NCU1A.w NCU1.1 visit 2
NCU1A.w NCU1.2 visit 2
...
NCU1A.w NCU1.1 visit 8
...
NCU1A.w NCU1.8 visit 8


NCU2A.w NCU2.1 visit 1
NCU2A.w NCU2.2 visit 1
...
NCU2A.w NCU2.8 visit 8

...
}}}

 * chip->warp normal stdscience pantasks as with xSS products (ipp-20141024 tag)
 * WSdiff runs in ~ippmops/stdscience_ws with modified ipp-20141024 ops tag to make uncompressed WSdiffs (like FSS)
  * larger volume, may need more nodes -- must be uncompressed for MOPS stamps since large data volume
  * default detection @5-sigma while WWdiff is <5-sigma and may need to be adjusted -- 
 * WSdiff published to normal MOPS datastore location?


Processing products -- czar needs to make sure all faults and issues are cleared daily (early morning) for NCU.* products
 * chip-cam-warp -- NCU.nightlyscience -- nightly
 * warp-stack diffims -- NCU.WS.nightlyscience -- nightly
 * publishing of WSdiffs -- (need datastore location to use from MOPS) -- nightly
 * manually done -- not czar responsibility
  * nightly stack -- NCU.nightlyscience -- nightly, manually done to avoid any poor images
  * stack-stack diffims -- NCU.SS.nightlyscience -- nightly, likely automatic possible once manual stacks made
 * stamps -- TBD


Cleanup --
 * chip -- 1 day?
 * warp -- 2 days (no specific requirement?)
 * WSdiff -- 1 day? uncompressed so likely will need to limit and just do updates for stamps
 * publishing WSdiff catalog bundles -- 
 * pstamp -- manual cleanup like other ps_ud_%


Tasks to do -- 
 * verify w-band stacks okay along ecliptic for opposition end October
 * check processing rate/nodes for WSdiffs
 * MOPS interested in SSdiff?
 * publishing location for WSdiff by MOPS preference -- IPP-MOPS-TEST or IPP-MOPS-WS -- unique set so likely normal location 
 * detection threshold -- 5-sigma default but may need to lower?