Current Tasks for the IPP Team

(Up to Main Page)

(Recently completed tasks)

(DRAVG Issues and Concerns)

Notes from WBS entries

a) Tasks required before the start of the survey:

Task	Due	Who	State	Notes
IPP to OTIS interface	3/12	CZW	DONE	we now need to iterate with OTIS
Detectability Server : psphotDetect	3/19	CZW	DONE	output values must be double-checked
Detectability Server : pstamp integration	3/26	CZW	DONE	Tested and Committed.
Raw Distribution	3/12	WS	DONE
DVO large-file upgrade	3/21	EAM	DONE
DVO merge catalogs	3/25	EAM	DONE
DVO Image-indexing	3/27	EAM	DONE

b) Tasks not required for the survey start:

Task	Due	Who	State	Notes
Finish Extended Source Analysis Code	3/31	EAM		petrosians, surface brightness profile done
Stack Photometry Process	4/30	EAM		Initial version of the code is now working
Stacks : example PS1 astrometry	3/19	PAP	DONE	this led to discovery of a 1/2 pixel error which caused many problems
Stacks : masking strategy	3/26	PAP	DONE
Plan for 3pi re-processing for stacks	4/30	PAP
Full-Scale Photometry & Astrometry Relative Calibration Demo	3/31	EAM	DONE	once with SAS, again with 3pi yz data
IPP->PSPS : missing detection fields	4/31	RH		requires input from EAM?
IPP->PSPS : missing difference fields	4/31	RH		requires input from EAM?
IPP->PSPS : stack tables	4/31	RH		blocked by 'extended source' task above
IPP->PSPS : finalize recalibration process	4/31	RH		blocked by 'Full-Scale Photometry.. Demo'
ISP automation : create detrends	3/31	HAF	DONE
ISP automation : update recipes	4/7	HAF	DONE
Distribution of Detrend Images	3/31	CZW	DONE
Integrated Release of Uncorrected Data	4/30	PAP

Tasks for the Immediate Future (these overlap the above)

• major missing features : required for the start of the survey
  • detectability server (integration with postage stamp server in progress)

• major missing features : important, but not blocking start of the survey
  • extended source analysis
  • stack photometry
  • ipp->psps interface
  • integrated release of uncorrected data
  • processing recipe for final stacks

• major demo month lessons to be addressed
  • keeping the pantasks queues filled
  • address large load spikes
  • operational rigidity
  • how to deal with down machines (on-the-fly replication?)
  • address real vs nfs failures
  • address real failures
  • more load and disk space balancing (machine limits by job?)
  • better targeting of data to nodes
  • more regular operations schedule - procesing czar
  • better tools for examining current state (more ippMon? more other tools?)

• current dev tasks
  • addstar imports from UKIDSS & SDSS
  • optimize dvo image lookups

• cluster management
  • automate cleanups of un-destreaked images
  • define reboot procedure

• psphot work:
  • 'scale error' in stacks
  • limit max source detections in psphot

• write ups
  • ppSub updates
  • DVO usage

Eugene Magnier

• email regarding data requests

• binned 4x4 mask for ken
• extended sources
  • set upper limits on Petrosian radii
  • generate a more complete test set & run tests
• ingest giebink stuff into svn trunk
• poor pixels flagged in detections

Heather Flewelling

• launch data used for stack pixel scale test with 0.200 arcsec/pixel
• addstar by night upgrade

Bill Giebink

• DIMM work
• psLib & psModules test code
• build a "realtest"

Roy Henderson

• PSPS work
• PSPS interface bugs

Paul Price

1. missing MOPS detections
2. update publish for MOPS (use PS1_DV1 CMF format and include moments)
3. Pipeline for uncorrected data
4. Implement ippdb/ippTools/ippTasks for stackphot

• pay attention to stack, diff, warps failures
• add skycell_id and tess_id to headers of diff + stack outputs (incl cmfs)
• check use of FWHM for ppSub scaling
• write up and demo data set for ppSub / ppStack

Bill Sweeney

• fix warptool blockage
• postage stamp server
  • stamps from cleaned runs - write tasks for detecting update completion - 1 week
    • optimize : don't reprocess everything
  • repair un-censored deletion : 2 days
  • meet with NCU folks on pstamp web interface
  • improve access control add quotas
  • enhance web interface with new features especially parse results file and display
  • automate cleanup of old requests -
  • update user documentation

Chris Waters

• SVN revisions/mask fraction values added to database
• create exposure level warp/diff/stack JPEG images
• bug tracker cleanup
• integrate tools/ directory
• queue rawExp compressions -- need more rawExp to compress
• sas relphot & relastro

Cindy Giebink & Steph Mohr

• ipp005 bios needs to be reset (wait for Gavin)
• debug hardware problems on ipp008, 9, 14, 16, 18
• move homedirs to ippc18
• areca scripts for automatic verify
• try neb-hosts with Chris
• work with Bill Sweeney to get otis