Return to the Main Page

Top-Level Overview

• IPP data model: Information on structure and content of IPP outputs

IPP Pipeline Database

• ippTools FAQ : how you tell pantasks what to do
• ippdb duplicate data
• ​bash interface to query the IPP mySQL database (A. Riffeser 2008/09/23)
• ippdb copy database : copy the entire contents of a mySql database into a new database.

Pantasks & ippTasks

• Pantasks FAQ : common questions and problems with pantasks
• Pantasks server mode : guide to running pantasks in the "server" mode.

Nebulous

• Nebulous FAQ
• Nebulous Throughput Issues

Detrend Creation

• Bad Pixel Masks : General description of how bad pixel masks are constructed. S.Rodney
• Biases
• Darks
• Flats
• Fringes
• Masks
• Shutter Correction

Analysis Components

• Deep field photometry - Durham_WHDF
• Extended source photometry - Sloan

Science Analysis Stages

• Chip
• Camera
• Fake
• Warp
• Stack
• Diff
• Magic

psLib

• fits I/O code

psModules

DVO

Introduction

DVO (the Desktop Virtual Observatory) is a system for manipulating collections of images and measurements related to astronomical objects. The DVO system consists of several programs which insert data in the database system, extract data from the database, or manipulate data in the database. One of these is the DVO shell, which provides a command-line driven, programmable user interface to the astronomical objects and measurements in the database. The DVO shell is based on the Opihi shell language which provides the tools to manipulate and display data in various representations. The DVO shell adds to this basic command set a collection of functions which provide direct access to the contents of the DVO database tables.

Schema

DVO uses the following database tables:

• Sky Layout : defines the organization of the object / measurement tables on the sky
• Photcodes : defines the photometric systems and transformations between them
• Images : describes the images known the DVO; for a mosaic camera, one chip corresponds to a single image, and an additional meta-image is used to represent the full mosaic (note: these meta-images may soon be moved to a separate table; also note that the mosaic meta-image is only supplied for mosaic images with 'mosaic' astrometry solutions).
• Average : average properties of the astronomical objects, excluding photometric average information (one row per object)
• SecFilt : average photometric properties for astronomical objects (one row per 'average' filter per object).
• Measure : all detections of the astronomical objects
• Missing : non-detections of known astronomical objects nominally touched by an image (note : this table is not populated by default)

The standard implementation of DVO uses a stores the database information as a collection FITS tables. For a subset of the tables (Average, SecFilt, Measure, Missing), the data is partitioned into multiple files representing different regions on the sky. The partitioning scheme allows for a wide range of scale on which the sky is divided. At one extreme, the entire sky is represented by a single file. At the next level, this is split into Declination bands of width 7.5 degrees. Next, these bands are split into RA ranges. The next levels subdivide the RA / DEC ranges into smaller and smaller patches. From the third level on down, the size of the sky regions varies with Galactic latitude to better sample regions of high and low stellar density.

DVO Shell

• Opihi Shell Language
• DVO Command Help Pages

Working With DVO

• Inserting Data (addstar)

Other DVO Pages

• DVO FAQ -- look here for questions and solutions and add your own!
• ​DVO Intro : introduction to the Desktop Virtual Observatory (on the CFHT elixir pages)
• ​dvo.pdf manual from project documentation pages (needs updating, but describes concepts of dvo)
• DVO DB Synth grizy bright -- Bright-end subset DVO database with complete Ohana tarball
• DVO Example -- a tarball and instructions on very basic DVO usage
• DVO Challenge -- links to notes and Heidelberg slides created by Mike Liu
  • Includes FAQs and change suggestions
• USNO-B in DVO : Building the USNO-B DVO catalog
• 2MASS, USNO-B, SDSS Merge : Notes on generating a merged DVO database
• 2MASS info in DVO : A quick summary on what info from 2MASS has been imported into DVO
• DVO GPC1 pt 2 : MWV's test of DVO and addstar with GPC1 pt 2 release (see mail to ps-ipp-users from Gene Magnier on 2008/10/06)

• SDSS stripe82 data set For the daring, here is a 202 MB tarfile expanding into a 588 MB directory with a very small subset of multi-epoch (but not [yet] coadded) SDSS stripe 82 data at ​http://www.mpia.de/homes/jester/IPPstripe82_catdir_20080610.tgz The README describes what's there and how it was made. This is not (yet) useful for science! Email jester at mpia.de with questions regarding this dataset.

Simtest

• New Simtest: Running the revised Simtest (IPP 2.6 and later)
• ​IPP-2.6 simtest tutorial (pdf): about simtest & ippMonitor by A. Riffeser
• Simtest: Annotated walk-through. S.Rodney, modified for IPP 2.2 by M. Wood-Vasey
• SimtestEAM : EAM notes
• Simtest Verification: verification of SIMTEST input/output data products
• Simtest2.1Notes : Some notes I took while running simtest on IPP 2.1. By Julia Fang
• Simtest_IPP_2.1: Annotated walk-through. S.Rodney