IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changes between Version 2 and Version 3 of DatabaseBackups


Ignore:
Timestamp:
Sep 16, 2009, 10:41:39 AM (17 years ago)
Author:
eugene
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • DatabaseBackups

    v2 v3  
    33(Up to [wiki:IPP_for_PS1 IPP for PS1])
    44
    5 Thanks to efforts by Cindy & Gavin, regular dumps of the two mysql databases being used by the processing system on maui (the ippdb and the nebulous database) are now being made available via the rsync server on ipp0002.ifa.hawaii.edu.  These are dumped every 4 hours, and are available from the rsync location:
     5'''Updated: We have recently (2009.09.16) changed the dump scheme to only dump the specific databases of interest.  The text below reflects this change.'''
     6
     7Thanks to efforts by Cindy & Gavin, regular dumps of the mysql databases being used by the processing system on Maui are now being made available via the rsync server on ipp0002.ifa.hawaii.edu.  The three databases distributed are the gpc1 processing database, the isp processing database, and the ippadmin database describing the database schema.  These are dumped every 4 hours, and are available from the rsync location:
    68
    79rsync://ipp0002.ifa.hawaii.edu/ippdb
    810
    9 if you want both, give a command like:
     11if you want all three, give a command like:
    1012
    1113rsync -auv rsync://ipp0002.ifa.hawaii.edu/ippdb/ ippdb/
    1214
    13 the database with the gpc1 processing information is in the file called ippdb01.dump.gz, while the nebulous database is in the dump called ippdb02.dump.gz.  These gzip files are currently 2.8GB and 1.8GB, so be careful.  They are also dumped every 4 hours, and the new one replaces the old name.  If people are unable to retrieve these in less than the 4 hour period (~1Mbit/sec), then we can adjust the naming to keep more than one old version around. 
     15The databases have names of the form ippdb01-DBNAME.dump.gz, eg, the GPC1 processing information is in the file called ippdb01-gpc1.dump.gz.  The GPC1 gzip file is currently 0.8GB, so be careful.  They are also dumped every 4 hours, and the new one replaces the old name.  If people are unable to retrieve these in less than the 4 hour period (~0.4 Mbit/sec), then we can adjust the naming to keep more than one old version around. 
    1416
    1517If you want just one of the above databases, use a command like:
    1618
    17 rsync rsync://ipp0002.ifa.hawaii.edu/ippdb/ippdb01.dump.gz .
     19rsync rsync://ipp0002.ifa.hawaii.edu/ippdb/ippdb01-gpc1.dump.gz .
    1820
    1921For reference, all of the various ipp mysql databases are now being dumped to /data/ipp000.0/ipp/mysql-dumps (had been /data/ipp000.0/jhoblitt/mysql-dumps), and these above two are linked into the 'distribution' subdirectory, which is made visible via the rsync server.  We are moving to a system of keeping a sampling of the old databases with the following timescales:
     
    2527
    2628(currently, we are keeping all of the old copies with a linear spacing...)
    27