IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links
wiki:201103_Optimization

I'm detailing here the optimization performed on the Nebulous and gpc1 databases in march 2011.

Nebulous Optimization

  • Run as ipp on ippdb00
  • Each table was optimized one after the other See attached log file: -> log.nebulous.optimization
  • Size variation (unfortunately I didn't record all the tables):
Table name #elements in table Size after opt.(bytes) Size before opt.(bytes)
cabinet 8
deleted 510597
directory 5264597
instance 439024114 156091023360 204308742144 -24%
lock_record 0
log 0
mountedvol 49
storage_object 390559412 165691785216 204665257984 -20%
storage_object_attr 390559412
storage_object_xattr 53272583
volume 52

GPC1 Optimization

  • Run as ipp on ippdb01
  • Each table was optimized one after the other See attached log file: -> log.gpc1.optimization
  • Size variation:
Total110201241600 79408070656 -27.9%
Filename Before After VariationLook at that!
Label.ibd 131072 131072
addMask.ibd 98304 98304
addProcessedExp.ibd 26214400 26214400
addRun.ibd 58720256 54525952 -7.1%
calDB.ibd 114688 114688
calRun.ibd 131072 131072
camMask.ibd 98304 98304
camProcessedExp.ibd 100663296 88080384 -12.5% ||
camRun.ibd 117440512 109051904 -7.1%
chipBackgroundImfile.ibd 54525952 37748736 -30.8% !||
chipBackgroundRun.ibd 8388608 819200 -90.2% !!||
chipImfile.ibd 843055104 843055104
chipMask.ibd 98304 98304
chipProcessedImfile.ibd 8573157376 7004487680 -18.3% ||
chipRun.ibd 134217728 113246208 -15.6% ||
dbversion.ibd 98304 98304
detInputExp.ibd 12582912 11534336 -8.3%
detNormalizedExp.ibd 114688 114688
detNormalizedImfile.ibd 12582912 10485760 -16.7% ||
detNormalizedStatImfile.ibd 835584 655360 -21.6% ||
detProcessedExp.ibd 10485760 10485760
detProcessedImfile.ibd 373293056 264241152 -29.2% !||
detRegisteredImfile.ibd 9437184 9437184
detResidExp.ibd 11534336 10485760 -9.1%
detResidImfile.ibd 381681664 255852544 -33.0% !||
detRun.ibd 344064 344064
detRunSummary.ibd 147456 114688 -22.2% ||
detStackedImfile.ibd 11534336 10485760 -9.1%
detectionEfficiency.ibd 780140544 318767104 -59.1% !!||
diffInputSkyfile.ibd 4102029312 4097835008 -0.1%
diffPhotRun.ibd 10485760 10485760
diffPhotSkyfile.ibd 226492416 121634816 -46.3% !||
diffRun.ibd 67108864 58720256 -12.5% ||
diffSkyfile.ibd 4223664128 3070230528 -27.3% !||
diffSummary.ibd 41943040 30408704 -27.5% !||
distComponent.ibd 5402263552 2906652672 -46.2% !||
distRun.ibd 314572800 247463936 -21.3% ||
distTarget.ibd 655360 655360
dqstatsContent.ibd 130023424 130023424
dqstatsRun.ibd 475136 491520
fakeMask.ibd 98304 98304
fakeProcessedImfile.ibd 4194304000 2323644416 -44.6% !||
fakeRun.ibd 92274688 88080384 -4.5%
flatcorrAddstarLink.ibd 311296 311296
flatcorrCamLink.ibd 557056 557056
flatcorrChipLink.ibd 360448 360448
flatcorrRun.ibd 114688 114688
magicDSFile.ibd 8191475712 5607784448 -31.5% !||
magicDSRun.ibd 255852544 239075328 -6.6%
magicDSUpdateRun.ibd 54525952 37748736 -30.8% !||
magicInputSkyfile.ibd 427819008 427819008
magicMask.ibd 46137344 37748736 -18.2% ||
magicNodeResult.ibd 3984588800 2000683008 -49.8% !||
magicRun.ibd 79691776 71303168 -10.5% ||
magicTree.ibd 5226102784 5226102784
magicUpdateRun.ibd 18874368 17825792 -5.6%
minidvodbCopy.ibd 131072 114688 -12.5% ||
minidvodbProcessed.ibd 180224 163840 -9.1%
minidvodbRun.ibd 196608 180224 -8.3%
newExp.ibd 100663296 96468992 -4.2%
newImfile.ibd 3632267264 2722103296 -25.1% !||
publishClient.ibd 114688 114688
publishDone.ibd 31457280 25165824 -20.0% ||
publishRun.ibd 58720256 50331648 -14.3% ||
pzDataStore.ibd 98304 98304
pzDownloadExp.ibd 41943040 37748736 -10.0%
pzDownloadImfile.ibd 5951717376 3435134976 -42.3% !||
rawExp.ibd 184549376 155189248 -15.9% ||
rawImfile.ibd 16655581184 14298382336 -14.2% ||
rcDSFileset.ibd 121634816 100663296 -17.2% ||
rcDestination.ibd 114688 114688
rcInterest.ibd 573440 589824
rcRun.ibd 131072 131072
receiveFile.ibd 131072 131072
receiveFileset.ibd 131072 131072
receiveResult.ibd 114688 114688
receiveSource.ibd 147456 147456
stackAssociation.ibd 524288 524288
stackAssociationMap.ibd 15728640 15728640
stackInputSkyfile.ibd 230686720 226492416 -1.8%
stackRun.ibd 125829120 109051904 -13.3% ||
stackSumSkyfile.ibd 134217728 109051904 -18.8% ||
stackSummary.ibd 475136 376832 -20.7% ||
staticskyInput.ibd 163840 163840
staticskyResult.ibd 196608 180224 -8.3%
staticskyRun.ibd 212992 196608 -7.7%
summitExp.ibd 67108864 58720256 -12.5% ||
summitImfile.ibd 5616173056 4630511616 -17.6% ||
warpBackgroundRun.ibd 1015808 917504 -9.7%
warpBackgroundSkyfile.ibd 75497472 54525952 -27.8% !||
warpImfile.ibd 2646605824 2172649472 -17.9% ||
warpMask.ibd 98304 98304
warpRun.ibd 113246208 96468992 -14.8% ||
warpSkyCellMap.ibd 13170114560 5901385728 -55.2% !!||
warpSkyfile.ibd 12532580352 9118416896 -27.2% !||
warpSummary.ibd 75497472 54525952 -27.8% !||
Last modified 15 years ago Last modified on Mar 4, 2011, 2:36:58 PM

Attachments (2)

Download all attachments as: .zip

Note: See TracWiki for help on using the wiki.