I'm detailing here the optimization performed on the Nebulous and gpc1 databases in march 2011.
Nebulous Optimization
- Run as ipp on ippdb00
- Each table was optimized one after the other See attached log file: -> log.nebulous.optimization
- Size variation (unfortunately I didn't record all the tables):
| Table name | #elements in table | Size after opt.(bytes) | Size before opt.(bytes) | |
| cabinet | 8 | |||
| deleted | 510597 | |||
| directory | 5264597 | |||
| instance | 439024114 | 156091023360 | 204308742144 | -24% |
| lock_record | 0 | |||
| log | 0 | |||
| mountedvol | 49 | |||
| storage_object | 390559412 | 165691785216 | 204665257984 | -20% |
| storage_object_attr | 390559412 | |||
| storage_object_xattr | 53272583 | |||
| volume | 52 |
GPC1 Optimization
- Run as ipp on ippdb01
- Each table was optimized one after the other See attached log file: -> log.gpc1.optimization
- Size variation:
| Total | 110201241600 | 79408070656 | -27.9% | |
| Filename | Before | After | Variation | Look at that! |
| Label.ibd | 131072 | 131072 | ||
| addMask.ibd | 98304 | 98304 | ||
| addProcessedExp.ibd | 26214400 | 26214400 | ||
| addRun.ibd | 58720256 | 54525952 | -7.1% | |
| calDB.ibd | 114688 | 114688 | ||
| calRun.ibd | 131072 | 131072 | ||
| camMask.ibd | 98304 | 98304 | ||
| camProcessedExp.ibd | 100663296 | 88080384 | -12.5% | || |
| camRun.ibd | 117440512 | 109051904 | -7.1% | |
| chipBackgroundImfile.ibd | 54525952 | 37748736 | -30.8% | !|| |
| chipBackgroundRun.ibd | 8388608 | 819200 | -90.2% | !!|| |
| chipImfile.ibd | 843055104 | 843055104 | ||
| chipMask.ibd | 98304 | 98304 | ||
| chipProcessedImfile.ibd | 8573157376 | 7004487680 | -18.3% | || |
| chipRun.ibd | 134217728 | 113246208 | -15.6% | || |
| dbversion.ibd | 98304 | 98304 | ||
| detInputExp.ibd | 12582912 | 11534336 | -8.3% | |
| detNormalizedExp.ibd | 114688 | 114688 | ||
| detNormalizedImfile.ibd | 12582912 | 10485760 | -16.7% | || |
| detNormalizedStatImfile.ibd | 835584 | 655360 | -21.6% | || |
| detProcessedExp.ibd | 10485760 | 10485760 | ||
| detProcessedImfile.ibd | 373293056 | 264241152 | -29.2% | !|| |
| detRegisteredImfile.ibd | 9437184 | 9437184 | ||
| detResidExp.ibd | 11534336 | 10485760 | -9.1% | |
| detResidImfile.ibd | 381681664 | 255852544 | -33.0% | !|| |
| detRun.ibd | 344064 | 344064 | ||
| detRunSummary.ibd | 147456 | 114688 | -22.2% | || |
| detStackedImfile.ibd | 11534336 | 10485760 | -9.1% | |
| detectionEfficiency.ibd | 780140544 | 318767104 | -59.1% | !!|| |
| diffInputSkyfile.ibd | 4102029312 | 4097835008 | -0.1% | |
| diffPhotRun.ibd | 10485760 | 10485760 | ||
| diffPhotSkyfile.ibd | 226492416 | 121634816 | -46.3% | !|| |
| diffRun.ibd | 67108864 | 58720256 | -12.5% | || |
| diffSkyfile.ibd | 4223664128 | 3070230528 | -27.3% | !|| |
| diffSummary.ibd | 41943040 | 30408704 | -27.5% | !|| |
| distComponent.ibd | 5402263552 | 2906652672 | -46.2% | !|| |
| distRun.ibd | 314572800 | 247463936 | -21.3% | || |
| distTarget.ibd | 655360 | 655360 | ||
| dqstatsContent.ibd | 130023424 | 130023424 | ||
| dqstatsRun.ibd | 475136 | 491520 | ||
| fakeMask.ibd | 98304 | 98304 | ||
| fakeProcessedImfile.ibd | 4194304000 | 2323644416 | -44.6% | !|| |
| fakeRun.ibd | 92274688 | 88080384 | -4.5% | |
| flatcorrAddstarLink.ibd | 311296 | 311296 | ||
| flatcorrCamLink.ibd | 557056 | 557056 | ||
| flatcorrChipLink.ibd | 360448 | 360448 | ||
| flatcorrRun.ibd | 114688 | 114688 | ||
| magicDSFile.ibd | 8191475712 | 5607784448 | -31.5% | !|| |
| magicDSRun.ibd | 255852544 | 239075328 | -6.6% | |
| magicDSUpdateRun.ibd | 54525952 | 37748736 | -30.8% | !|| |
| magicInputSkyfile.ibd | 427819008 | 427819008 | ||
| magicMask.ibd | 46137344 | 37748736 | -18.2% | || |
| magicNodeResult.ibd | 3984588800 | 2000683008 | -49.8% | !|| |
| magicRun.ibd | 79691776 | 71303168 | -10.5% | || |
| magicTree.ibd | 5226102784 | 5226102784 | ||
| magicUpdateRun.ibd | 18874368 | 17825792 | -5.6% | |
| minidvodbCopy.ibd | 131072 | 114688 | -12.5% | || |
| minidvodbProcessed.ibd | 180224 | 163840 | -9.1% | |
| minidvodbRun.ibd | 196608 | 180224 | -8.3% | |
| newExp.ibd | 100663296 | 96468992 | -4.2% | |
| newImfile.ibd | 3632267264 | 2722103296 | -25.1% | !|| |
| publishClient.ibd | 114688 | 114688 | ||
| publishDone.ibd | 31457280 | 25165824 | -20.0% | || |
| publishRun.ibd | 58720256 | 50331648 | -14.3% | || |
| pzDataStore.ibd | 98304 | 98304 | ||
| pzDownloadExp.ibd | 41943040 | 37748736 | -10.0% | |
| pzDownloadImfile.ibd | 5951717376 | 3435134976 | -42.3% | !|| |
| rawExp.ibd | 184549376 | 155189248 | -15.9% | || |
| rawImfile.ibd | 16655581184 | 14298382336 | -14.2% | || |
| rcDSFileset.ibd | 121634816 | 100663296 | -17.2% | || |
| rcDestination.ibd | 114688 | 114688 | ||
| rcInterest.ibd | 573440 | 589824 | ||
| rcRun.ibd | 131072 | 131072 | ||
| receiveFile.ibd | 131072 | 131072 | ||
| receiveFileset.ibd | 131072 | 131072 | ||
| receiveResult.ibd | 114688 | 114688 | ||
| receiveSource.ibd | 147456 | 147456 | ||
| stackAssociation.ibd | 524288 | 524288 | ||
| stackAssociationMap.ibd | 15728640 | 15728640 | ||
| stackInputSkyfile.ibd | 230686720 | 226492416 | -1.8% | |
| stackRun.ibd | 125829120 | 109051904 | -13.3% | || |
| stackSumSkyfile.ibd | 134217728 | 109051904 | -18.8% | || |
| stackSummary.ibd | 475136 | 376832 | -20.7% | || |
| staticskyInput.ibd | 163840 | 163840 | ||
| staticskyResult.ibd | 196608 | 180224 | -8.3% | |
| staticskyRun.ibd | 212992 | 196608 | -7.7% | |
| summitExp.ibd | 67108864 | 58720256 | -12.5% | || |
| summitImfile.ibd | 5616173056 | 4630511616 | -17.6% | || |
| warpBackgroundRun.ibd | 1015808 | 917504 | -9.7% | |
| warpBackgroundSkyfile.ibd | 75497472 | 54525952 | -27.8% | !|| |
| warpImfile.ibd | 2646605824 | 2172649472 | -17.9% | || |
| warpMask.ibd | 98304 | 98304 | ||
| warpRun.ibd | 113246208 | 96468992 | -14.8% | || |
| warpSkyCellMap.ibd | 13170114560 | 5901385728 | -55.2% | !!|| |
| warpSkyfile.ibd | 12532580352 | 9118416896 | -27.2% | !|| |
| warpSummary.ibd | 75497472 | 54525952 | -27.8% | !|| |
Last modified
15 years ago
Last modified on Mar 4, 2011, 2:36:58 PM
Attachments (2)
- log.optimization.nebulous (4.9 KB ) - added by 15 years ago.
- log.optimization.gpc1 (19.6 KB ) - added by 15 years ago.
Download all attachments as: .zip
Note:
See TracWiki
for help on using the wiki.
