IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links
wiki:Cluster_Storage_Notes

Version 3 (modified by watersc1, 17 years ago) ( diff )

--

In Nebulous

Check of the disk space currently (2009/10/16) being used by data stored in nebulous, and statistics about sizes of the files in each category.

TYPE MEAN STD N MIN MEDIAN MAX SUM % of Used Space
TRACE 3.46 95.27 3902062 0.00 0.00 10829.07 13494927.30 0.00
STATS 10.04 8.89 3884084 0.00 13.10 102.01 38988744.16 0.01
SKYCELL 41.22 61.24 1922394 0.00 2.81 520.31 79232777.36 0.02
BURNTOOL_TABLE 76.95 72.53 1682116 0.00 51.29 584.33 129435696.02 0.03
PSF 64.62 13.24 2587255 0.00 56.25 115.31 167180079.84 0.03
JPEG 51.91 165.29 6775231 0.00 7.00 3298.14 351714397.82 0.07
STACK 11809.94 11761.83 48313 0.00 11534.06 140650.31 570573824.06 0.11
UNKNOWN_NOTFITS 10972.14 20442.42 60558 0.00 49.40 306655.48 664450739.46 0.13
UNKNOWN_FITS 2241.68 14525.85 422433 0.00 19.69 353359.69 946961256.15 0.18
CMF 322.90 393.48 3822911 0.00 202.50 46833.75 1234432157.29 0.24
CAM 1102.99 263.75 1318222 0.00 1077.19 8451.56 1453986776.25 0.28
LOG 183.25 3892.34 8654277 0.00 33.80 1351187.40 1585881549.63 0.31
MDC 924.30 192.00 3198924 0.00 975.06 5270.19 2956777135.35 0.58
BURNTOOL_PIX 23681.65 3507.57 1132306 0.00 22927.50 89108.44 26814873777.19 5.22
CHIP 4662.56 7820.79 6366919 0.00 393.75 92221.88 29686130415.00 5.78
DETREND 11591.66 21677.09 2649409 0.00 393.75 353359.69 30711054109.65 5.97
WARP 16582.21 27519.21 2388445 0.00 9900.00 150547.50 39605693942.12 7.70
DIFF 13623.76 9349.08 3254188 0.00 14425.31 85047.19 44334282774.38 8.62
OTA 22368.91 4450.01 11786142 0.00 21780.00 184398.75 263643128239.76 51.29

By Host

Check of the disk space currently (2009/10/14) being used by data not stored in nebulous. These data take up about 7.2% of the total space (11.1% of the used space).

Host Total Space (1K-blocks) Used Free Non-nebulous % Free % Non-neb
ipp004 10651598144 5622358560 5029239584 3747030344 47 35
ipp005 10651598144 8621873568 2029724576 326652 19 0
ipp006 10651598144 7733304032 2918294112 113020092 27 1
ipp007 10651588352 8074202560 2577385792 3068969672 24 29
ipp009 10651598144 7903595072 2748003072 623558468 26 6
ipp010 10651598144 7627871712 3023726432 269742448 28 3
ipp011 10651588352 8003055296 2648533056 104111800 25 1
ipp012 10651588352 9035420672 1616167680 2672570052 15 25
ipp013 10651588352 9107607296 1543981056 104070488 14 1
ipp015 10651588352 10119020768 532567584 169670616 5 2
ipp016 10651588352 9484318432 1167269920 5121399452 11 48
ipp017 10651588352 10119216800 532371552 5140463616 5 48
ipp019 10651588352 8075610080 2575978272 2371211444 24 22
ipp020 10651588352 8530601568 2120986784 104303692 20 1
ipp021 10651588352 8251176928 2400411424 103793780 23 1
ipp023 21420144640 16311272160 5108872480 2718361524 24 13
ipp024 21420144640 17064687872 4355456768 117619612 20 1
ipp025 21420144640 3427014976 17993129664 91373084 84 0
ipp026 21420144640 16206263520 5213881120 103656564 24 0
ipp027 21419913728 91602368 21328311360 744764240 100 3
ipp028 21420144640 16622661888 4797482752 7123144 22 0
ipp029 21420144640 16773698880 4646445760 284475160 22 1
ipp030 21420144640 20074678624 1345466016 8391876984 6 39
ipp031 21420144640 16494694144 4925450496 69761144 23 0
ipp032 21420144640 16223739744 5196404896 110053452 24 1
ipp033 21420144640 16840848288 4579296352 174278292 21 1
ipp034 21420144640 16193123328 5227021312 68819048 24 0
ipp035 21420144640 17831230016 3588914624 2380815256 17 11
ipp036 21420144640 16666786976 4753357664 1066852800 22 5
ipp038 21419913728 10616335264 10803578464 52003420 50 0
ipp039 21419913728 10617034880 10802878848 43669672 50 0
ipp040 20443361792 11645773504 8797588288 5435374148 43 27
ipp041 21419913728 15421995552 5997918176 52020228 28 0
ipp042 21419913728 10616933440 10802980288 440199100 50 2
ipp043 21419913728 10616996864 10802916864 226442312 50 1
ipp044 21419913728 10657926208 10761987520 261300920 50 1
ipp045 21419913728 10630508064 10789405664 174404276 50 1
ipp046 21419913728 10629758528 10790155200 195439012 50 1
ipp047 21419913728 10655551904 10764361824 77119308 50 0
ipp048 21419913728 12934113536 8485800192 4824947980 40 23
ipp049 21419913728 11785732544 9634181184 729768548 45 3
ipp050 21419913728 10616460192 10803453536 116654884 50 1
ipp051 21419913728 10814412064 10605501664 483813432 50 2
ipp052 21419913728 10616604352 10803309376 169498380 50 1
ipp053 21419913728 8211971360 13207942368 2411682708 62 11

By Keyword

Keyword matching done based on summing the disk usage of all directories with the name /data/@HOST@/keyword.

Keyword Total Space Used % of cluster
megacam 13692865644 2
gpc1 12013899736 1
ipp018.0 5414586080 1
gpc1_distribution 5138885616 1
beaumont 3726478784 0
iqanalysis 2891251656 0
home 2792454308 0
MOPS 2767351540 0
gpc1_destreak 2575021036 0
ipp 1203034300 0
price 1081230820 0
backup 641238272 0
rodney 433771656 0
gpc1dark 317590620 0
eugene 236727456 0
heather 184381476 0
billsstuff 179740860 0
bills 109660908 0
old 90156472 0
watersc1 77461988 0
isp 41834288 0
tmp 32880604 0
allskycam 21680532 0
kaiser 19740236 0
giebink 19061432 0
datastore 14572464 0
pstamp 11499136 0
gpc1_dist 6798048 0
md09smf 2228540 0
pstamp-work 323632 0
gpc1_rel_200901 1508 0
gpc1-magic 1156 0
jhoblitt 400 0
MD08.200906.v0_0 36 0
mkhome.sh 4 0
node_update.sh 4 0

Attachments (12)

Download all attachments as: .zip

Note: See TracWiki for help on using the wiki.