IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changes between Version 1 and Version 2 of Cluster_Storage_Notes


Ignore:
Timestamp:
Sep 28, 2009, 1:49:31 PM (17 years ago)
Author:
watersc1
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • Cluster_Storage_Notes

    v1 v2  
    1  /data/ipp004.0 : home
    2  /data/ipp005.0 : gpc1 stare data, bill's megacam download
    3  /data/ipp006.0 :
    4  /data/ipp007.0 : empty
    5  /data/ipp008.0 : dead
    6  /data/ipp009.0 : allskycam downloads
    7  /data/ipp010.0 : isp, allskycam downloads
    8  /data/ipp011.0 : empty
    9  /data/ipp012.0 : empty
    10  /data/ipp013.0 : empty
    11  /data/ipp014.0 : empty
    12  /data/ipp015.0 : empty
    13  /data/ipp016.0 : 2005
    14  /data/ipp017.0 : 2003
    15  /data/ipp018.0 : 2004
    16  /data/ipp019.0 : 2002 (also has some test gpc1 data and the old user home directories)
    17  /data/ipp020.0 : 2006
    18  /data/ipp021.0 : 2007
     1Check of the disk space currently (2009/09/28) being used by data not stored in nebulous.  These data take up about 7.2% of the total space.
    192
    20   * data downloaded to date (2/20)
     3== By Host ==
    214
    22 The following IPP nodes will hold megacam data for this experiment:
     5|| Host || Total Space (1K-blocks) || Used || Free || Non-nebulous || % Free || % Non-neb ||
     6|| ipp004 || 10651598144 || 5622358560 || 5029239584 || 3726208168 ||  47 ||  35 ||
     7|| ipp005 || 10651598144 || 8621874048 || 2029724096 || 326652 ||  19 ||   0 ||
     8|| ipp006 || 10651598144 || 8203168512 || 2448429632 || 113020052 ||  23 ||   1 ||
     9|| ipp007 || 10651588352 || 8523579136 || 2128009216 || 3065213712 ||  20 ||  29 ||
     10|| ipp009 || 10651598144 || 7803063264 || 2848534880 || 606915700 ||  27 ||   6 ||
     11|| ipp010 || 10651598144 || 7969927040 || 2681671104 || 269742408 ||  25 ||   3 ||
     12|| ipp011 || 10651588352 || 8250810624 || 2400777728 || 104111760 ||  23 ||   1 ||
     13|| ipp012 || 10651588352 || 8343616032 || 2307972320 || 2672570052 ||  22 ||  25 ||
     14|| ipp013 || 10651588352 || 8354247872 || 2297340480 || 104070448 ||  22 ||   1 ||
     15|| ipp015 || 10651588352 || 9868445920 || 783142432 || 169670576 ||   7 ||   2 ||
     16|| ipp016 || 10651588352 || 8578898720 || 2072689632 || 5121399452 ||  19 ||  48 ||
     17|| ipp017 || 10651588352 || 9539441408 || 1112146944 || 5140463572 ||  10 ||  48 ||
     18|| ipp019 || 10651588352 || 7208615520 || 3442972832 || 2371211444 ||  32 ||  22 ||
     19|| ipp020 || 10651588352 || 8582322912 || 2069265440 || 104303652 ||  19 ||   1 ||
     20|| ipp021 || 10651588352 || 8364005440 || 2287582912 || 103793740 ||  21 ||   1 ||
     21|| ipp023 || 21420144640 || 20027901376 || 1392243264 || 6773902984 ||   6 ||  32 ||
     22|| ipp024 || 21420144640 || 17930651488 || 3489493152 || 144152296 ||  16 ||   1 ||
     23|| ipp025 || 21420144640 || 3752811264 || 17667333376 || 91373084 ||  82 ||   0 ||
     24|| ipp026 || 21420144640 || 19941056960 || 1479087680 || 103656548 ||   7 ||   0 ||
     25|| ipp027 || 21419913728 || 91602368 || 21328311360 || 103525952 || 100 ||   0 ||
     26|| ipp028 || 21420144640 || 19713562048 || 1706582592 || 7123144 ||   8 ||   0 ||
     27|| ipp029 || 21420144640 || 19954425088 || 1465719552 || 284475144 ||   7 ||   1 ||
     28|| ipp030 || 21420144640 || 19972288672 || 1447855968 || 8453374444 ||   7 ||  39 ||
     29|| ipp031 || 21420144640 || 19839987712 || 1580156928 || 69761128 ||   7 ||   0 ||
     30|| ipp032 || 21420144640 || 19781307296 || 1638837344 || 110053436 ||   8 ||   1 ||
     31|| ipp033 || 21420144640 || 19477544608 || 1942600032 || 174278276 ||   9 ||   1 ||
     32|| ipp034 || 21420144640 || 19637290112 || 1782854528 || 68819032 ||   8 ||   0 ||
     33|| ipp035 || 21420144640 || 19896185536 || 1523959104 || 2340824444 ||   7 ||  11 ||
     34|| ipp036 || 21420144640 || 19733060256 || 1687084384 || 1062798808 ||   8 ||   5 ||
     35|| ipp038 || 21419913728 || 11055127552 || 10364786176 || 52003404 ||  48 ||   0 ||
     36|| ipp039 || 21419913728 || 11070860160 || 10349053568 || 43669656 ||  48 ||   0 ||
     37|| ipp040 || 20443361792 || 10804629920 || 9638731872 || 5435374140 ||  47 ||  27 ||
     38|| ipp041 || 21419913728 || 17740141632 || 3679772096 || 52020220 ||  17 ||   0 ||
     39|| ipp042 || 21419913728 || 11214110400 || 10205803328 || 440199092 ||  48 ||   2 ||
     40|| ipp043 || 21419913728 || 11382157568 || 10037756160 || 51957560 ||  47 ||   0 ||
     41|| ipp044 || 21419913728 || 11220202528 || 10199711200 || 34252164 ||  48 ||   0 ||
     42|| ipp045 || 21419913728 || 11179958720 || 10239955008 || 34402944 ||  48 ||   0 ||
     43|| ipp046 || 21419913728 || 11203634848 || 10216278880 || 34257724 ||  48 ||   0 ||
     44|| ipp047 || 21419913728 || 11291985568 || 10127928160 || 34515260 ||  47 ||   0 ||
     45|| ipp048 || 21419913728 || 13373260448 || 8046653280 || 4196363976 ||  38 ||  20 ||
     46|| ipp049 || 21419913728 || 7508035872 || 13911877856 || 60336240 ||  65 ||   0 ||
     47|| ipp050 || 21419913728 || 11108808352 || 10311105376 || 1034250648 ||  48 ||   5 ||
     48|| ipp051 || 21419913728 || 11133117120 || 10286796608 || 84581784 ||  48 ||   0 ||
     49|| ipp052 || 21419913728 || 11094362784 || 10325550944 || 169298772 ||  48 ||   1 ||
     50|| ipp053 || 21419913728 || 11176545504 || 10243368224 || 2352806520 ||  48 ||  11 ||
    2351
    24  /data/ipp016.0 : 2005 -- 19855 of 20634 images; none fits-compressed
    25  /data/ipp017.0 : 2003 -- 17332 of 17383 images; (03Am03, 04, 03Bm01, 02), 03, 04, 05 not fits-compressed
    26  /data/ipp018.0 : 2004 -- 17214 of 17390 images; (04Am06, 04Am07, 04Bm02, 03), 04, 05, 06, 07 not fits-compressed
    27  /data/ipp019.0 : 2002 -- 2901 or 2908 images, all fits-compressed
    28  /data/ipp020.0 : 2006 -- not yet downloaded
    29  /data/ipp021.0 : 2007 -- not yet downloaded.
     52----
     53
     54
     55== By Keyword ==
     56
     57Keyword matching done based on summing the disk usage of all directories with the name /data/@HOST@/keyword.
     58
     59|| Keyword || Total Space Used || % of cluster ||
     60|| megacam || 13692865644 ||   2 ||
     61|| gpc1 || 12058754484 ||   2 ||
     62|| gpc1_destreak || 7548158320 ||   1 ||
     63|| ipp018.0 || 5414586080 ||   1 ||
     64|| gpc1_distribution || 4226157092 ||   1 ||
     65|| iqanalysis || 2889355284 ||   0 ||
     66|| MOPS || 2767351540 ||   0 ||
     67|| home || 2712770112 ||   0 ||
     68|| beaumont || 2165476844 ||   0 ||
     69|| ipp || 1203020132 ||   0 ||
     70|| price || 1077176844 ||   0 ||
     71|| rodney || 433771656 ||   0 ||
     72|| gpc1dark || 317590620 ||   0 ||
     73|| eugene || 236727456 ||   0 ||
     74|| heather || 184181872 ||   0 ||
     75|| billsstuff || 179740860 ||   0 ||
     76|| bills || 136196272 ||   0 ||
     77|| old || 90156472 ||   0 ||
     78|| watersc1 || 75601752 ||   0 ||
     79|| isp || 41834288 ||   0 ||
     80|| tmp || 32880604 ||   0 ||
     81|| allskycam || 21680532 ||   0 ||
     82|| kaiser || 19740236 ||   0 ||
     83|| giebink || 19061432 ||   0 ||
     84|| datastore || 11193764 ||   0 ||
     85|| gpc1_dist || 6798048 ||   0 ||
     86|| pstamp || 6049392 ||   0 ||
     87|| md09smf || 2228540 ||   0 ||
     88|| pstamp-work || 323632 ||   0 ||
     89|| jhoblitt || 400 ||   0 ||
     90|| mkhome.sh || 4 ||   0 ||
     91|| node_update.sh || 4 ||   0 ||
     92|| MD08.200906.v0_0 || 0 ||   0 ||
     93