Cluster Storage Notes

Accounting

2011-02-28	Item	Balance
Total Disk Space (1k blocks) :	1,145,007,221,440	1,145,007,221,440
Contained in Nebulous:	900,429,403,840	244,577,817,600
Identified Not in Nebulous:	63,018,670,216	181,559,147,384

Accounting

2010-09-27	Item	Balance
Total Disk Space (1k blocks) :	762,480,098,880	762,480,098,880
Contained in Nebulous:	721,827,135,488	40,652,963,392
Identified Not in Nebulous:	66,723,319,220	-26,070,355,828

Accounting

2010-09-20	Item	Balance
Total Disk Space (1k blocks) :	762,485,617,760	762,485,617,760
Contained in Nebulous:	690,849,054,720	71,636,563,040
Identified Not in Nebulous:	62,557,092,220	9,079,470,820

In Nebulous By Host

Usage by filetype/processing stage in gigabytes. (2011-02-28)

Host	BTABLE	BTPIX	CAM	CHIP	CMF	DETREND	DIFF	JPEG	LOG	MDC	MEGACAM	OTA	PSF	SKYCELL	STACK	STATS	TRACE	UNKFITS	UNKNOTFITS	WARP	nebulous	total_used	zdisk
ipp004.0	1.73	0.00	52.01	6.58	12.65	12.04	2.71	7.71	6.70	3.12	0.00	1225.78	4.19	3.14	7.56	0.33	0.04	43.03	38.09	3.89	1431.28	8557.55	10158.16
ipp005.0	37.52	0.00	887.14	472.08	183.68	263.87	414.81	57.91	124.81	26.90	0.00	18250.42	39.38	145.30	493.04	2.78	0.19	296.05	785.75	456.14	22937.77	34250.90	40916.94
ipp006.0	42.56	0.00	882.35	990.98	254.30	298.26	1032.36	83.05	166.03	39.92	0.00	17960.73	57.08	226.41	627.95	3.23	0.34	273.19	815.51	1020.81	24775.06	31304.55	40916.94
ipp007.0	34.81	0.00	777.55	752.39	222.50	270.76	811.59	74.38	131.79	35.08	0.00	16386.36	50.70	154.37	587.04	2.89	0.31	252.35	725.59	732.56	22003.02	26752.11	40916.94
ipp008.0	17.89	0.00	440.61	484.45	111.43	136.18	580.82	37.90	86.75	20.42	0.00	9007.89	29.39	97.82	238.50	1.98	0.11	143.02	413.27	518.76	12367.21	14193.70	40916.94
ipp009.0	18.09	0.00	219.87	422.34	118.12	109.79	346.73	42.32	72.00	20.37	10.20	9505.61	28.29	43.91	128.90	1.97	0.18	99.25	221.50	352.02	11761.46	14183.42	40916.94
ipp010.0	16.53	0.00	269.98	338.63	135.25	182.21	379.53	50.82	111.50	24.14	0.00	7097.72	34.27	39.57	181.85	2.37	0.15	77.63	205.76	211.14	9359.04	9661.08	10158.16
ipp011.0	18.10	0.00	315.01	258.58	138.15	176.95	220.67	52.62	101.50	25.75	0.00	7216.87	35.78	54.72	245.21	2.33	0.15	96.41	256.33	285.71	9500.82	9847.21	10158.15
ipp012.0	16.42	0.00	134.50	357.98	83.37	102.57	359.44	38.44	43.41	15.41	5.82	8587.70	21.24	67.41	261.97	0.96	0.08	76.88	154.70	400.57	10728.85	13932.47	40916.94
ipp013.0	18.15	0.00	263.14	280.04	139.24	165.86	305.33	57.38	99.03	24.02	0.00	6974.82	34.76	81.03	389.17	2.16	0.09	75.41	223.08	249.96	9382.67	9712.23	10158.15
ipp014.0	7.31	0.00	101.99	503.18	37.23	901.85	366.19	5.70	31.44	6.64	0.00	7886.93	8.26	80.36	32.48	1.31	0.38	47.82	178.55	324.46	10522.08	12860.53	40916.94
ipp015.0	12.65	0.00	242.41	338.80	157.51	136.65	256.50	38.19	124.87	22.65	0.00	6855.52	34.42	66.91	274.19	3.67	0.57	29.27	234.64	210.14	9039.54	9713.33	10158.15
ipp016.0	19.65	0.00	288.11	150.37	76.25	88.43	123.08	30.68	54.19	14.33	0.00	11150.48	20.34	43.01	95.75	1.68	0.07	127.22	294.39	179.87	12757.89	14147.71	40916.94
ipp017.0	14.41	0.00	272.63	217.62	171.80	187.44	330.23	58.55	111.89	25.10	0.00	6769.20	36.72	104.21	394.29	2.37	0.10	74.09	240.02	275.00	9285.66	9710.75	10158.15
ipp018.0	11.13	0.00	265.71	256.95	137.85	214.97	304.97	41.46	83.99	19.10	0.00	7080.84	29.00	94.88	267.83	1.99	0.14	76.47	236.15	200.96	9324.36	9750.94	10158.15
ipp019.0	17.31	0.00	238.10	187.99	147.31	147.66	287.18	52.09	103.84	24.02	0.00	5730.78	34.50	99.95	329.17	2.00	0.09	56.42	202.80	213.50	7874.72	9814.61	10158.15
ipp020.0	10.29	0.00	240.84	184.64	91.38	147.61	272.37	22.18	62.82	10.79	0.00	7315.43	15.02	43.68	291.39	0.97	0.12	109.92	234.39	175.15	9228.99	9639.50	10118.32
ipp021.0	22.12	0.00	358.69	489.74	187.98	187.40	500.08	53.75	109.54	28.52	0.00	9425.98	39.91	84.28	232.01	2.50	0.21	98.94	359.72	529.50	12710.86	14179.39	40916.94
ipp023.0	22.07	0.00	929.82	414.17	279.98	911.95	578.39	100.05	237.33	46.50	0.00	11357.32	66.77	117.23	496.44	6.33	0.49	399.67	682.63	458.52	17105.64	19344.83	20427.84
ipp024.0	27.43	0.00	662.46	545.33	336.33	280.39	578.97	97.29	246.37	51.52	11.72	13905.75	72.67	129.73	546.68	6.43	0.51	154.63	582.55	535.45	18772.22	19338.92	20427.84
ipp025.0	32.58	0.00	823.26	599.90	280.25	227.00	772.11	93.64	254.21	54.02	0.00	13785.15	73.97	189.68	647.04	6.60	0.42	178.68	639.80	651.64	19309.96	20015.83	20427.84
ipp026.0	20.68	0.00	650.87	449.42	300.83	267.88	638.97	111.65	267.39	55.94	0.00	13699.81	78.70	198.57	739.88	6.70	1.21	167.93	570.75	552.19	18779.38	19359.97	20427.84
ipp027.0	30.99	0.00	781.36	298.48	273.93	180.18	657.23	107.39	125.06	40.85	0.00	12492.12	57.77	221.64	772.88	3.22	0.25	253.74	639.57	509.64	17446.32	19871.13	20427.62
ipp028.0	30.86	0.00	645.82	588.46	439.15	260.77	666.16	115.24	280.74	55.53	0.00	13265.50	77.74	205.37	700.80	7.02	2.92	143.61	591.80	700.17	18777.67	19339.69	20427.84
ipp029.0	30.00	0.02	567.22	524.08	380.16	288.57	637.10	108.25	263.88	50.57	0.00	12884.28	72.14	190.74	696.18	6.53	0.54	941.10	471.61	496.49	18609.46	19339.52	20427.84
ipp030.0	21.89	0.00	541.49	438.14	349.25	371.27	588.44	97.16	231.32	46.78	1889.71	11629.17	68.67	191.39	599.37	6.06	0.49	124.73	478.83	556.88	18231.03	19340.52	20427.84
ipp031.0	30.79	0.00	700.20	557.06	388.44	296.06	767.69	110.01	275.99	53.81	0.00	13376.77	76.69	202.39	666.19	6.66	0.57	159.58	570.73	631.23	18870.86	19337.45	20427.84
ipp032.0	30.36	0.00	648.00	750.89	426.84	353.40	618.74	99.51	322.23	56.68	0.00	13407.39	81.13	174.61	542.93	7.77	0.80	101.67	635.17	600.75	18858.88	19326.57	20427.84
ipp033.0	33.91	0.00	670.73	746.85	439.02	342.93	565.98	94.24	323.07	56.22	0.00	13523.82	80.56	132.77	454.21	7.85	2.51	105.69	570.01	558.13	18708.48	19351.06	20427.84
ipp034.0	26.74	0.00	642.56	768.74	438.36	363.94	558.14	98.23	320.25	56.06	0.00	13410.55	80.26	133.66	462.17	7.71	2.73	119.19	673.25	616.61	18779.16	19333.52	20427.84
ipp035.0	27.99	0.00	563.89	792.98	447.74	349.50	556.86	100.21	305.08	52.78	0.00	11752.61	77.11	122.41	451.89	7.33	0.57	76.94	525.20	515.49	16726.58	19459.59	20427.84
ipp036.0	25.57	0.00	651.51	719.59	406.73	360.05	571.58	101.75	311.54	56.11	0.00	12487.76	81.59	156.02	566.56	7.62	0.63	116.60	585.24	582.27	17788.74	19332.71	20427.84
ipp037.0	29.45	0.00	862.28	434.47	238.06	193.86	666.59	73.47	118.22	34.29	0.00	12777.05	49.00	215.18	649.34	2.56	0.32	242.94	812.02	781.59	18180.68	19402.23	20427.84
ipp038.0	25.24	0.00	684.73	620.71	400.00	380.09	641.42	105.85	273.57	48.48	2004.66	10934.88	71.48	217.48	755.40	5.53	0.27	122.11	555.29	710.51	18557.72	19338.46	20427.62
ipp039.0	24.60	0.00	780.61	612.18	391.12	279.27	637.75	126.44	313.10	55.50	9.48	12907.97	80.66	212.97	804.66	6.16	0.30	156.14	657.43	723.86	18780.21	19351.03	20427.62
ipp040.0	21.16	0.00	646.36	667.34	394.48	358.12	650.88	94.22	218.56	49.09	1321.22	10117.01	72.81	206.30	638.99	5.03	0.32	94.78	651.46	761.69	16969.81	18452.84	19496.31
ipp041.0	27.78	0.00	682.24	646.58	383.04	229.94	615.74	96.31	223.11	47.09	0.00	13331.26	68.52	202.00	700.06	5.01	0.28	126.50	578.62	733.81	18697.90	19340.21	20427.62
ipp042.0	26.86	0.00	675.00	625.93	413.34	348.31	602.69	121.42	251.58	51.41	2087.51	10789.97	74.08	205.50	769.27	5.17	0.23	146.59	516.61	739.62	18451.10	19339.32	20427.62
ipp043.0	22.05	0.00	590.38	619.80	376.82	367.03	571.42	95.21	232.10	45.87	2003.12	10699.22	66.98	168.93	644.92	5.22	0.23	135.37	492.99	609.69	17747.35	19337.67	20427.62
ipp044.0	26.52	0.00	625.92	620.98	365.72	356.83	575.95	92.22	231.42	43.49	1983.47	11345.82	62.90	170.87	601.23	4.73	0.23	151.27	512.07	635.17	18406.80	19338.07	20427.62
ipp045.0	17.35	0.00	335.31	278.56	200.65	285.54	34.00	48.32	154.70	23.19	1979.21	8361.79	35.32	27.68	106.65	3.85	0.01	76.91	180.01	100.89	12249.93	17098.79	20427.62
ipp046.0	27.70	0.00	664.12	756.72	390.72	379.60	673.81	96.30	257.58	47.51	1957.10	11330.64	69.25	130.09	490.42	5.38	0.22	134.81	541.53	710.57	18664.07	19338.41	20427.62
ipp047.0	33.11	0.00	715.39	1095.23	504.59	332.86	646.57	108.51	435.07	58.08	601.82	12166.13	87.33	136.57	514.73	7.83	0.23	84.73	673.94	765.14	18967.87	19324.59	20427.62
ipp048.0	35.27	0.00	749.00	1011.39	414.65	311.94	669.03	102.18	302.37	52.24	12.08	12961.79	78.78	157.18	598.30	6.76	0.23	145.14	641.19	644.01	18893.52	19325.72	20427.62
ipp049.0	26.59	0.00	698.69	929.68	362.80	256.05	661.61	91.74	232.61	46.32	0.00	13132.92	69.64	186.64	578.60	5.99	0.21	124.76	658.20	637.70	18700.74	19402.98	20427.62
ipp050.0	27.29	0.00	743.50	1048.19	373.32	266.47	758.44	100.16	292.43	54.18	241.83	11898.75	81.32	204.71	688.10	6.56	0.27	100.08	677.31	890.37	18453.27	19333.06	20427.62
ipp051.0	35.77	0.00	613.83	408.71	365.65	301.27	186.48	96.24	272.47	47.36	312.76	12266.70	71.23	55.22	661.03	6.47	0.16	119.18	420.05	204.63	16445.20	17538.76	20427.62
ipp052.0	30.95	0.00	782.15	921.70	369.45	306.07	649.84	101.04	312.42	52.46	247.64	12755.14	78.59	159.23	690.56	6.86	0.21	154.84	641.03	684.06	18944.24	19331.58	20427.62
ipp053.0	25.54	0.00	643.04	603.90	235.86	178.51	695.54	71.68	137.12	31.41	0.00	9583.03	45.25	172.35	598.47	2.75	0.23	187.15	546.35	721.63	14479.80	19668.02	20427.62
nebulous	1191.75	0.02	27222.39	26789.48	13773.26	13716.12	25588.71	3861.06	9648.99	1907.62	16679.36	542767.14	2762.17	6726.05	23912.25	223.18	21.91	7400.43	23793.46	25360.55	773346	0.00	0.00

2010-11-05	1018.43	0.02	17435.60	25155.18	8553.67	10343.61	37475.55	2903.06	6921.83	26000.71	16679.36	521180.32	1909.37	1953.38	14310.55	198.52	17.84	7972.35	11942.22	22267.42	734239	0.00	0.00
2010-09-27	918.70	5300.54	15312.53	29724.67	7885.91	12913.28	35151.58	2571.17	6343.02	23074.12	16679.36	479075.42	1700.70	1713.32	12759.33	181.03	13.74	6792.38	10211.12	20066.18	688388	0.00	0.00
2010-09-17	881.64	5300.54	14614.97	24881.73	7670.06	10169.85	31880.33	2527.01	6235.41	22456.17	16679.36	466606.25	1653.25	1666.95	10931.73	175.16	13.80	6554.09	9737.67	18208.93	658845	0.00	0.00
2010-08-31	700.15	5043.63	12153.41	21797.65	6646.25	8173.74	102149.79	2215.34	5484.88	19422.63	16118.97	412240.75	1428.41	1417.45	9248.43	152.88	13.75	5045.70	8066.48	17265.02	0.00	0.00	0.00
2010-06-30	632.91	5300.54	10107.98	50342.60	5812.37	8825.46	138862.67	1903.96	5105.31	16518.10	16679.36	389417.69	1222.54	1090.20	7452.35	132.42	13.81	3360.59	6405.75	33418.52	0.00	0.00	0.00
2010-03-10	434.96	5300.54	5097.21	47390.77	3482.93	7290.61	79614.43	1038.09	3789.50	8553.75	16679.36	371492.33	559.41	466.39	3028.16	82.57	13.64	1994.03	2681.70	88722.46	0.00	0.00	0.00
2010-01-28	407.88	27232.79	3494.31	33465.69	2862.11	44719.29	59782.64	601.59	2854.32	5212.26	16679.36	337526.94	329.86	174.01	1851.94	62.14	13.69	1357.02	1575.63	59263.81	0.00	0.00	0.00
2009-12-01	271.22	27232.79	2602.76	53268.00	2094.33	34487.15	78070.53	454.34	2124.31	3898.29	16510.10	279834.80	229.40	119.03	671.66	48.95	13.48	909.36	1106.52	76556.49	580503.53	0.00	0.00

By Host

Check of the disk space currently (2011/02/28) being used by data not stored in nebulous. These data take up about X% of the total space (X% of the used space).

Host	Total Space (1K-blocks)	Used	Free	Non-nebulous	% Free	% Non-neb
ipp004	10651598144	8973239232	1678358912	7371490896	16	69
ipp005	42904518272	35815592768	7088925504	11381177628	17	27
ipp006	42904518272	32668553184	10235965088	6199963672	24	14
ipp007	42904518272	27952711232	14951807040	4602882764	35	11
ipp008	42904518272	14700751776	28203766496	45632956	66	0
ipp009	42904518272	14704648864	28199869408	691988412	66	2
ipp010	10651598144	10060146912	591451232	241980348	6	2
ipp011	10651588352	10250903008	400685344	80060532	4	1
ipp012	42904518272	14347394752	28557123520	198769384	67	0
ipp013	10651588352	10112537248	539051104	144074956	5	1
ipp014	42904518272	13219043040	29685475232	168041652	69	0
ipp015	10651588352	10118754048	532834304	332358608	5	3
ipp016	42904518272	14699270048	28205248224	95662796	66	0
ipp017	10651588352	10116474464	535113888	116254076	5	1
ipp018	10651588352	10159401280	492187072	106511460	5	1
ipp019	10651588352	10226582624	425005728	1652898304	4	16
ipp020	10609824064	10044322624	565501440	59617960	5	1
ipp021	42904518272	14702507744	28202010528	111269996	66	0
ipp023	21420144640	20163556640	1256588000	1940992564	6	9
ipp024	21420144640	20179066944	1241077696	178676560	6	1
ipp025	21420144640	20960867360	459277280	177012604	2	1
ipp026	21420144640	20170042912	1250101728	169700144	6	1
ipp027	21419913728	20715117120	704796608	1932644184	3	9
ipp028	21420144640	20170339680	1249804960	178266696	6	1
ipp029	21420144640	20174304672	1245839968	354640020	6	2
ipp030	21420144640	20170773312	1249371328	764866668	6	4
ipp031	21420144640	20166011040	1254133600	130257772	6	1
ipp032	21420144640	20169502496	1250642144	139354724	6	1
ipp033	21420144640	20202255904	1217888736	271522924	6	1
ipp034	21420144640	20170005376	1250139264	180138064	6	1
ipp035	21420144640	20290399392	1129745248	2345664780	5	11
ipp036	21420144640	20170695200	1249449440	1216200064	6	6
ipp037	21420144768	20225213408	1194931360	834128544	6	4
ipp038	21419913728	20169322240	1250591488	380765644	6	2
ipp039	21419913728	20179480608	1240433120	158860056	6	1
ipp040	20443361792	19244143904	1199217888	1136390764	6	6
ipp041	21419913728	20169431264	1250482464	239754708	6	1
ipp042	21419913728	20163379744	1256533984	537228476	6	3
ipp043	21419913728	20164065920	1255847808	1280129160	6	6
ipp044	21419913728	20166445408	1253468320	594072876	6	3
ipp045	21419913728	17929384608	3490529120	5071266628	16	24
ipp046	21419913728	20168884384	1251029344	568320128	6	3
ipp047	21419913728	20167797024	1252116704	262764232	6	1
ipp048	21419913728	20165048384	1254865344	340210592	6	2
ipp049	21419913728	20234969440	1184944288	557612204	6	3
ipp050	21419913728	20165953792	1253959936	787441832	6	4
ipp051	21419913728	18390923648	3028990080	1124237488	14	5
ipp052	21419913728	20167708128	1252205600	276736640	6	1
ipp053	21419913728	20494524320	925389408	5288176076	4	25

---

By Keyword

Keyword matching done based on summing the disk usage of all directories with the name /data/@HOST@/keyword. (2011-02-28)

Keyword	Total Space Used	% of cluster
gpc1	17014990056	1
roc	12450709516	1
eugene	6598403172	1
gpc1_distribution	6523127136	1
beaumont	4259782908	0
gpc1_destreak	3451268956	0
ipp	3026086624	0
heather	1924793392	0
backup	1788625856	0
home.OLD	1501499432	0
price	1035287492	0
iqanalysis	754367696	0
bills	584289132	0
rodney	433771656	0
watersc1	329553228	0
home	322149228	0
gpc1dark	317590620	0
MOPS	304913816	0
ipp018.0	101898700	0
rhenders	91779592	0
old	90156472	0
isp	41834288	0
kaiser	19740236	0
tmp	15780216	0
allskycam	14507512	0
gpc1_dist	6798048	0
burntool_logs	5445456	0
datastore	4507452	0
md09smf	2228540	0
eamtest	1683728	0
pstamp	371368	0
pstamp-work	323632	0
megacam	154644	0
rsync.back.log	120360	0
ippMonitor	106412	0
jt	13116	0
gpc1_rel_200901	2496	0
rsync.back.v2.log	2444	0
giebink	2060	0
gpc1-magic	1408	0
mysql	752	0
jhoblitt	396	0
rsync.back.v3.log	288	0
serge	236	0
ippTests	236	0
lost+found	144	0
MD08.200906.v0_0	40	0
du.20101031.out	8	0
mkhome.sh	4	0
sizes.dat	4	0
pcontrol.log	4	0
node_update.sh	4	0
rsync.pro	4	0
rm.021.log	0	0
rm.log	0	0
heather.zagursky	0	0
gavin	0	0
rm.016.log	0	0
sch	0	0
schastel	0	0
disktest	0	0

Orphan / Widow Counts

Counts of nebulous orphans (disk files with no matching nebulous database instance) and widows (nebulous database instances with no matching disk files). Pre-demo month values: 2010-01-29

	2010-01-29	2010-01-29	2010-01-29	2010-03-04		2010-03-04	2010-03-04
Host	Orphans	Number Zero-size	Widows	Orphans		Number Zero-size	Widows
ipp004.0	952	156	18	274		145	24
ipp005.0	1250	94	0	1629		114	94
ipp006.0	1177	260	2	1076		252	22
ipp007.0	1067	213	11	1285		219	18
ipp009.0	4199	1654	6	2912		1614	91
ipp010.0	1880	160	2	2333		183	32
ipp011.0	3454	474	12	1491		419	94
ipp012.0	1939	127	182	620		95	12
ipp013.0	581	102	19	509		95	47
ipp014.0	52768	386	0	52871		400	20464
ipp015.0	591	39	1	1605		143	54
ipp016.0	1418	287	2	588		287	35
ipp017.0	2271	297	396	2213		301	126
ipp019.0	837	119	5	304		83	13
ipp020.0	934	244	4	530		230	50
ipp021.0	2814	246	53	2549		226	248
ipp023.0	7619	124	23	7210		116	1023
ipp024.0	3301	1034	4	6642		1234	3993
ipp025.0	13688	12304	9	13704		12327	288
ipp026.0	1600	729	30	4201		928	71
ipp028.0	12535	11356	140	26221		12131	3340
ipp029.0	1514	969	16	12334		1547	566
ipp030.0	1050	20	10	8267		424	141
ipp031.0	842	105	10	5598		360	4314
ipp032.0	782	480	6	7075		802	306
ipp033.0	4973	4206	48	12396		4591	48
ipp034.0	2202	2135	31	7198		2394	498
ipp035.0	1583	792	35	11497		1299	35
ipp036.0	1873	1353	134	1401		1325	115
ipp038.0	116	91	1	117		92	1
ipp039.0	110	94	0	3093		231	0
ipp040.0	384	104	1009	103		91	1028
ipp041.0	189	113	0	582		132	57
ipp042.0	86	76	9	2805		226	16
ipp043.0	131	126	2	132		126	1194
ipp044.0	94	81	2	2053		177	2
ipp045.0	109	102	2	1944		184	2
ipp046.0	102	88	13	1908		181	13
ipp047.0	96	94	0	141		96	1
ipp048.0	110	100	0	2824		224	0
ipp049.0	2144	138	36	2144		138	36
ipp050.0	94	93	0	94		93	0
ipp051.0	442	157	1	1947		231	3
ipp052.0	93	90	4	2868		236	4
ipp053.0	91	84	1	91		84	1