In Nebulous By Host

Usage by filetype/processing stage in gigabytes. (2010-01-28)

Host	BTABLE	BTPIX	CAM	CHIP	CMF	DETREND	DIFF	JPEG	LOG	MDC	MEGACAM	OTA	PSF	SKYCELL	STACK	STATS	TRACE	UNKFITS	UNKNOTFITS	WARP	Nebulous Used	Total Used	Disk Size
ipp004.0	0.00	0.00	0.00	1.41	4.38	5.39	0.00	0.99	2.04	37.46	0.00	348.41	2.23	0.17	0.00	0.13	0.37	0.00	11.55	1318.28	1732.81	5627.29	10158.16
ipp005.0	0.00	0.00	0.00	1.04	0.15	15.80	0.00	0.00	0.77	0.00	0.00	8190.31	0.00	0.00	0.00	0.02	0.00	0.00	0.00	0.00	8208.09	8223.63	10158.16
ipp006.0	7.40	0.00	25.23	217.83	31.45	657.30	958.14	7.05	23.24	60.40	0.00	6005.05	3.30	2.80	47.28	0.53	0.09	15.68	6.55	1277.91	9347.21	8679.14	10158.16
ipp007.0	5.09	0.00	18.89	214.97	26.78	355.24	784.60	5.38	16.43	50.18	0.00	4070.98	2.67	1.99	34.39	0.38	0.08	8.25	4.03	1049.83	6650.17	9036.53	10158.15
ipp009.0	6.54	0.00	40.32	394.99	31.80	742.67	1359.89	5.98	20.49	45.39	10.20	4732.94	2.51	2.05	24.48	0.56	0.08	20.46	17.80	1385.95	8845.10	8832.25	10158.16
ipp010.0	4.93	0.00	13.82	254.35	24.43	638.84	1011.89	6.03	18.85	47.57	0.00	6173.05	2.54	2.04	23.80	0.50	0.08	8.04	1.40	1105.94	9338.13	9064.40	10158.16
ipp011.0	5.93	0.00	16.21	193.39	26.18	661.90	893.52	5.86	18.11	53.35	0.00	4586.66	2.82	2.18	27.32	0.52	0.08	13.08	2.19	1242.81	7752.13	7321.68	10158.15
ipp012.0	7.20	0.00	27.33	266.49	27.98	688.78	1329.03	5.94	12.40	34.78	5.82	5557.41	2.19	2.14	34.97	0.38	0.02	20.79	11.61	1280.23	9315.49	9018.93	10158.15
ipp013.0	5.31	276.07	5.04	65.96	16.36	599.47	761.89	5.04	10.51	33.91	0.00	6674.62	2.13	1.93	33.59	0.36	0.01	7.94	0.76	919.83	9420.73	9190.43	10158.15
ipp014.0	3.73	697.81	4.62	283.90	11.99	890.59	41.49	0.87	12.08	38.56	0.00	6394.02	2.00	0.00	0.00	1.19	0.33	5.87	0.00	47.80	8436.86	8550.70	10118.31
ipp015.0	4.53	521.43	8.57	350.30	18.31	839.89	369.69	2.06	15.49	39.72	0.00	7018.53	2.00	0.55	9.60	1.02	0.49	6.71	0.00	248.64	9457.52	9587.31	10158.15
ipp016.0	4.01	0.00	3.29	4.17	5.62	145.56	113.85	1.97	8.80	17.60	0.00	2403.02	0.85	0.64	1.98	0.10	0.01	9.57	0.00	44.96	2766.01	2954.93	10158.15
ipp017.0	4.35	0.00	48.89	537.20	28.15	659.24	1167.76	5.36	15.54	42.20	0.00	5373.80	3.01	1.87	51.24	0.53	0.01	22.11	23.23	1327.97	9312.47	8824.51	10158.15
ipp018.0	0.00	0.00	0.00	96.22	1.06	111.30	0.00	0.05	1.45	3.70	0.00	3246.98	0.01	0.00	0.00	0.16	0.06	0.05	0.00	0.00	3461.02	3492.15	10158.15
ipp019.0	6.36	0.00	17.16	118.79	20.41	215.22	848.99	5.26	15.30	36.88	0.00	5402.64	2.19	1.93	24.65	0.15	0.00	11.55	3.01	1150.33	7880.84	9060.99	10158.15
ipp020.0	4.72	0.00	10.31	101.00	20.27	492.60	569.90	4.81	16.19	50.22	0.00	6780.64	2.37	1.51	9.36	0.41	0.09	7.53	0.60	1317.07	9389.62	8989.41	10158.15
ipp021.0	5.00	0.00	13.82	142.50	23.92	631.19	780.29	5.83	19.44	54.04	0.00	6786.47	2.76	2.05	22.02	0.48	0.08	7.61	1.75	954.93	9454.19	9261.08	10158.15
ipp023.0	11.06	970.40	429.57	856.07	57.75	2072.53	1544.69	26.61	81.98	126.54	0.00	8768.61	7.79	3.31	36.67	2.34	0.30	308.59	209.85	1184.47	16699.11	18565.97	20427.84
ipp024.0	13.36	1359.60	60.90	1122.97	82.21	1744.03	1832.19	18.47	85.43	173.83	11.72	10457.54	10.75	5.44	67.46	2.36	0.32	31.05	14.30	1889.14	18983.08	18008.68	20427.84
ipp025.0	0.00	2.27	18.64	172.41	11.00	344.49	216.60	1.38	35.61	105.45	0.00	1750.25	2.72	2.27	19.25	0.78	0.23	0.00	6.57	307.97	2997.91	2974.56	20427.84
ipp026.0	11.30	1226.42	51.69	882.16	84.53	1679.99	2020.44	21.74	107.47	215.86	0.00	10703.59	12.94	6.40	50.06	2.51	0.99	26.53	8.32	1460.59	18573.51	17674.28	20427.84
ipp028.0	12.73	1376.55	56.10	1046.84	104.26	1952.95	1888.91	22.06	118.23	239.58	0.00	9979.60	13.73	7.11	60.51	2.93	2.68	29.21	8.07	2097.15	19019.21	18065.99	20427.84
ipp029.0	14.71	1266.09	59.37	1116.72	97.28	1820.19	2066.75	22.50	105.13	205.26	0.00	10573.64	12.91	6.77	74.56	2.56	0.34	31.87	9.85	1409.45	18895.95	18263.02	20427.84
ipp030.0	12.69	980.87	78.55	1060.20	69.69	1600.25	1966.87	13.31	76.38	129.71	1889.71	8942.75	8.77	4.25	49.85	2.15	0.27	23.60	29.67	1585.23	18524.77	18150.01	20427.84
ipp031.0	15.80	1259.38	67.55	1189.31	95.56	1900.57	1889.33	21.88	110.51	214.62	0.00	10413.13	13.27	6.68	74.97	2.60	0.34	29.59	14.56	1759.92	19079.59	18150.94	20427.84
ipp032.0	14.56	1281.74	69.38	1146.19	96.09	1760.82	1674.59	20.11	104.85	209.44	0.00	10465.10	12.66	5.60	50.08	2.57	0.59	29.13	12.68	1928.47	18884.65	17717.35	20427.84
ipp033.0	14.35	1416.30	57.69	1105.94	88.83	1797.16	1561.04	18.60	104.78	203.10	0.00	10473.55	12.17	5.24	40.62	2.68	2.31	29.90	8.72	1893.94	18836.93	17968.74	20427.84
ipp034.0	13.10	1304.43	74.64	1083.41	93.82	1772.92	1964.58	19.49	100.83	214.85	0.00	10350.97	13.13	5.92	70.76	2.61	2.51	30.08	15.62	1612.72	18746.40	18027.18	20427.84
ipp035.0	13.32	1189.74	60.04	962.70	86.21	1728.32	1881.69	20.76	96.50	181.80	0.00	9142.14	11.36	6.04	78.31	2.34	0.36	25.59	13.30	1399.64	16900.15	18352.96	20427.84
ipp036.0	12.88	1316.50	58.54	956.28	86.00	1710.40	1993.83	20.29	91.53	206.79	0.00	9873.18	12.67	5.83	75.31	2.52	0.41	26.77	13.99	1566.84	18030.57	18152.77	20427.84
ipp038.0	13.98	787.67	219.19	1289.51	108.46	1195.79	1962.26	21.68	115.20	144.73	2004.66	8401.46	10.31	5.06	48.07	1.76	0.02	44.45	152.29	2087.66	18614.21	17636.60	20427.62
ipp039.0	12.87	797.76	261.99	1499.85	120.41	1219.65	2752.42	35.55	142.36	201.77	9.48	8996.60	14.37	9.90	71.82	2.11	0.04	53.56	249.74	2089.79	18542.02	17344.27	20427.62
ipp040.0	9.11	431.55	68.10	1018.28	67.84	855.01	1583.00	8.83	56.23	96.20	1321.22	5722.93	7.52	3.36	50.66	1.27	0.01	16.02	12.73	1490.25	12820.11	17274.43	19496.31
ipp041.0	11.07	670.69	82.95	1086.05	87.94	808.47	1390.53	14.42	72.39	120.62	0.00	13232.27	8.68	4.33	53.67	1.44	0.01	28.60	35.72	1308.96	19018.81	18270.85	20427.62
ipp042.0	12.05	625.81	160.43	1184.79	111.27	953.33	2393.90	23.07	93.99	156.22	2087.51	7860.80	10.71	6.62	71.61	1.57	0.01	53.32	96.69	2323.56	18227.26	17598.20	20427.62
ipp043.0	11.36	627.97	119.79	1219.38	102.48	994.01	1758.63	18.39	86.52	137.53	2003.12	8864.52	9.60	5.22	53.71	1.50	0.01	46.91	57.59	1641.57	17759.82	18011.22	20427.62
ipp044.0	13.62	784.27	171.75	1306.98	108.25	1053.30	1899.31	20.46	94.77	150.19	1983.47	8702.74	10.27	5.38	46.55	1.61	0.01	46.28	92.75	1923.88	18415.83	17788.51	20427.62
ipp045.0	12.90	643.45	156.01	1236.82	101.92	1153.56	1591.96	16.18	80.31	135.12	1979.21	8882.57	9.03	4.18	30.92	1.50	0.01	34.83	51.28	2202.11	18323.87	17479.45	20427.62
ipp046.0	13.55	772.86	169.21	1292.19	107.57	1042.10	1929.61	21.20	104.64	151.68	1957.10	8735.18	10.43	5.81	61.08	1.60	0.01	50.81	84.44	1877.72	18388.80	17725.58	20427.62
ipp047.0	11.69	800.54	105.04	1526.09	123.77	908.85	2426.54	21.30	177.67	192.25	601.82	7546.80	13.33	6.33	43.82	2.02	0.01	31.77	41.41	1902.49	16483.55	18217.83	20427.62
ipp048.0	11.12	600.24	101.24	1130.82	91.86	805.43	1794.34	16.90	73.29	133.20	12.08	7110.96	9.27	5.10	63.86	1.45	0.00	35.31	47.76	1366.19	13410.42	18162.44	20427.62
ipp049.0	7.44	536.32	72.88	575.72	53.70	774.79	580.20	8.32	37.51	77.79	0.00	7036.27	5.30	2.31	21.79	1.05	0.00	11.08	26.38	524.27	10353.13	13730.43	20427.62
ipp050.0	9.27	712.56	115.91	900.07	84.93	753.60	1336.05	16.02	73.67	129.79	241.83	6926.10	9.02	4.49	42.86	1.39	0.01	18.62	43.49	1138.78	12558.48	18304.63	20427.62
ipp051.0	10.91	792.47	99.05	1039.09	93.91	849.29	1335.90	17.32	84.72	130.38	312.76	7107.88	9.12	4.74	45.16	1.45	0.00	29.56	37.89	1269.02	13270.60	18251.13	20427.62
ipp052.0	10.55	781.59	158.10	992.26	93.12	989.40	1514.79	19.06	82.74	139.36	247.64	7381.80	9.68	5.11	49.63	1.58	0.01	50.98	68.12	1322.59	13918.10	18133.45	20427.62
ipp053.0	1.41	421.41	36.52	222.06	32.21	127.10	40.74	7.24	31.97	42.66	0.00	3378.48	2.76	1.35	3.64	0.49	0.00	17.77	27.38	26.93	4422.09	6794.95	20427.62
Sum	407.88	27232.79	3494.31	33465.69	2862.11	44719.29	59782.64	601.59	2854.32	5212.26	16679.36	337526.94	329.86	174.01	1851.94	62.14	13.69	1357.02	1575.63	59263.81
% neb use	0.06	4.54	0.58	5.58	0.47	7.45	9.97	0.10	0.47	0.86	2.78	56.30	0.05	0.02	0.30	0.01	0.00	0.22	0.26	9.88
Host	BTABLE	BTPIX	CAM	CHIP	CMF	DETREND	DIFF	JPEG	LOG	MDC	MEGACAM	OTA	PSF	SKYCELL	STACK	STATS	TRACE	UNKFITS	UNKNOTFITS	WARP	total

By Host

Check of the disk space currently (2010/02/23) being used by data not stored in nebulous. These data take up about X% of the total space (X% of the used space).

Host	Total Space (1K-blocks)	Used	Free	Non-nebulous	% Free	% Non-neb
ipp004	10651598144	10026600352	624997792	4062173952	6	38
ipp005	10651598144	8623103680	2028494464	3846688	19	0
ipp006	10651598144	10120836288	530761856	23058428	5	0
ipp007	10651588352	10121328320	530260032	3024720728	5	28
ipp009	10651598144	10123485056	528113088	551858148	5	5
ipp010	10651598144	10120323872	531274272	157354328	5	1
ipp011	10651588352	10120761440	530826912	9801856	5	0
ipp012	10651588352	10121565216	530023136	16853600	5	0
ipp013	10651588352	10120332512	531255840	9782924	5	0
ipp014	10609814272	8871570784	1738243488	9799580	16	0
ipp015	10651588352	10119544704	532043648	79148476	5	1
ipp016	10651588352	7977333024	2674255328	48686164	25	0
ipp017	10651588352	10119871552	531716800	11053836	5	0
ipp019	10651588352	10121043392	530544960	1609861036	5	15
ipp020	10651588352	10120436640	531151712	9803248	5	0
ipp021	10651588352	10120510560	531077792	9792472	5	0
ipp023	21420144640	20349617632	1070527008	2624457160	5	12
ipp024	21420144640	20349709888	1070434752	25084620	5	0
ipp025	21420144640	9752726432	11667418208	29498252	54	0
ipp026	21420144640	20350860000	1069284640	11535676	5	0
ipp027	21419913728	2646015328	18773898400	10828756	88	0
ipp028	21420144640	20351964416	1068180224	16571316	5	0
ipp029	21420144640	20349490400	1070654240	193218764	5	1
ipp030	21420144640	20349564960	1070579680	636345304	5	3
ipp031	21420144640	20349364928	1070779712	11025024	5	0
ipp032	21420144640	20349207840	1070936800	50396320	5	0
ipp033	21420144640	20349721024	1070423616	133693012	5	1
ipp034	21420144640	20132953760	1287190880	12785336	6	0
ipp035	21420144640	20349255552	1070889088	2175854876	5	10
ipp036	21420144640	20349468800	1070675840	989118384	5	5
ipp038	21419913728	20349447552	1070466176	210200924	5	1
ipp039	21419913728	20349545472	1070368256	10482148	5	0
ipp040	20443361792	19422110912	1021250880	5625139232	5	28
ipp041	21419913728	20349332128	1070581600	10116288	5	0
ipp042	21419913728	20349827872	1070085856	463574004	5	2
ipp043	21419913728	20349122688	1070791040	1168259680	5	5
ipp044	21419913728	20349451840	1070461888	436884844	5	2
ipp045	21419913728	20349843488	1070070240	371244668	5	2
ipp046	21419913728	20349594176	1070319552	370681380	5	2
ipp047	21419913728	20459449696	960464032	1493451924	4	7
ipp048	21419913728	20362105216	1057808512	2931527216	5	14
ipp049	21419913728	10905015136	10514898592	1819205192	49	8
ipp050	21419913728	20470454336	949459392	4297216276	4	20
ipp051	21419913728	20361173152	1058740576	3477157408	5	16
ipp052	21419913728	20361638528	1058275200	2771389288	5	13
ipp053	21419913728	6635762400	14784151328	2596907032	69	12

---

By Keyword

Keyword matching done based on summing the disk usage of all directories with the name /data/@HOST@/keyword.

Keyword	Total Space Used	% of cluster
gpc1_distribution	13009200216	2
ipp018.0	5414586080	1
gpc1	4513249564	1
gpc1_destreak	4460297968	1
beaumont	4259782908	1
home	3094540600	0
MOPS	2767351540	0
ipp	2473778884	0
heather	1096811696	0
price	1091120932	0
iqanalysis	561213928	0
rodney	433771656	0
gpc1dark	317590620	0
eugene	236727456	0
bills	189375280	0
billsstuff	179740868	0
pstamp.ipp049	96681408	0
watersc1	96381740	0
old	90156472	0
datastore.ipp049	71220040	0
tmp	48318360	0
isp	41834288	0
allskycam	21680532	0
kaiser	19740236	0
datastore	9023680	0
eam_tmpdir	7338896	0
gpc1_dist	6798048	0
md09smf	2228540	0
pstamp-work	323632	0
rhenders	318056	0
megacam	255232	0
giebink	2060	0
gpc1_rel_200901	1508	0
gpc1-magic	1156	0
mysql	748	0
jhoblitt	400	0
lost+found	256	0
ippTests	236	0
MD08.200906.v0_0	36	0
mkhome.sh	4	0
pstamp	4	0
node_update.sh	4	0

Orphan / Widow Counts

Counts of nebulous orphans (disk files with no matching nebulous database instance) and widows (nebulous database instances with no matching disk files).

Host	Orphans	Number Zero-size	Widows
ipp004.0	952	156	18
ipp005.0	1250	94	0
ipp006.0	1177	260	2
ipp007.0	1067	213	11
ipp009.0	4199	1654	6
ipp010.0	1880	160	2
ipp011.0	3454	474	12
ipp012.0	1939	127	182
ipp013.0	581	102	19
ipp014.0	52768	386	0
ipp015.0	591	39	1
ipp016.0	1418	287	2
ipp017.0	2271	297	396
ipp019.0	837	119	5
ipp020.0	934	244	4
ipp021.0	2814	246	53
ipp023.0	7619	124	23
ipp024.0	3301	1034	4
ipp025.0	13688	12304	9
ipp026.0	1600	729	30
ipp028.0	12535	11356	140
ipp029.0	1514	969	16
ipp030.0	1050	20	10
ipp031.0	842	105	10
ipp032.0	782	480	6
ipp033.0	4973	4206	48
ipp034.0	2202	2135	31
ipp035.0	1583	792	35
ipp036.0	1873	1353	134
ipp038.0	116	91	1
ipp039.0	110	94	0
ipp040.0	384	104	1009
ipp041.0	189	113	0
ipp042.0	86	76	9
ipp043.0	131	126	2
ipp044.0	94	81	2
ipp045.0	109	102	2
ipp046.0	102	88	13
ipp047.0	96	94	0
ipp048.0	110	100	0
ipp049.0	2144	138	36
ipp050.0	94	93	0
ipp051.0	442	157	1
ipp052.0	93	90	4
ipp053.0	91	84	1