Index: /tags/ipp-1-X/rel-02/doc/design/datasys_cost.tex =================================================================== --- /tags/ipp-1-X/rel-02/doc/design/datasys_cost.tex (revision 22034) +++ /tags/ipp-1-X/rel-02/doc/design/datasys_cost.tex (revision 22034) @@ -0,0 +1,324 @@ +% Copyright (C) 2004 Joshua Hoblitt +% +% $Id: datasys_cost.tex,v 1.10 2004-03-10 02:50:05 jhoblitt Exp $ + +\documentclass[panstarrs,psreport]{panstarrs} +%\usepackage{array} + +%\documentclass[panstarrs]{panstarrs} + +% basic document variables +\title{Pan-STARRS PS1 Data Systems Cost Estimate} +\author{Joshua Hoblitt} +\shorttitle{PS1 Datasys Cost} +\group{Pan-STARRS Algorithm Group} +\project{Pan-STARRS Image Processing Pipeline} +\organization{Institute for Astronomy} +\version{02} +\docnumber{PSDC-xxx-xxx} +% note the use of the docnumber & version number: +% the complete PSDC document number is given by +% \thedocnumber-\theversion + +\begin{document} +\maketitle + +% -- Revision History -- +% provide explicit values for the old versions +% use '\theversion' for the current version (set above) +% use \hline between each table row +\RevisionsStart +% version Date Description +01 & 2004.03.08 & First draft \\ +02 & 2004.03.09 & Add power consumption\\ + & & Tables more consistent\\ +\hline +\RevisionsEnd + +\pagebreak +\tableofcontents + +\pagebreak +\listoffigures + +\pagebreak +\pagenumbering{arabic} + +\section{Scope} + +\subsection{Identification} + +This document establishes the estimated cost of the network and computing hardware necessary to support PS1. Due to the rapid rate of change in the IT industry the part numbers specified in this document may change prior to the actual purchase of equipment but the cost structure is expected to remain stable. + +\section{Image Processing Pipeline and Data Storage Equipment} + +\subsection{Requirements} + +\subsubsection{CPU} + +Phase 2 and phase 4 dominate the IPP computational processing needs. Assuming 3.0GHz CPUs we need 40 CPUs for phase 2 and 30 CPUs for phase 4. + +\subsubsection{Storage} + +The storage needs for the first year of PS1's operation have been estimated to be between 700-1100TB. Assuming that 0.5TB SATA disks become available in the next year we will require between 2000-3000 units. + +\subsection{Hardware} + +A 5u rackmount case has been identified that can support 24 hot-swappable SATA disks, 1 internal disk, and a dual CPU motherboard. The large data storage capacity requirement is the driver for the number of complete systems we will have to acquire. + +We will need between 85 and 132 nodes to support our data requirements. + +\begin{center} +\begin{tabular}{lrrr} +% \begin{tabular}{>{$}l<{$}>{$}r>{$}r>{$}r} +Item &Estimated Price&85 nodes&132 nodes\\ +\cline{1-4} +24 x 0.5TB SATA disks (bulk storage) &\$7,200 &\$61,200 &\$950,400\\ +1 x 0.5TB SATA disk (OS + software) &\$300 &\$25,500 &\$39,600\\ +2 x 3.0GHz CPUs &\$2,000 &\$170,000 &\$264,000\\ +2 x 12-port SATA raid controller &\$1,500 &\$127,500 &\$198,000\\ +1 x Motherboard &\$500 &\$42,500 &\$66,000\\ +4 x 1GB RAM DIMM &\$1,400 &\$119,000 &\$184,800\\ +1 x 5u Rackmount Chassis &\$2,800 &\$238,000 &\$369,600\\ +\cline{1-4} +Total &$\sim$\$16,000&$\sim$\$1,360,000&$\sim$\$2,112,000\\ +\end{tabular} +\end{center} + +\subsubsection{Spares} + +\tbd{TBD} + +\subsubsection{Maintenance} + +\tbd{TBD} + +\section{Network Equipment} + +\subsection{Requirements} + +\subsubsection{Bandwidth} + +It has been estimated that we need a throughput of $\sim604Mb/s$ to support PS1 at a 30s cadence. A OC-12c Packet over SONET connection can provide enough bandwidth. + +\subsubsection{Switch ports} + +We will needs to support 32 x Summit Pixel Servers and up to 16 x Servers/Workstations at the summit. The data center switch should be able to support up to 192 computation nodes and control computers. + +\subsection{Network Link} + +An OC-12c PoS link from the summit of Haleakala to Kihei on Maui will cost \$16,970 per month with a 3-year contract or \$16,460 per month with a 5-year contract. Setup fees will vary by location and are estimated to be in the range of \$10,000 - \$100,000 per end point (\$20K - \$200K total). + +\subsection{Hardware} + +\subsubsection{Summit Core Switch} + +\begin{center} +Cisco 6513 +\begin{tabular}{lr} +Item &Estimated Price\\ +\cline{1-2} +1 x WS-C6513 Cat 6513 &\$15,250\\ +1 x WS-X6K-S720-6408A &\$33,000\\ +1 x WS-X6548-RJ-45 &\$17,995\\ +1 x WS-C6K-13SLT-FAN2 &\$745\\ +2 x WS-CAC-4000W-US &\$10,000\\ +\cline{1-2} +Total &$\sim$\$76,990\\ +\end{tabular} +\end{center} + +\subsubsection{Data Center Core Switch} + +\begin{center} +Cisco 6513 +\begin{tabular}{lr} +Item &Estimated Price\\ +\cline{1-2} +1 x WS-C6513 Cat 6513 &\$15,250\\ +1 x WS-X6K-S720-6408A &\$33,000\\ +4 x WS-X6548-RJ-45 &\$71,980\\ +1 x WS-C6K-13SLT-FAN2 &\$745\\ +2 x WS-CAC-4000W-US &\$10,000\\ +\cline{1-2} +Total &$\sim$\$130,975\\ +\end{tabular} +\end{center} + +\subsubsection{Summit Border Router} + +\begin{center} +Cisco 7606 +\begin{tabular}{lr} +Item &Estimated Price\\ +\cline{1-2} +1 x 7606-SUP720XL-PS &\$49,500\\ +1 x OSM-2OC12-POS-SI+ &\$60,000\\ +1 x WS-X6548-RJ-45 &\$17,995\\ +\cline{1-2} +Total &$\sim$\$127,495\\ +\end{tabular} +\end{center} + +\subsubsection{Date Center Border Router} + +\begin{center} +Cisco 7606 +\begin{tabular}{lr} +Item &Estimated Price\\ +\cline{1-2} +1 x 7606-SUP720XL-PS &\$49,500\\ +1 x OSM-2OC12-POS-SI+ &\$60,000\\ +1 x WS-X6548-RJ-45 &\$17,995\\ +\cline{1-2} +Total &$\sim$\$127,495\\ +\end{tabular} +\end{center} + +\subsubsection{Spares} + +\tbd{TBD} + +\subsubsection{Maintenance} + +\tbd{Cisco SmartNet contracts are typically $\sim5\%$ of the purchase price.} + +\section{Object Database Equipment} + +\subsection{Requirements} + +\tbd{TBD} + +\subsection{Hardware} + +\tbd{TBD} + +\subsubsection{Spares} + +\tbd{TBD} + +\subsubsection{Maintenance} + +\tbd{TBD} + +\section{Moving Object Pipeline Equipment} + +\subsection{Requirements} + +\tbd{TBD} + +\subsection{Hardware} + +\tbd{TBD} + +\subsubsection{Spares} + +\tbd{TBD} + +\subsubsection{Maintenance} + +\tbd{TBD} + +\section{Software} + +\subsection{Lustre} + +\subsubsection{Maintenance} + +\tbd{TBD} + +\section{Power Consumption} + +\subsection{Nodes} + +The Pan-STARRS Prototype IPP Computational/Storage Node draws $\sim600w$ when idle. As this is the idle load and the power consumption of computer components is rapidly increasing we should budget for $\sim750w$ per node. + +\begin{center} +85 nodes +\begin{tabular}{lr} +Item &Estimated Power Consumption\\ +\cline{1-2} +Nodes &63,750w\\ +Network + Misc. &25,000w\\ +\cline{1-2} +Total &88,750w\\ +\end{tabular} +\end{center} + +\begin{center} +132 nodes +\begin{tabular}{lr} +Item &Estimated Power Consumption\\ +\cline{1-2} +Nodes &99,000w\\ +Network + Misc. &25,000w\\ +\cline{1-2} +Total &124,000w\\ +\end{tabular} +\end{center} + +\subsection{Air Conditioning} + +It takes 1ton of A/C to remove 12kBTU of heat. + +\begin{center} +\begin{tabular}{lr} +Heat Generated &A/C Load\\ +\cline{1-2} +88,750w &25.242tons\\ +124,000w &35.268tons\\ +\end{tabular} +\end{center} + +\subsection{Total Power Consumption} + +Assuming that 1ton of A/C requires 1kw of power. + +\begin{center} +\begin{tabular}{lrr} +Item &85 nodes &132 nodes\\ +\cline{1-3} +Nodes + Net + Misc. &88,750w &124,000w\\ +A/C &25,242w &35,268w\\ +\cline{1-3} +Total &113,992w &159,268w\\ +\end{tabular} +\end{center} + +\subsection{Cost Estimate} + +This Billing estimate is from Maui Electric Company, Ltd. (MECO) for schedule "J" service with a power factor of 0.9 (MECO refers to this as a power factor of 90\%) based on Feburary, 2004 rates. + +\begin{center} +\begin{tabular}{lr} +Peak Demand &Estimated Price\\ +\cline{1-2} +115kw &\$13,000 per month\\ +160kw &\$18,100 per month\\ +\end{tabular} +\end{center} + +\section{Misc} + +\subsection{Hardware} + +\begin{center} +\begin{tabular}{lr} +Item &Estimated Price\\ +\cline{1-2} +Racks/cabinets &\$50,000\\ +Cabling &\$25,000\\ +Tools &\$10,000\\ +\cline{1-2} +Total &$\sim$\$85,000\\ +\end{tabular} +\end{center} + +\subsection{Electrical Wiring} + +Each cabinet will require 4 x 220v/15amp circuits. \tbd{Material/labor costs are TBD}. + +\bibliographystyle{plain} +\bibliography{panstarrs} + +\end{document}