Changes between Version 18 and Version 19 of Processing_Throughput

Timestamp:

Sep 25, 2011, 2:59:21 PM (15 years ago)

Author:

Mark Huber

Comment:

--

Processing_Throughput

@@ -26 +26 @@
      * https://github.com/ganglia
    * raid throughputs: Gene has noticed the R/W to the raid doesn't seem much faster than to a single disk. Mark looking into.
-     * using multiple tests (dd, bonnie, iozone) seems to indicate w/in RAM caching have ~2-400MB/s for writes, large files drop to ~2x single SATA disk speeds ~80MB/s with single process. Multiple processes seem to degrade the rate linearly
+     * using multiple tests (dd, bonnie, iozone) seems to indicate w/in RAM caching have ~2-400MB/s for writes, large files drop to ~2x single SATA disk speeds with single process, ~80MB/s. Multiple processes seem to degrade the rate linearly for large files, smaller files better. Some conflicting rates to work out.
      * need to look more at latencies since filesizes are << RAM, order 30MB or less.
-     * adding iostat reports to ganglia would be useful to track the IO during full processing with OTA/skycells processed locally.
+     * adding iostat reports to ganglia would be useful to track the IO during full processing with OTA/skycells processed locally and to verify tests.
      * more details on the raid config for active machines will help as well 
 === Action items from 2011.08.29 ===