Changes between Version 1 and Version 2 of Mirroring

Timestamp:

Mar 10, 2009, 9:35:03 PM (17 years ago)

Author:

jester@…

Comment:

Reformat for trac

Mirroring

@@ -3 +3 @@
 = Questions/Notes: =
 
-# Server setup?
-# Performance of rsync on real-life updated dvo database tables? <br />This could be done using the Stripe82 data after successively updating dvo with more and more detections. May need to do this with the full stripe82 dataset, i.e. a few hundred square degrees, rather than the current 2.5x2.5 test set.
-# Transfer rate needed? Gene estimates: 
-## ~1 Mbit/s continuous for ''detections''
-## ~3 Mbit/s continuous for ''average tables'' ('''what about extended-source parameters?''')
-## ~75 Mbit/s continous for ''raw images'' (but might also want weights & masks - i.e. double the raw rate)
+ 1. Server setup?
+ 1. Performance of rsync on real-life updated dvo database tables? <br />This could be done using the Stripe82 data after successively updating dvo with more and more detections. May need to do this with the full stripe82 dataset, i.e. a few hundred square degrees, rather than the current 2.5x2.5 test set.
+ 1. Transfer rate needed? Gene estimates: 
+  * ~1 Mbit/s continuous for ''detections''
+  * ~3 Mbit/s continuous for ''average tables'' ('''what about extended-source parameters?''')
+  * ~75 Mbit/s continous for ''raw images'' (but might also want weights & masks - i.e. double the raw rate)
 Johannes Koppenhöfer has managed transfer rates of 400 Mbit/s from Hawaii to Garching, via two parallel rsync transfers at 200 Mbit/s each, but so far only over timescales of 10 minutes. The best sustained rate was ~80 Mbit/s over a few hours from ipp000 or alala to Heidelberg via rsync, though this was a much earlier experiment that should be repeated soon.
 
@@ -76 +76 @@
 == recommended TCP/IP settings (to be set in /etc/sysctl.conf): ==
 
+{{{
 net.core.rmem_max=62500000
-
 net.core.wmem_max=62500000
+net.core.netdev_max_backlog = 2500
 
 net.ipv4.tcp_rmem=4096 87380 62500000
-
 net.ipv4.tcp_wmem=4096 16384 62500000
-
-net.core.netdev_max_backlog = 2500
-
 net.ipv4.tcp_moderate_rcvbuf=1
-
 net.ipv4.tcp_timestamps=1
-
 net.ipv4.tcp_window_scaling=1
-
 net.ipv4.tcp_sack=1
-
 net.ipv4.tcp_ecn=1
-
 net.ipv4.tcp_adv_win_scale=7
-
 net.ipv4.tcp_syncookies=0
-
 net.ipv4.tcp_congestion_control=cubic
-
+}}}
 
 == Speed test to Munich/Garching (single job, single file): ==
 
-# Hawaii->cluster: 224.21Mbit/s
-# Hawaii->MPE:      30.96Mbit/s
-# Hawaii->USM:      53.28Mbit/s
-
+{{{
+  Hawaii->cluster: 224.21Mbit/s
+  Hawaii->MPE:      30.96Mbit/s 
+  Hawaii->USM:      53.28Mbit/s
+}}}
 
 == rsync command used for tests: ==
 
+{{{
 \rsync -avP rsync://ipp0002.ifa.hawaii.edu/catdir.synth.grizy/n0000.tar.gz .
+}}}