Changes between Version 6 and Version 7 of Ingestion_Statistics_201206

Timestamp:

Jun 7, 2012, 12:10:04 PM (14 years ago)

Author:

Serge CHASTEL

Comment:

--

Ingestion_Statistics_201206

@@ -2 +2 @@
 
 [wiki:Moped_accident Back to the ingestion log page]
+
+== Ingesting a regular mysqldump file ==
 
 This wikipage gives statistics related the nebulous ingestion that happened in early June 2012.
@@ -19 +21 @@
 || volume.ibd || 212992 || 0.20 || 212992 || 0.20 || 0% || || || || ||
 
+== Ingesting binlogs ==
+ * Binlogs have a fixed size roughly 1GB
+ * They contain 'BEGIN' and 'COMMIT' very often. So if autocommit is set on the server, when piping the output of mysqlbinlog to a mysql client, there is not need to COMMIT.
+ * Statements like 'CREATE USER', 'USE <database>' should be filtered.
+ * A binlog in ascii form is about 40-45 millions lines long.
+ * Ingesting a binlog without filtering lasted about 3 hours; with filtering between 1.5 and 2 hours.