Jailbreaking MySQL Replication Featuring Tungsten Replicator. Robert Hodges, CEO, Continuent

Transcription

1 Jailbreaking MySQL Replication Featuring Tungsten Robert Hodges, CEO, Continuent

2 About Continuent / Continuent is the leading provider of data replication and clustering for open source relational databases / Our Products: Tungsten - High-performance, MySQL replication Tungsten Enterprise - Commercial replication and data management solution for MySQL and PostgreSQL / Our Services: Consulting on Tungsten plus replication and clustering in general Subscriptions for commercial products

3 Continuent Consulting Services / Practical consulting by industry experts on any aspect of Tungsten or replication/clustering for open source databases / Hourly support contracts Advice, troubleshooting, bug fixes / Projects Cluster design, roll-outs, upgrades, special replication problems / Sponsored development Implementation of features large and small / Offered for both open source and commercial products

4 Tungsten Enterprise Clusters Apache/Mod_PHP libmysqlclient.a Apache/Mod_PHP libmysqlclient.a Connector Connector DBMS DBMS DBMS Manager Slave Manager Master Manager Slave

5 Why Jailbreak MySQL Replication?

6 60 Second Intro to MySQL Replication Master I/O Thread downloads binlog Slave IO and SQL threads I/O thread writes relay logs; updates master.info SQL Thread reads and applies relay logs; updates relay-log.info Binlogs master.info Relay logs relay-log.info File: mysql-bin Pos: Master_Log_File: mysql-bin Read_Master_Log_Pos: Relay_Log_File: relay-mysql-bin Exec_Master_Log_Pos:

7 Large Social Networking Site / Goal: Update on master; unload reads to slaves / Problem: Severe slave lag Master Multi-threaded application updates on multi-core system with fast storage Singlethread slave Slave Slave is blocked by I/O bound queries

8 Furniture Store Inventory Management / Goal: Pull inventory changes into centralized reporting server in real time / Problem: No replication from multiple masters into a single slave MySQL permits only a single master per slave Denver Chicago BI Slave Omaha Des Moines Salt Lake St. Louis

9 Multi-Site Credit Card Processing / Goal: Process transactions on any available site / Problem: Unable to add or remove DBMS servers without stopping all applications and/or losing data Master Master Master Dead master breaks replication for entire cluster

10 Online Call Center Reporting / Goal: Load call session data into Oracle to generate reports / Problem: No way to load in real time from MySQL MySQL Master Oracle 11 EE BI Server MySQL replication only works between MySQL instances

11 How to Handle These Challenges? Can we make replication better??! It s s time to jailbreak MySQL replication

12 Introducing Tungsten 2.0

13 What Is Tungsten? Tungsten is a fast, opensource replication engine for MySQL GPL V2 license Written in Java Designed for speed and flexibility

14 Tungsten Features / Global transaction IDs / Transaction filters / Replicate to PostgreSQL and Oracle / Time-delay replication / Backup, restore, auto-provisioning / Cross-version replication: 5.5 -> 5.1 -> 5.0 -> 4.1 / Row and statement replication / Built-in consistency checks / Multi-master replication / Parallel replication / Use any MySQL build: Oracle, Percona, MariaDB

15 Message Engine Architecture Tungsten Process Pipeline Stage Stage Extractor Filters Applier Queue Extractor Filters Applier MySQL Binlog Different threads for each stage In-memory buffer between stages with block commit Slave DBMS

16 Typical Deployment Master ( configuration) MySQL Tail binlog or login as client Tungsten (replicator) replicator. properties Binlogs Transaction History Log Transport via TCP/IP connection (Transactions + Metadata) Transaction History Log replicator. properties Tungsten (replicator) Slave Apply using JDBC MySQL

17 Attacking Big Replication Problems

18 Failover and Data Protection / Tungsten replication is designed to protect data / Global transaction IDs -- promote any slave to master / Flush events -- Ensure slaves are up-to-date / Consistency checks -- Check table consistency without stopping replication / Back and restore commands -- Provision/repair / Checksums -- Detect log corruption automatically

19 Sequence Numbers In Action Master Seqno 35 Epoch 1 Seqno 25 Epoch 1 Slave Slave Seqno 28 Epoch 1 Seqno 21 Epoch 1 Slave Backup Backup Backups Backup Backup Backups

20 Reconfiguration After Failover Old Master Seqno 35 Epoch 1 (epoch number prevents reconnect as slave) Seqno 25 Epoch 1 Slave (Relay) Manager New Master Seqno 36 Epoch 29 Seqno 21 Epoch 1 Slave Backup Backup Backups Backup Backup Backups

21 Parallel Replication / Tungsten parallelizes in three different ways / Pipeline parallelism - Spread work across stages / Service parallelism -- Spread work across different replicators and replication services within replicators / Parallel apply -- Spread apply operations across multiple threads

22 Shard-Based Parallel Apply / Look for workloads that have lots of independent streams of updates Shared data requires full serialization shared tenant_1 tenant_2 tenant_3 tenant_4 Tenants independent from each other but depend on shared data shared tenant_1 tenant_2 tenant_3 tenant_4 Tenant database updates can move in parallel streams

23 Parallel Slave Apply - Pipeline Design Tungsten Process Pipeline Stage Stage Stage Extractor Applier Extractor Applier Parallel Queue Extractor Extractor Extractor Applier Applier Applier (Sharding) Transaction History Log Binlog THL shard.list file Slave DBMS

24 Some Typical Performance Results Large, non-contending transactions run 2x faster Smaller transactions are a bit faster as shown by checkpoint intervals

25 Multiple Replication Services per DBMS / Tungsten can run several independent pipelines per replicator process / Pipelines can do any task / Multi-source replication - Consolidate transactions to one slave / Multi-master - Multiple active masters accept updates

26 Multi-Source Replication / Consolidation of data from NYC, FRA masters to SFO BI server Nyc MySQL Fra MySQL Tungsten Nyc replication service Fra replication service ReplicationService ManagerMBean Open Open ManagerMBean ManagerMBean Sfo MySQL JMX interface for overall service management JMX interfaces for individual replication services

27 Multi-Master Replication sjc master sjc (local) nyc (local) nyc master nyc(remote) chi(remote) chi(remote) sjc(remote) chi master chi (local) nyc(remote) sjc(remote)

28 Replication to/from Other DBMS Types / Tungsten replication uses a platform independent transaction format / Filters can transform SQL / Adding new DBMS requires only a new extractor or applier

29 MySQL to Oracle Replication Master DB Master Transaction History Log Filters MySQL Extractor Platform- Independent SQL Events Slave Transaction History Log Filters Oracle Applier Log Record JDBC SQL Requests (Binlogs enabled) Bin Logs Oracle EE BI Server

30 MySQL to Mongo DB Pipeline Stage Stage Stage Stage Extractor Applier Extractor Applier Extractor Applier Extractor Mongo Applier In-Memory Queue In-Memory Queue MySQL THL Transaction History Log Mongo DB

31 What s Next for Tungsten?

32 What s in the Next Couple of Builds? / Single command replicator installation (As easy as MySQL CHANGE MASTER TO command) / JSON administrative APIs / Replication from MySQL to MongoDB / Improved reliability

33 What s in the Roadmap? / Replicate even faster Apply shard updates in parallel directly from replicator log (THL) Update batching on individual threads / Replicate robustly between active masters Conflict resolution! Eliminate MySQL circular replication / Replicate from more Database Types PostgreSQL Oracle EE with Change Data Capture (CDC) / Replicate to more DBMS Types MongoDB More SQL DBMS More NoSQL DBMS / MySQL plugins to make replication work better Set server id, count temp tables, etc.

34 Wrap-up and Conclusion

35 Conclusion / Replication problems are changing quickly / Tungsten builds on MySQL to solve new replication problems / Tungsten is 100% open source / Continuent provides expert support and services

36 Contact Information HQ 560 S. Winchester Blvd., Suite 500 San Jose, CA Tel (866) Fax (408) Continuent Web Site: Tungsten 2.0: