Galera in MariaDB 10.4 State of the Art and Plans

Transcription

1 Galera in MariaDB 10.4 State of the Art and Plans Seppo Jaakola Codership

2 Seppo Jaakola One of the Founders of Codership Codership Galera Replication developers Partner of MariaDB for developing and supporting MariaDB Galera Cluster Galera releases since

3 Galera in 10.4 Status Agenda Galera Cluster Upgrading Streaming Replication XA Transaction Support Spider Cluster 3

4 Galera in 10.4 and Beyond Galera 4.0 Group Commit Support <refactor for MariaDB> Non Blocking DDL <testing> Huge transactions by streaming replication <testing> Inconsistency Voting Protocol <testing> v MariaDB 10.4 Gcache Encryption MariaDB GTID Compatibility v v <implementation> <requirement> Galera 4.1 XA transaction Support Spider Cluster v v <implementation> <design> 4

5 Galera Upgrade wsrep API Change

6 Galera Rolling Upgrades read & write read & write Upgrade with API #26 MariaDB MariaDB MariaDB API 25 API 25 API 25 Galera Replication API 25 6

7 Galera Rolling Upgrades read & write Upgrade with API #26 read & write MariaDB MariaDB MariaDB API 25 API 25 API 26 One node upgraded To API #26 Galera Replication API 25 7

8 Galera Rolling Upgrades Upgrade with API #26 read & write read & write MariaDB MariaDB MariaDB API 25 API 26 API 26 One node upgraded To API #26 Galera Replication API 25 8

9 Galera Rolling Upgrades read & write read & write read & write MariaDB MariaDB MariaDB API 26 API 26 API 26 All nodes upgraded To API #26 Galera Replication API 26 API #26 features now Enabled in replication 9

10 Streaming Replication Huge Transaction Support

11 Huge Transaction Demo Setup 1. Two nodes 2. Steady load of pure autocommit updates to measure trx throughput 3. A huge table with ~1.5M rows 4. Run update on huge table to modify all rows monitor trx/sec rate in the cluster when the huge transaction kicks in 11

12 Impact of Huge Transaction Huge Transaction Slave Lag Trx in master 24 secs Trx in slave 9 secs 0 12

13 Streaming Replication Transaction is replicated, gradually in small fragments, during transaction processing i.e. before actual commit, we replicate a number of small scale fragments Size threshold for fragment replication is configurable Replicated fragments are applied in slave transactions in all cluster nodes Fragments hold locks in all nodes and cannot be conflicted later 13

14 Streaming Replication Huge transaction Update, update, update... Node A Node B Huge trx Galera Replication 14

15 Streaming Replication Huge transaction Update, update, update... Node A Node B Huge trx WS Galera Replication 15

16 Streaming Replication Huge transaction Update, update, update... Node A Node B Huge trx WS Galera Replication 16

17 Streaming Replication Huge transaction commit Node A Node B Huge trx WS Galera Replication 17

18 Fragment Transaction SR transaction pool applier SR#1 THD applier SR#2 THD applier SR#n THD WS SR trx :2 CF: 0 certification 18

19 Fragment Transaction SR transaction pool applier SR#1 THD applier WS SR#2 THD SR trx :2applier CF: 0 ev apply_event() ev->apply_event() wsrep_sr_store->append_frag_apply()) SR#n THD 19

20 Fragment Transaction SR transaction pool applier SR#1 THD applier SR#2 THD applier SR#n THD WS SR trx :2 CF: 1 certification 20

21 Fragment Transaction SR transaction pool applier SR#1 THD applier WS SR trx :2applier SR#2 THD CF: 1 trans_commit() wsrep_sr_store->append_frag_commit()) SR#n THD 21

22 Configuring Streaming Replication wsrep_trx_fragment_unit Unit metrics for fragmenting, options are: bytes WS size in bytes events # of binlog events rows # of rows modified statements # of SQL statements issued wsrep_trx_fragment_size Threshold size (in units), when fragment will be replicated 0 = no streaming 22

23 Streaming Replication Demo Setup 1. Same scenario as before 2. Configure node1 to fragment huge transaction in 10K batches wsrep_trx_fragment_unit = bytes wsrep_trx_fragment_size = monitor trx/sec rate in the cluster when streaming replication progresses 23

24 Streaming Replication Streaming Replication trx/sec Streaming Replication 70 secs time 24

25 Streaming Replication trx/sec time 25

26 XA Transactions with Galera 3

27 XA Transaction Support XA Start Node A Node B XA trans 27

28 XA Transaction Support XA Insert into persons jones Node A Node B XA trans insert 28

29 XA Transaction Support XA Prepare Node A Node B XA trans insert 29

30 XA Transaction Support XA Prepare Node A Node B XA trans insert WS 30

31 XA Transaction Support XA Prepare Node A Node B XA trans insert WS apply insert jones 31

32 XA Transaction Support XA Rollback Node A Node B XA trans insert jones 32

33 XA Transaction Support Node A Node B jones 33

34 XA by Streaming Replication

35 XA Transaction Support XA Start Node A Node B XA trans WS 35

36 XA Transaction Support XA Insert into persons jones Node A Node B XA trans insert SR trans insert WS 36

37 XA Transaction Support XA Prepare Node A Node B XA trans insert SR trans insert 37

38 XA Transaction Support XA Rollback Node A Node B XA trans insert SR trans insert jones WS rollback 38

39 XA Transaction Support Node A Node B 39

40 Spider Cluster

41 Insert into t values. Table t Spider SE A B XA XA Shard A Shard B

42 Insert into t values. Table t Spider SE A B XA XA garbd Node 1 Node 2 Node 3 Node 1 Node 2 G a l e r a G a l e r a

43 Insert into t values. Spider Node SE 1 Spider Node SE 1 Spider Node SE 1 G a l e r a XA XA garbd Node 1 Node 2 Node 3 Node 1 Node 2 G a l e r a G a l e r a

44 S p i d e r A C I D Insert into t values (1),(2) shard A shard B XA start XA start Insert (1) Insert (2) XA prepare XA prepare XA Commit XA Commit

45 S p i d e r A C I D Insert into t values (1),(2) shard A shard B Select * from t XA start Insert (1) XA start () () = () Insert (2) XA prepare XA prepare XA Commit XA Commit (1) () = (1) (1) (2) = (1),(2)

46