Safe Harbor Statement

Transcription

1 Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle s products remains at the sole discretion of Oracle. Die folgenden Informationen sind zur Skizzierung der grundsätzlichen Produktausrichtung von Oracle bestimmt. Sie sind nur für reine Informationszwecke gedacht und dürfen nicht in einen Vertrag aufgenommen werden. Es besteht keine Verpflichtung Material, Code oder Funktionalitäten zu liefern und die Informationen dürfen nicht als Grundlage für Einkaufsentscheidungen herangezogen werden. Die Entwicklung, Produktplanung und die zeitliche Koordinierung von Produkteigenschaften oder Funktionalitäten bleibt in der alleinigen Verantwortung von Oracle. 1

2 MySQL 5.6 & 5.7 Unlimited scaling??? Carsten Thalheimer Technical Sales Consultant Linux - Virtualization - MySQL (LVM GBU - EMEA) 2

3 MySQL Transparent Development MySQL is Open Source (GPL 2) as well as under a variety of propriety agreements MySQL Lab releases MySQL Haadop Applier, MySQL Utilities 1.4 etc, MySQL Utilities MySQL Development Milestone Releases MySQL Only for testing, not fit for production MySQL Community Edition MySQL 5.6, MySQL Cluster 7.3 Optional Oracle Support offering available MySQL Commercial Editions MySQL 5.6, MySQL Cluster 7.3 (Standard Edition, Enterprise Edition, Cluster CGE) Fully Functional Release Candidate Quality Two to Four per Year Early Community Testing, Use, & Feedback Accelerates Rate of Enhancements Improves Quality 3

4 Program Agenda Replication basics Replication changes in MySQL 5.6 Replication changes in MySQL 5.7 DMR MySQL 5.7 Labs release Summary 4

5 Driving MySQL Innovation Red bullet points: Announced during MySQL Connect 2013 MySQL Enterprise Monitor 2.2 MySQL Cluster 7.1 MySQL Cluster Manager 1.0 MySQL Workbench 5.2 MySQL Database 5.5 MySQL Enterprise Backup 3.5 MySQL Enterprise Monitor 2.3 All GA! MySQL Cluster Manager 1.1 Oracle VM Template for MySQL Enterprise Edition MySQL Enterprise Oracle Certifications MySQL Windows Installer MySQL Enterprise Security MySQL Enterprise Scalability All GA! MySQL Enterprise Backup 3.7 MySQL Cluster 7.2 MySQL Cluster Manager 1.2 MySQL Utilities 1.0 MySQL Migration Wizard MySQL for Excel MySQL Enterprise Backup 3.8 MySQL Enterprise Audit MySQL Enterprise HA with DRBD All GA! Plus Connector/ODBC, Connector/PHP, Connector/Net, Connector/J, Connector Python, Connector /C++, Connector/C, Ruby Driver MySQL Database 5.6 MySQL Utilities 1.3 MySQL Cluster 7.3 MySQL Workbench 6.0 MySQL Enterprise Monitor 3.0 MySQL Enterprise Backup 3.9 MySQL yum Linux repository All GA! MySQL Proxy MySQL Applier for Hadoop MySQL DMR* MySQL Utilities Fabric Lab* MySQL Multi Master Rep. Lab* Lab and DMR* 2013 *Development Milestone Release 5

6 Driving MySQL Innovation Red bullet points: Announced during MySQL Connect 2013 MySQL Enterprise Monitor 2.2 MySQL Cluster 7.1 MySQL Cluster Manager 1.0 MySQL Workbench 5.2 MySQL Database 5.5 MySQL Enterprise Backup 3.5 MySQL Enterprise Monitor 2.3 All GA! MySQL Cluster Manager 1.1 Oracle VM Template for MySQL Enterprise Edition MySQL Enterprise Oracle Certifications MySQL Windows Installer MySQL Enterprise Security MySQL Enterprise Scalability All GA! MySQL Enterprise Backup 3.7 MySQL Cluster 7.2 MySQL Cluster Manager 1.2 MySQL Utilities 1.0 MySQL Migration Wizard MySQL for Excel MySQL Enterprise Backup 3.8 MySQL Enterprise Audit MySQL Enterprise HA with DRBD All GA! Plus Connector/ODBC, Connector/PHP, Connector/Net, Connector/J, Connector Python, Connector /C++, Connector/C, Ruby Driver MySQL Database 5.6 MySQL Utilities 1.3 MySQL Cluster 7.3 MySQL Workbench 6.0 MySQL Enterprise Monitor 3.0 MySQL Enterprise Backup 3.9 MySQL yum Linux repository All GA! MySQL Proxy MySQL Applier for Hadoop MySQL DMR* MySQL Utilities Fabric Lab* MySQL Multi Master Rep. Lab* Lab and DMR* 2013 *Development Milestone Release 6

7 Current Generation of MySQL Replication Simple to configure Heterogeneous Low TCO no shared storage Configure over LAN and WAN Fast failover Asynchronous: risk of of data loss, Semi-Synchronous is configurable Automated failover or switchover via Utilities 7

8 Why Replicate? Duplicates database from a master to a slave Redundant copies of the data provide foundation for High Availability Scale out by distributing queries across the replication cluster Web / App Servers Writes & Reads Reads Master Slaves 8

9 Replication Solutions 9

10 Complex Topologies Ratio Master to Slave ~ 1:10 Relieve master server by creating relay slaves Just keep binary logs Row Based Replication best Do not store data in tables --log slave-upades Use Blackhole engine Black hole that accepts data but throws it away and does not store it 10

11 Async Replication 11

12 Semi-sync Replication 12

13 MySQL 5.6: Best Release Ever! IMPROVED PERFORMANCE AND SCALABILITY Scales to 48 CPU Threads Up to 230% performance gain over MySQL 5.5 IMPROVED INNODB Better transactional throughput and availability IMPROVED OPTIMIZER Better query exec times and diagnostics for query tuning and debugging IMPROVED REPLICATION Higher performance, availability and data integrity IMPROVED PERFORMANCE SCHEMA Better Instrumentation, User/Application level statistics and monitoring New! NoSQL ACCESS TO INNODB Fast, Key Value access with full ACID compliance, better developer agility 13

14 Development Priorities PERFORMANCE Improve read consistency from slaves Reduce risk of data loss if master fails Minimize overhead FAILOVER & RECOVERY Self-Healing Improve availability DATA INTEGRITY Correct, consistent & accessible DEV/OPS AGILITY Enhance responsiveness to business Reduce TCO 14

15 MySQL 5.6: Transforming Replication PERFORMANCE Multi-Threaded Slaves Binary Log Group Commit Optimized Row-Based Replication FAILOVER & RECOVERY Global Transaction Identifiers Replication Failover & Admin Utilities Crash Safe Slaves & Binlogs DATA INTEGRITY Replication Event Checksums DEV/OPS AGILITY Replication Utilities Time-Delayed Replication Remote Binlog Backup Informational Log Events Server UUIDs 15

16 MySQL 5.6: Transforming Replication PERFORMANCE Multi-Threaded Slaves Binary Log Group Commit Optimized Row-Based Replication FAILOVER & RECOVERY Global Transaction Identifiers Replication Failover & Admin Utilities Crash Safe Slaves & Binlogs DATA INTEGRITY Replication Event Checksums DEV/OPS AGILITY Replication Utilities Time-Delayed Replication Remote Binlog Backup Informational Log Events Server UUIDs 16

17 Multi-Threaded Slaves Increases slave throughput, reducing lag All transactions received into slave s relay log Implements multiple SQL threads, based on database Applies events to different databases in parallel Great for systems which isolate application data using databases e.g. multi-tenant 17

18 Queries per Second 5x Higher Performance with MySQL Multi-Threaded Slave Performance QPS 58,11 144,4 282,53 Worker Threads 18

19 Optimized Row Based Replication Primary Key Changed Columns Increases replication throughput for master and slave Reduces Binlog size, memory requirements & network bandwidth Only replicates those elements of the Row image that have changed 19

20 Binlog Group Commit Increases replication throughput by increasing performance of the master Commits multiple transactions as a group to Binlog on disk Finer grained locking; reducing lock wait times 20

21 Replication Binary Log Group Commit Performance Sync_binlog = 1 Up to 2.3x with binlog configured versus with no binlog Up to 3.5x faster with binlog configured Sysbench R/W 8 x Socket / 6-core Intel Xeon 7540, 2GHz 512GB RAM SSD 21

22 Global Transaction Identifiers Simple to track & compare replication across the farm Unique identifier for each transaction written to the Binlog Automatically identify the most up-to-date slave for failover Deploy n-tier replication hierarchies Master GTID= GTID= GTID= GTID=

23 MySQL Utilities Automate common Dev/Ops tasks Replication: provisioning, testing, monitoring and failover Database comparisons: consistency checking Database administration: users, connections, tables, etc New utilities in development, i.e. log analysis Implemented as Python scripts, plug-in for MySQL Workbench Extensible to include custom scripting Resources: Documentation & Community Forum

24 Utility Workflow for Replication Replicate Check Show Fail-Over & Admin Replicate: Check: Show: Initiates Replication to the new slave Validates the replication configuration and operation Display Replication topology Fail-Over & Admin: Detects and failovers (or switches) from master to slave. Status monitoring 24

25 Replication HA Utilities Fail-Over & Admin Failed Master Enabling self-healing replication topologies Automated failover & recovery mysqlfailover Utility Promoted Master Slaves Monitoring Switchover & administration mysqlrpladmin Utility HA Utilities Fully configurable slave promotion policies Delivers HA within the core MySQL distribution 25

26 mysqlfailover monitoring resumes MySQL Replication Monitor and Failover Utility Failover Mode = auto Next Interval = Mon Mar 19 16:05: Fail-Over Master Information Binary Log File Position Binlog_Do_DB Binlog_Ignore_DB mysql-bin GTID Executed Set A0F7E82D E B56:1-5 UUIDs host port role state gtid_mode health jane 3306 MASTER UP ON OK jane 3307 SLAVE UP ON OK freddy 3306 SLAVE UP ON OK

27 mysqlfailover master failed Failover starting... # Candidate slave jane:3306 will become the new master. # Preparing candidate for failover. # Creating replication user if it does not exist. # Stopping slaves. # Performing STOP on all slaves. # Switching slaves to new master. # Starting slaves. # Performing START on all slaves. # Checking slaves for errors. # Failover complete. # Discovering slaves for master at jane:3306 Fail-Over Failover console will restart in 5 seconds. 27

28 Program Agenda Replication basics Replication changes in MySQL 5.6 Replication changes in MySQL 5.7 DMR MySQL 5.7 Labs release Summary 28

29 MySQL Connect 2013 Replication & Utilities Update 29

30 Some words about DMR (Micro view) MySQL 5.7 is the next big thing, it ll be the new Best release ever Demonstrates ongoing Oracle commitment Some customers will use it for production soon Lots of new features It s faster, it scales higher Improved InnoDB Online Alter Table Online Rename Index, Online Change Varchar Faster Replication Enhanced Performance Schema Memory and Stored Program Instrumentation It will not be available in the vey short term (not in FY 2014) 30

31 Connections per second MySQL 5.7.2: Connections / second Faster processing of new connections % +64% MySQL MySQL With Selects Without Select mysql-bench 25 concurrent client threads Executing connect/select/disconnect iterations each Built with input from Facebook Offloaded THD initialization and network initialization to worker thread 31

32 Queries per Second MySQL Sysbench Benchmarks Sysbench Point Select ,000 QPS Concurrent User Sessions 95% Faster than MySQL % Faster than MySQL 5.5 MySQL-5.7 MySQL-5.6 MySQL-5.5 Intel(R) Xeon(R) CPU X7560 x86_64 4 sockets x 8 cores-ht (64 CPU threads) 2.27GHz, 256G RAM Oracle Linux

33 Lossless Semi-Synchronous Replication Master App commits Written to Binary log Send to slave(s) Commit to SE & externalized Ack Commit Slave Write to relay log Apply txn Master waits until defined set of slaves have received the transaction before: Committing txn to Storage Engine Making change visible to other clients Acknowledging commit to application Does not wait for slave to apply change Latency minimized MySQL DMR Ensures that no other transaction acts on new data until it s safe on a slave (rpl_semi_sync_master_wait_point = AFTER_SYNC) 33

34 Multi-Threaded Inter-Transactional Replication Higher slave throughput Multiple worker threads apply multiple transactions to the slave in parallel Parallel transaction must act on disjoint data Don t read or write any overlapping rows Including within the same database! Consistency maintained Increases the slave s throughput Work-in-progress Refactoring work done, Tuning work underway MySQL DMR 34

35 Replication Monitoring Now in Performance Schema MySQL DMR Replication is a delicate module of MySQL - people want to know its status frequently and in detail Table to monitor via SQL replication status replication_connection_configuration, replication_connection_status, replication_execute_configuration and replication_execute_status replication_execute_status_by_coordinator replication_execute_status_by_worker 35

36 Multi-Source Replication MySQL Lab Master 1 Binlog Master 2 Binlog Master N Binlog Consolidate updates from multiple Masters into one Slave Consolidated view of all shards IO 1 Relay 1 Coordinator W1 W2 WX IO 2 Relay 2 Coordinator W1 W2 WX Coordinator W1 W2 WX IO N Relay N Coordinator W1 W2 WX Centralized point for backups Compatible with Semi- Synchronous Replication & enhanced MTS Control and filters will be persource (filters global in labs) Slave Application keeps data sets disjoint between sources 36

37 MySQL Utilities - Fabric High availibity and sharding Application Connector SQL MySQL Fabric Read-slaves Read-slaves Master group Master group Scale-out through sharding Connectors Python Java PHP MySQL Utilities Lab Application provides shard key Range or Hash Tools for resharding Global updates & tables Available in MySQL Utilities

38 MySQL Utilities - Fabric New MySQL Utilities Lab MySQL Fabric is daemon for managing farms of MySQL servers Easy to use, built-in high availability Easy to use, elastic, horizontal scaling for the cloud Attractive data models and drivers for developers Farms consist of groups. Any number of individual MySQL servers A MySQL Replication cluster A group describing a replication cluster consists of a master and any number of slaves MySQL Fabric can setup, administrate and monitor groups Failure detectors (heartbeating) can be used for automatic failover Failover is based on MySQL 5.6+ GTID logic, use MySQL or newer. 38

39 MySQL Utilities - Fabric Sharding MySQL Utilities Lab Fabric supports range, hash or list based partitioning of tables A column reflects the shard key Each partition is assigned to a logical shard group Sharding is not transparent to SQL users 39

40 Q&A Werner Ressle Carsten Thalheimer Technical Sales Consultant LVM GBU (EMEA) You can meet