MySQL HA Solutions Selecting the best approach to protect access to your data

Similar documents
Everything You Need to Know About MySQL Group Replication

MySQL Group Replication. Bogdan Kecman MySQL Principal Technical Engineer

Mix n Match Async and Group Replication for Advanced Replication Setups. Pedro Gomes Software Engineer

1 Copyright 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8

MySQL High Availability. Michael Messina Senior Managing Consultant, Rolta-AdvizeX /

Building Highly Available and Scalable Real- Time Services with MySQL Cluster

Introduction to MySQL InnoDB Cluster

MySQL Architecture Design Patterns for Performance, Scalability, and Availability

Group Replication: A Journey to the Group Communication Core. Alfranio Correia Principal Software Engineer

MySQL High Availability Solutions. Alex Poritskiy Percona

State of MySQL Group Replication

MySQL High Availability

High Availability for Enterprise Clouds: Oracle Solaris Cluster and OpenStack

MySQL Cluster Web Scalability, % Availability. Andrew

MySQL Replication Update

MySQL InnoDB Cluster. MySQL HA Made Easy! Miguel Araújo Senior Software Developer MySQL Middleware and Clients. FOSDEM 18 - February 04, 2018

Copyright 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12

MySQL Group Replication in a nutshell

MySQL HA Solutions. Keeping it simple, kinda! By: Chris Schneider MySQL Architect Ning.com

MySQL & NoSQL: The Best of Both Worlds

MySQL High Availability

High Availability for Highly Reliable Systems

Safe Harbor Statement

Choosing a MySQL HA Solution Today

HA for OpenStack: Connecting the dots

High Availability Solutions for the MySQL Database

State of the Dolphin Developing new Apps in MySQL 8

Power your cloud infrastructure with Oracle VM and Cisco!

Copyright 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12

MySQL as a Document Store. Ted Wennmark

MySQL Replication Options. Peter Zaitsev, CEO, Percona Moscow MySQL User Meetup Moscow,Russia

MySQL InnoDB Cluster. New Feature in MySQL >= Sergej Kurakin

MySQL Replication. Rick Golba and Stephane Combaudon April 15, 2015

Choosing a MySQL HA Solution Today. Choosing the best solution among a myriad of options

Design Patterns for Large- Scale Data Management. Robert Hodges OSCON 2013

<Insert Picture Here> MySQL Cluster What are we working on

What s New in MySQL 5.7 Geir Høydalsvik, Sr. Director, MySQL Engineering. Copyright 2015, Oracle and/or its affiliates. All rights reserved.

<Insert Picture Here> MySQL Web Reference Architectures Building Massively Scalable Web Infrastructure

Choosing a MySQL High Availability Solution. Marcos Albe, Percona Inc. Live Webinar June 2017

Welcome to Virtual Developer Day MySQL!

High Availability Using MySQL Group Replication

Performance comparisons and trade-offs for various MySQL replication schemes

Oracle DBAs, Make the Most of MySQL

High availability with MariaDB TX: The definitive guide

What s New in MySQL 5.7

<Insert Picture Here> Oracle NoSQL Database A Distributed Key-Value Store

WLS Neue Optionen braucht das Land

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Improvements in MySQL 5.5 and 5.6. Peter Zaitsev Percona Live NYC May 26,2011

A Guide to Architecting the Active/Active Data Center

MySQL Replication: Latest Developments

MySQL Cluster Ed 2. Duration: 4 Days

Become a MongoDB Replica Set Expert in Under 5 Minutes:

MySQL Reference Architectures for Massively Scalable Web Infrastructure

MySQL Cluster for Real Time, HA Services

MySQL in the Cloud: Creating a Market-Leading DBaaS

Enterprise Open Source Databases

MySQL Enterprise High Availability

The Exciting MySQL 5.7 Replication Enhancements

Lessons from database failures

1 BRIEF / Oracle Solaris Cluster Features and Benefits

Oracle Linux, Virtualization & OEM12 Discussion Sahil Mahajan / Sundeep Dhall

Aurora, RDS, or On-Prem, Which is right for you

MySQL High available by design

MySQL Replication: Pros and Cons

MySQL Replication Advanced Features In 20 minutes

Highly Available Database Architectures in AWS. Santa Clara, California April 23th 25th, 2018 Mike Benshoof, Technical Account Manager, Percona

How To Make Databases on Linux on System z Highly Available

Oracle Solaris Virtualization: From DevOps to Enterprise

Craig Blitz Oracle Coherence Product Management

Eliminate Idle Redundancy with Oracle Active Data Guard

Oracle Database 18c and Autonomous Database

Future-Proofing MySQL for the Worldwide Data Revolution

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

MySQL Replication : advanced features in all flavours. Giuseppe Maxia Quality Assurance Architect at

Oracle VM Template for MySQL Enterprise Edition

MySQL Replication: What's New In MySQL 5.7 and MySQL 8. Luís Soares Software Development Director MySQL Replication

Software Defined Storage for the Evolving Data Center

How To Make Databases on SUSE Linux Enterprise Server Highly Available Mike Friesenegger

Migrating to Aurora MySQL and Monitoring with PMM. Percona Technical Webinars August 1, 2018

Oracle Database 11g: Real Application Testing & Manageability Overview

Various MySQL High Availability (HA) Solutions

HA solution with PXC-5.7 with ProxySQL. Ramesh Sivaraman Krunal Bauskar

InnoDB: Status, Architecture, and Latest Enhancements

Percona XtraDB Cluster MySQL Scaling and High Availability with PXC 5.7 Tibor Korocz

Percona XtraDB Cluster

Experience the GRID Today with Oracle9i RAC

MySQL CLUSTER. Low latency for a real-time user experience; 24 x 7 availability for continuous service uptime;

Oracle Secure Backup 12.2 What s New. Copyright 2018, Oracle and/or its affiliates. All rights reserved.

GR Reference Models. GR Reference Models. Without Session Replication

CO MySQL for Database Administrators

Functional Testing of SQL Server on Kaminario K2 Storage

MySQL Cluster Student Guide

The vsphere 6.0 Advantages Over Hyper- V

MySQL usage of web applications from 1 user to 100 million. Peter Boros RAMP conference 2013

Multi-Data Center MySQL with Continuent Tungsten

A Carrier-Grade Cloud Phone System

MySQL Technical Overview

MySQL CLUSTER. Low latency for a real-time user experience. 24 x 7 availability for continuous service uptime

Microsoft SQL Server

Transcription:

MySQL HA Solutions Selecting the best approach to protect access to your data Sastry Vedantam sastry.vedantam@oracle.com February 2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved

Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle s products remains at the sole discretion of Oracle. February 2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved 2

Don t assume 99.999% HA needed for all apps Recovery Time Objective Maximum length of downtime before there is break in business continuity Recovery Point Objective Point in time to which data must be recovered when service is reestablished Tier 1 Tier 2 Tier 3 Tier 4 Mission-critical services Business-critical services Task-critical services Non-critical services February 2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved 3

Cost & Complexity Mapping Uptime to Availability Replicated Systems Clustered & Virtualized Systems Web & Cloud Services Shared Nothing, Geo- Replicated Clusters ecommerce, Telecoms & Military SPs & Line of Business 9 9. 9 9 9 % February 2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved 4

MySQL HA Solutions MySQL Fabric DRBD Windows/S olaris/clust erware Clustering or Oracle VM MySQL Cluster MySQL Replication 9 9. 9 9 9 % February 2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved 5

Layers of HA It s not just reliably storing the data Redundant App Servers Routing to the Data Redundant Access to Data Data Redundancy February 2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved 6

Why Replicate? Duplicates database from a master to a slave Redundant copies of the data provide foundation for High Availability Scale out by distributing queries across the replication farm Web / App Servers Writes & Reads Reads Master Slaves February 2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved 7

MySQL Replication Workflow Binary Log Relay Log Session Dump I/O SQL Master Database Slave Database Session thread: processes queries from the application writes data to master database & associated events to binary log Dump thread: reads events from binary log and sends them to a slave I/O thread: receives replication events and stores them in slave s relay log SQL thread: reads replication events from slave s relay log and applies them to slave database February 2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved 8

Asynchronous vs. Synchronous Replication Asynchronous MySQL Default In parallel: Master acks to app and sends transaction to slave Fast Risk of lost changes if master dies Semi-Synchronous MySQL 5.5+ - Enhanced in MySQL 5.7 Serially: Master waits for change to be received by slave then In parallel ack to app and apply changes on slave Intermediate latency Lossless (MySQL 5.7) Synchronous Only available with MySQL Cluster Serially: Master waits for change to be applied on all slaves before ack to app Higher latency If Active/Active, best suited to small transactions Lossless February 2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved 9

MySQL 5.6 Replication Performance and Scalability Simplicity 5x Higher slave throughput with MTS (multiple schemas) Reduced master impact Binlog Group Commit Global Transaction IDs Automation Robustness Insurance MySQL Replication Utilities (including auto-failover) Crash safety Replication checksums Time Delayed Replication February 2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved 10

MySQL 5.7 Replication Pre-GA Performance and Scalability Monitoring Operational Simplicity Resilience MORE Resilience Intra-schema Multi-Threaded Slave Faster Master Performance Schema Dynamic slave filters On-line CHANGE MASTER Lossless Semi-Synchronous Replication Multiple Semi-Synchronous Acks GTIDs stored in transactional tables Automatic slave retries February 2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved 11

Multi-Source Replication labs.mysql.com Master 1 Master 2 Master N Consolidate updates from multiple Masters into one Slave Binlog Binlog Binlog Consolidated view of all shards More flexible topologies Centralized point for backups Compatible with Semi-Sync Replication & enhanced MTS IO 1 Relay 1 Coordinator W1 W2 WX IO 2 Relay 2 Coordinator W1 W2 WX Coordinator W1 W2 WX IO N Relay N Coordinator W1 W2 WX Master-specific slave filters Slave February 2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved 12

MySQL Group Replication labs.mysql.com Application MySQL Masters MySQL Server API Replication Plugin Group Comms (Corosync) Shared-nothing virtually synchronous database system Multi-master update anywhere Conflict detection and resolution (transaction rollback) Optimistic State Machine Replication Automatic group membership management and failure detection No need for server fail-over Elastic scale out/in No single point of failure Automatic reconfiguration Well integrated InnoDB GTID-based replication PERFORMANCE_SCHEMA February 2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved 13

MySQL Fabric An extensible and easy-touse framework for managing a farm of MySQL server supporting highavailability and sharding February 2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved 14

MySQL Fabric 1.5 High Availability + Sharding-Based Scale-out Application Application Connector Connector SQL MySQL Fabric Read-slaves Read-slaves HA group HA group High Availability Server monitoring with auto-promotion and transparent application failover Optionally scale-out through sharding Application provides shard key Range or Hash Tools for resharding Global updates & tables Fabric-aware connectors rather than proxy: Python, Java, PHP,.NET, C (labs) Lower latency, bottleneck-free Server provisioning using OpenStack etc. February 2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved 15

MySQL Fabric Framework Server/Shard State & Mapping Master Group Global Data SQL Queries HA Group Shard 1 HA Group Shard 2 Primary Secondary Primary Secondary Primary Secondary Coordination and Control MySQL Fabric Controller Extra Read Replicas Extra Read Replicas Extra Read Replicas

MySQL on Oracle Clusterware Oracle Clusterware unifies servers in a server farm to form a cluster At the core of Oracle RAC Oracle Cluster 12c includes MySQL Server 5.6 agent Planned migration and failover of MySQL database Hidden from the application February 2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved 17

Oracle VM Template for MySQL Oracle VM Automatic Fault Detection & Recovery Oracle VM Pre-Installed & Pre-Configured Full Integration & QA Testing Single Point of Support Oracle VM Manager Secure Live Migration (SSL) Oracle VM Server Pool Oracle VM Servers ocfs2 iscsi / FC-AL February 2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved 18

Oracle Solaris Clustering Kernel based heartbeating and monitoring SPARC and x86. Solaris Virtualization-aware MySQL agent included with Oracle Solaris Cluster Learn more: http://www.oracle.com/technetwo rk/server-storage/solariscluster/overview/index.html February 2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved 19

Oracle Linux and DRBD Stack Application Based on distributed storage NOT physical shared storage Synchronous replication at block device level eliminates risk of data loss Open source, mature & proven Certified and supported by Oracle Services Cluster s/w Hosts VIP MySQL MySQL DRBD sync DRBD Pacemaker Corosync Oracle Linux Oracle Linux Active Standby February 2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved 20

Windows Server Failover Clustering Native Windows HA clustering with MySQL Quorum (3rd vote), data (InnoDB + schema) & binaries (optional) stored in shared storage (iscsi & FCAL) Loss of service = couple of seconds + InnoDB recovery time Cluster managed through MS Failover Cluster Management snapin GUI Slave App App Virtual IP Vote Data App Bin February 2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved 21

MySQL Cluster Scaling Clients Application Layer Data Layer MySQL Cluster Data Nodes February 2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved 22

MySQL Cluster HA Clients Application Layer Data Layer MySQL Cluster Data Nodes February 2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved 23

Active-Active Geo-Replication Asynchronous replication between MySQL Clusters Active-Active Update anywhere Conflict detection Application notified through exception tables Can opt to have conflicts resolved automatically Auto-conflict-resolution Conflicting transaction and dependent ones are rolled-back (MySQL Cluster 7.4 pre GA) No changes to application schema February 2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved 24

Oracle MySQL HA & Scaling Solutions MySQL Replication MySQL Fabric Oracle VM Template Oracle Clusterware Solaris Cluster Windows Cluster DRBD MySQL Cluster App Auto-Failover Data Layer Auto-Failover Platform Support All All Linux Linux Solaris Windows Linux All Clustering Mode Master + Slaves Master + Slaves Active/Pas sive Active/Passi ve Active/P assive Active/Pas sive Active/P assive Multi- Master Failover Time N/A Secs Secs + Secs + Secs + Secs + Secs + < 1 Sec Scale-out Reads Cross-shard operations N/A N/A N/A N/A N/A N/A Transparent routing For HA Shared Nothing Storage Engine InnoDB+ InnoDB+ InnoDB+ InnoDB+ InnoDB+ InnoDB+ InnoDB+ NDB Single Vendor Support February 2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved 25

White Papers & Webinar Replays High Availability http://www.mysql.com/why-mysql/white-papers/#en-22-16 http://www.mysql.com/news-and-events/on-demand-webinars/#en-20-16 MySQL Replication http://www.mysql.com/why-mysql/white-papers/#en-22-38 http://www.mysql.com/news-and-events/on-demand-webinars/#en-20-38 MySQL Cluster http://www.mysql.com/why-mysql/white-papers/#en-22-28 http://www.mysql.com/news-and-events/on-demand-webinars/#en-20-28 February 2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved 26

MySQL Central @ OpenWorld October 25 29, San Francisco Keynote Conferences Sessions Birds-of-a-feather sessions Tutorials Hands-on Labs Demos Receptions OpenWorld Extensive Content Oracle Confidential Restricted 27

Thanks for attending!