ProxySQL Tutorial. With a GPL license! High Performance & High Availability Proxy for MySQL. Santa Clara, California April 23th 25th, 2018
|
|
- Morgan O’Connor’
- 5 years ago
- Views:
Transcription
1 ProxySQL Tutorial High Performance & High Availability Proxy for MySQL With a GPL license! Santa Clara, California April 23th 25th, 2018
2 Who we are René Cannaò ProxySQL Founder Derek Downey Director of OSDB, Pythian 2
3 Agenda What is ProxySQL? Features Fundamentals What is new? Internals Admin Clustering Rules Mirroring Failover New protocols GTID casual reads 3
4 Other sessions Consistent Reads Using ProxySQL and GTID Tuesday April 24, Automatic Failovers with Kubernetes using Orchestrator, ProxySQL and Zookeeper Tuesday April 24, 4
5 Overview of ProxySQL
6 What is ProxySQL The MySQL data stargate 6
7 Main motivations empower the DBAs improve operation understand and improve performance create a proxy layer to shield the database High performance and High Availability 7
8 ProxySQL Features Some of the most interesting features: on-the-fly rewrite of queries caching reads outside the database server connection pooling and multiplexing complex query routing and read/write split load balancing real time statistics monitoring Data masking Multiple instances on same ports
9 ProxySQL Features (2) Some of the most interesting features: High Availability and Scalability seamless failover firewall query throttling query timeout query mirroring runtime reconfiguration Scheduler Support for Galera/PXC and Group Replication
10
11 What s new in ProxySQL Native Support for Group Replication Multiple regex engines Better performance Support for millions of users Support for tens of thousands of database servers Better queries control
12 What s new in ProxySQL Native ProxySQL Clustering Solution Support for ClickHouse as a backend SQLite network Support for millions of shards
13 What s new in ProxySQL 2.0 (dev) all in 1.4.x plus: Support for Aurora SSL support for frontend SSLv1.2 Native Support for Galera Causal reads using GTID Multi-threaded connections reset
14 Hostgroups and Query Routing All backends are grouped into hostgroups Hostgroups have logical functionalities
15 Hostgroups example #1 HostGroup0 (HG0): Write masters HostGroup1( HG1): Read slaves Read/Write split
16 Hostgroups example #2 HG0: main write masters HG1: main read slaves HG2: reporting slaves HG3: ad-hoc queries slaves HG4: data warehouse write masters HG5: data warehouse read slaves HG6: remote site servers HG7: test servers HG8 : mirror for traffic on HG0 HG9 : mirror for traffic on HG1
17 Basic design HG0 APP1 HG1 APP2 ProxySQL HG2 APP3
18 Basic design HG0 APP APP HG1 ProxySQL HG2 Very low latency using Unix Domain Socket (?)
19 One ProxySQL per host
20 Silos approach
21 Clustered ProxySQL Architecture APP APP APP APP PROXYSQL PROXYSQL PROXYSQL PROXYSQL Clustered Proxy Layer PROXYSQL PROXYSQL PROXYSQL DBMANAGER DB DB DB DB DB DB
22 Clustered ProxySQL at scale Tested with: 8 app servers with 3k clients connections each (24k total) 4 middle layer proxysqls processing 4k connections each from local proxysqls (16k total) 256 backends/shard (meaning 256 routing rules) processing 600 connections each (150k total) Single ProxySQL was tested with up to 950k connections At today, ProxySQL is able to process up to 750k QPS
23 ProxySQL Internals
24 ProxySQL Modules in 1.3.x ProxySQL APP1 Queries cache HG0 Monitoring APP2 Users Auth APP3 Thread #1 HG1 Connection Pool Query Processor Hostgroup Manager Thread #2 Thread #3 Admin
25 ProxySQL Modules in 1.4.x ProxySQL APP1 Monitoring ClickHouse Server Admin SQLite3 Server Query Processor Thread #3 idles Thread #3 Thread #2 idles Thread #2 Users Auth Thread #1 idles Queries cache APP3 Cluster ClickHouse Auth Thread #1 APP2 HG0 Purge Thread Connection Pool Hostgroup Manager HG1
26 Queries Processor Based on Queries Rules Defines what to cache Defines the hostgroup target Timeout/delay Firewall Mirroring Rewrite queries
27 Queries rules Complex rules to match incoming traffic: regex on query regex on digest text username schemaname Source IP address Bind IP address/port digest Rules can be chained
28 Queries Cache and Rewrite Caching on the wire Internal key/value storage In memory only Pattern based Expired by timeout Rewrite on the wire Regex match/replace on query on digest text Optionally cached or mirrored
29 Users Authentication Credentials stored in the proxy User login always possible (even without backends) Max connections Login credentials are encrypted Extremely scalable, up to millions of users:
30 Hostgroups Manager Management of servers Track servers status Tightly integrated with the connections pool
31 Connections Pool Reduced the overhead of creating new connections, and are recycled when not in use One to many connections Multiplexing & maximum connections Auto-reconnect and automatic re-execution of queries Failover management
32 Purge Thread Unsafe connections are reset instead of being dropped Drastically reduce the need to establish new connections In ProxySQL 2.0 : each worker thread perform most of the reset
33 Auto-reconnect and re-execution Automatic detection of failures Graceful handling Auto-reconnect when possible Pause until a backend becomes available Re-execution of queries
34 Multiplexing Reduce the number of connections against mysqld (configurable) Many clients connections (tens of thousands) can use few backend connections (few hundreds) Tracks connection status (transactions, user variables, temporary tables, etc) Order by waiting time
35 Multiplexing (see it in web UI)
36 Multiplexing (see it in web)
37 More metrics on web UI
38 More metrics on web UI
39 More metrics on web UI
40 Monitoring Module It monitors backends and collects metrics Monitors replication lag and shun hosts Monitors read_only (and super_read_only and innodb_read_only in 2.0) variables (replication hostgroups) Ping and terminates unresponsive nodes
41 Monitoring Module Built in support for asynchronous replication: second behind master and pt-heartbeat Support for any type of clustering solution via external scripts (Galera/PXC, and any heterogeneous replication setup) In ProxySQL 1.4.0, support for Group Replication In ProxySQL 2.0, support for Galera
42 Admin Module
43 Admin Interface Allows runtime configuration Exports internal statuses It uses MySQL protocol Configuration possible from any client/tool using MySQL API Covered during the tutorial
44 Admin Interface Disk Memory Runtime Runtime Memory Config Disk
45 Try it! Source code on GitHub: Forum: Tutorials on:
46 Demo Environment
47 Demo Code on GitHub: Some hosts provided: Username: plsc Passwords: proxysql 47
48 ProxySQL Cluster
49 ProxySQL Cluster New in experimental (not fully completed, subject to change) Support for MySQL Query Rules, MySQL Users, MySQL Servers and ProxySQL Servers A group of instances constantly check each other for changes in configuration A configuration change applied in a proxy is pulled by the other proxies Allow to keep multiple ProxySQL instances with the same configuration(s)
50 ProxySQL Cluster
51 ProxySQL Cluster Conflict resolution is timestamp based No order Last win No quorum (in the roadmap) Highly scalable: Core nodes vs satellite nodes
52 ProxySQL Cluster - Config mysql> SET admin-cluster_username='radmin'; mysql> SET admin-cluster_password='radmin'; mysql> LOAD ADMIN VARIABLES TO RUNTIME; mysql> SAVE ADMIN VARIABLES TO DISK; mysql> INSERT INTO proxysql_servers (hostname) VALUES ('proxysql1'),('proxysql2'),('proxysql3'); mysql> LOAD PROXYSQL SERVERS TO RUNTIME; mysql> SAVE PROXYSQL SERVERS TO DISK; mysql> SHOW VARIABLES LIKE 'admin-cluster%'; Variable_name Value admin-cluster_username radmin admin-cluster_password radmin admin-cluster_check_interval_ms 1000 admin-cluster_check_status_frequency 10 admin-cluster_mysql_query_rules_diffs_before_sync 3 admin-cluster_mysql_servers_diffs_before_sync 3 admin-cluster_mysql_users_diffs_before_sync 3 admin-cluster_proxysql_servers_diffs_before_sync 3 admin-cluster_mysql_query_rules_save_to_disk true admin-cluster_mysql_servers_save_to_disk true admin-cluster_mysql_users_save_to_disk true admin-cluster_proxysql_servers_save_to_disk true rows in set (0.00 sec) 52
53 ProxySQL Cluster - Monitoring Stats_proxysql_servers_checksums Stats_proxysql_servers_metrics 53
54 ProxySQL Cluster DEMO
55 MySQL Query rules
56 Query rewriting overview Sql-aware Regex-based flexible 56
57 Query rewriting examples read/write splitting Data masking Sharding 57
58 Query rewriting flow 58
59 Match Related Tables mysql_query_rules username schemaname flagin/out client_addr proxy_addr proxy_port digest match_digest match_pattern negate_match_pattern mysql_users active fast_forward(bypass)
60 Action related fields flagout replace_pattern destination_hostgroup cache_ttl timeout retries delay mirror_flagout mirror_hostgroup OK_msg error_msg log multiplex apply active
61 3 layers for ProxySQL tables Disk Memory Runtime Runtime Memory Config Disk
62 Precautions Confirm the query hits with stats_mysql_query_rules double check rules and rewrite results hold off on writing rules to disk until you're sure they are working as expected have a rollback plan load from disk, then load from memory to runtime test select query rules and rewrites on a slaves first test mutable rules on a mirror or other throw away db.
63 Example - Simple R/W mysql> SELECT username, default_hostgroup FROM mysql_users\g *************************** 1. row *************************** username: root default_hostgroup: 0 1 row in set (0.00 sec) mysql> SELECT match_digest, destination_hostgroup FROM mysql_query_rules\g *************************** 1. row *************************** match_digest: ^SELECT.*FOR UPDATE destination_hostgroup: 0 *************************** 2. row *************************** match_digest: ^SELECT destination_hostgroup: 1 2 rows in set (0.00 sec) 63
64 Query Rewriting with ProxySQL DEMO Click to add text
65 Mirroring with ProxySQL Click to add text
66 What is mirroring? 66
67 What is mirroring? 67
68 Why mirror queries? Validate performance on a different server using different hostgroups. Validate performance of query rewrite or schema change Pre-fetch slave replication (Replication Booster) 68
69 How to mirror mysql>show CREATE TABLE mysql_query_rules\g *********************** 1. row ************************ table: mysql_query_rules Create Table: CREATE TABLE mysql_query_rules ( rule_id INTEGER PRIMARY KEY AUTOINCREMENT NOT NULL, active INT CHECK (active IN (0,1)) NOT NULL DEFAULT 0, username VARCHAR, schemaname VARCHAR, flagin INT NOT NULL DEFAULT 0, *snip* mirror_flagout INT UNSIGNED, mirror_hostgroup INT UNSIGNED, error_msg VARCHAR, *snip*) 69
70 Mirroring flow 70
71 Mirroring - example #1 mysql> SELECT username, destination_hostgroup, mirror_hostgroup, mirror_flagout FROM mysql_query_rules WHERE username='plam_mirror'\g ****************** 1. row ********************** username: pl_mirror destination_hostgroup: 3 mirror_hostgroup: 4 mirror_flagout: NULL 71
72 Mirroring - example #2 72
73 Mirroring Demo Click to add text
74 Mirroring caveats Can be dropped: mysql-mirror_max_concurrency, mysql-mirror_max_queue_length Can be executed out of order No error handling of failed queries 74
75 Failover with ProxySQL
76 Failover highlights improve failover time as perceived by the application prevent errors sent to the application perform transparent database failovers: gracefully redirecting traffic without the application knowing existing applications do not have to be rewritten to autoreconnect since connections are not lost from failovers 76
77 Failover scenario - without ProxySQL 77
78 Failover scenario - without ProxySQL 78
79 Failover scenario - with ProxySQL 79
80 Failover scenario - with ProxySQL 80
81 Failover scenario - with ProxySQL 81
82 Failover scenario - with ProxySQL 82
83 Failover without ProxySQL (10 minute outage) 83
84 Failover with ProxySQL (10 second outage) 84
85 Failover - MySQL Servers mysql> SELECT hostgroup_id, hostname, status FROM mysql_servers WHERE hostname IN ('mysql1, 'mysql2 )\G *************************** 1. row *************************** hostgroup_id: 0 hostname: mysql1 status: ONLINE *************************** 2. row *************************** hostgroup_id: 1 hostname: mysql2 status: ONLINE 2 rows in set (0.00 sec) 85
86 Failover - Replication Hostgroups mysql> SELECT * FROM mysql_replication_hostgroups\g *************************** 1. row *************************** writer_hostgroup: 0 reader_hostgroup: 1 comment: 1 row in set (0.00 sec) 86
87 ProxySQL Failover ProTIP ProxySQL does not handle promotion or re-slaving External process needed, such as MHA or Orchestrator 87
88 Failover Demo Click to add text
89 New Features Click to add text
90 ClickHouse Server New in experimental (not fully completed, subject to change) Support for ClickHouse: Fast, really fast data analytics using MySQL client Users management Supports only one backend Supports only DDL and SELECT (no INSERT)
91 ClickHouse Server
92 ClickHouse Server
93 SQLite3 Server New in experimental (not fully completed, subject to change) Support for SQLite3 : Fully transactional, in-memory Same users as MySQL backends A lot of features in the roadmap
94 You-Name-It Server What other service should become part of ProxySQL?
95 You-Name-It Server What other service should become part of ProxySQL?
96 Causal read with GTID Feature introduced in 2.0 Ensures that reads sent to slave returns what the client has written on master Requires GTID and MySQL 5.7+
97 ProxSQL Read / Write Split 97
98 ProxySQL Binlog Reader 98
99 ProxySQL Binlog Reader 99
100 10 0
101 We offer support Subscriptions Consulting Professional services
102 Rate My Session 10 2
103 Thank You!
ProxySQL Tutorial. Percona Live Europe With a GPL license! High Performance & High Availability Proxy for MySQL
Percona Live Europe 2016 ProxySQL Tutorial High Performance & High Availability Proxy for MySQL With a GPL license! Amsterdam, Netherlands October 3 5, 2016 Visit us at booth #102 Who we are David Turner
More informationConsistent Reads Using ProxySQL and GTID. Santa Clara, California April 23th 25th, 2018
Consistent Reads Using ProxySQL and GTID Santa Clara, California April 23th 25th, 2018 Disclaimer I am not René Cannaò @lefred MySQL Community Manager / Oracle the one who provided a hint for this not
More informationPercona Live 2017 ProxySQL Sharding. Marco tusa Santa Clara, California April 24th 27th, 2017
Percona Live 2017 ProxySQL Sharding Marco tusa Santa Clara, California April 24th 27th, 2017 About me Marco The Grinch Open source enthusiast 2 Agenda Example of ProxySQL/MySQL setup Understand Query Rules
More informationPercona Live Europe 2016 Use ProxySQL to Improve Your MySQL High Availability Solution Marco Tusa Manager Consulting Amsterdam, Netherlands October 3
Percona Live Europe 2016 Use ProxySQL to Improve Your MySQL High Availability Solution Marco Tusa Manager Consulting Amsterdam, Netherlands October 3 5, 2016 Percona Live 2017 Use ProxySQL to Improve Your
More informationProxySQL's Internals
ProxySQL's Internals What is ProxySQL? A "Layer 7" database proxy MySQL / ClickHouse protocol aware High Performance High Availability Architecture Overview Clients connect to ProxySQL Requests are evaluated
More informationProxySQL - GTID Consistent Reads. Adaptive query routing based on GTID tracking
ProxySQL - GTID Consistent Reads Adaptive query routing based on GTID tracking Introduction Rene Cannao Founder of ProxySQL MySQL DBA Introduction Nick Vyzas ProxySQL Committer MySQL DBA What is ProxySQL?
More informationFortify your MySQL data security in AWS using ProxySQL and Firewalling. Barcelona 21 June, 2018
Fortify your MySQL data security in AWS using ProxySQL and Firewalling Barcelona 21 June, 2018 About me Marco The Grinch Open source enthusiast In love with ProxySQL Consulting team leader Percona Consultant
More informationPercona Live Europe 2016 Use ProxySQL to Improve Your MySQL High Availability Solution
Percona Live Europe 2016 Use ProxySQL to Improve Your MySQL High Availability Solution Marco Tusa Manager Consulting Amsterdam, Netherlands October 3 5, 2016 About me Marco The Grinch Open source enthusiast
More informationHA solution with PXC-5.7 with ProxySQL. Ramesh Sivaraman Krunal Bauskar
HA solution with PXC-5.7 with ProxySQL Ramesh Sivaraman Krunal Bauskar Agenda What is Good HA eco-system? Understanding PXC-5.7 Understanding ProxySQL PXC + ProxySQL = Complete HA solution Monitoring using
More informationPercona XtraDB Cluster ProxySQL. For your high availability and clustering needs
Percona XtraDB Cluster-5.7 + ProxySQL For your high availability and clustering needs Ramesh Sivaraman Krunal Bauskar Agenda What is Good HA eco-system? Understanding PXC-5.7 Understanding ProxySQL PXC
More informationHighly Available Database Architectures in AWS. Santa Clara, California April 23th 25th, 2018 Mike Benshoof, Technical Account Manager, Percona
Highly Available Database Architectures in AWS Santa Clara, California April 23th 25th, 2018 Mike Benshoof, Technical Account Manager, Percona Hello, Percona Live Attendees! What this talk is meant to
More informationPercona XtraDB Cluster
Percona XtraDB Cluster Ensure High Availability Presenter Karthik P R CEO Mydbops www.mydbops.com info@mydbops.com Mydbops Mydbops is into MySQL/MongoDB Support and Consulting. It is founded by experts
More informationMySQL Replication. Rick Golba and Stephane Combaudon April 15, 2015
MySQL Replication Rick Golba and Stephane Combaudon April 15, 2015 Agenda What is, and what is not, MySQL Replication Replication Use Cases Types of replication Replication lag Replication errors Replication
More informationChoosing a MySQL HA Solution Today
Choosing a MySQL HA Solution Today Choosing the best solution among a myriad of options. Michael Patrick Technical Account Manager at Percona The Evolution of HA in MySQL Blasts from the past Solutions
More informationHow to Implement ProxySQL with AWS Aurora. Written by Marco Tusa Wednesday, 04 April :00 - Last Updated Wednesday, 04 April :37
In this post, we'll look at how to implement ProxySQL with AWS Aurora. Recently, there have been a few discussions and customer requests that focused on AWS Aurora and how to make the various architectures
More informationWhich technology to choose in AWS?
Which technology to choose in AWS? RDS / Aurora / Roll-your-own April 17, 2018 Daniel Kowalewski Senior Technical Operations Engineer Percona 1 2017 Percona AWS MySQL options RDS for MySQL Aurora MySQL
More informationMonitoring MySQL Performance with Percona Monitoring and Management
Monitoring MySQL Performance with Percona Monitoring and Management Santa Clara, California April 23th 25th, 2018 MIchael Coburn, Product Manager Your Presenter Product Manager for PMM (also Percona Toolkit
More informationChoosing a MySQL High Availability Solution. Marcos Albe, Percona Inc. Live Webinar June 2017
Choosing a MySQL High Availability Solution Marcos Albe, Percona Inc. Live Webinar June 2017 Agenda What is availability Components to build an HA solution HA options in the MySQL ecosystem Failover/Routing
More informationMonitoring MySQL Performance with Percona Monitoring and Management
Monitoring MySQL Performance with Percona Monitoring and Management Your Presenters Michael Coburn - PMM Product Manager Working at Percona for almost 5 years Consultant, Manager, TAM, now Product Manager
More informationMySQL High Availability
MySQL High Availability And other stuff worth talking about Peter Zaitsev CEO Moscow MySQL Users Group Meetup July 11 th, 2017 1 Few Words about Percona 2 Percona s Purpose To Champion Unbiased Open Source
More informationProxySQL and MHA integration MHA (Master High Availability Manager and tools for MySQL), is almost fully integrated with the ProxySQL process.
Sunday 11 September 2016 15:32 - Last Updated Monday 14 November 2016 19:21 ProxySQL and MHA integration MHA Master High Availability Manager and tools for MySQL is almost fully integrated with the ProxySQL
More informationUsing MySQL for Distributed Database Architectures
Using MySQL for Distributed Database Architectures Peter Zaitsev CEO, Percona SCALE 16x, Pasadena, CA March 9, 2018 1 About Percona Solutions for your success with MySQL,MariaDB and MongoDB Support, Managed
More informationWhat s New in MySQL and MongoDB Ecosystem Year 2017
What s New in MySQL and MongoDB Ecosystem Year 2017 Peter Zaitsev CEO Percona University, Ghent June 22 nd, 2017 1 In This Presentation Few Words about Percona Few Words about Percona University Program
More informationWritten by Marco Tusa Tuesday, 21 November :21 - Last Updated Tuesday, 21 November :48
ProxySQL PXC Single Writer Mode and auto failover re-bootstrap Tuesday 2 November 207 2 - Last Updated Tuesday 2 November 207 248 Overview ProxySQL had been adopted as solution for HA in place of HAProxy
More informationMySQL High Availability. Michael Messina Senior Managing Consultant, Rolta-AdvizeX /
MySQL High Availability Michael Messina Senior Managing Consultant, Rolta-AdvizeX mmessina@advizex.com / mike.messina@rolta.com Introduction Michael Messina Senior Managing Consultant Rolta-AdvizeX, Working
More informationProxySQL Tools Documentation
ProxySQL Tools Documentation Release 0.3.12 TwinDB Development Team Dec 29, 2017 Contents 1 ProxySQL Tools 3 1.1 Features.................................................. 3 1.2 Credits..................................................
More informationHigh availability with MariaDB TX: The definitive guide
High availability with MariaDB TX: The definitive guide MARCH 2018 Table of Contents Introduction - Concepts - Terminology MariaDB TX High availability - Master/slave replication - Multi-master clustering
More informationAccelerate MySQL for Demanding OLAP and OLTP Use Case with Apache Ignite December 7, 2016
Accelerate MySQL for Demanding OLAP and OLTP Use Case with Apache Ignite December 7, 2016 Nikita Ivanov CTO and Co-Founder GridGain Systems Peter Zaitsev CEO and Co-Founder Percona About the Presentation
More informationChoosing a MySQL HA Solution Today. Choosing the best solution among a myriad of options
Choosing a MySQL HA Solution Today Choosing the best solution among a myriad of options Questions...Questions...Questions??? How to zero in on the right solution You can t hit a target if you don t have
More informationMariaDB MaxScale 2.0, basis for a Two-speed IT architecture
MariaDB MaxScale 2.0, basis for a Two-speed IT architecture Harry Timm, Business Development Manager harry.timm@mariadb.com Telef: +49-176-2177 0497 MariaDB FASTEST GROWING OPEN SOURCE DATABASE * Innovation
More information1 Copyright 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8
1 Copyright 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8 ADVANCED MYSQL REPLICATION ARCHITECTURES Luís
More informationMySQL HA Solutions Selecting the best approach to protect access to your data
MySQL HA Solutions Selecting the best approach to protect access to your data Sastry Vedantam sastry.vedantam@oracle.com February 2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved
More informationEverything You Need to Know About MySQL Group Replication
Everything You Need to Know About MySQL Group Replication Luís Soares (luis.soares@oracle.com) Principal Software Engineer, MySQL Replication Lead Copyright 2017, Oracle and/or its affiliates. All rights
More informationMariaDB CeBIT MariaDB 10.1: Datenbankverschlüsselung und andere Sicherheitsvorteile. Jens Bollmann, Principal Instructor/Consultant
2015, MariaDB Corp. MariaDB CeBIT 2016 MariaDB 10.1: Datenbankverschlüsselung und andere Sicherheitsvorteile Jens Bollmann, Principal Instructor/Consultant Agenda MariaDB 10.1/10.2 new features High Availabilty
More informationMySQL usage of web applications from 1 user to 100 million. Peter Boros RAMP conference 2013
MySQL usage of web applications from 1 user to 100 million Peter Boros RAMP conference 2013 Why MySQL? It's easy to start small, basic installation well under 15 minutes. Very popular, supported by a lot
More informationWhy we re excited about MySQL 8
Why we re excited about MySQL 8 Practical Look for Devs and Ops Peter Zaitsev, CEO, Percona February 4nd, 2018 FOSDEM 1 In the Presentation Practical view on MySQL 8 Exciting things for Devs Exciting things
More informationHigh Noon at AWS. ~ Amazon MySQL RDS versus Tungsten Clustering running MySQL on AWS EC2
High Noon at AWS ~ Amazon MySQL RDS versus Tungsten Clustering running MySQL on AWS EC2 Introduction Amazon Web Services (AWS) are gaining popularity, and for good reasons. The Amazon Relational Database
More informationMulti-Data Center MySQL with Continuent Tungsten
Multi-Data Center MySQL with Continuent Tungsten Peter Boros, Consultant, Percona Robert Hodges, CEO, Continuent Percona Technical Webinars March 2, 2013 About This Presentation Why is multi-data center
More informationMaking Non-Distributed Databases, Distributed. Ioannis Papapanagiotou, PhD Shailesh Birari
Making Non-Distributed Databases, Distributed Ioannis Papapanagiotou, PhD Shailesh Birari Dynomite Ecosystem Dynomite - Proxy layer Dyno - Client Dynomite-manager - Ecosystem orchestrator Dynomite-explorer
More informationMySQL Multi-Site/Multi-Master Done Right
MySQL Multi-Site/Multi-Master Done Right MySQL Clustering for HA and DR The Dream: Multiple, active DBMS servers with identical data over distance Too good to be true? High Performance High Availability
More informationG a l e r a C l u s t e r Schema Upgrades
G a l e r a C l u s t e r Schema Upgrades Seppo Jaakola Codership Agenda Galera Cluster Overview DDL vs DML Demo of DDL Replication in Galera Cluster Rolling Schema Upgrade (RSU) Total Order Isolation
More informationAccelerate MySQL for Demanding OLAP and OLTP Use Cases with Apache Ignite. Peter Zaitsev, Denis Magda Santa Clara, California April 25th, 2017
Accelerate MySQL for Demanding OLAP and OLTP Use Cases with Apache Ignite Peter Zaitsev, Denis Magda Santa Clara, California April 25th, 2017 About the Presentation Problems Existing Solutions Denis Magda
More informationGalera in MariaDB 10.4 State of the Art and Plans
Galera in MariaDB 10.4 State of the Art and Plans Seppo Jaakola Codership Seppo Jaakola One of the Founders of Codership Codership Galera Replication developers Partner of MariaDB for developing and supporting
More informationMySQL Group Replication & MySQL InnoDB Cluster
MySQL Group Replication & MySQL InnoDB Cluster Production Ready? Kenny Gryp productions Table of Contents Group Replication MySQL Shell (AdminAPI) MySQL Group Replication MySQL Router Best Practices Limitations
More informationPercona XtraDB Cluster 5.7 Enhancements Performance, Security, and More
Percona XtraDB Cluster 5.7 Enhancements Performance, Security, and More Michael Coburn, Product Manager, PMM Percona Live Dublin 2017 1 Your Presenter Product Manager for PMM (Percona Monitoring and Management)
More informationMigrating to XtraDB Cluster 2014 Edition
Migrating to XtraDB Cluster 2014 Edition Jay Janssen Managing Consultant Overview of XtraDB Cluster Percona Server + Galera Cluster of Innodb nodes Readable and Writable Virtually Synchronous All data
More informationAurora, RDS, or On-Prem, Which is right for you
Aurora, RDS, or On-Prem, Which is right for you Kathy Gibbs Database Specialist TAM Katgibbs@amazon.com Santa Clara, California April 23th 25th, 2018 Agenda RDS Aurora EC2 On-Premise Wrap-up/Recommendation
More informationMySQL High Availability Solutions. Alex Poritskiy Percona
MySQL High Availability Solutions Alex Poritskiy Percona The Five 9s of Availability Clustering & Geographical Redundancy Clustering Technologies Replication Technologies Well-Managed disasters power failures
More informationA Guide to Architecting the Active/Active Data Center
White Paper A Guide to Architecting the Active/Active Data Center 2015 ScaleArc. All Rights Reserved. White Paper The New Imperative: Architecting the Active/Active Data Center Introduction With the average
More informationInstalling and Configuring VMware Identity Manager Connector (Windows) OCT 2018 VMware Identity Manager VMware Identity Manager 3.
Installing and Configuring VMware Identity Manager Connector 2018.8.1.0 (Windows) OCT 2018 VMware Identity Manager VMware Identity Manager 3.3 You can find the most up-to-date technical documentation on
More informationPercona XtraDB Cluster MySQL Scaling and High Availability with PXC 5.7 Tibor Korocz
Percona XtraDB Cluster MySQL Scaling and High Availability with PXC 5.7 Tibor Korocz Architect Percona University Budapest 2017.05.11 1 2016 Percona Scaling and High Availability (application) 2 Scaling
More informationMySQL Group Replication. Bogdan Kecman MySQL Principal Technical Engineer
MySQL Group Replication Bogdan Kecman MySQL Principal Technical Engineer Bogdan.Kecman@oracle.com 1 Safe Harbor Statement The following is intended to outline our general product direction. It is intended
More informationAll of us are very good in writing good queries, we know that ;) but sometimes a bad query may escape our control and hit (badly) our database.
Saturday 20 August 206 5:40 - Last Updated Wednesday 24 August 206 08:7 All of us are very good in writing good queries we know that but sometimes a bad query may escape our control and hit badly our database.
More informationMarkLogic Server. Database Replication Guide. MarkLogic 6 September, Copyright 2012 MarkLogic Corporation. All rights reserved.
Database Replication Guide 1 MarkLogic 6 September, 2012 Last Revised: 6.0-1, September, 2012 Copyright 2012 MarkLogic Corporation. All rights reserved. Database Replication Guide 1.0 Database Replication
More informationCopyright 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
1 MySQL : 5.6 the Next Generation Lynn Ferrante Principal Consultant, Technical Sales Engineering Northern California Oracle Users Group November 2012 2 Safe Harbor Statement The
More informationMySQL Replication: What's New In MySQL 5.7 and MySQL 8. Luís Soares Software Development Director MySQL Replication
MySQL Replication: What's New In MySQL 5.7 and MySQL 8 Luís Soares Software Development Director MySQL Replication Tuesday, 24th April 2018, Santa Clara, CA, USA Copyright 2018, Oracle and/or its affiliates.
More informationWhat s New in MySQL 5.7 Geir Høydalsvik, Sr. Director, MySQL Engineering. Copyright 2015, Oracle and/or its affiliates. All rights reserved.
What s New in MySQL 5.7 Geir Høydalsvik, Sr. Director, MySQL Engineering Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes
More informationEnterprise Open Source Databases
Enterprise Open Source Databases WHITE PAPER MariaDB vs. Oracle MySQL vs. EnterpriseDB MariaDB TX Born of the community. Raised in the enterprise. MariaDB TX, with a history of proven enterprise reliability
More informationWelcome to Virtual Developer Day MySQL!
Welcome to Virtual Developer Day MySQL! Keynote: Developer and DBA Guide to What s New in MySQL 5.6 Rob Young Director of Product Management, MySQL 1 Program Agenda 9:00 AM Keynote: What s New in MySQL
More informationDocument Sub Title. Yotpo. Technical Overview 07/18/ Yotpo
Document Sub Title Yotpo Technical Overview 07/18/2016 2015 Yotpo Contents Introduction... 3 Yotpo Architecture... 4 Yotpo Back Office (or B2B)... 4 Yotpo On-Site Presence... 4 Technologies... 5 Real-Time
More informationTechnology Overview ScaleArc. All Rights Reserved.
2014 ScaleArc. All Rights Reserved. Contents Contents...1 ScaleArc Overview...1 Who ScaleArc Helps...2 Historical Database Challenges...3 Use Cases and Projects...5 Sample ScaleArc Customers...5 Summary
More informationUtilising ProxySQL for connection pooling in PHP. Tibor Korocz, Percona Johan Nilsson, Verisure Innovation
Utilising ProxySQL for connection pooling in PHP Tibor Korocz, Percona Johan Nilsson, Verisure Innovation Agenda Small introduction Explaining our use cases What is the problem? Possible solutions What
More informationIntroduction to MySQL InnoDB Cluster
1 / 148 2 / 148 3 / 148 Introduction to MySQL InnoDB Cluster MySQL High Availability made easy Percona Live Europe - Dublin 2017 Frédéric Descamps - MySQL Community Manager - Oracle 4 / 148 Safe Harbor
More informationScaleArc for SQL Server
Solution Brief ScaleArc for SQL Server Overview Organizations around the world depend on SQL Server for their revenuegenerating, customer-facing applications, running their most business-critical operations
More informationConfiguring the Oracle Network Environment. Copyright 2009, Oracle. All rights reserved.
Configuring the Oracle Network Environment Objectives After completing this lesson, you should be able to: Use Enterprise Manager to: Create additional listeners Create Oracle Net Service aliases Configure
More informationMySQL Database Scalability
MySQL Database Scalability Nextcloud Conference 2016 TU Berlin Oli Sennhauser Senior MySQL Consultant at FromDual GmbH oli.sennhauser@fromdual.com 1 / 14 About FromDual GmbH Support Consulting remote-dba
More informationBuilding Highly Available and Scalable Real- Time Services with MySQL Cluster
Building Highly Available and Scalable Real- Time Services with MySQL Cluster MySQL Sales Consulting Director Philip Antoniades April, 3rd, 2012 1 Copyright 2012, Oracle and/or its affiliates. All rights
More informationIT Best Practices Audit TCS offers a wide range of IT Best Practices Audit content covering 15 subjects and over 2200 topics, including:
IT Best Practices Audit TCS offers a wide range of IT Best Practices Audit content covering 15 subjects and over 2200 topics, including: 1. IT Cost Containment 84 topics 2. Cloud Computing Readiness 225
More informationThe Exciting MySQL 5.7 Replication Enhancements
The Exciting MySQL 5.7 Replication Enhancements Luís Soares (luis.soares@oracle.com) Principal Software Engineer, MySQL Replication Team Lead Copyright 2016, Oracle and/or its affiliates. All rights reserved.
More informationMySQL Replication : advanced features in all flavours. Giuseppe Maxia Quality Assurance Architect at
MySQL Replication : advanced features in all flavours Giuseppe Maxia Quality Assurance Architect at VMware @datacharmer 1 About me Who s this guy? Giuseppe Maxia, a.k.a. "The Data Charmer" QA Architect
More informationFIREFLY ARCHITECTURE: CO-BROWSING AT SCALE FOR THE ENTERPRISE
FIREFLY ARCHITECTURE: CO-BROWSING AT SCALE FOR THE ENTERPRISE Table of Contents Introduction... 2 Architecture Overview... 2 Supported Browser Versions and Technologies... 3 Firewalls and Login Sessions...
More informationMySQL Proxy. Making MySQL more flexible Jan Kneschke
MySQL Proxy Making MySQL more flexible Jan Kneschke jan@mysql.com MySQL Proxy proxy servers forward requests to backends and can transform, handle or block them released under the GPL see http://forge.mysql.com/wiki/mysql_proxy
More informationUsing MHA in and out of the Cloud. Garrick Peterson Percona University, Toronto 2013
Using MHA in and out of the Cloud Garrick Peterson Percona University, Toronto 2013 Agenda Who am I MHA Overview HA In the Cloud IP Management options Simple use case What do we use Recommendations GTID
More informationHigh Availability Failover. Version 1.0
High Availability Failover Version 1.0 CONTENTS High Availability Failover High Availability Failover (Active/Active) 2 Prerequisites 2 STEP 1: DB Replication Server Setup 2 STEP 2: Configure the MySQL
More informationBIG-IP Service Provider: Message Routing Administration. Version 13.0
BIG-IP Service Provider: Message Routing Administration Version 13.0 Table of Contents Table of Contents Using the Diameter Configuration Wizard...5 Overview: Diameter Configuration Wizard... 5 About
More informationMigrating To MySQL The Live Database Upgrade Guide
Migrating To MySQL 5.7 - The Live Database Upgrade Guide October 4, 2016 Krzysztof Książek Severalnines krzysztof@severalnines.com 1 Agenda! Why upgrading to MySQL 5.7?! Preparing an upgrade - changes
More informationMigrating and living on RDS/Aurora. life after Datacenters
Migrating and living on RDS/Aurora life after Datacenters Why to migrate to RDS - It is AWS native - A lot of complexity is handled by Amazon - It is Someone Else s Problem (SEP ) - You have someone to
More informationDataSunrise Database Security Suite Release Notes
www.datasunrise.com DataSunrise Database Security Suite 4.0.4 Release Notes Contents DataSunrise Database Security Suite 4.0.4... 3 New features...3 Known limitations... 3 Version history... 5 DataSunrise
More informationHow to setup Orchestrator to manage thousands of MySQL servers. Simon J Mudd 3 rd October 2017
How to setup Orchestrator to manage thousands of MySQL servers Simon J Mudd 3 rd October 2017 Session Summary What is orchestrator and why use it? What happens as you monitor more servers? Features added
More informationOffice 365 and Azure Active Directory Identities In-depth
Office 365 and Azure Active Directory Identities In-depth Jethro Seghers Program Director SkySync #ITDEVCONNECTIONS ITDEVCONNECTIONS.COM Agenda Introduction Identities Different forms of authentication
More informationHigh-Performance Distributed DBMS for Analytics
1 High-Performance Distributed DBMS for Analytics 2 About me Developer, hardware engineering background Head of Analytic Products Department in Yandex jkee@yandex-team.ru 3 About Yandex One of the largest
More informationThe Hazards of Multi-writing in a Dual-Master Setup
The Hazards of Multi-writing in a Dual-Master Setup Jay Janssen MySQL Consulting Lead November 15th, 2012 Explaining the Problem Rules of the Replication Road A given MySQL instance: Can be both a master
More informationSystem Description. System Architecture. System Architecture, page 1 Deployment Environment, page 4
System Architecture, page 1 Deployment Environment, page 4 System Architecture The diagram below illustrates the high-level architecture of a typical Prime Home deployment. Figure 1: High Level Architecture
More informationScaling Databases with DBIx::Router. Perrin Harkins We Also Walk Dogs
Scaling Databases with DBIx::Router Perrin Harkins We Also Walk Dogs What is DBIx::Router? Load-balancing Failover Sharding Transparent (Mostly.) Why would you need this? Web and app servers are easy to
More informationDesign Patterns for Large- Scale Data Management. Robert Hodges OSCON 2013
Design Patterns for Large- Scale Data Management Robert Hodges OSCON 2013 The Start-Up Dilemma 1. You are releasing Online Storefront V 1.0 2. It could be a complete bust 3. But it could be *really* big
More informationDistributed PostgreSQL with YugaByte DB
Distributed PostgreSQL with YugaByte DB Karthik Ranganathan PostgresConf Silicon Valley Oct 16, 2018 1 CHECKOUT THIS REPO: github.com/yugabyte/yb-sql-workshop 2 About Us Founders Kannan Muthukkaruppan,
More informationMySQL for Database Administrators Ed 4
Oracle University Contact Us: (09) 5494 1551 MySQL for Database Administrators Ed 4 Duration: 5 Days What you will learn The MySQL for Database Administrators course teaches DBAs and other database professionals
More informationWhat is the Future of PostgreSQL?
What is the Future of PostgreSQL? Robert Haas 2013 EDB All rights reserved. 1 PostgreSQL Popularity By The Numbers Date Rating Increase vs. Prior Year % Increase January 2016 282.401 +27.913 +11% January
More informationMarkLogic Server. Database Replication Guide. MarkLogic 9 May, Copyright 2017 MarkLogic Corporation. All rights reserved.
Database Replication Guide 1 MarkLogic 9 May, 2017 Last Revised: 9.0-3, September, 2017 Copyright 2017 MarkLogic Corporation. All rights reserved. Table of Contents Table of Contents Database Replication
More informationOpen Source Database Performance Optimization and Monitoring with PMM. Fernando Laudares, Vinicius Grippa, Michael Coburn Percona
Open Source Database Performance Optimization and Monitoring with PMM Fernando Laudares, Vinicius Grippa, Michael Coburn Percona Fernando Laudares 2 Vinicius Grippa 3 Michael Coburn Product Manager for
More informationHow Microsoft Built MySQL, PostgreSQL and MariaDB for the Cloud. Santa Clara, California April 23th 25th, 2018
How Microsoft Built MySQL, PostgreSQL and MariaDB for the Cloud Santa Clara, California April 23th 25th, 2018 Azure Data Service Architecture Share Cluster with SQL DB Azure Infrastructure Services Azure
More informationMySQL Group Replication in a nutshell
1 / 126 2 / 126 MySQL Group Replication in a nutshell the core of MySQL InnoDB Cluster Oracle Open World September 19th 2016 Frédéric Descamps MySQL Community Manager 3 / 126 Safe Harbor Statement The
More informationUnderstanding Percona XtraDB Cluster 5.7 Operation and Key Algorithms. Krunal Bauskar PXC Product Lead (Percona Inc.)
Understanding Percona XtraDB Cluster 5.7 Operation and Key Algorithms Krunal Bauskar PXC Product Lead (Percona Inc.) Objective I want to use Percona XtraDB Cluster but is it suitable for my needs and can
More informationMySQL Multi-Site/Multi-Master MySQL High Availability and Disaster Recovery ~~~ Heterogeneous Real-Time Data Replication Oracle Replication
MySQL Multi-Site/Multi-Master MySQL High Availability and Disaster Recovery ~~~ Heterogeneous Real-Time Data Replication Oracle Replication Continuent Quick Introduction History Products 2004 2009 2014
More informationPolarDB. Cloud Native Alibaba. Lixun Peng Inaam Rana Alibaba Cloud Team
PolarDB Cloud Native DB @ Alibaba Lixun Peng Inaam Rana Alibaba Cloud Team Agenda Context Architecture Internals HA Context PolarDB is a cloud native DB offering Based on MySQL-5.6 Uses shared storage
More informationArchitecture and Design of MySQL Powered Applications. Peter Zaitsev CEO, Percona Highload Moscow, Russia 31 Oct 2014
Architecture and Design of MySQL Powered Applications Peter Zaitsev CEO, Percona Highload++ 2014 Moscow, Russia 31 Oct 2014 About Percona 2 Open Source Software for MySQL Ecosystem Percona Server Percona
More informationThe CORAL Project. Dirk Düllmann for the CORAL team Open Grid Forum, Database Workshop Barcelona, 4 June 2008
The CORAL Project Dirk Düllmann for the CORAL team Open Grid Forum, Database Workshop Barcelona, 4 June 2008 Outline CORAL - a foundation for Physics Database Applications in the LHC Computing Grid (LCG)
More informationPostgres-XC PG session #3. Michael PAQUIER Paris, 2012/02/02
Postgres-XC PG session #3 Michael PAQUIER Paris, 2012/02/02 Agenda Self-introduction Highlights of Postgres-XC Core architecture overview Performance High-availability Release status 2 Self-introduction
More informationWhat s new in Percona Xtradb Cluster 5.6. Jay Janssen Lead Consultant February 5th, 2014
What s new in Percona Xtradb Cluster 5.6 Jay Janssen Lead Consultant February 5th, 2014 Overview PXC 5.6 is the aggregation of Percona Server 5.6 Codership MySQL 5.6 patches Galera 3.x Agenda Major new
More informationLessons from database failures
Lessons from database failures Colin Charles, Chief Evangelist, Percona Inc. colin.charles@percona.com / byte@bytebot.net http://www.bytebot.net/blog/ @bytebot on Twitter Percona Webminar 18 January 2017
More information