MySQL in the Cloud: Creating a Market-Leading DBaaS

Transcription

1 MySQL in the Cloud: Creating a Market-Leading DBaaS

2 Today s Agenda New Market Opportunities MySQL in the Cloud Today Product Developments Supporting New Cloud Services Questions

3 Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle s products remains at the sole discretion of Oracle.

4 MySQL Is Ubiquitous In The Cloud Hosting SaaS IaaS, PaaS, DaaS

5 #1 in Web Ease-of-use Scale-Out Low-Cost

6 Driving MySQL Roadmap Development ELASTIC SCALABILITY SECURITY SELF HEALING MANAGEMENT & MONITORING

7 Tough Questions In The Cloud, Today performance issues? servers down? expensive, slow queries? security policies, change? on-line backup? Replication synch issues? geographic availability?..version of MySQL to run? will systems scale? can I recover? managing MySQL databases?

8 MySQL Enterprise Edition Highest Levels of MySQL Scalability, Security & Uptime Oracle Product Certifications/Integrations MySQL Enterprise Backup Oracle Premier Support MySQL Enterprise Monitor/Query Analyzer MySQL Enterprise Security MySQL Enterprise Scalability MySQL Enterprise High Availability MySQL Workbench

9 MySQL Enterprise Monitor Web-based, global view of MySQL cloud-based instances Continuous, automated, rulesbased monitoring and alerts (SMTP, SNMP enabled) Identify potential issues before customers affected by outage Historic and real-time trend analysis, predict future capacity requirements Real-time Replication Monitor with auto-discovery of master-slave topologies Integrated with MySQL Support Enabled 80% less DBA overhead for Latam s leading social game developer, deployed in the cloud

10 MySQL Enterprise Security Provisioning & Security Single directory of users for centralized provisioning, management & authentication against all granted databases. Enables Cloud providers to implement global level security using industry standard PAM and Windows modules Enables Cloud consumers to enforce centralized authentication for those accessing provisioned database(s) over the cloud

11 MySQL Enterprise Security Example - PAM 1. Joe logs in using application user name/password. App Connector 2. Connector sends the user name/password to the MySQL server. Connected PAM Authentication 3. User name/password sent to the PAM library, yes/no answer from PAM library returned to client. 4. PAM library verifies credentials (using e.g. LDAP or Kerberos etc) and returns yes/no answer for delivery to client. PAM library and various backends CREATE USER joe IDENTIFIED WITH 'authentication_pam' AS mysql';

12 MySQL Enterprise Scalability Performance & Scale Out MySQL Thread Pool Improves sustained performance/scale as user connections grow. 20x scale improvement in SysBench OLTP R/W benchmarks Reduces the need for Cloud providers to provision additional MySQL instances to meet performance SLAs

13 Default Thread Handling External Clients Default Thread Handling Connection Execution Threads Internal Clients Connections /statements assigned to Threads for life Connections assigned to 1 thread for the life of the connection, same thread used for all statements No prioritization of threads, statement executions Many concurrent connections = many concurrent execution threads to consume server memory, limit scalability

14 With Thread Pool Enabled External Clients Thread Pool Thread Group 1 Threads Thread Group 2 Threads Thread Group N Threads N Connection Execution Threads Thread Group 1 Thread Group 2 Thread Group N Internal Clients Thread Pool contains configurable number of thread groups (default = 16), each manages up to 4096 re-usable threads Each connection assigned to thread group via round robin Threads are prioritized, statements queued to limit concurrent executions, load on server, improve scalability as connections grow

15 Transactions Per Second MySQL Enterprise Scalability MySQL 5.5 Sysbench OLTP Read/Write 8,000 7,000 6,000 5,000 MySQL Enterprise Edition With Thread Pool 4,000 3,000 2,000 1,000 0 MySQL Community Server Without Thread Pool Simultaneous Database Connections 20x Better Scalability with Thread Pool MySQL Oracle Linux 6.1, Unbreakable Kernel sockets, 24 cores, 2 X 12-core Intel(R) Xeon(R) X GHz CPUs 72GB DDR3 RAM 2 X LSI SCSI Disk (MR9261-8i) (597GB)

16 MySQL Enterprise Backup Online Backup for InnoDB Full, Incremental, Partial Backups (scriptable interface) Compression Point in Time, Full, Partial Recovery options Metadata on status, progress, history Unlimited Database Size Cross-Platform Windows, Linux, Unix MEB Backup Files Certified with Oracle Secure Backup mysqlbackup MySQL Database Files Offer on-line auto-backups for your customers

17 MySQL Enterprise High Availability Oracle VM Template for MySQL Enterprise Edition Pre-integrated, pre-tested virtual appliance for self-service deployment in minutes Oracle VM Oracle VM Oracle VM Oracle VM Oracle VM Rapid DEPLOYMENT Increased RELIABILITY Higher AVAILABILITY Lower COST Oracle VM Server Pool Oracle VM Servers

18 MySQL Enterprise Edition In Progress MySQL Enterprise Backup 3.8 Now GA! - Parallel Backups, Better performance MySQL Enterprise Monitor Large-scale deployments (for SaaS, cloud) - Capacity analysis, planning, alerts - Backup Management - Integration with Oracle Enterprise Manager 12c MySQL Workbench SE 5.2, MySQL Enterprise Security management - MySQL Enterprise Audit management - MySQL Enterprise Backup management

19 Innovation for the Cloud: MySQL 5.6

20 MySQL 5.6 = A Better MySQL MySQL 5.6 builds on MySQL 5.5 by improving: - Performance and Scalability (up to 64 cores) - Optimizer for better query execution times, diagnostics - InnoDB for better transactional throughput, availability - Replication for higher availability, data integrity - Performance Schema for better instrumentation - Many Other Enhancements Available Now! Get it here: dev.mysql.com/downloads/mysql/

21 MySQL 5.6: Optimizer Subquery Optimizations File sort optimizations with small limit 4X better execution time 40s to 10s Index Condition Pushdown 160X Better execution time 15s to 90ms Postpone Materialization of views/subqueries in FROM 240X better execution time for EXPLAIN 8m to 2s Batched Key Access and Multi Range Read 280X Better execution time 2800s to 10s Provision fewer instances to meet performance SLAs

22 MySQL 5.6: InnoDB Better Performance, Scale Improved thread concurrency, LRU flushing Reduced contention during file extension Increase max redo log size Separate tablespaces for undo log Fast checksum SSD Optimizations Better Recovery Dump and restore buffer pool Better Usability Full-text Search Variable page sizes 4k, 8k Transactional by Default > 95% of MySQL apps run InnoDB Exploiting latest generation of cloud hardware platforms

23 MySQL 5.6: Performance Schema Instrumentation Users/Hosts/Accounts Which application users, hosts, accounts are consuming the most resources? Summaries for Billing and Chargeback Aggregated statistics grouped by thread, user, host, account or object Statements/Stages What are my most resource intensive queries? Where do they spend time? Table/Index I/O, Table Locks Which application tables/indexes cause the most load or contention? Network I/O What is the network load like? How long do sessions idle? Capture granular resource consumption for billing

24 MySQL 5.6 Replication Scaling + HA for the Cloud PERFORMANCE Multi-Threaded Slaves Binary Log Group Commit Optimized Row-Based Replication FAILOVER & RECOVERY Global Transaction Identifiers Replication Failover & Admin Utilities Crash Safe Slaves & Binlogs DATA INTEGRITY Replication Event Checksums DEV/OPS AGILITY Replication Utilities Time-Delayed Replication Remote Binlog Backup Informational Log Events Server UUIDs

25 Queries per Second 5x Higher Replication Performance 300 Multi-Threaded Slave Performance QPS Worker Threads SysBench, running across 10 x schemas Oracle Linux 6.1, Oracle Sun Fire x4150 m2 Server

26 Global Transaction Identifiers Simple to track & compare replication across the cluster Unique identifier for each transaction written to the Binlog Automatically identify the most up-to-date slave for failover Deploy n-tier replication hierarchies Master GTID= GTID= GTID= GTID=123456

27 Replication HA Utilities Failed Master Enabling self-healing replication topologies within and across cloud data centers Automated failover & recovery mysqlfailover Utility Switchover & administration mysqlrpladmin Utility Promoted Master Monitoring HA Utilities Delivers HA within the core MySQL distribution Eliminates the need for 3 rd party solutions Allows extensibility to support variety of HA mechanisms Slaves

28 Growing Suite of MySQL Utilities Workflow for Replication Provisioning Check Repl Show HA Check: Verifying pre-requisites for Replication Repl: Initiating Replication to the new slave Show: Displaying Replication topology HA: Detecting and failing-over from master to slave. Monitoring status. Implemented as Python scripts Available from LaunchPad or as a plug-in for MySQL Workbench Extensible to include custom scripting

29 MySQL Database Development Priorities Optimized for Web, Cloud-based, Embedded use cases Simplified, Pluggable architecture - Faster release, maintenance cycles - More NoSQL options (HTTP, JSON, JavaScript, etc.) Refactoring - Data Dictionary on InnoDB - Optimizer/Parser/Protocol InnoDB - Optimized for mass use cases (fast bulk INSERT, read only, fast recovery), GIS Easy HA, Replication and Sharding

30 Supporting your DBaaS Oracle Premier Support for MySQL Straight from the Source Largest Team of MySQL Experts Backed by MySQL Developers Forward Compatible Hot Fixes MySQL Maintenance Releases MySQL Support in 29 Languages Direct Access to MySQL Support Engineers 24/7/365 Unlimited Incidents Knowledge Base MySQL Consultative Support Only From Oracle "The rep that assisted me was simply outstanding. He immediately recognized the cause of my problem and provided the resolution. mysql.com/support/quotes

31 Tough Questions, Real Solutions performance issues? MySQL Enterprise Scalability expensive, slow queries? Where/When/How to Tune? Replication synch issues? will systems scale? servers down? MySQL Enterprise Monitor, Advisors, Query Analyzer MySQL Enterprise Monitor, Advisors MySQL Consultative Support MySQL Enterprise Monitor, Query Analyzer MySQL Enterprise Monitor, Advisors, Query Analyzer MySQL Consultative Support MySQL Enterprise Monitor, Replication Monitor Oracle Premier 7x24 Support MySQL Enterprise Scalability MySQL Enterprise Monitor, Advisors, Query Analyzer MySQL Consultative Support Oracle Premier 24x7 Support MySQL Enterprise High Availability security policies, change? MySQL External Authentication MySQL Enterprise Monitor, Security Advisor Developers productive? MySQL Workbench SE MySQL Enterprise Monitor, Query Analyzer..version of MySQL to run? Oracle Premier 24x7 Support can I recover? MySQL Enterprise Backup managing Oracle and MySQL databases? MySQL Enterprise Oracle Certifications/Integrations

32 Summary MySQL is the Leading Web Database MySQL is Ubiquitous in the Cloud Easy to Develop, Deploy & Manage: On Premise, Private Clouds, Public Clouds

33 Learn More mysql.com MySQL Products and Editions TCO calculator White Papers Customer use cases and success stories dev.mysql.com Downloads Documentation Forums PlanetMySQL edelivery.oracle.com Download and evaluate all MySQL products

34

35 MySQL Workbench SE Database Design Visual Design, modeling Forward/Reverse Engineer Schema validation, Schema doc SQL Development SQL Editor - Color Syntax Highlighting Objects - Import/Export, Browse/Edit Connections - Wizard, SSH Tunnel Database Administration Status, Configuration, Start/Stop Users, Security, Sessions Import/Export Dump Files Scripting & Plug-in Support UI Designed to match VS 2010 Saves you time developing and managing your Cloud based MySQL applications.

36 MySQL Replication Evolution Scalability and HA for the Cloud PERFORMANCE Improves read consistency from slaves Reduces risk of data loss if master fails FAILOVER & RECOVERY Minimize service interruption Self-Healing DATA INTEGRITY Correct, consistent & accessible DEV/OPS AGILITY Reducing TCO Quickly responding to business demand

37 MySQL Cluster High Write Scalability, Real Time Performance, % Uptime Web High Volume OLTP ecommerce User Profile Management Session Management & Caching Content Management Online Gaming Telecoms Subscriber Databases (HLR/HSS) Service Delivery Platforms VoIP, IPTV & VoD Mobile Content Delivery Mobile Payments LTE Access Copyright 2011 Oracle Corporation 37

38 MySQL Cluster Ideal For The Cloud Auto-sharding for transparent scaling Elastic, on-demand scalability Multi-master for write-intensive applications Shared nothing, distributed design for % uptime Auto failover and self healing recovery Geo-redundancy supporting multiple Availability Zones Low latency, real-time responsiveness

39 Node 2 Node 4 Node 1 Node 3 MySQL Cluster Architecture JPA REST Application Nodes Node Group 1 Node Group 2 Cluster Mgmt F1 F3 F2 F4 Cluster Mgmt F3 F4 F1 Data Nodes F2

40 MySQL Cluster 7.2 Enabling Next Generation Web Services 70x Higher Complex Query Performance: Adaptive Query Localization Native Memcached API MySQL 5.5 Server Integration VM Support Enhancing Cross Data Center Scalability Multi-Site Clustering Simplified Active / Active Replication Ease of Use MySQL Cluster Manager Consolidated Privileges

41 API Flexibility: SQL & NoSQL Combined Clients JDBC / ODBC PHP / PERL Native memcached HTTP/REST Python / Ruby NDB API Data Nodes Mix & Match SQL: Complex, relational queries HTTP / memcached: Key-Value web services Java: Enterprise Apps NDB API: Real-time services