Accelerate MySQL for Demanding OLAP and OLTP Use Case with Apache Ignite December 7, 2016

Transcription

1 Accelerate MySQL for Demanding OLAP and OLTP Use Case with Apache Ignite December 7, 2016 Nikita Ivanov CTO and Co-Founder GridGain Systems Peter Zaitsev CEO and Co-Founder Percona

2 About the Presentation Problems Existing Solutions Nikita Ivanov will show the power of Apache Ignite 2

3 About Percona We Exist to help you to succeed with MySQL and MongoDB 3

4 Support Broad Ecosystem Percona Server for MySQL AWS for MySQL and Aurora MySQL MongoDB MariaDB Percona Server for MongoDB Google CloudSQL 4

5 Percona Software 100% Open Source Percona Server for MySQL Percona Server for MongoDB Percona XtraDB Cluster Percona Xtrabackup Percona Toolkit Percona Monitoring and Management 5

6 Services Support More than Support (Percona Care) Managed Services (Percona Care Ultimate) Consulting, Training 6

7 My Conviction There is no silver bullet in technology! 7

8 Why? All design decisions comes with their own benefits and drawbacks 8

9 Technologies not Technology Large Scale applications tend to use more than one technology on data layer 9

10 Works especially well with Open Source! Additional Components do not require hefty license fees Easy to prototype and test out Open Source Community is good at building bridges 10

11 Balance is Needed Use as many technologies as you need, but no more 11

12 MySQL MySQL is no Exception. It is not Great for Everything. 12

13 Some of the Problems Hot Data Highly Volatile Data Large Data Volume Analytical Processing Full Text Search 13

14 Hot Data For example Cache Large volume of simple requests High overhead due to SQL No good Memory focused Engine Not Designed for very high Concurrency 14

15 Solutions MySQL External MemcacheD interface MemcacheD Redis Thread Pool 15

16 Highly Volatile Data Lots of updates, especially to a single row Design around full Transactional ACID semantics Disk Log based durability Pessimistic Logging 16

17 Solutions MySQL Data Design Configuration Tuning Parallel Replication External MemcacheD Redis 17

18 Large Data Volume MySQL is designed as single node system Limited in CPU, Memory Manual Sharding solutions are painful Especially with complex queries 18

19 Solutions MySQL Manual Sharding Vitess ProxySQL External Shading for MemcacheD and Redis MongoDB Cassandra 19

20 Analytics (OLAP) MySQL does not support column based storage MySQL optimizer is limited for complex queries MySQL does not do parallel query execution MySQL does not do distributed query execution 20

21 Solutions MySQL External Configuration and Schema Design (Limited) Hadoop & Spark Vertica ClickHouse 21

22 Full Text Search Can handle basic Full Text Search Does not scale well with data volume No parallel processing Limited search relevance options Hard To do GIS searches; Facets No language processing 22

23 Solutions MySQL Small Scale search applications only Supported with Innodb tables since MySQL 5.6 Elastic Solr Sphinx External 23

24 New Solutions constantly appear Always be on lookout for a better solutions! 24

25 Apache Ignite Nikita Ivanov will show what you can do with Apache Ignite! 25

26 Accelerate MySQL for Demanding OLAP and OLTP Use Cases with Apache Ignite December 7, 2016 Nikita Ivanov Founder & CTO, GridGain Systems Apache Ignite PMC

27 Why In-Memory Computing Now? Data Growth Driving Demand Declining DRAM Cost Growth of Global Data Zettabytes of Data DRAM Flash Disk 8 zettabytes in 2015 growing to 35 in 2020 Cost drops 30% every 12 months

28 In-Memory Data Fabric Ideal accelerator for SQL data stores and apps Apache Ignite is a leading open-source, cloud-ready distributed software delivering 100x performance and scalability by storing and processing data in memory across scale out or scale up infrastructure GridGain Systems, Inc.

29 In-Memory Data Fabric Main components 2014 GridGain Systems, Inc.

30 In-Memory Data Grid Distributed In-Memory Key-Value Store Replicated and Partitioned data TBs of data, of any type On-Heap and Off-Heap Storage Highly Available In-Memory Replicas Automatic Failover Distributed ACID Transactions SQL99 queries and JDBC/ODBC driver Collocation of Compute and Data 2014 GridGain Systems, Inc.

31 In-Memory Compute Grid Direct API for MapReduce Zero Deployment Cron-like Task Scheduling State Checkpoints Load Balancing Automatic Failover Full Cluster Management Pluggable SPI Design 2014 GridGain Systems, Inc.

32 Smart Metering and Utilities delivers a comprehensive IoT platform SilverSpring Requirements: 100x speed up of DB-based ops Add scalability & elasticity Use open source technologies GridGain Security Why GridGain Used: Strong compute capabilities Co-located in-memory processing Demonstrated best On-demand elasticity & scalability ANSI-99 SQL Support Transactional consistency 50+ Million Meters SilverSpring IoT Platform

33 Join Us at Percona Live! MySQL, MongoDB, Open Source Databases April 24-27, 2017 Santa Clara, CA Tutorials, keynotes and sessions from technical experts Use WebinarPL code to receive a 10% discount Save even more with early bird pricing until January 8th Sponsorship opportunities available 33

34 More Information Percona Peter Zaitsev: Consulting: GridGain Systems Nikita Ivanov: GridGain Professional or Enterprise Edition for 30-Day Trial: Apache Ignite: THANK YOU!!! 2014 GridGain Systems, Inc.