MariaDB 5.5 and what comes next

Transcription

1 MariaDB 5.5 and what comes next Colin Charles, Monty Program Ab on Twitter Percona Live NYC, New York, USA 2 October 2012

2 whoami MariaDB guy at Monty Program Ab Formerly MySQL AB/Sun Microsystems Past lives included Fedora Project (FESCO), OpenOffice.org

3 Aims 32 months, four major releases (5.1,5.2,5.3,5.5) & more (Galera Cluster, 10.0) Discuss the broader MySQL ecosystem The future of MariaDB

4 MariaDB is... (currently) Community developed Feature enhanced branch of MySQL with more Backwards compatible not a fork feature complete

5 Ownership MySQL (database) owned by MySQL AB (company) -> Sun -> Oracle Monty Program is just a (major) sponsor of MariaDB maria-captains: 50% MP, 50% community including Sphinxsearch, Twitter, SkySQL, Taobao, Facebook, Percona, Codership, & more

6 Compatibility with MySQL NDB cluster included, but not enabled by default Client libraries, client server protocol, SQL dialect, master-slave replication all same Data files supported as long as same versions XtraDB enabled by default now. InnoDB included too & may change to default MariaDB Galera Cluster is a separate download v/mariadb-versusmysql-compatibility

7 MariaDB 5.5 GA April Current release: MariaDB By far the most popular release of MariaDB downloaded, in use, today

8 MariaDB 5.5: an opensource threadpool Modified from 5.1 (libevent based), great for CPU bound loads and short running queries No minimization of concurrent transactions with dynamic pool size Windows (threadpool), Linux (epoll), Solaris (event ports), FreeBSD/ OSX (kevents)

9 MariaDB 5.5: Better for DBAs non-blocking client library start operation, do work in thread, operation processed, result travels back use cases: multiple queries against single server (utilize more CPUs); queries against multiple servers (SHOW STATUS on many machines) SELECT now has LIMIT ROWS EXAMINED to consume less resources SELECT * from t1, t2 LIMIT 10 ROWS EXAMINED 1000;

10 That s it? From December 2010 to April 2012, 2 features for a 16 month delay?!?

11 MariaDB 5.3 Biggest change in the optimizer since it was written Replication improvements Released February 2012 Based on the MySQL 5.1 codebase

12 Better replication Original statements logged with row based replication (RBR) events Checksum for binlog events RBR works for tables with no primary key Consistent snapshot between storage engines

13 Group commit in the binary log sync_binlog=1, innodb_flush_log_at_trx_commit=1 note_id=

14 MariaDB 5.3: GIS support! MySQL has OpenGIS SFS (Simple feature access, SQL access method) Now, SQL with full geometry types ST_ prefix

15 Optimizer enhancements Join additions block nested loop joins for outer-joins, block hash joins, Batched Key Access (BKA) Optimization for derived tables & views mergeable derived tables processed like VIEWs + optimizer creates indexes over materialized derived tables Disk access optimization ICP, MRR

16 Subquery optimizations Semi-join optimization, materialization for non-correlated IN queries, subquery cache Goodbye rewriting as JOINs or separate queries DBT-3, 60M rows, 29GB XtraDB

17 Welcome MySQL 5.6 Instant EXPLAIN kb.askmonty.org/ en/optimizerfeaturecomparisonmatrix/ Optimizer trace in 5.6?

18 Progress reporting For ALTER TABLE or LOAD DATA INFILE MariaDB [mail]> alter table mail engine = maria; Stage: 1 of 2 'copy to tmp table' 17.55% of stage done MariaDB [mail]> select id, user, db, command, state, -> time_ms, progress from information_schema.processlist; command state time_ms progress Query copy to tmp table row in set (0.47 sec)

19 NoSQL access methods Comes with HandlerSocket direct access to XtraDB/InnoDB for CRUD operations Dynamic columns create columns with dynamic content basically a blob with handling functions

20 MariaDB 5.2 Released November 2011 Pluggable authentication w/pam plugin User statistics: CLIENT_STATISTICS, USER_STATISTICS, INDEX_STATISTICS, TABLE_STATISTICS (userstats=1) Virtual columns - PERSISTENT or VIRTUAL SphinxSE storage engine started shipping

21 Still using MyISAM? Mitigates thread contention for key cache lock, with notable performance improvements Key caches divided into different segments, allowing for better key cache concurrency 1-64 segments

22 MariaDB 5.1 Arrived February 2010 Storage engines: XtraDB, FederatedX, PBXT*, OQGRAPH*, Aria, etc. microslow patch, processlist w/microsecond precision table elimination

23 How do we support all this? Version Released Support till Latest release MySQL Feb 2010 Feb Nov 2010 Nov Feb 2012 Feb Apr 2012 Apr

24 Oh, and we re fast Oracle loves MySQL performance on Microsoft Windows. So do we OLTP read-only OLTP write-only

25 How open is MariaDB? Mailing lists: Launchpad nchpad.net ad.net Code hosting: Launchpad launchpad.net/ maria/ Bugs database/feature worklog: Jira mariadb.atlassian.ne t/ #maria on freenode

26 Knowledgebase

27 Deployments! happy users: pap.fr, wabtec, Paybox Services, We made the switch on OLX, Jelastic, Web of Trust, SaltOS, ERP5, etc. Saturday -- and we re seeing MariaDB had these same bugs that we ran into benefits already -- our daily with MySQL. However the big difference was optimization time is down from that when we reported these bugs, they were 24 minutes to just 4 minutes -- quickly resolved within 48 hours! -- Dreas van Ali Watters, CEO, travelblog.org Donselaar, Chief Technology Officer, SpamExperts B.V. after migrating over 300 servers from MySQL 5.0 to MariaDB 5.1. Migrating from MySQL 5.1 to MariaDB 5.2 was as simple as removing MySQL RPMs and installing the MariaDB packages, then running mysql_upgrade. - Panayot Belchev, proprietor, Host Bulgaria on providing MariaDB to over 7,000 of their web hosting customers.

28 Getting MariaDB has repositories (APT,YUM) & regular downloads OpenSUSE build service Gentoo, FreeBSD, Homebrew, Mageia, many distributions

29 We have a book

30 Other branches MySQL Percona MariaDB MySQL Percona MariaDB M 61M M 60M

31 What are we missing from Percona Server? percona_innodb_buffer_pool_shm - requires big shmax not default on many systems percona_log_slow_query_loglog_slow_verbosity - InnoDB filtering information not fully in MariaDB Disabled test suite is awesome resource :)

32 percona_suppress_log_warning_1592 percona_log_slow_slave_statements percona_slow_query_log-control_global_slow percona_query_cache_with_comments percona_query_cache_with_comments_prepared_statement s percona_show_temp_tables percona_slow_query_log-use_global_long_query_time percona_query_cache_with_comments_disable percona_log_connection_error percona_query_response_time percona_query_response_time-stored percona_sql_no_fcache percona_status_wait_query_cache_mutex percona_slave_innodb_stats percona_query_response_time-replication percona_server_variables_debug percona_server_variables_release percona_log_warnings_suppress percona_slow_extended-log_slow_verbosity-cl slow_query_log_use_global_control percona_slow_extended-use_global_control percona_slow_query_log-log_slow_verbosity percona_slow_extended-log_slow_verbosity percona_slow_extended-microseconds_in_slow_extended percona_slow_extended-use_global_long_query_time percona_bug percona_processlist_row_stats percona_server_variables_debug percona_slow_extended-slave_statements percona_show_slave_status_nolock percona_slow_extended-slave_innodb_stats percona_log_slow_slave_statements-anduse_global_long_query_time percona_slow_query_logmicroseconds_in_slow_query_log percona_slow_extendedslow_query_log_timestamp_always-cl percona_slow_extendedslow_query_log_microseconds_timestamp-cl percona_slow_extended-slave_statements-anduse_global_long_query_time userstat_bug percona_innodb_expand_fast_index_creation percona_innodb_kill_idle_trx percona_innodb_kill_idle_trx_locks percona_slow_extended-log_slow_sp_statements-cl

33 read only? InnoDB/XtraDB is fine InnoDB has higher throughput, but stalls & checkpoints w/ high write load Faster even?

34 Track record We found the latest MySQL security bug and MariaDB was first to be patched (sql/password.c & memcmp()) We don t like regressions We care about backward compatibility & introduce features carefully XtraDB innodb_adaptive_checkpoint=none reflex estimate keep_average (no more reflex...)

35 User stats plugin Disabled by default, consider enabling it to show use! data from over 85 countries!

36 We love the community Tokutek s TokuDB ships with MariaDB too groonga is to be merged We re looking at spider next Multiple software packages talk about us (as an alternative to MySQL): Drupal, MediaWiki, Plone, phpmyadmin, WordPress, etc.

37 Future MySQL 5.6 just RC, we have most features in 5.5 MariaDB 10.0 new InnoDB inside MariaDB (done) Global transaction ID support Multi-source replication (done) Enhanced semisync replication Persistent InnoDB statistics (done) Cassandra Storage Engine (done), HBase Storage Engine

38 MariaDB Galera Cluster Now in ALPHA!

39 Support mariadb.org/service-providers/ SkySQL, Percona, FromDual, PalominoDB, OpenQuery Monty Program does developer support & NRE

40 We re incredibly social facebook: fb.com/mariadb.dbms google plus: gplus.to/mariadb we also have a LinkedIn group

41 Q&A url: