MySQL as a Document Store Ted Wennmark ted.wennmark@oracle.com
Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle s products remains at the sole discretion of Oracle.
Program Agenda 1 2 MySQL Document Store MySQL Future 3
Program Agenda 1 2 MySQL Document Store MySQL Future 4
Today s Challenges Developers want to move faster Time to market has a premium value Rapid prototyping, iterate fast 5
Today s Challenges (cont.) Relational databases ask for schema up front Potentially saving you time in the future Less variations; less code to handle edge cases Added cost with each schema change NoSQL databases do not ask for schema Saving you time up front But potentially adding operational costs over time No cost per schema change 6
Why can you not Have both schema-less and schema in the same technology stack? One that checks all the boxes of all stakeholders: Developers: [ x ] Schemaless [ x ] Rapid Prototyping/Simpler APIs [ x ] Document Model Operations: [ x ] Performance Management/Visibility [ x ] Robust Replication, Backup, Restore [ x ] Comprehensive Tooling Ecosystem Business Owner: [ x ] Don t lose my data = ACID transactions [ x ] Capture all my data = Extensible/Schemaless [ x ] Products On Schedule/Time to Market = Rapid Development 7
NEW! MySQL Document Store Native JSON Documents in MySQL 5.7 Schema-less Document Storage X Protocol (MySQL 5.7.12 DMR) Implemented by X Plugin to Extend MySQL Server as a Document Store X Dev API SQL and Document CRUD Operations Implemented in Connector/Node.js, Connector/J, Connector/Net MySQL Shell Javascript, Python, SQL modes
Architecture Std Protocol 3306 SQL API Std Protocol X Protocol 33060 CRUD API X Protocol MySQL X and Std Protocols MySQL Shell Core X Protocol Plugin Plugins Memcached Plugin 9
New! MySQL X DevAPI Modern: fluent API, method chaining Stateless sessions enable transparent scaling to multi-server environments SQL support CRUD for Collections of Documents and Tables Documents as simple basic domain objects Search expressions match SQL SELECT expressions Implemented in MySQL Shell & MySQL Connectors NEW! MySQL Connector/node.js MySQL Connector/J MySQL Connector/Net
New! MySQL Shell Integrated Development and Administration Shell Exposes New X DevAPI Multi-Language scripting JavaScript, Python, and SQL Configurable results formats Traditional Table, JSON, Tab Separated 11
tomas@localhost $ mysqlsh --uri root@localhost/test Creating an X Session to root@localhost:33060/test Enter password: Default schema `test` accessible through db. Currently in JavaScript mode. Use \sql to switch to SQL mode and execute queries. mysql-js> db.createcollection("posts"); <Collection:posts> mysql-js> db.posts.add({"title":"hello World", "text":"first post!"}) Query OK, 1 item affected (0.03 sec) mysql-js> db.posts.find("title = 'Hello World'").sort(["title"]); [ { "_id": "8202bda28206e611140b3229389b6526", "text": "First post!", "title": "Hello World" } ] 1 document in set (0.01 sec) 12
Under the Hood 13
Create a Collection Collections are tables Tables with: - JSON column - Generated Column 14
Under The Hood II Create Document (CRUD) Look inside general-log X-Plugin translates CRUD -> SQL No code changes in core parts of MYSQL 15
Under The Hood III Read Document (CRUD) Look inside general-log 16
CRUD Operations NoSQL/Document and SQL/Relational Operation Document Relational Create Collection.add() Table.insert() Read Collection.find() Table.select() Update Collection.modify() Table.update() Delete Collection.remove() Table.delete() 17
CRUD Operations NoSQL/Document Javascript Java NodeJS C#
CRUD Operations SQL/Relational Javascript Java NodeJS C# 19
MySQL Document Store Built on Proven SQL/InnoDB/Replication Schema-less/Relational/Hybrid ACID/Transactions CRUD/JSON/Documents Modern Dev API Modern/Efficient Protocol SQL Queries/Analytics over JSON Documents Transparent and Easy HA/Scaling/Sharding
New! Documentation New Style - Developer Focused Developer Guides Lots of examples http://dev.mysql.com/doc/dev/mysqlsh-api-javascript/ 21
Program Agenda 1 2 MySQL Document Store MySQL Future 22
Vision
Be the most popular open source database for scale-out 24
3 MySQL will focus on three things. 25
Ease-of-Use MySQL Out-of-Box Solution Scale-Out 26
Ease-of-Use MySQL Download, Install, HA & Scale-Out in 15 minutes Single Interface for Everything MySQL Easy to Setup, Scale-Out, Manage & Monitor Excellent Quality 27
Out-of-Box Solution MySQL Integrated Solution vs. Individual Components Designed & Developed Together Tested & Delivered Together Managed & Monitored Together 28
Scale-Out MySQL Maintain World-Class Performance Rock Solid, Server-Side HA With Auto-Failover Read Scale-Out With Replication Write Scale-Out With Sharding 29
4 Rollout will happen in four steps. 30
MySQL Vision 4 Steps MySQL Document Store Relational & Document Model S1 Read Scale-Out Async Replication + Auto Failover S3 Timeline MySQL HA Out-Of-Box HA S2 Write Scale-Out Sharding S4 31
Introducing 32
Ease-of-Use Built-in HA MySQL InnoDB cluster Out-of-Box Solution Everything Integrated Scale-Out High Performance 33
MySQL InnoDB Cluster Goals A single product: MySQL All components created together Tested together Packaged together Easy to use A single client: MySQL Shell Easy packaging Homogenous servers Flexible and Modern C++ 11 Protocol Buffers Developer friendly Scale-out Sharded clusters Federated system of N replica sets Each replica set manages a shard 34
MySQL InnoDB Cluster Architecture - S2 Application Application MySQL Connector MySQL Connector MySQL InnoDB cluster MySQL Router MySQL Router M HA MySQL Shell M M Group Replication
MySQL InnoDB Cluster Architecture - S3 Application Application MySQL Connector MySQL Connector MySQL InnoDB cluster MySQL Router MySQL Router M HA MySQL Shell M M S1 S2 S3 S4 S Read-Only Slaves
ReplicaSet (Shard 1) ReplicaSet (Shard 2) ReplicaSet (Shard 3) MySQL InnoDB Cluster Architecture - S4 Application Application Application MySQL Connector MySQL Connector MySQL Connector MySQL InnoDB Application cluster MySQL Connector MySQL Router MySQL Router MySQL Router MySQL Router M HA M HA M H MySQL Shell M M M M M M S1 S2 S3 S4 S S1 S2 S3 S4 S S1 S2 S3
MySQL InnoDB Cluster Architecture Application Application Application Application MySQL Connector MySQL Connector MySQL Connector MySQL Connector MySQL Shell MySQL InnoDB cluster MySQL Enterprise Monitor
MySQL InnoDB cluster
MySQL InnoDB cluster Demo
MySQL InnoDB Cluster DEMO Applicaion MySQL Connector MySQL InnoDB cluster Application MySQL Router M 3310 HA MySQL Shell M M 3320 3330 Group Replication
The Demo Showed MySQL InnoDB cluster MySQL HA in 4 minutes Very easy, even for somebody new to MySQL Everything managed through MySQL Shell Convenient, easy-to-use AdminAPI 42
1 One seamless solution for HA: Easy-to-Use, Out-of-Box, Scale- Out. MySQL InnoDB cluster 43
What s next? 44
MySQL Vision 4 Steps MySQL Document Store Relational & Document Model S1 Read Scale-Out Async Replication + Auto Failover S3 Timeline MySQL HA Out-Of-Box HA S2 Write Scale-Out Sharding S4 Download Preview Release from labs.mysql.com 45
Resources Topic MySQL as a Document Database MySQL Shell X Dev API X Plugin MySQL JSON Link(s) http://dev.mysql.com/doc/refman/5.7/en/document-database.html http://dev.mysql.com/doc/refman/5.7/en/mysql-shell.html http://dev.mysql.com/doc/refman/5.7/en/mysqlx-shell-tutorial-javascript.html http://dev.mysql.com/doc/refman/5.7/en/mysqlx-shell-tutorial-python.html http://dev.mysql.com/doc/x-devapi-userguide/en/ http://dev.mysql.com/doc/refman/5.7/en/x-plugin.html http://mysqlserverteam.com/tag/json/ https://dev.mysql.com/doc/refman/5.7/en/json.html https://dev.mysql.com/doc/refman/5.7/en/json-functions.html 46
Thank you!