MySQL 5.7 For Operational DBAs an Introduction. Peter Zaitsev, CEO, Percona February 16, 2016 Percona Technical Webinars

Transcription

1 MySQL 5.7 For Operational DBAs an Introduction Peter Zaitsev, CEO, Percona February 16, 2016 Percona Technical Webinars

2 MySQL 5.7 is Great! A lot of Worthy Changes for Developers and DBAs 2

3 What Developers Care about? Things they can use while developing applications JSON GIS Full Text Search Improvements Better Optimizer 3

4 What DBAs Care About? Performance Availability Security Agility Visibility Architecture 4

5 Today We focus on MySQL 5.7 for Operational DBAs 5

6 Performance Going Faster; Scaling Better 6

7 High Concurrency Starts with 8 Threads What about 2-4 threads? *Information from Oracle OpenWorld presentation by Geir Hoydalsvik 7

8 MySQL 5.7: Single-threaded workload Multi-threaded workload looks great Single-threaded workload shows some regression 8

9 Transparent Page Compression Rely on File System Hole Punching Much Simpler File systems may have problems having Hole for each page 9

10 Disk usage (Linkbench data set by Sunny Bains)

11 Performance on Fast SSD (FusionIO NVMFS)

12 Results on Slower SSD (Intel 730*2, EXT4)

13 Parallel (MTS) Replication Can run multiple parallel workers on the slave Works even for one table! 13

14 Speedup (by Vitor Oliveira) 14

15 Improved Optimizer UNION ALL Does not use TMP Table Subqueries in FROM Clause handles same as in VIEW Better Cost Model Refactored Prepared Statements Refactored Query Parser 15

16 Can Change Costs 16

17 New Hints Try out different plans easily 17

18 Innodb Temporary Tables Separate Tablespace No Redo Logging No Change Buffering Less Locking Better performance than MyISAM 18

19 Internal Oracle Benchmark Sysbench OLTP read only 19

20 Improved Index Creation Up to 3x faster Index Build Speed 20

21 Native Innodb Partitioning Better performance with many partitions Less memory usage with many partitions 21

22 Availability Stay Up, Do not lose Data, Recover Faster 22

23 Semi-Sync Replication Eliminate loss of visible data rpl_semi_sync_master_wait_point=after_sync Better Semi-Sync Performance As well 23

24 Statement Timeout Do not let run-away queries kill your server SET GLOBAL MAX_STATEMENT_TIME=100; Works for Read-Only Statements only 24

25 Online GTID Deployment Enable GTID without need to shut down Master and Slaves 25

26 Improved Innodb Crash Recovery Especially with many tables with innodb_file_per_table 26

27 Security Keep System Secure 27

28 Secure by Default Install with better security by default No anonymous user Only created With secure random password Password Strength enforced 28

29 AES256 Encryption SET block_encryption_mode = 'aes-256-cbc'; = SHA2('My secret passphrase',512); = RANDOM_BYTES(16); = AES_ENCRYPT('text',@key_str,@init_vector); 29

30 Password Password Strength Enforcement Password Expiration Enforcement SET GLOBAL default_password_lifetime = 180; ALTER USER 'jeffrey'@'localhost' PASSWORD EXPIRE INTERVAL 90 DAY; ALTER USER 'jeffrey'@'localhost' PASSWORD EXPIRE NEVER; 30

31 LOCK/UNLOCK Accounts Can Lock account for whatever reason ALTER USER ACCOUNT LOCK; Locked Users Logged to the error log Locked_connects incremented 31

32 Easier to use SSL SSL Enabled by default Easier to configure SSL 32

33 Tablespace Encryption Fresh in MySQL CREATE TABLE t1 (c1 INT) ENCRYPTION='Y'; Only Tablespace content is encrypted at this point 33

34 Agility Implement Changes Faster 34

35 More Online ALTER TABLE Enlarge VARCHAR Rename Index 35

36 Dynamic Variables New Variables are mostly Dynamic Old Variables are being converted 36

37 Online Buffer Pool Resize Chunk for Resize innodb_buffer_pool_chunk_size SET GLOBAL innodb_buffer_pool_size=4*1024*1024*1024; buffer- pool- online- resize.html 37

38 Warm not Hot 38

39 Query Rewrite Plugin Have developers running nasty queries? Rewrite them to nice ones Or make to cause and error 39

40 Mysqldump -> mysqlpump Parallel MySQLDump Not as parallel as mydumper 40

41 Automatic Undo Space Management Protection from run-away undo space Works only when dedicated undo tablespaces are used innodb_undo_tablespaces=4 innodb_undo_log_truncate=on; innodb_max_undo_log_size=1g 41

42 Visibility Prevent Problems; Resolve them faster 42

43 Performance Schema improvements Memory Instrumentations Memory used (bytes) Operation counts Type of memory used (caches, internal buffers, etc) Statement Instrumentations Stored Procedures Stored Functions Prepared Statements Transactions Other Instrumentation Replication slave status MDL lock instrumentatio n User variables per thread Server stage tracking Track long running SQL 43

44 SYS Schema Included in MySQL 5.7 Get the memory usage per user with SYS schema: mysql> update performance_schema.setup_instruments set enabled='yes', timed='yes' where name like 'memory/%'; Query OK, 375 rows affected (0.00 sec) Rows matched: 375 Changed: 375 Warnings: 0 mysql> select * from sys.memory_global_total\g *************************** 1. row *************************** total_allocated: MiB 1 row in set (0.01 sec) mysql> select * from sys.memory_by_user_by_current_bytes\g *************************** 1. row *************************** user: root current_count_used: 42 current_allocated: KiB current_avg_alloc: 8.60 KiB current_max_alloc: KiB total_allocated: GiB *************************** 2. row *************************** user: background current_count_used: 0 current_allocated: 0 bytes current_avg_alloc: 0 bytes current_max_alloc: 0 bytes total_allocated: KiB 2 rows in set (0.01 sec) 44

45 Better Integration with OS 45

46 INNODB_METRICS 46

47 INFORMATION_SCHEMA 47

48 Explain on a Running Query mysql> show processlist\g... Id: 8 Command: Query Time: 90 State: Sending data Info: select count(*), osm_id from points_new group by osm_id mysql> explain for connection 8\G *************************** 1. row *************************** id: 1 select_type: SIMPLE table: points_new partitions: NULL type: ALL possible_keys: NULL key: NULL key_len: NULL ref: NULL rows: filtered: Extra: Using temporary; Using filesort Shows query plan on connection <id> Applicable for SELECT/INSERT/DELETE/ UPDATE 48

49 JSON Explain 49

50 Architecture Architect Better Applications 50

51 JSON Datatype Build Hybrid SQL-Document based applications Optimized Binary Internal Storage Optimizer Support for JSON references 51

52 Multi Source Replication Master > Slave Master > Slaves Masters > Slave (Multi-Source), Since 5.7 Master > Slave > Slaves Now 1 replication slave can have many master servers! Important for BI/Data Science/Ad-hoc analytics 52

53 Generated Columns Define Column as function of other columns Can be persistent or always computed Can be indexed (even if virtual) total_eur DOUBLE AS (price_eur * amount), 53

54 Multiple Triggers on same event Allows Developers to create triggers independently CREATE TRIGGER t1_bi_1_1 BEFORE INSERT ON t1 FOR EACH ROW FOLLOWS t1_bi 54

55 Additional Information You want to know this too 55

56 Time to kill MyISAM Feature MyISAM InnoDB Full Text Indexes yes Since MySQL 5.6 Portable tables (tablespaces) yes Since MySQL 5.6 Spatial Indexes/RTREE (GIS) yes Since MySQL 5.7 Last update for table yes Since MySQL 5.7 ( id=6658) Suitable for temp tables yes Since MySQL 5.7 Also complex selects uses InnoDB ondisk temp tables Fast count(*) yes *Faster in MySQL 5.7 but does not store counter 56

57 Defaults Changes Number of Important Changes sql_mode binlog_format=row Innodb_file_format=barracuda Innodb_checksum_algorithm=crc32 57

58 Comple list of Features? There are more than 150! Great list maintained by Morgan Tocker 58

59 Percona Server 5.7 Better way to access MySQL 5.7 Features 59

60 Percona Server 5.7 All MySQL 5.7 Community features included Alternatives to many Enterprise Only features 100% GPL with no restrictions RC2 Out now. GA Imminent 60

61 Even More Visibility Low Overhead Table/User/Index access statistics Query Response Time Analyses Enhanced Slow Query Log More Information Schema Tables 61

62 Query Response Time example 62

63 More Control Utility User for DBaaS Deployment Enforcing Storage Engine Set Variable for Statement 63

64 Variable for Statement Example SET STATEMENT sort_buffer_size=100000, max_statement_time=1000 FOR SELECT name FROM name ORDER BY name; 64

65 Enterprise Security PAM Authentication Plugin Audit Plugin 65

66 Better Performance Low impact backups with Backup Locks True Incremental Backups with Change Tracking Scale to 10K+ connections with ThreadPool Ongoing work Optimizing for real customer workloads 66

67 TokuDB Storage Engine The only Mature Transactional Storage engine alternative to Innodb Write Optimized High Compression Great with Slow Storage Saves money in the Cloud 67

68 Can get a lot of compression

69 Percona Live Data Performance Conference April in Santa Clara, CA at the Santa Clara Convention Center Register with code WebinarPL to receive 15% off at registration MySQL, NoSQL, Data in the Cloud 69

70 Thank You! Peter bit.ly/perconajobs 70