Practical MySQL Performance Optimization. Peter Zaitsev, CEO, Percona July 02, 2015 Percona Technical Webinars

Transcription

1 Practical MySQL Performance Optimization Peter Zaitsev, CEO, Percona July 02, 2015 Percona Technical Webinars

2 In This Presentation We ll Look at how to approach Performance Optimization Discuss Practical Performance Optimization Tips Look at the Tools which can help us 2

3 First Things First MySQL Performance does not Matter! 3

4 What DOES Matter? Application Performance! 4

5 Even More so Application Performance Always Matters! 5

6 Take Away Performance Problems might not be MySQL Performance Solutions might not be with MySQL 6

7 Many Tools Use the best Tool for the job MongoDB Cassandra Hadoop Elastic Search Redis 7

8 Say Performance Think Response Time 8

9 Related Issues Stability Scalability Efficiency 9

10 Scalability? Load Scalability with: Data Size Infrastructure 10

11 Performance Sandbags Security Manageability Compatibility Compliance Ease of use by Developers 11

12 Good Enough You can always improve your system. Know when to stop. 12

13 Economics Performance Optimization Positive Business Impact Negative Business Impact 13

14 Positive (How to get a Budget) Very Slow Performance Better Response Time (External) Better Response Time (Internal) Downtime More Engaged Users Higher Sales More productive team Better ability to take decisions 14

15 Direct Costs Optimized System uses less resources Decent Database Node on Amazon EC2 - $1000/month Using less of Nodes, less storage, slower storage are direct savings 15

16 Cost Calculation Examples 30% Less resources needed for 1-2 nodes 30% Less resources needed for 100 nodes Often no real savings achieved Can likely use 30 percent less nodes $360K out of $1.2M saved yearly 16

17 Take Away Larger Scale Systems should spend more on Performance Optimization Even few percent means a lot of $$ on very high scale 17

18 Negative Business Impact Working on Performance means not working on the new features Optimized Architecture can be more complicated and slow down pace 18

19 Dealing with Negatives Focus on the performance optimization which does not impact agility first Consider working with external team Percona can help! 19

20 Lets Look at MySQL in More details! 20

21 What MySQL Does Selects Processes Queries Inserts Deletes Updates 21

22 What to focus on? Performance Optimization focused Making queries run faster Using less resources Scaling better 22

23 Transaction Optimization Specific Application Transaction Find out which queries it runs Optimize them 23

24 General Optimization Look at what queries Server Runs Prioritize them Optimize them 24

25 Queries Are those the right queries? Get rid of them? Can we change them to be doing less work? 25

26 Things to Consider Do not look at the average case only Look at trends over time Think about future performance But avoid focusing only on outliers Consider daily, weekly, monthly cycles Data size change? Cardinality? 26

27 Query Tips Do less queries latency and overhead Read or modify less data Less data processing on the fly How much data is traversed vs sent How much data is sent vs used by app 27

28 Schema Look at Schema and Queries together Minor Schema changes Data Architecture 28

29 Schema Tips Learn Indexing Design Schema for data access Starting with Text book schema is OK ending is likely not Technics Partitioning & Sharding Normalization and Denormalization Covering Indexes 29

30 The Following Also Matter Infrastructure Operating System and Configuration MySQL Version MySQL Configuration 30

31 Optimization Process Low Hanging Fruit MySQL Configuration OS Settings Indexes Caching Medium Level Infrastructure OS MySQL Version Storage Engine Hard Changes Major schema changes Application architecture change 31

32 Infrastructure Optimization Scaling Up or Out One MySQL Node Many MySQL Nodes Type Public Cloud Private Cloud Bare Metal 32

33 Hardware CPU Memory Disk Network 33

34 CPU Intel owns the market 2 sockets commonly used Faster cores or more cores Turboboost 34

35 Memory Main purpose Cache Think Database size vs Memory Look together with Storage Optimization 35

36 Invest in Memory or Storage 36

37 Storage FLASH (SSD) is best! Directly Attached storage is Fastest Virtualization, SAN costs performance but brings features 37

38 Storage Redundancy Server Level MySQL Replication Percona XtraDB Cluster Local Level Storage level (RAID) Filesystem level (Local and Distributed) Internal Flash Redundancy (RAIN) 38

39 Network Latency Distance Number of Hops Throughput 1Gb is a must, trunking recommended 10Gb increasingly affordable Availability Bonding Multipath 39

40 OS Choices Linux Server grade Recent Supporting MySQL well 40

41 OS Tuning Defaults are good for common workloads Filesystem: EXT4 or XFS More Detail 41

42 MySQL Version New versions typically improve performance Scalability, Improved Optimizer, etc. Expect some regressions Try Percona Server

43 MySQL Configuration Do not run with defaults Do not ever obsess with tuning More Details: 43

44 MySQL Tuning in 1 slide max_connections log_bin table_open_cache_size table_definitions_cache_size open_files_limit innodb_buffer_pool_size innodb_log_file_size Innodb_flush_log_at_trx_commit Innodb_flush_method=O_DIRECT 44

45 Tools and The Process 45

46 Process Developers Part Do not bring bad queries and schema in production Operations Process Catch bad queries Validate changes in hardware, configuration, versions 46

47 Queries will be impacted Hardware Changes Configuration MySQL Version Changes Impact of Data Growth Changes to the Query Mix Optimizer Plan Changes 47

48 Tools PT-Query-Digest from Percona Toolkit MySQL Enterprise Monitor MonYog VividCortex Percona Cloud Tools 48

49 How to look at the queries Examples are from Percona Cloud Tools Other tools are similar 49

50 What Queries Server Handles 50

51 Server Summary 51

52 Query Information 52

53 See Change 53

54 To Sum it Up It is Application Performance what Matters! Use Right Tools for Right Job See what Queries MySQL is Running Reduce Number of Queries Reduce Data They Return See how they can do less work Do that work more efficiently 54

55 Performance Audit w/support Trial: Start Getting Your MySQL in Shape This Summer Ø Performance Audit provides a comprehensive review of your MySQL server, including: Configuration Operating system Hardware configuration Application architecture Table design Indexing and Queries Capacity Scaling Potential Ø Results in a a detailed report that prioritizes how to improve the performance and reliability of your deployment Ø Plus 3-Month Technical Support Trial to use for questions regarding your audit, help with the follow up action plan, or any other urgent issues with which you need our help Ø Contact Percona Sales for More Information

56 Super Saver Rates End on July 5 th! 56

57 Percona Support Managed Services Consulting Software 57

58 Thank You! Peter Zaitsev 58