MySQL for Database Administrators Volume I Student Guide

Transcription

1 MySQL for Database Administrators Volume I Student Guide D61762GC20 Edition 2.0 September 2011 D74260

2 Disclaimer This document contains proprietary information and is protected by copyright and other intellectual property laws. You may copy and print this document solely for your own use in an Oracle training course. The document may not be modified or altered in any way. Except where your use constitutes "fair use" under copyright law, you may not use, share, download, upload, copy, print, display, perform, reproduce, publish, license, post, transmit, or distribute this document in whole or in part without the express authorization of Oracle. The information contained in this document is subject to change without notice. If you find any problems in the document, please report them in writing to: Oracle University, 500 Oracle Parkway, Redwood Shores, California USA. This document is not warranted to be error-free. Restricted Rights Notice If this documentation is delivered to the United States Government or anyone using the documentation on behalf of the United States Government, the following notice is applicable: U.S. GOVERNMENT RIGHTS The U.S. Government s rights to use, modify, reproduce, release, perform, display, or disclose these training materials are restricted by the terms of the applicable Oracle license agreement and/or the applicable U.S. Government contract. Trademark Notice Oracle and Java are registered trademarks of Oracle and/or its affiliates. Other names may be trademarks of their respective owners. Authors Patricia Garcia, Jeffrey Gorton Technical Contributors and Reviewers Kimseong Loh, Mattias Jonsson, Rob Young, John Russell, Bill Millar, Calvin Sun, Oleksii Porytskyi, Ritheesh Vedire, Stefan Hinz, Todd Farmer, Ron Soltani This book was published using: Oracle Tutor

3 Table of Contents Introduction to MySQL Introduction to MySQL Course Goals Course Lesson Map Introductions Classroom Environment MySQL Overview Acquisitions of the MySQL Company MySQL Is Powering the World! MySQL Database Server Editions MySQL Tools MySQL Connectors and APIs MySQL Services Community Support Oracle Lifetime Support for MySQL MySQL-Supported Operating Systems MySQL Websites MySQL Curriculum Footprint MySQL Certification MySQL Online Documentation Architecture Architecture Objectives MySQL Architecture Client Programs Administrative and Utility Programs MySQL Server Server Process Connection Layer Communication Protocols SQL Layer SQL Statement Processing Storage Layer Storage Engine: Overview Features Dependent on Storage Engine How MySQL Uses Disk Space How MySQL Uses Memory Memory Structures MySQL Plugin Interface Summary Practice 2-1 Overview: Quiz System Administration System Administration Objectives MySQL Server Distributions MySQL Binary Distributions MySQL Source Distributions i

4 MySQL RPM Installation Files for Linux Linux MySQL RPM Installation Process Linux MySQL Server Installation Directories Starting MySQL Server on Linux Stopping MySQL Server on Linux Improving Installation Security Windows MySQL Server Installation Directory Running MySQL on Windows Data Directory Upgrading MySQL Server Release Checking Upgraded Tables Employing Multiple Servers Multiple Server Options Summary Practice 3-1 Overview: Install the MySQL Server Practice 3-2 Overview: MySQL Data Directory Practice 3-3 Overview: Start and Stop the MySQL Server Server Configuration Server Configuration Objectives MySQL Configuration Options Reasons to Use Option Files Option File Groups Writing an Option File Option File Locations Startup Options in an Option File Sample Option Files Displaying Options from Option Files Server System Variables Dynamic System Variables Displaying Dynamic System Variables Structured System Variables Server Status Variables SQL Modes Setting the SQL Mode Common SQL Modes Log Files Log File Usage Matrix Binary Logging Binary Logging Formats List Binary Log Files View Binary Log Contents Deleting Binary Logs Summary Practice 4-1 Overview: Edit and Create a Configuration File Practice 4-2 Overview: Quiz Practice 4-3 Overview: Further Practice: Server Configuration Clients and Tools Clients and Tools ii

5 Objectives Command-Line Client Programs Invoking Command-Line Clients Connection Parameter Options Quiz Invoking mysql Client mysql Client: Safe Updates mysql Client: Output Formats mysql Client: MySQL Client Commands mysql Client: SQL Statements mysql Client: Help on SQL Statements mysql Client: SQL Statement Terminators mysql Client: Special Statement Terminators mysql Client: Redefining the Prompt mysql Client: Using Script Files mysqladmin Client Invoking the mysqladmin Client Quiz MySQL Tools MySQL Enterprise Monitor MySQL Enterprise Monitor: Dashboard MySQL Enterprise Monitor: Access MySQL Workbench MySQL Workbench: GUI Window MySQL Workbench: Access MySQL Proxy MySQL Connectors Third-Party APIs Quiz Summary Practice 5-1 Overview: Invoke the mysql Client Practice 5-2 Overview: Invoke the mysqladmin Client Practice 5-3 Overview: View the MySQL Enterprise Monitor Demos Practice 5-4 Overview: View the MySQL Workbench Demos Data Types Data Types Objectives Data Types: Overview Creating Tables with Data Types Numeric Data Types Character String Data Types Character Set and Collation Support Binary String Data Types Temporal Data Types Setting Data Types to NULL Creating Tables with Column Attributes Column Attributes Choosing Data Types Summary iii

6 Practice 6-1 Overview: Quiz Practice 6-2 Overview: Set a Data Type Obtaining Metadata Obtaining Metadata Objectives Metadata Access Methods INFORMATION_SCHEMA Database INFORMATION_SCHEMA Tables INFORMATION_SCHEMA Table Columns Using SELECT with INFORMATION_SCHEMA INFORMATION_SCHEMA Examples Creating Shell Commands with INFORMATION_SCHEMA Tables Creating SQL Statements with INFORMATION_SCHEMA Tables MySQL-Supported SHOW Statements SHOW Statement Examples Additional SHOW Statement Examples DESCRIBE Statement mysqlshow Client mysqlshow Examples Summary Practice 7-1 Overview: Obtain Metadata by Using INFORMATION_SCHEMA Practice 7-2 Overview: Obtain Metadata by Using SHOW and DESCRIBE Practice 7-3 Overview: Obtain Metadata by Using mysqlshow Transactions and Locking Transactions and Locking Objectives Transactions Transaction Diagram ACID Transaction SQL Control Statements SQL Control Statements Flow: Example AUTOCOMMIT Mode Implicit Commit Transactional Storage Engines Transaction Isolation Problems Isolation Levels Isolation Level Problems Setting the Isolation Level Global Isolation Level Transaction Example: Isolation Locking Concepts Explicit Row Locks Deadlocks Transaction Example: Deadlock Implicit Locks Summary Practice 8-1 Overview: Quiz Practice 8-2 Overview: Use Transaction Control Statements Practice 8-3 Overview: Further Practice with Transactions and Locking iv

7 InnoDB Storage Engine InnoDB Storage Engine Objectives InnoDB Storage Engine InnoDB as Default Storage Engine InnoDB Features Display the Storage Engine Setting Set the Storage Engine to InnoDB Convert Existing Tables to InnoDB InnoDB System Tablespace Multiple Tablespaces Multiple Tablespace Directory Structure Tablespace Configuration Decrease Tablespace Size Log Files and Buffers: Diagram Multiple Buffer Pools Referential Integrity Multi-Versioning Locking Next-Key Locking Consistent Non-Locking Reads Reduce Deadlocks Foreign Key Locking Summary Practice 9-1 Overview: Quiz Practice 9-2 Overview: Set and Confirm InnoDB Settings Other Storage Engine Information Other Storage Engine Information Objectives Storage Engines and MySQL Available Storage Engines MyISAM Storage Engine MyISAM: Feature Chart MyISAM: Row Storage Formats MyISAM: Table Compression MyISAM: Locking MyISAM: Locking Priority InnoDB Versus MyISAM: Feature Chart MEMORY Storage Engine MEMORY: Feature Chart MEMORY: Indexing Options MEMORY: Best Practices Quiz ARCHIVE Storage Engine ARCHIVE: Storage Format ARCHIVE: Retrieval and Archiving BLACKHOLE Storage Engine BLACKHOLE: Master and Slave Process BLACKHOLE: Repeater and Filter v

8 NDBCLUSTER Storage Engine NDBCLUSTER: Process Diagram NDBCLUSTER: Primary Advantages Choosing Appropriate Storage Engines Choosing Among InnoDB, MyISAM, and MEMORY Using Multiple Storage Engines Summary Practice 10-1 Overview: Quiz Practice 10-2 Overview: Set and Use Storage Engines Partitioning Partitioning Objectives Partitioning Partitioning Analogy MySQL-Specific Partitioning Partitioning Types Partitioning Support Improve Performance with Partitioning Performance Challenges with Partitioning Basic Partition Syntax RANGE Partitioning LIST Partitioning HASH Partitioning KEY Partitioning Subpartitioning Obtaining Partition Information Obtaining Partition Information: SHOW CREATE TABLE Obtaining Partition Information: SHOW TABLE STATUS Obtaining Partition Information: INFORMATION_SCHEMA Obtaining Partition Information: EXPLAIN PARTITIONS Altering a Partition Redefining Partitioning Type Dropping Partitions Issues of Using DROP PARTITION Removing Partitioning Performance Effects of Altering a Partition Quiz Storage Engine Support of Partitioning Partitioning with InnoDB Partitioning with MyISAM Partitioning and Locking Partitioning Limitations Partition Expression Limitations Summary Practice 11-1 Overview: Quiz Practice 11-2 Overview: Create and Modify a Partitioned Table Practice 11-3 Overview: Remove Partitions from a Table User Management User Management vi

9 Objectives Importance of User Management User Account Verification View User Account Settings Authentication Creating a User Account Setting the Account Password Confirming Passwords Manipulating User Accounts Authorization Determining Appropriate User Privileges Granting Administrative Privileges SHOW PROCESSLIST GRANT Statement Display GRANT Privileges User Privilege Restrictions Grant Tables Use of Grant Tables Modifying Grant Tables Revoking Account Privileges Disabling Client Access Control Setting Account Resource Limits Summary Practice 12-1 Overview: Quiz Practice 12-2 Overview: Create, Verify and a User Practice 12-3 Overview: Set Up a User for world_innodb Practice 12-4 Overview: Further Practice Security Security Objectives Security Risks MySQL Installation Security Risks Network Security Password Security Operating System Security File System Security Protect Your Data Using Secure Connections SSL Protocol Using SSL with the MySQL Server Starting the MySQL Server with SSL Requiring SSL-Encrypted Connections Checking SSL Status Advantages and Disadvantages of Using SSL Secure Remote Connection to MySQL MySQL Security FAQ Summary Practice 13-1 Overview: Quiz Practice 13-2 Overview: Determine the Status of SSL Connectivity vii

10 Practice 13-3 Overview: Enable MySQL for SSL Connections Table Maintenance Table Maintenance Objectives Implementation of Table Maintenance SQL for Table Maintenance Operations ANALYZE TABLE Statement CHECK TABLE Statement CHECKSUM TABLE Statement OPTIMIZE TABLE Statement REPAIR TABLE Statement mysqlcheck Client Program myisamchk Utility Options for mysqlcheck and myisamchk InnoDB Table Maintenance MyISAM Table Maintenance MEMORY Table Maintenance ARCHIVE Table Maintenance Summary Practice 14-1 Overview: Quiz Practice 14-2 Overview: Table Maintenance Using SQL Statements Practice 14-3 Overview: Table Maintenance Using MySQL Utilities Exporting and Importing Data Exporting and Importing Data Objectives Exporting and Importing Data Export Data by Using SELECT with INTO OUTFILE Using Data File Format Specifiers Escape Character Sequences Import Data by Using LOAD DATA INFILE Skipping or Transforming Input Data Duplicate Records Summary Practice 15-1 Overview: Export MySQL Data Practice 15-2 Overview: Import Data Programming Inside MySQL Programming Inside MySQL Objectives Stored Routines Uses of Stored Routines Stored Routine Issues Executing Stored Routines Stored Procedure: Example Stored Function: Example Examine Stored Routines Stored Routines and Execution Security Quiz Triggers Create Triggers viii

11 Trigger Events Trigger Error Handling Examining Triggers Dropping Triggers Restrictions on Triggers Trigger Privileges Quiz Events Schedule Event Scheduler and Privileges Event Executed with Definer Privileges Examining Events Dropping Events Quiz SIGNAL and RESIGNAL Summary Practice 16-1 Overview: Create Stored Routines Practice 16-2 Overview: Review Stored Routines Practice 16-3 Overview: Creating Triggers Practice 16-4 Overview: Create and Test an Event Views Views Objectives Views Create Views Quiz Updatable Views Insertable Views Quiz SQL SECURITY DEFINER WITH CHECK OPTIONS Examine Views Alter View Definitions Drop Views Quiz Summary Practice 17-1 Overview: Create Views Practice 17-2 Overview: Updatable Views Practice 17-3 Overview: View and Modify Views MySQL Backup and Recovery MySQL Backup and Recovery Objectives Backup Basics Backups with MySQL Quiz Logical (Textual) Backups Physical (Raw or Binary) Backups Snapshot-Based Backup ix

12 Replication-Based Backup Quiz Binary Logging and Incremental Backups Backup Tools: Overview MySQL Enterprise Backup mysqlbackup Restoring a Backup with mysqlbackup mysqlbackup Single-File Backups Restoring mysqlbackup Single-File Backups Quiz Raw InnoDB Backups Raw MyISAM Backups mysqlhotcopy Raw Binary Portability mysqldump Consistency with mysqldump mysqldump Output Format Options Restoring mysqldump Backups Quiz Backing Up Log and Status Files Replication as an Aid to Backup Comparing Backup Methods Backup Strategy Processing Binary Log Contents Quiz Summary Practice 18-1 Overview: Quiz Practice 18-2 Overview: MySQL Enterprise Backup Practice 18-3 Overview: mysqldump Practice 18-4 Overview: A Complete Recovery Introduction to Replication Introduction to Replication Objectives MySQL Replication Types of Replication MySQL Replication Replication Threads and Files Replication Threads Replication Files Setting Up MySQL Replication CHANGE MASTER TO Monitor MySQL Replication Replication Slave I/O Thread States Replication Slave SQL Thread States Troubleshooting MySQL Replication Summary Practice 19-1 Overview: Quiz Practice 19-2 Overview: Binary Log Practice 19-3 Overview: Setup Replication x

13 Practice 19-4 Overview: Backing up a Slave Introduction to Performance Tuning Introduction to Performance Tuning Objectives General Table Optimizations EXPLAIN PROCEDURE ANALYSE Top Status Variables Top Server System Variables Summary Practice 20-1 Overview: Quiz Practice 20-2 Overview: EXPLAIN Practice 20-3 Overview: PROCEDURE ANALYSE Conclusion Conclusion Course Goals MySQL Curriculum Path MySQL Resources We Need Your Evaluation! Thank You Q&A Session Appendix: Query Optimization Using EXPLAIN Output Columns Appendix: Query Optimization Using EXPLAIN Output Columns The EXPLAIN Statement EXPLAIN Output Columns for Joins EXPLAIN Output Columns for Table Processing EXPLAIN Output Columns for Joins Appendix: Practice Solutions Scripts Appendix: Practice Solutions Scripts Lesson 1: Introduction Lesson 2: MySQL Architecture Lesson 3: System Administration Lesson 4: Server Configuration Lesson 5: Clients and Tool Lesson 6: Data Types Lesson 7: Obtain Metadata Lesson 8: Transactions and Locking Lesson 9: InnoDB Storage Engine Lesson 10: Other Storage Engine Information Lesson 11: Partitioning Lesson 12: User Management Lesson 13: Security Lesson 14: Table Maintenance Lesson 15: Export and Import Lesson 16: Programming Inside MySQL Lesson 17: Views Lesson 18: Backup and Recovery Lesson 19: Introduction to Replication xi

14 Lesson 20: Introduction to Performance Tuning xii

15 Preface Profile Before you begin this course, you should have the following: Some experience with databases and SQL and a desire to administer MySQL A desire to attain MySQL DBA certification Prerequisites You should have one of the following prerequisites: Completion of the MySQL for Beginners (D61918GC10) course Some experience with relational databases and SQL How This Course Is Organized MySQL for Database Administrators is an instructor-led course featuring lecture, demonstrations, quizzes, and hands-on practice exercises. The practice sessions reinforce the concepts and skills introduced. xiii

16 Related Publications Additional Publications System release bulletins Installation and user s guides Read-me files International Oracle User s Group (IOUG) articles Oracle Magazine xiv

17 Typographic Conventions Typographic Conventions in Text The following typographical conventions are used throughout this training guide: Computer input and output is printed in this format: Computer input or output. This is also used for the names of executable programs and file locations. Keywords from the SQL language appear in this format: SQL KEYWORD. SQL keywords are not case-sensitive and may be written in any letter case, but the training guide uses uppercase. When commands are shown that are meant to be executed from within a particular program, the prompt shown preceding the command indicates which command to use. For example, sys> indicates a command that you execute from your shell, and mysql> indicates a statement that you execute from the mysql client program: shell> mysql -u root -h mysql> SELECT * FROM world.city; The sys is your command interpreter. On Linux, this is typically a program such as sh, csh, or bash. On Windows, the equivalent program is command.com or cmd.exe, typically run in a console window. When you enter a command or statement shown in an example, do not type the prompt shown in the example. Database, table, and column names must often be substituted into statements. To indicate that such substitution is necessary, this manual uses db_name, tbl_name, and col_name. For example, you might see a statement like this: mysql> SELECT col_name FROM db_name.tbl_name; This means that if you were to enter a similar statement, you would supply your own database, table, and column names for the placeholders db_name, tbl_name, and col_name., perhaps like this: mysql> SELECT author_name FROM biblio_db.author_list; In syntax descriptions, square brackets ([ and ]) indicate optional words or clauses. For example, in the following statement, IF EXISTS is optional: DROP TABLE [IF EXISTS] tbl_name; When a syntax element consists of a number of alternatives, the alternatives are separated by vertical bars (pipe, ). When one member from a set of choices may be chosen, the alternatives are listed within square brackets ([ and ]): TRIM([[BOTH LEADING TRAILING] [remstr] FROM] str) When one member from a set of choices must be chosen, the alternatives are listed within braces ({ and }): {DESCRIBE DESC} tbl_name [col_name wild] xv

18 Typographic Conventions (continued) Typographic Conventions in Text (continued) An ellipsis (...) indicates the omission of a section of a statement, typically to provide a shorter version of more complex syntax. For example, INSERT... SELECT is shorthand for the form of INSERT statement that is followed by a SELECT statement. An ellipsis can also indicate that the preceding syntax element of a statement may be repeated. In the following example, multiple reset_option values may be given, with each of those after the first preceded by commas: RESET reset_option[, reset_option]... xvi