ApsaraDB for RDS. User Guide

Transcription

1

2 Preface Document overview The ApsaraDB Relational Database Service (RDS) is a stable, reliable, and auto-scaling online database service.based on the Apsara distributed file system and high-performance storage, the RDS supports MySQL, SQL Server, and PostgreSQL engines. It provides a complete set of solutions for disaster recovery, backup, recovery, monitoring, migration, and other features, to free you from the worries about database operation and management. This document describes how to configure RDS through the RDS console to help you know more about RDS features and functions. You can also manage the RDS through APIs and SDKs. If you need operators' help, you can click Ticket Service > Submit Ticket on the RDS console or Click Here to submit a ticket. For information about more RDS functions and pricing, log in to Official Website of ApsaraDB. Declaration Some product features or services described in this document may be out of your purchase or use scope. Please follow the actual commercial contracts and conditions and terms.this document is only for guidance. No content in this document shall constitute any express or implied warranty.due to product version upgrade or other reasons, the content of this document will be irregularly updated. Ensure that the document version is consistent with the corresponding software version. Note RDS includes multiple types of databases. This document uses the MySQL database as an example to describe the features and usage guides of all RDS products. Some types of databases may not include a certain feature. The actual page shall prevail. General description convention Description Note 1

3 Local database/source database Refers to the database deployed in the local equipment room or the database not on the ApsaraDB.In most cases, it refers to the source database to be migrated to the ApsaraDB in this document. RDS for XX (XX is MySQL, SQL Server, PostgreSQL, or PPAS) indicates the RDS of a specific database type, for example, RDS for MySQL means the instance enabled on the RDS and whose database type is MySQL. Quick start If it is the first time for you to use ApsaraDB, refer to ApsaraDB Quick Start documents to have knowledge of the RDS and quickly migrate your local database to the RDS. ApsaraDB Quick Start (MySQL) ApsaraDB Quick Start (SQL Server) ApsaraDB Quick Start (PostgreSQL) If you want to query any content beyond Quick Start, refer to this document. Login and logout RDS instances can be managed through the RDS console. This chapter describes how to login and log out to the RDS Console and access the specific instance management console interface to perform subsequent instance management and control operations. Prerequisites Before logging in to the RDS Console, you need to buy the RDS instance. For the method for buying a RDS instance, please refer to Purchase. For detailed charging standards, please refer to RDS Price. Logging in to the RDS console 2

4 Use the account for purchasing the RDS to log in to the RDS Console.The system displays the RDS Overview interface, as shown in the figure below. Select Instance List in the menu, and click Instance Name of the database or the corresponding Manage button to access the instance management interface, as shown in the figure below. After accessing the specific instance management console, you can manage the instance account and database, set instance parameters, etc. Logging out of the RDS console You can log out of the RDS console in the following two methods: - Click user information in the upper right corner. In the displayed menu, click Exit. 3

5 - Directly close the browser. Instance management Restarting an instance Operation procedure 1. Log in to the RDS console and select the target instance. 2. Click Restart Instance in the upper right corner on the instance management page. In the displayed dialog box, click OK, as shown in the figure as follows. Setting parameters RDS allows you to define some instance parameters. For details about the parameters that can be modified, see Parameter Settings on the RDS Console. Considerations - Please set the parameters according to the permissible parameter value ranges shown on the parameter settings page. - The instance must be restarted after modifying some parameters. Please check the parameter settings page to see if a restart is required. Before restarting, please make the appropriate business arrangements. Background information Since RDS is completely compatible with the native database service, their parameter setting methods are also similar for users. You can modify parameters through the RDS console by referring to this example, or through APIs to run related commands. For a description of the database parameters, click the following link to see the official documents of different database versions. 4

6 - SQL Server - MySQL MySQL 5.5 MySQL5.6 SQL Server 2008 R2 Operation procedure 1. Log in to the RDS Console and select the target instance. 2. Select Parameter Settings in the instance menu. Select the parameter modification method. To modify one parameter a. Click the target value and click OK, as indicated by 1 in the image below. b. Click Submit modify to confirm the modification, as indicated by 2 in the image below. following th 5

7 To batch modify parameters a. Click Export Parameters to export the parameter file (.txt) to your local device, as indicated by 1 in the image below. b. Open the parameter file and batch modify the relevant parameters. c. Click Import Parameters, as indicated by 2 in the image below. d. In the Import Parameters window, paste the parameters to modify and the parameter values and click OK, as indicated by 3 and 4 in the image below. e. Confirm the parameter modification results in the parameter list and click Submit modify, as indicated by 5 in the image below. Viewing the modification history You can view the historical modification records on the Modification History tab page. Setting the maintenance period ApsaraDB will be regularly maintained to ensure stable running of instances. You can set the maintenance period in the idle service hours based on service regularities to prevent possible impacts on services during maintenance. RDS will perform regular maintenance within the period you have set. 6

8 Background information To ensure stability of instances of on the Alibaba Cloud platform, the backend system irregularly maintains instances and machines. Before official maintenance, the RDS sends text messages and s to contacts configured by your Alibaba Cloud account. To ensure stability during the maintenance process, instances enter the Instance being maintained state before the preset maintenance period on the day of maintenance. When an instance is in this state, normal data access to the database is not affected. However, apart from account management, database management, and adding IP addresses to the white list, other services concerning changes (such as common operations like upgrade, degrade, and restart) are unavailable on the console of this instance. However, query services such as performance monitoring are available. When the maintenance period preset by an instance begins, transient disconnection will occur once or twice on the instance during this period. You must ensure that the application program supports the reconnection mechanism. After transient disconnection, the instance will restore to the normal state. Operation procedure Log in to the RDS Console and select the target instance. Select Basic information in the menu. Click Setting behind Time segment in Configuration information, as shown in the figure below. The default maintenance period of the RDS is from 02:00 to 06:00. Select the maintenance period and click Save, as shown in the figure below. Note: Time segment is the time in Beijing. 7

9 Migration across zones If the zone of an instance is fully loaded or in other cases where the instance performance is affected, you can migrate the instance to another zone. Background information - There will be 30 seconds of transient disconnection during migration across zones. Please ensure that your application has a reconnection mechanism. - Migration across zones is possible only when the region of an instance has multiple zones. Operation procedure 1. Log in to the RDS Console and select the target instance. 2. Select Basic Information in the menu. Click Migration Across Zones in Basic Information, as shown in the figure below. Select a target zone on the Migrate Instance to Another Zone page and click OK, as shown in the figure below. 8

10 Switching master/slave instances This section describes how to switch the master/slave instances. Notice slave instance switch**. Please ensure that your application has a reconnection mechanism. Operation procedure 1. Log in to the RDS Console and select the target instance. 2. Select Service Availability in the menu. Click Master/Slave Database Switch in Instance Availability, as shown in the figure below. 9

11 Click OK on the Master/Slave Database Switch page. Modifying the data replication mode You can select different data replication modes to improve RDS availability based on your business characteristics. Operation procedure 1. Log in to the RDS Console and select the target instance. 2. Select Service Availability in the menu. Click Modify Data Replication Mode in Instance Availability, as shown in the figure below. On the Modify Data Replication Mode page, select a data replication mode and click OK, as shown in the figure below. - Semi-synchronous replication: Normally data is replicated in the forced synchronous replication mode. If an exception (unavailability of the Slave node or network exception between the Master and Slave nodes) occurs when the Master node replicates data to the Slave node, the Master node will suspend response to the application until the replication mode times out and degrades to asynchronous replication.if the application is allowed to update data now, unavailability of the Master node will cause data inconsistency. When data replication between the two nodes resumes normal (the Slave node or network connection is recovered), asynchronous replication will be changed to forced synchronous replication.the time of restoring to forced synchronous replication depends on the implementation mode of semi-synchronous replication. ApsaraDB for MySQL5.5 is different from ApsaraDB for MySQL5.6 in this regard. - Asynchronous replication: The application initiates an update (including the Add, Delete, and Modify operations) request. After completing the corresponding operation, the Master node immediately responds to the application and then replicates data to the Slave node asynchronously.therefore, in the asynchronous 10

12 replication mode, unavailability of the Slave node does not affect the operation on the primary database, but there is a slight probability for unavailability of the Slave node to cause data inconsistency. Releasing an instance Background information RDS instances support two payment methods: Subscription and Pay-As-You-Go. - Subscription: Instances paid for by yearly or monthly subscription cannot be voluntarily deleted or released. When the service you purchased expires, the RDS instance will be locked and cannot be read or written. You must renew your subscription to continue using the instance. If you do not renew the subscription, the instance will be automatically and irrecoverably deleted 6 days after the end of the service period. Before this happens, please back up your data and migrate it from the RDS to avoid data loss. If there are read-only instances under the master instance, they will also be released. - Pay-As-You-Go: These instances can be voluntarily released. Operation procedure 1. Log onto the RDS Console and select the target instance. 2. Select Basic Information in the menu. In Running Status, click Release, as shown below. 11

13 In the pop-up box, click OK to release the instance. Upgrading Database Versions Background Information allows users with lower database versions to upgrade to a higher version, but not downgrade to a lower version. Refer to the actual interface to see which versions can be upgraded. Operation Procedure 1. Log onto the RDS Console and select the target instance. 2. Select Basic Information in the instance menu. 3. Click Upgrade Database Version after Database Type. On the Database Version Upgrade page, select the database version to upgrade and click Start Upgrade. Note: We suggest you first purchase an instance with the database version you wish to upgrade to, in order to test its compatibility before upgrading. Account management Creating an account Before using the database, you need to create an account in the RDS instance. This section describes how to create an account in RDS. Background information Databases under a single instance share all the resources of this instance. - MySQL and SQL Server instances support the creation of up to 500 accounts. - PostgreSQL and PPAS instances have no limit on the number of accounts. 12

14 Note: - You can create only an initial account on RDS for SQL Server When assigning database account permissions, please follow the minimum permission principle and service roles to create accounts and rationally assign Read-Only and Read/Write permissions. When necessary, you may split database accounts and databases into smaller units so that each database account can only access data for its own services. If you do not need to write data to a database, please assign Read-Only permission. - Please use strong passwords for database accounts and change the passwords on a regular basis. Operation procedure 1. Log in to the RDS Console and select the target instance. Select Account management in the menu, and click Create Account, as shown in the figure below. Enter the information of the account to create, and click OK, as shown in the figure below. 13

15 - Database account: It consists of 2 to 16 characters (which can be lowercase letters, digits or underscores). It must begin with a letter and end with a letter or digit, e.g., user4example*. Authorized database: It refers to the authorized database of this account. Select Unauthorized Database on the left, and click Authorize to add the database to Authorized Database.This field can be blank if no database has been created. You can click the permission setting button on the upper-right corner of Authorized Database to batch set the permissions of the databases under this account to All to Read and Write or All to Read Only. Password: It refers to the password corresponding to this account. The password consists of 6 to 32 characters which may be letters, digits, hyphens or underscores, e.g., password4example. Confirm password: Enter the password again, e.g., password4example to ensure that a correct password is entered. Remarks: Related information of this account can be added to the remarks to facilitate subsequent account management. A maximum of 256 characters can be entered (one Chinese character is equal to three characters). 14

16 Resetting passwords When using RDS, if you forget the password of the database account, you can reset the password on the RDS Console. NOTE: For data security considerations, it is recommended to change the password periodically. Operation procedure 1. Log in to the RDS Console and select the target instance. 2. Select Account Management in the menu. 3. Click Reset Password next to the account for which you want to reset password, as shown in the figure below. 4. On the Reset Account Password page, enter a new password and click OK.The password consists of 6 to 32 characters which may be letters, digits, hyphen or underscores. Old passwords are not recommended. Changing account permissions When using RDS, you can change permissions of the account in the instance based on actual requirements at any time. Operation procedure Log in to the RDS Console and select the target instance. Select Account Management in the menu. Click Change Account Permissions after the account of which the permissions will be changed, as shown in the figure below. 15

17 On the Change Account Permissions page, change the account permissions and click OK, as shown in the figure below. - Add an authorized database: Click Unauthorized Database and then Authorize> to add the database to Authorized Database. - Delete an authorized database: Click Authorized Database and then < Remove to add the database to Unauthorized Database. - Change permissions of Authorized Database: Click Authorized Database, and select Read and Write or Read Only. You can click the permission setting button in the upper-right corner of Authorized Database to batch set the permissions of the databases under this account to All Read and Write or All Read Only. Authorize a service account If you are seeking for technical supports from Alibaba Cloud and if it is necessary to operate your database instance during technical support, you need to authorize a service account that will be used by the technical support staff to provide technical support services. Background information When you authorize the service account to operate Check Modification Configuration or Check List Structure, Index and SQL, the system will generate a temporary service account and the corresponding permissions are given to this account according to your authorization information. 16

18 This temporary service account will be automatically deleted after the validity period of authorization expires. Authorized operations 1. Log on to the ApsaraDB console and select the target instance. 2. Select Account Management in the menu. Then select Authorized Service Account on the Account Management page. Select the permissions to be authorized to the service account and click Authorize the Permissions, as shown in the figure below. - For troubleshooting of the IP white lists, database parameters and other problems, you need to authorize Check Modification Configuration only. For the database performance problems caused by your application, you need to authorize Check List Structure, Index and SQL. After setting the permission expiration time on the page of Set Permission Expiration Time, click Confirm as shown in the figure below. Subsequent operations After a service account is authorized, you may cancel the authorization (as shown in Fig.1 below) or extend the authorization validity period (as shown in Fig.2) on the page of Authorize a Service 17

19 Account. Database management Creating a database Users can create databases using the RDS Management Console. Database names are unique within an instance, but can be duplicate across instances. If you use SQL Server 2012, refer to Creating a database and an account (SQL Server 2012) to create a database using a client. Background information Databases under a single instance share all the resources of this instance. - MySQL instances support the creation of up to 500 databases. - SQL Server 2008 R2 instances support the creation of up to 50 databases. - PostgreSQL and PPAS version instances have no limit on the number of databases. Creating a database Log in to the RDS Console and select the target instance. Select Database Management in the menu, and click Create database, as shown in the figure below. 18

20 Enter the information of the database you want to create, and click OK, as shown in the figure below. - Database (DB) name: It contains 2 to 64 characters which consist of lowercase letters, digits, underscores, or hyphens. It must begin with a letter and end with a letter or digit, e.g., dbname4example. - Support character set: Set the character sets for the database: utf8, gbk, latin1, and utf8mb4. - Authorized account: Select an account authorized by this database. This field can be blank if no account has been created. - Account type: This option is visible after Authorized Account is selected. Set the permission authorized by this database to Authorized Account, which can be set to Read and Write or Read Only. - Remarks: Related information of this database can be added to the remarks to 19

21 facilitate later database management. A maximum of 256 characters can be entered (one Chinese character is equivalent to three characters). Deleting a database This section describes how to delete a database from an instance on RDS. NOTE: If you use RDS for SQL Server 2012, delete the database using a client. Operation procedure 1. Log in to the RDS Console and select the target instance. 2. Select Database Management in the menu.the databases in this instance are listed. Select the database you want to delete, click Delete, and then click OK in the popup dialog box, as shown in the figure below. Network management Setting access modes RDS supports two access modes: standard mode and high security mode. This chapter describes the differences between the two access modes and the method of configuration. Operation procedure Both the Intranet address and the Internet address are used in this example. When using the RDS, please configure the connection mode based on the system plan. 20

22 1. Log in to the RDS Console and select the target instance. 2. Select Database Connection in the menu. Click Switch Access Mode in Database Connection, click OK on the displayed confirmation interface, and switch the access mode to High Security Mode, as shown in the figure below. If Access Mode is High Security Mode already, no switch is needed. - Standard mode: The RDS uses LSB to eliminate the impact of database engine HA switching on the application layer and shorten the response time, but that may slightly increase the probability of transient disconnections and disable the RDS from intercepting SQLs. This mode supports only one connection address. When the instance has both the Intranet address and the Internet address, it is required to first release the Intranet address or the Internet address, and then switch to Standard Mode. - High security mode: This mode can prevent 90% of transient disconnections and support SQL interception (the SQL injection attack is prevented based on SQL semantic analysis), but the response time will be increased by 20% or more.this mode supports coexistence of the Intranet address and the Internet address. Setting network types ApsaraDB supports two network types: classic network and Virtual Private Cloud (VPC). This chapter describes the differences between the two network types and the method of configuration. Background information On the Alibaba Cloud platform, a classic network and VPC have the following differences: - Classic network: The cloud service on the classic network is not isolated, and unauthorized access can be blocked only by the security group or white list policy of the cloud service. - VPC: It helps you build an isolated network environment on the Alibaba Cloud.You can customize the route table, IP address range and gateway on the VPC. Besides, you can combine your own machine room and cloud resources in the VPC of Alibaba Cloud into a virtual machine room through a leased line or VPN to migrate applications to the cloud smoothly. 21

23 Operation Guide By default, RDS uses the classic network. If you want to use VPC, ensure that RDS and VPC are in the same region. You may create VPC in either of the following scenarios: - If RDS is not created, first create VPC, and then create RDS under VPC. For details, refer to the section New RDS Scenario below. - If RDS already exists, create VPC in the region where RDS is located and add RDS to VPC. For details, refer to the section Existing RDS Scenario below. New RDS scenario Create VPC. For details, refer to the VPC Quick Start. Create an RDS instance in the region where VPC is located. For details, refer to Purchase. During the purchase process, select VPC for Network Type and select the created VPC, as shown in the figure below. Existing RDS scenario Create VPC in the region where RDS is located. For details, refer to the VPC Quick Start. Log in to the RDS Console and select the target instance. Select Database Connection in the instance menu. Click Switch to VPC on the Database Connection page, as shown in the figure below. 22

24 On the Switch to VPC page, select VPC and Virtual Switch, and click OK, as shown in the figure below. NOTE: After switching to VPC, the original intranet address is changed from a classic network address to a VPC address whereas the original Internet address remains unchanged, and ECS outside of VPC cannot be accessed. Setting intranet and internet addresses If your applications are deployed on the ECS in the same region, you do not need an Internet address. In this case, please skip this step. If your applications are deployed on the ECS in the other region or a system other than Alibaba Cloud, you need to apply for an Internet address and use it for application interconnection. Background information The RDS provides two kinds of connection addresses: Intranet address and Internet address. - The Intranet address or the Internet address can be used only when Access Mode is set to Standard Mode. 23

25 If your applications are deployed on the ECS in the same region, you can use the Intranet address. The system provides an Intranet address by default, and you can directly modify the connection address. If your applications are deployed on the ECS in the other region or a system other than Alibaba Cloud, you need to use an Internet address. You can click the Apply for an Internet Address to release an Intranet address and generate an Internet address. - The Intranet address and the Internet address can be used at the same time only when Access Mode is High Security Mode. If your applications are deployed on the ECS in the same region and a system other than Alibaba Cloud at the same time, you must use both Intranet and Internet addresses. Note - Before accessing the database, you need to add the IP addresses or IP segments used to access the database to a white list. For details, refer to Set a white list. - The RDS will charge a fee for traffic over the Internet address. For detailed charges, please refer to RDS Price. - To get a higher transmission rate and a higher security level, you are recommended to migrate the applications to an Alibaba ECS in the same region as your RDS. Operation procedure Both the intranet address and the internet address are used in this example. When using the RDS, please and configure the connection mode based on the system plan. 1. Log in to the RDS Console and select the target instance. 2. Select Database Connection in the menu. Click Apply for an Internet Address in Database Connection, and click OK on the displayed confirmation interface to generate an Internet address, as shown in the figure below. Traffic at the Internet address may cause charges and reduce the instance security. Please be cautious about your selection. Click Modify the Connection Address, set the Intranet and the Internet connection addresses and port numbers in the displayed window, and click OK, as shown in the figure 24

26 below. - Connection type: Select Intranet Address or Internet Address according to the connection type to be modified. - Connection address: The address format is xxx.sqlserver.rds.aliyuncs.com. xxx is a user-defined field consisting of 8 to 64 characters (only supporting letters and digits). It must start with a lowercase letter, e.g., extranet4example. - Port: indicates the number of the port through which the RDS provides external services, which can be an integer within the range of 3,200 to 3,999. Security management SQL audit You can use the RDS Console or APIs to check SQL details and periodically audit SQL, so as to detect problems timely. Currently, only ApsaraDB for MySQL supports SQL audit. Background information - You can use SQL Details and binlog to check incremental data of ApsaraDB for MySQL. There are some differences between the two. SQL Audit: Similar to audit log of MySQL, SQL Audit collects statistics on all DML 25

27 and DDL operation information. Some of the information is obtained through network protocol analysis. SQL Audit does not parse actual parameter values, and a small amount of records may be lost when the SQL query volume is large. Therefore, this method may result in inaccurate incremental data statistics. binlog: It accurately records all ADD, DELETE and MODIFY operations performed on the database, and can accurately recover the user s incremental data. However, binlogs are firstly stored in an instance. The system periodically migrates full binlogs to OSS and stores the binlogs for seven days. Binlogs which are not full cannot be saved (it is why part of binlogs are not uploaded when you click Oneclick Binlog Upload). In this way, the incremental data of the database can be accurately recorded, but logs cannot be obtained in real time. - SQL audit records are retained for 30 days. - SQL Audit is disabled by default. If SQL Audit is enabled, additional charges are incurred. For detailed charges, refer to RDS Price. Operation procedure 1. Log in to the RDS Console and select the target instance. 2. Select Data Security in the instance menu. On the Data Security page, click SQL Audit and then Enable SQL Audit, as shown in the figure below. After enabling SQL Audit, you can query SQL information based on criteria such as time, DB, user and key words. Disabling SQL audit To disable SQL Audit so as to avoid additional charges, you can click Disable SQL Audit on the SQL Audit page.when SQL Audit is disabled, contents of SQL Audit, including historical audit contents, cannot be viewed. 26

28 Setting a white list For the security and stability of the database, you need to add IP addresses or IP segments used to access the database to a white list. This section describes how to set a white list. Before using the target instance, you need to modify the white list. Context You can access the database in three scenarios: Access the RDS database through the Internet i. Refer to Setting Intranet and Internet Addresses to apply for an Internet IP address. Refer to this section to add the application service IP address to the white list. If you cannot connect to the RDS after adding the application service IP address to the white list, refer to How to locate the local IP address using RDS for MySQL to obtain the actual IP address of the application service. Access the RDS database through the Intranet: i. Ensure that the network type is the same for RDS and ECS. For details about how to set the network type, refer to Setting Network Type. ii. Refer to Setting Intranet and Internet Addresses to apply for an Intranet IP address. iii. Refer to this section to add the ECS IP address to the white list. - Access the RDS database through the Internet and Intranet simultaneously: i. Ensure that the network type is the same for RDS and ECS, and set the access mode to High Security Mode.For details about how to set the network type, refer to Setting Network Type. ii. Refer to Setting Intranet and Internet Addresses to apply for Internet and Intranet IP addresses. iii. Refer to this section to add the application service IP address and ECS IP address to the white list. Operation procedure 1. Log in to the RDS Console and select the target instance. 2. Select Data Security in the instance menu. 27

29 On the Data Security page, click Modify after the default group, as shown in the figure below.you can also click Clear after the default group to delete the white list from the default group, and click Add White List Group to create a custom group. On the Add White List Group page, delete the default white list , enter a custom white list and then click OK, as shown in the figure below. Parameters are described as follows: - Group name: The group name contains 2 to 32 characters which consist of lowercase letters, digits or underscores. The group name must start with a lowercase letter and end with a letter or digit. The default group cannot be modified or deleted. - Intra-group white list: Enter IP addresses or IP segments which can access the database. IP addresses or IP segments are separated by commas. 1,000 white lists can be set for MySQL, PostgreSQL and PPAS, and 800 white lists can be set for SQL Server. The white list can contain IP addresses (for example, ) or IP segments (for example, /24, which indicates any IP address in 28

30 the format of X can access the database). % or /0 indicates any IP address is allowed to access the database. This configuration greatly reduces security of the database, and thus is not recommended unless necessary. After an instance is created, the local loopback IP address is set as the default white list, and thus external IP addresses are prohibited to access this instance. - Load Intranet IP address of ECS: Click the IP address, and ECS of the same account is displayed. You can add the ECS to the white list. Subsequent operations Correct use of the white list can provide improved access security protection for RDS, and thus it is recommended to periodically maintain the white list.during future operations, you can click Modify after the group name to modify an existing group, or click Delete to delete an existing group. Setting SSL Encryption To increase link security, you can enable SSL encryption and install SSL certificates on the necessary application services. Background Information SSL (Secure Sockets Layer) is used on the transport layer to encrypt network connections. It can increase the security and integrity of communication data, but will also increase the network connection time. Considerations Due to the inherent drawbacks of SSL encryption, activating this function will significantly increase your CPU usage. We suggest only enable SSL encryption for Internet connections that require encryption. Intranet connection are relatively secure, and generally do not require link encryption. Operation Procedure 1. Log onto the RDS Console and select the target instance. 2. In the menu bar, select Security control. Then, on the Security control page, select the SSL tab. 29

31 Click Disable, as shown below. In the SSL Setting dialog box, select the link for which to activate SSL encryption and click OK to activate SSL encryption, as shown below. Note: Users can choose to encrypt both Internet and intranet links as needed, but only one link can be encrypted. Click Download License to download the SSL certificate, as shown below. The downloaded SSL certificate is a package including the following two files: - p7b file: used to import the CA certificate on Windows OS 30

32 PEM file: used to import the CA certificate on other systems or for other applications Subsequent Operations After activating SSL encryption, you need to configure the SSL certificate when you connect RDS to an application or a client. This section uses MySQL Workbench as an example to describe how to install the SSL certificate. For details about how to install the SSL certificate on other applications or a client, refer to corresponding product instructions. 1. Start MySQL Workbench. 2. Choose Database > Manage Connections. Enable Use SSL and import the SSL certificate, as shown in the figure below. 31

33 Setting Transparent Data Encryption Transparent Data Encryption (TDE) can be used to perform real-time I/O encryption and decryption on instance data files. To increase data security, you can enable TDE to encrypt instance data. Background Information TDE can perform real-time I/O encryption and decryption on data files. The data are encrypted before being written to the disk and decrypted when read from the disk into the memory. TDE will not increase the size of data files. Developers will not have to modify any applications before using the TDE function. Considerations - Once TDE is activated, it cannot be deactivated. - Encryption uses keys produced and managed by the Key Management Service (KMS). RDS does not provide the keys and certificates needed for encryption. After activating TDE, if the user wants to restore the data to the local device, he must use RDS to decrypt the data first. - After activating TDE, CPU usage will significantly increase. Prerequisites Key Management Service (KMS) is activated. Operation Procedure 1. Log onto the RDS Console and select the target instance. 2. In the menu bar, select Data Security. Then, on the Data Security page, select the TDE tab. Click Not Activated, as shown below. 32

34 Click OK to activate TDE. Note: If you have not activated the Key Management Service, you will be prompted to do so when activating TDE. After following the instructions to activate the Key Management Service, click Not Activated to activate TDE. Log into the database and execute the following command to encrypt the relevant tables. alter table <tablename> engine=innodb block_format=encrypted; Subsequent Operations If you want to decrypt a table encrypted with TDE, execute the following command. alter table <tablename> engine=innodb block_format=default; Monitoring alarm Setting monitoring frequency The RDS Console provides abundant performance metric items for users to conveniently view and know the running status of instances. You can use the RDS Console to set the monitoring frequency, view monitoring data of a specific instance, create monitoring views, and compare instances of the same type under the same account. Background information Improving the RDS performance monitoring frequency will incur additional charges. For detailed charges, refer to RDS Price. Operation procedure Log in to the RDS Console and select the target instance. 33

35 Select Monitor and alarm in the menu. Different types of databases contain different metric items. For details, refer to the Monitoring List below. Click Monitoring Frequency Setting on the Monitor tab, as shown in the figure below. On the specific metric item page, you can perform the following operations: - Select the monitoring type to be displayed (as shown in Figure 2) - Select the monitoring period to be displayed (as shown in Figure 3) - Display the monitoring data. Also you can frame select the monitoring period to be displayed (as shown in Figure 4), and click Reset Zoon to recover the monitoring period (as shwon in Figure 6) - Select the monitoring data to be displayed (as shown in Figure 5) - Refresh the monitoring data to be disolayed (as shwon in Figure 8) On the setting page displayed, click Monitoring Frequency and then OK, as shown in the figure below. 34

36 List of metric items RDS for MySQL Metric Item Description Monitoring Frequency Monitoring Period Disk Space Disk space usage of the instance, including the overall usage of the disk space, data space, log space, temporary file space and system file space Unit: MByte 7 days IOPS I/O request times of the instance per second Unit: time/s 1 year Connections Total number of current connections, including the number of active connections and total connections 1 year CPU memory usage Usage of CPU and memory of the instance (not including memory used by the operating system) 1 year Network Traffic Incoming/outgoing traffic of the instance per second Unit: KByte 1 year QPS/TPS The number of SQL statements executed and transactions processed per second 1 year InnoDB buffer pool InnoDB buffer pool read hit rate, utilization rate, and percentage of dirty data blocks 1 year InnoDB read/write volume Average InnoDB data reads and writes per second Unit: KByte 1 year 35

37 InnoDB reads/writes The number of InnoDB reads and writes per second 1 year InnoDB log The number of InnoDB physical writes to the log file, log write requests, and FSYNC writes to the log file 1 year Temporary tables The number of temporary tables created automatically on the hard disk when the database executes the SQL statement 1 year MyISAM Key Buffer Average per-second Key Buffer read hit rate, write hit rate and usage of MyISAM 1 year MyISAM read and write times Times of MyISAM read and write from/to the buffer pool and from/to the hard disk per second 1 year COMDML The number of statements executed for the database per second. The statements include Insert, Delete, Insert_Select, Replace, Replace_Select, Select and Update. 1 year ROWDML The number of operations performed on InnoDB, including the number of physical writes to the log file per second, the number of rows read, updated, deleted and inserted to InnoDB table per second. 1 year 36

38 RDS for SQL Server Metric Item Description Monitoring Frequency Monitoring Period Disk Space Disk space usage of the instance, including the overall usage of the disk space, data space, log space, temporary file space and system file space Unit: MByte 7 days IOPS I/O request times of the instance per second Unit: time/s 1 year Connections Total number of current connections, including the number of active connections and total connections 1 year CPU usage CPU usage (including CPU used by the operating system) of the instance 1 year Network Traffic Incoming/outgoing traffic of the instance per second Unit: KByte 1 year TPS The number of transactions processed per second 1 year QPS The number of SQL statements executed per second 1 year Cache hit rate Read hit rate of the buffer pool 1 year Average full table scans per second Average number of full table scans per second 1 year SQL compilations per second The number of compiled SQL statements per second 1 year 37

39 Page writes of the checking point per second The number of page writes of the checking point in the instance per second 1 year Logins per second The number of logins per second 1 year Lock timeouts per second The number of lock timeouts per second 1 year Deadlocks per second The number of deadlocks in the instance per second 1 year Lock waits per second The number of lock waits per second 1 year RDS for PostgreSQL Metric Item Description Monitoring Frequency Monitoring Period Disk space Usage of the instance disk space Unit: MByte 7 days IOPS The number of I/O requests of the data disk and log disk in the instance per second Unit: time/s 1 year RDS for PPAS Metric Item Description Monitoring Frequency Monitoring Period Disk space Usage of the instance disk space Unit: MByte 7 days IOPS The number of I/O requests of the data disk and log disk in the instance per second Unit: time/s 1 year 38

40 Setting monitoring view The RDS Console provides abundant performance metric items for users to conveniently view and know the running status of multiple instances under the same account. You can use the RDS Console to create a monitoring view and compare instances of the same type under the same account. Operation procedure 1. Log in to the RDS Console. 2. Select Overview (without entering a specific instance) in the menu. 3. Click + on the Overview page, as shown in the figure below. 39

41 4. Set monitoring parameters on the Monitoring View Setting page, and click OK, as shown in the figure below. - Database type: Select the type of the database to be monitored - Select monitoring instances: Select the instances to be added to the monitoring view. Up to four instances in databases of the same type can be added. - Select metric items: The options include Disk Space, IOPS, Connections and CPU Usage 40

42 Log management The RDS Console can be used to query error logs of an instance to locate and analyze failures. Operation procedure 1. Log in to the RDS Console and select the target instance. 2. Select Log Management in the instance menu. On the Error Log page, select the time range of the error logs to be queried, and click Query, as shown in the figure below. 41

43 Performance optimization RDS provides optimization suggestions such as Slow Log, SQL Run Report, and Missing Indexes, enabling you to optimize databases based on your own needs. Operation procedure Log in to the RDS Console and select the target instance. Select Performance Optimization in the instance menu. Query Slow Log, SQL Run Report, and Missing Indexes on the Performance Optimization page, as shown in the figure below. Performance counters RDS records the following database performance counters, which provide the information required for database optimization: Counter Content Operation Slow Log Records the SQL statements that are executed for more than 1s in a database during a period of one month, and performs statement deduplication (The execution time threshold can be specified using the long_query_time parameter in Parameter Setting.) (The counter does not list slow logs that are generated during the last two hours. These logs are contained in the slow_log table of the MySQL database) Query the specified database or all databases during the specified period 42

44 SQL Run Report Missing Indexes Records the SQL statements that are executed for more than 5s during a period of one month Records information about the database tables with missing indexes, and recommends the CREATE INDEX statement Query the top 10 SQL statements by execution times or execution duration during the specified period. Optimize SQL by using the recommended CREATE INDEX statement Backup and recovery Backing up RDS data You can configure a backup policy to adjust the cycles of RDS data backup and log backup and thereby realize automatic backup. You can also manually back up RDS data.instance backup files occupy backup space. Charges will be incurred if the used space exceeds the free quota. Please design a backup cycle properly to meet service requirements based on backup space capacity. For detailed charges, refer to RDS Price. Background information ApsaraDB supports data backup and log backup. Enable log backup if you want to recover data by time. The following table lists the backup policies applicable to different database types: Database Type Data Backup Log Backup MySQL SQL Server - Automatic backup supports full physical backup - Manual backup supports full physical backup, full logical backup, and single-database logical backup - Supports full After being generated, binglogs (500 MB per log) are compressed and uploaded immediately. Local files are deleted within 24 hours. Binlog files occupy instance disk capacity. Using One-key Binlog Upload, users can upload Binlog files to the OSS. This does not affect the data recovery function and will stop the Binlog files from occupying instance disk space. Included in data backup; individual transaction logs 43

45 physical backup and incremental physical backup - Automatic backup uses the cycle Full Backup-Incremental Backup-Incremental Backup. For example, if a full backup is performed on Monday, incremental backups will be performed on Tuesday and Wednesday, another full backup will be performed on Thursday, then incremental backups on Friday and Saturday, and so on. If a full backup is manually performed at any time in the backup cycle, the next two backups will be incremental backups. - The SQL Server always compresses transaction logs during the backup process - On the Backup and Recovery page of the target instance s management console, you can click Compress Transaction Log to manually compress the transaction log. are not provided for download 44

46 PostgreSQL PPAS Supports full physical backup Supports full physical backup After being generated, writeahead logs (WALs) (16 MB per log) are compressed and uploaded immediately. Local files are deleted within 24 hours After being generated, WALs (16 MB per log) are compressed and uploaded immediately. Local files are deleted within 24 hours Automatic backup (Backup policy setting) After you configure a backup policy, ApsaraDB will automatically back up databases based on the policy. 1. Log in to the RDS Console and select the target instance. 2. Click Backup Recovery in the menu. On the Backup Recovery page, select Backup Settings and click Edit, as shown in the figure below. 45

47 On the Backup Settings page, set backup specifications and click OK, as shown in the figure below. - Retention Days: Specifies the number of days when backup files are retained. The default value is 7 days; value range: days - Backup Cycle: You can set it to one or multiple days in a week. SQL Server, PostgreSQL, and PPAS instances are backed up daily by default and this cannot be modified. - Backup Time: This value can be set to any time; units: hours. - Log Backup: Specifies whether to enable log backup. This is enabled by default for SQL Server instances and cannot be modified. Manual backup 1. Log in to the RDS Console and select the target instance. Select Backup Instance, as shown in the figure below. On the Backup Instance page, select a backup mode and policy, and click OK, as shown in the figure below. NOTE: MySQL Single-database logical backup is used as an example. 46

48 - Backup Mode: For MySQL instances, the values are Physical Backup or Logical Backup. For SQL Server, PostgreSQL, and PPAS instances, the values are Automatic Backup and Full Backup. When Automatic Backup is selected for an SQL Server instance, incremental backup will be performed if either the current or the last two backups are full. If not, a full backup will be performed. - Backup Policy: If you select Logical Backup or Full Backup, you can select Instance Backup or Single-Database Backup. Single-database backup is not supported for PostgreSQL and PPAS instances. If you select Single-Database Backup, select the database you want to back up on the left and click > to add the selected database to the list on the right. Downloading RDS and log backup data To protect users rights, RDS allows users to download data backup files and log backup files that are not encrypted. Background information RDS is based on the master-backup instance architecture. Each instance has a unique ID. RDS performs data backup on the backup instance and log backup on the master instance and backup instance. 47

49 If you want to download data to the local device and recover the data to the local database, you need to download the data file and log file under the same instance ID. RDS supports different backup policies for different types of databases. Accordingly, downloadable data backups and log backups are also different. For details, refer to Backing Up RDS Data. Operation procedure Log in to the RDS Console and select the target instance. Click Backup Recovery in the menu. Select Data Backup on the Backup Recovery page. Select the latest data backup file prior to the data recovery time, and click Download, as shown in the figure below. Click the desired download method on the Instance Backup File Download page. The various download methods are described as follows: NOTE: Traffic fees will be incurred when you download backup files over the Internet. For detailed charges, refer to RDS Price. - I understand and want to download: The backup file will be downloaded using an Internet address - Copy Intranet Address: When ECS and RDS are in the same region, you can use an intranet address on ECS to download the backup file at a faster speed and with higher security - Copy Internet Address: An Internet address is copied and used to download the backup file via other tools 48

50 Select Log Backup, select the log backup file generated after the data backup time but before the recovery time, and click Download. Note that the selected log backup file must be under the same instance ID as that for the data backup file. Download the log backup file. For details, refer to Step 4. Tag mangerment Creating Tags If you have a large number of instances, you can bind tags to them to facilitate classification and management. Each tag is composed of a key-value pair, so you can implement two-level classification for your instances. Constraints - Up to 10 tags can be bound to a single instance and they must have unique TagKeys. Tags with the same TagKeys will be overwriten. - You cannot bind/unbind more than 5 tags at once. - Tag information is independent in different regions. - After unbinding a tag, if it is not bound to any other instances, it will be deleted. Procedure 1. Log onto the RDS Console and click Instance List. 2. Select the region of the target instance. Select the tag adding method. To add one tag: Select More next to the target instance > Edit Tags. Click New Tag and enter the tag s Key and Value. Then, click OK, as shown below. Note: If you have already created tags, you can click Existing Tag and select an existing tag. 49

51 After entering the information for all the tags to bind, click OK to complete. Deleting Tags If you have changed your instance or no longer need to use tags, you can delete the tags from the instance. Constraints - You cannot bind/unbind more than 5 tags at once. - After unbinding a tag, if it is not bound to any other instances, it will be deleted. Operation Procedure 1. Log onto the RDS Console and click Instance List. 2. Select More next to the target instance, and select Edit Tags. Click the X after the tag to delete it, as shown below. 50

52 Click OK to complete the operation. Filter Instances by Tags Operation Procedure 1. Log onto the RDS Console and click Instance List. Click Tags and select the Key and Value of tags to filter instances, as shown below. Note: After filtering instances by tags, if you need to remove a filter, you can remove the filter condition to the right of the Tags key. Data migration 51

53 Migrating local data to RDS You can import the data of the local database to the ApsaraDB to realize smooth service migration. The data import method varies with different types of RDS. - For details about how to import data to RDS for MySQL, refer to Quick Start (MySQL). - For details about how to import data to RDS for SQL Server, refer to Quick Start (SQL Server). - For details about how to import data to RDS for PostgreSQL, refer to Quick Start (PostgreSQL). - For details about how to import data to RDS for PPAS, refer to Quick Start (PPAS). Migrating RDS for MySQL data to the local MySQL database RDS for MySQL supports the migration of cloud data to the local database by using physical and logical backup files. Export using a physical backup file Background information Due to software restrictions, data recovery is supported only in Linux currently. If you want to recover data to Windows, you can first recover data to Linux and then migrate the data to Windows. Prerequisites RDS adopts the open source software Percona XtraBackup to perform full physical backup on the MySQL database. You need to download the software and use it for data recovery.the official website for Percona XtraBackup is Download the version compatible with your operating system.for example:download the RHEL6/x86_64 version and run the rpm command to install it. sudo rpm -ivh percona-xtrabackup rhel6.x86_64.rpm Operation procedure This example assumes that the local server runs the RHEL6/x64 system and the path to the backup 52

54 file is /home/mysql/. 1. Download the RDS physical backup file and upload the file to the target server.for details about how to obtain the backup file, refer to Downloading Backup Data.If the target server can access the source instance, you can use wegt "url" to download the backup file. url indicates the backup file download address. 2. Switch to the backup file path. cd /home/mysql/ 3. Decompress the backup file. tar vizxf filename.tar.gz filename.tar.gz indicates the name of the backup file. 4. Check whether the databases contained in the decompressed file are correct. cd filename/ ll The system displays the following information, in which db0dz1rv11f44yg2, mysql, and test are the databases in RDS: -rw-r--r-- 1 root root 269 Aug 19 18:15 backup-my.cnf drwxr-xr-x 2 root root 4096 Aug 21 10:31 db0dz1rv11f44yg2 -rw-rw root root Aug 7 10:44 ibdata1 drwxr-xr-x 2 root root 4096 Aug 21 10:31 mysql drwxr-xr-x 2 root root 4096 Aug 21 10:31 test -rw-r--r-- 1 root root 10 Aug 19 18:15 xtrabackup_binary -rw-r--r-- 1 root root 23 Aug 19 18:15 xtrabackup_binlog_info -rw-r--r-- 1 root root 77 Aug 19 18:15 xtrabackup_checkpoints -rw-r--r-- 1 root root 2560 Aug 19 18:15 xtrabackup_logfile -rw-r--r-- 1 root root 72 Aug 19 18:15 xtrabackup_slave_info 5. Recover the data file. innobackupex --defaults-file=./backup-my.cnf --apply-log./ Data is successfully recovered when the system displays innobackupex: completed OK!. Modify the configuration file.comment out innodb_fast_checksum, innodb_page_size, and innodb_log_block_size in the decompressed file backup-my.cnf, and add datadir=/home/mysql, as shown in the figure below. 53

55 # This MySQL options file was generated by innobackupex # The MySQL Server [mysqld] innodb_data_file_path=ibdata1:200m:autoextend innodb_log_files_in_group=2 innodb_log_file_size= #innodb_fast_checksum=0 #innodb_page_size=16364 #innodb_log_block_size=512 datadir=/home/mysql/ 7. Reinstall MySQL and obtain the root permission of the database. rm -rf mysql mysql_install_db --user=mysql --datadir=/home/mysql/ MySQL is successfully reinstalled when the system displays the following information: Installing MySQL system table... OK Filling help table... OK 8. Modify the file owner. chown -R mysql:mysql /home/mysql/ 9. Start the MySQL process. mysqld_safe --defaults-file=/home/mysql/backup-my.cnf & 10. Log in to the database from a client. mysql u root p 11. Verify database integrity. show databases; The database is successfully recovered when the system displays the following information: 54

56 Database information_schema db0dz1rv11f44yg2 mysql performance_schema test Export using a logical backup file This example assumes that the local server runs the RHEL6/x64 system and the path to the backup file is /home/mysql/. Operation procedure 1. Download the RDS logical backup file and upload the file to the target server.for details about how to obtain the backup file, refer to Downloading Backup Data.If the target server can access the source instance, you can use wegt "url" to download the backup file.url indicates the backup file download address. 2. Switch to the backup file path. cd /home/mysql/ 3. Decompress the backup file. tar vizxf filename.tar.gz filename.tar.gz indicates the name of the backup file. 4. Decompress the SQL file. gunzip filename.sql.gz filename.sql.gz indicates the name of the compressed SQL file. 5. Perform logical import to import data to the target database. mysql -u username -p -h hostname -P port dbname < filename.sql filename.sql indicates the name of the decompressed SQL file. 55

57 Migrating RDS for SQL Server data to the local SQL Server database RDS for MySQL supports the migration of cloud data to the local database by using physical backup files. Operation procedure 1. Download the full and incrementalphysical backup files of RDS and upload the files to the target server.for details about how to obtain the backup file, refer to Downloading Backup Data.If the target server can access the source instance, you can use wegt "url" to download the backup file.url indicates the backup file download address. 2. After download, decompress the full physical backup file and incremental physical backup file.a backup file is named in the format of database name+backup type+date and time+task ID.bak, of which backup type may be one of the following: - datafull: Specifies full backup, such as rdsumu2myfzbeai1_datafull_ _ bak. - datadiff: Specifies incremental backup, such as rdsumu2myfzbeai1_datadiff_ _ bak. - log: Specifies log backup, such as rdsumu2myfzbeai1_log_ _ bak. 3. Obtain the decompressed full backup file and incremental backup file. This example assumes that the backup files are stored in the following paths: - Path to the full backup file: d:\backup\rdsumu2myfzbeai1_datafull_ _ bak - Path to the incremental backup file: d:\backup\rdsumu2myfzbeai1_datadiff_ _ bak 4. Log in to the local SQL Server Console and query the logical names of the RDS files based on the backup files. restore filelistonly from disk=&apos;d:\backup\rdsumu2myfzbeai1_datafull_ _ bak&apos; go The system displays the following information, where the logical name of the data file is data1 and that of the log file is log: 56