Oracle Enterprise Manager for Exadata Cloud

Oracle Enterprise Manager for Exadata Cloud Implementation, Management, and Monitoring Best Practices O R A C L E W H I T E P A P E R O C T O B E R 2 0 1 7

Disclaimer The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle s products remains at the sole discretion of Oracle. ORACLE ENTERPRISE MANAGER FOR EXADATA CLOUD

Introduction 1 The Business of Operating Exadata Database Machine and Exadata Cloud 1 Best Practices for Combined Use of Enterprise Manager and Cloud Automation 6 Agent Deployment Options for Exadata Cloud targets and Enterprise Manager 7 Deployment Models 7 Preinstallation Tasks 8 Create Named Credentials 8 Create named credentials for the oracle user 8 Create named credentials for the opc user 9 Deploy Agents 9 Standard Agent: Exadata Cloud Service with VPN or Exadata Cloud at Customer 9 Hybrid Cloud Agent: Exadata Cloud Service without VPN 10 Discover Cluster 12 Discover ASM, Database, and Listener 12 Exadata Cloud vs Exadata Database Machine: Monitoring Targets 13 Target Overview 13 Host, Database, Grid Infrastructure, and Exadata Storage Server Administration 15 Exadata Cloud vs Exadata Database Machine: Management Best Practices 18 Creating and deleting databases 19 Database Performance and Oracle Automated Workload Repository (AWR) 22 IO Resource Management (IORM) 24 Database Server Operating System 26 Exadata Storage Servers 27 Storage Space Consumption 27 ORACLE ENTERPRISE MANAGER FOR EXADATA CLOUD

Summary 29 ORACLE ENTERPRISE MANAGER FOR EXADATA CLOUD

Introduction Oracle Enterprise Manager (EM) is Oracle s integrated enterprise IT management product and provides a complete cloud lifecycle management solution. EM s end-to-end integration with Oracle Engineered Systems, such as the Oracle Exadata Database Machine, provides comprehensive monitoring for traditional on premises systems. In the case of Oracle Exadata Cloud Machine and Oracle Exadata Cloud Service, collectively Exadata Cloud, EM provides support for monitoring and management of customer visible targets, and this is due to the separation of roles and responsibilities between the customer and Oracle. To help Oracle Exadata customers succeed at their transition to the cloud, this paper compares and contrasts monitoring and management of on-premises and cloud systems, describes the details of EM monitoring for Exadata Cloud, and the best practices for implementing and operating EM in two common Exadata Cloud deployment models:» Exadata Cloud Service with VPN or Exadata Cloud Machine» Exadata Cloud Service without VPN The Business of Operating Exadata Database Machine and Exadata Cloud Oracle Exadata Database Machine customers can monitor and manage all of the components of Exadata Database Machine because they purchased all of the hardware and software that makes up the system. Consequently, the Exadata Database Machine Target for EM provides the comprehensive chassis view (Figure 1), and Exadata Database Machine target view (Figure 2) detailing all of the components purchased by the customer. These subsystems include cluster databases, database instances, hosts, Integrated Lights Out Management (ILOM) servers, Exadata Storage Servers, and InfiniBand networks and switches. 1 ORACLE ENTERPRISE MANAGER FOR EXADATA CLOUD

Figure 1 Exadata Database Machine EM Chassis View 2 ORACLE ENTERPRISE MANAGER FOR EXADATA CLOUD

Figure 2 Exadata Database Machine EM Targets The EM views into Exadata Cloud (Figure 4) are different than the EM views into Exadata Database Machine because of the differences in management roles and responsibilities between the customer and Oracle (Figure 4). 3 ORACLE ENTERPRISE MANAGER FOR EXADATA CLOUD

Figure 3 Exadata Cloud EM Targets 4 ORACLE ENTERPRISE MANAGER FOR EXADATA CLOUD

Figure 4 Exadata Cloud Management Responsibilities Customer-managed platform and database components (top of Figure 4) of Exadata Cloud include the following parts of the system:» Virtual machine (VM) operating systems running the Exadata Compute Node software» Grid Infrastructure on the Compute Node VM» Database software on the Compute Node VM The boxes labeled DomU are the virtual machines running the Exadata Compute Node software, and this is where the customer can install EM agents. Oracle-managed infrastructure components (bottom of Figure 4) include the following parts of the system:» Ethernet switches» InfiniBand switches» Power supplies» Exadata Storage Servers» Hypervisor running on the physical servers 5 ORACLE ENTERPRISE MANAGER FOR EXADATA CLOUD

The customer does not have direct access to the Oracle-managed infrastructure components or to the monitoring data from these components. In the case of complex support issues, the customer and Oracle support may exchange information about their respective views into the system as appropriate for the circumstances. To use EM to monitor and manage Exadata Cloud the customer installs EM agents on the Exadata Cloud Compute nodes, and then discovers the Grid Infrastructure, Cluster Database, and other targets associated with the Oracle Real Application Cluster (RAC) on Exadata Cloud. This process is similar to the discovery performed for those corresponding targets in on-premises Exadata Database Machine. The Exadata Database Machine infrastructure components, however, are not discoverable from the customer s EM for Exadata Cloud. Best Practices for Combined Use of Enterprise Manager and Cloud Automation Deployments of Exadata Cloud are different than deployments of Exadata Database Machine in two important ways:» Exadata Cloud is a subscription to a service, not a purchase of hardware and software» The definition of Exadata Cloud service does not include access to the physical hardware or management of the Exadata Storage Server Because of the differences between Exadata Cloud and on-premises Exadata Database Machine, management actions that require coordination between the customer-accessible database and platform, and the Oracle-managed infrastructure, should be performed through Oracle Cloud Automation. Complete details of available Oracle Cloud Automation are found at https://docs.oracle.com/en/cloud/paas/exadata-cloud/exars/index.html. For optimal system deployment and maintenance, Oracle Cloud Automation should be used to perform the following tasks:» ASM disk group creation» Stopping, starting, or restarting a database node» Managing SSH access» Database creation and deletion» Control and monitor Exadata IORM» Database backup and restore» Database patching» Creating, deleting, and viewing database snapshots Management actions that are performed within the database, and actions not covered by the aforementioned list, and may be performed through EM. For example, EM may be used to perform the following tasks:» ASM storage space monitoring and management» Management of In-Memory processing» Scheduling of database jobs» Database resource management» Database feature usage» Schema management» Database security management beyond SSH access» Database performance monitoring By separating platform and infrastructure service-specific tasks from database-specific tasks, users of Exadata Cloud can apply EM to optimize monitoring and management processes. Customers should take care to ensure EM usage follows the established best practices in this document to avoid creating implementations that are difficult to manage. For example, if a customer uses EM to create a database outside of Oracle Cloud Automation, then that database cannot be patched or restarted with Oracle Cloud Automation. Likewise, if a customer uses EM to create 6 ORACLE ENTERPRISE MANAGER FOR EXADATA CLOUD

database backups, then Oracle Cloud Automation will not have visibility to the backups or the ability to restore from them. These situations can be handled with additional management effort, but for the simplest and fastest experience with Exadata Cloud they should be avoided when possible. Agent Deployment Options for Exadata Cloud targets and Enterprise Manager The screen shots and examples in this paper were created using Oracle Enterprise Manager 13.2. Subsequent versions of Oracle Enterprise Manager and Oracle Enterprise Manager plug-ins may have updated screens and procedures. Please refer to the documentation specific to your release when implementing Oracle Enterprise Manager. The Enterprise Manager Agent is deployed and configured for Exadata Cloud through the following process:» Identify deployment model» Complete deployment pre-installation tasks» Create named credentials» Deploy agents» Discover Cluster» Discover ASM, Database, and Listener Deployment Models There are two deployment models EM agents for Exadata Cloud:» Standard agents for Exadata Cloud Machine and Exadata Cloud Service with VPN» Hybrid Cloud Agents for Exadata Cloud Machine without VPN Standard agents are used when network access is open between the Oracle Management Server (OMS) and the Exadata Cloud Compute node VM. This use case is typical when the network is either secured in the customer s on-premises data center, or by a VPN between the customer s data center and the Oracle Public Cloud. In use cases where on-premises EM manages Exadata Cloud Service without a VPN, all communication is secured by ssh connectivity between the OMS servers, and in this use case a Hybrid Cloud Agent must be installed on the Exadata Cloud Compute Node VMs. Figure 5 shows this use case. Monitoring and management functionality is the same in either deployment model. Figure 5 Hybrid Cloud Agent Network Diagram 7 ORACLE ENTERPRISE MANAGER FOR EXADATA CLOUD

Preinstallation Tasks The following prerequisite steps are required for configuring EM to monitor and manage Exadata Cloud:» Ensure OMSs can resolve the Fully Qualified Domain Names (FQDNs) of the compute nodes» Install public key file to oracle and opc users on Exadata Cloud Compute Nodes or identify keys used to access accounts» Copy SSH public and private key files provisioned for access to the compute nodes to the EM console host where the discovery will be performed» Obtain passwords for accounts used to monitor ASM and databases on the compute nodes» Select a port to use for the EM agent, and confirm that the port is not currently in use on each compute node» Identify the path that will be used for the installation directory for the agents on each compute node; e.g., /u02/app/oracle/em/agent_haem» Ensure there is and will be sufficient disk space available in the installation directory For more information on requirements for EM agent installation, see Hardware Requirements for Enterprise Manager Cloud Control in the Enterprise Manager Cloud Control Basic Installation Guide at http://docs.oracle.com/cd/e73210_01/embsc/guid-8a43781b-83e3-4bb9-a3da-a0f6ba9823d8.htm#guid- D4185A25-EA9C-4610-B6B3-974BD0E874C1. Create Named Credentials Enterprise Manager uses Named Credentials to access the Exadata Cloud Compute Nodes. These credentials are private ssh keys configured for access to the opc and oracle users on the compute nodes, and allow for secure passwordless authentication from EM to the Exadata Cloud Compute Nodes. The following sections show how to create named credentials for the oracle and opc users. Create named credentials for the oracle user 1. Navigate to Setup->Security->Named Credentials 2. Click Create 3. Enter a name for the credential, such as the following NC_HOST_SSH_ORACLE_<VMNAME>_<YYYYMMDD> 4. Ensure Authenticating Target Type is Host 5. Select SSH Key Credentials for Credential type 6. Select Global for Scope 7. Enter oracle for User Name 8. Specify the SSH Private Key that allows access to the oracle user for the VM a. Click Browse... next to Upload Private Key for the SSH Private Key b. Navigate to and select the Private Key file for the oracle user for this VM c. Press Open 9. Specify the SSH Public Key that allows access to the oracle user for the VM a. Click Browse... next to Upload Public Key for the SSH Public Key b. Navigate to and select the Public Key file for the oracle user for this VM c. Press Open 10. Leave Run Privilege as None 11. Optional - If the credentials will be used by other EM users, grant access to the credential 12. Press Save 8 ORACLE ENTERPRISE MANAGER FOR EXADATA CLOUD

13. Press Save when presented with the Warning dialog as the credential must be saved without testing because the target has not yet been discovered Create named credentials for the opc user 1. Navigate to Setup->Security->Named Credentials 2. Click Create 3. Enter a name for the credential, such as the following NC_HOST_SSH_ORACLE_<VMNAME>_<YYYYMMDD> 4. Ensure Authenticating Target Type is Host 5. Select SSH Key Credentials for Credential type 6. Select Global for Scope 7. Enter opc for UserName 8. Specify the SSH Private Key that allows access to the opc user for the VM a. Click Browse... next to Upload Private Key for the SSH Private Key b. Navigate to and select the Private Key file that allows access to the opc user for this VM c. Press Open 9. Specify the SSH Public Key that allows access to the opc user for the VM a. Click Browse... next to Upload Public Key for the SSH Public Key b. Navigate to and select the Public Key file that allows access to the opc user for this VM c. Press Open 10. Select Sudo for Run Privilege 11. Enter root for Run as 12. Optional - If the credentials will be used by other EM users, grant access to the credential 13. Press Save 14. Press Save when presented with the Warning dialog as the credential must be saved without testing because the target has not yet been discovered Deploy Agents After ensuring host names resolve, TCP ports are open, and login credentials work, then EM agents can be deployed from the OMS to the Exadata Cloud Compute Nodes. The processes to deploy standard and Hybrid Cloud agents are slightly different, and are detailed in the following sections. Standard Agent: Exadata Cloud Service with VPN or Exadata Cloud at Customer Access to Exadata Cloud Service with VPN or Exadata Cloud at Customer makes use of a standard agent. The following prerequisites must be met before deploying the standard agent in these environments:» Ensure that required ports are open on the compute nodes; the OMSs must be able to communicate to the listener and agent on the compute nodes, and the agents on the compute nodes must be able to communicate with the configured upload port for the OMSs.» Ensure that the compute nodes can resolve the FQDN for the configured upload port for the OMSs For more information about enabling access to a compute node port on Exadata Cloud Service, see Enabling Access to a Compute Node Port in Using Oracle Database Exadata Cloud Service http://docs.oracle.com/en/cloud/paas/exadata-cloud/csexa/enable-access-port.html. For more information about enabling access to a compute node port on Exadata Cloud at Customer, see Enabling Access to a Compute Node Port in Oracle Public Cloud Machine Using Oracle Exadata Cloud at Customer 9 ORACLE ENTERPRISE MANAGER FOR EXADATA CLOUD

B872F97E4D90.htm#EXACM-GUID-AD275C82-1D35-41E8-B958-B872F97E4D90. For more information about ports required for Enterprise Manager see Configuring Enterprise Manager for Firewalls in the Enterprise Manager Cloud Control Advanced Installation and Configuration Guide https://docs.oracle.com/cloud-machine/latest/exadatacm/exacm/guid-ad275c82-1d35-41e8-b958- http://docs.oracle.com/cd/e73210_01/emadv/guid-e00c6b3b-d5e2-4e2f-9f94-8a136e3d696e.htm#emadv625. Perform the following steps in EM for each Exadata Cloud Compute Node VM 1. Navigate to Setup -> Add Target -> Add Targets Manually 2. Select Install Agent on Host 3. Press Add 4. Enter the FQDN or IP address for the Compute Node VM as the Host 5. Select Linux x86-64 for the Platform 6. Press Next 7. Specify the Installation Base Directory (e.g., /u02/app/oracle/em/agent_haem) 8. Select the named credential for the oracle user for this VM for Named Credential 9. Select the named credential for the opc user for this VM for Root Credential 10. Update the Port as necessary to the port identified for use for the agents in this environment 11. Press Next 12. Review the information on the Add Host Targets: Review page and if correct, press Deploy Agent For further detail see Installing Oracle Management Agents in the Oracle Enterprise Manager Cloud Control Basic Installation Guide at http://docs.oracle.com/cd/e73210_01/embsc/guid-d08c7c37-7bcd-4e32-a74b- 7C5FD266D151.htm#EMBSC181. Some jobs within Enterprise Manager are executed via the agent s ability to ssh into the local host. Therefore, after the successful installation of the Oracle Management Agent, follow the steps below to ensure that the compute nodes have the ability to ssh to localhost. 1. Connect as the root user on the compute node where the EM agent will be installed 2. Change into the /etc/ssh directory 3. Edit sshd_config 4. Add "ListenAddress 127.0.0.1" after the line containing "Address Family" as in the example below: AddressFamily inet ListenAddress 127.0.0.1 NOTE: the ListenAddress line must be after the AddressFamily line in the sshd_conf file. If it is not, sshd will not restart. 5. Restart sshd: service sshd restart 6. Repeat for each compute node Hybrid Cloud Agent: Exadata Cloud Service without VPN Access to Exadata Cloud Service without VPN requires Hybrid Cloud Management with the EM Hybrid Cloud Agent. The following prerequisites must be met before deploying the Hybrid Cloud Agent:» At least one agent in the Enterprise Manager environment is configured as a Hybrid Cloud Gateway Agent. Consider configuring additional hybrid cloud gateway agents in different locations for availability 10 ORACLE ENTERPRISE MANAGER FOR EXADATA CLOUD

» Hybrid Cloud Gateway Agent(s) can resolve the FQDNs of the compute nodes or access Compute Nodes by IP address» Hybrid Cloud Gateway Agent(s) can access Compute Nodes via ssh directly or through a proxy server. If direct communication is not possible, configure an external proxy» Ensure OMSs will be able to communicate with the compute nodes via ssh. If direct communication is not possible, the OMS uses the My Oracle Support (MOS) Proxy by default or another Agent Proxy can be configured Additional details are shown in Prerequisites for Installing Agents on Oracle Cloud VMs in Enabling Hybrid Cloud Management in the Oracle Enterprise Manager Cloud Control Administrator's Guide http://docs.oracle.com/cd/e73210_01/emadm/guid-5d80bfcd-aa60-4805-89ee- 26B4C1E9E4B0.htm#EMADM15148. For more information on configuring an external proxy for use with the Hybrid Cloud Gateway Agents, see Configuring an External Proxy to Enable Gateways to Communicate with the Oracle Cloud in the Oracle Enterprise AA60-4805-89EE-26B4C1E9E4B0.htm#EMADM15295. For more information on configuring a proxy for the OMSs, see Registering the Proxy Details for My Oracle Support in the Oracle Enterprise Manager Lifecycle Management Administrator's Guide Manager Cloud Control Administrator's Guide http://docs.oracle.com/cd/e73210_01/emadm/guid-5d80bfcd- http://docs.oracle.com/cd/e73210_01/emlcm/guid-dfb714be-7400-46e8-99e7-6f6b1138a6ef.htm#guid- B4ED6C20-9427-417F-A227-2A61DDB1EBDC. After validating the aforementioned prerequisites, perform the following steps for each of the Compute Node VMs of the Exadata Cloud Service: 1. Navigate to Setup -> Add Target -> Add Targets Manually 2. Select Install Agent on Host 3. Press Add 4. Enter the FQDN or IP address for the Compute Node VM as the Host 5. Select Linux x86-64 for the Platform 6. Press Next 7. Specify the Installation Base Directory (e.g., /u02/app/oracle/em/agent_haem) 8. Select the Configure Hybrid Cloud Agent checkbox 9. Select a Hybrid Cloud Gateway Agent 10. Confirm the Hybrid Cloud Gateway Proxy Port 11. Select or add the named credential for the oracle user for this VM for Named Credential 12. Select or add the named credential for the opc user for this VM for Root Credential 13. Update the Port as necessary to the port identified for use for the agents in this environment 14. Press Next 15. Review the information on the Add Host Targets: Review page and if correct, press Deploy Agent For further detail see Hybrid Cloud Management Prerequisites and Basic Setup in the Oracle Enterprise Manager Cloud Control Administrator's Guide at http://docs.oracle.com/cd/e73210_01/emadm/guid-5d80bfcd-aa60-4805-89ee-26b4c1e9e4b0.htm#emadm15292 and Enabling Hybrid Cloud Management in the Oracle Enterprise Manager Cloud Control Administrator's Guide at http://docs.oracle.com/cd/e73210_01/emadm/guid-5d80bfcd- AA60-4805-89EE-26B4C1E9E4B0.htm#EMADM15141. Some jobs within Enterprise Manager are executed via the agent s ability to ssh into the local host. Therefore, after the successful installation of the Oracle Management Agent, follow the steps below to ensure that the compute nodes have the ability to ssh to localhost. 11 ORACLE ENTERPRISE MANAGER FOR EXADATA CLOUD

1. Connect as the root user on the compute node where the EM agent will be installed 2. Change into the /etc/ssh directory 3. Edit sshd_config 4. Add "ListenAddress 127.0.0.1" after the line containing "Address Family" as in the example below: AddressFamily inet ListenAddress 127.0.0.1 NOTE: the ListenAddress line must be after the AddressFamily line in the sshd_conf file. If it is not, sshd will not restart. 5. Restart sshd: Discover Cluster service sshd restart 6. Repeat for each compute node After the agents are deployed the next step is to discover the Oracle High Availability Service and Cluster targets using the following steps: 1. Navigate to Setup -> Add Target -> Add Targets Manually 2. Select Add Using Guided Process 3. Select Oracle Cluster and High Availability Service 4. Press Add 5. Press the magnifying glass next to Specify Host 6. Filter as necessary and select the first VM target 7. Press Select 8. Press Discover Target 9. Review the Cluster Target Properties, updating the target name if desired 10. Press Save For further detail see Discovering and Adding Cluster Targets in the Oracle Enterprise Manager Cloud Control Administrator's Guide http://docs.oracle.com/cd/e73210_01/emadm/guid-86be0c0d-552c-4968-bf2e- BD8DC2ACD081.htm#EMADM13658. Discover ASM, Database, and Listener After discovering the Oracle High Availability Service and Cluster targets Enterprise Manager can discover ASM, databases, and listeners using the following steps: 1. Wait for the Oracle High Availability Service and Cluster targets discovered previously to show Up 2. Navigate to Setup -> Add Target -> Add Targets Manually 3. Select Oracle Database, Listener and Automatic Storage Management 4. Press Add 5. Press the magnifying glass next to Specify Host or Cluster 6. Filter as necessary and select the cluster discovered previously 7. Press Select 8. Press Next 9. Review the discovery results for the Cluster Database, Cluster ASM, and Listener targets 10. Confirm/edit the Monitoring Credentials for the cluster databases, select the row, and press Test Connection to ensure the monitoring credentials are correct 12 ORACLE ENTERPRISE MANAGER FOR EXADATA CLOUD

11. Confirm/edit the Monitoring Credentials for the cluster ASM, select the row, and press Test Connection to ensure the monitoring credentials are correct 12. Select the Cluster Database(s), ASM Cluster, and Listeners to be discovered. 13. Press Next 14. Review the targets being discovered and ensure information is correct. 15. Once the information is correct, press Save 16. Review the status on the Confirmation dialog and press Close For further detail see Discovering and Adding Database Targets in the Oracle Enterprise Manager Cloud Control Administrator's Guide at http://docs.oracle.com/cd/e73210_01/emadm/guid-86be0c0d-552c-4968-bf2e- BD8DC2ACD081.htm#EMADM15517. Exadata Cloud vs Exadata Database Machine: Monitoring Targets This section compares and contrasts Exadata Cloud and Exadata Database Machine in the context of the following monitoring tasks:» General database and Grid Infrastructure administration» Database performance and Oracle Automated Workload Repository (AWR)» Database server operating system» IO Resource Management (IORM)» Exadata Storage Servers» ASM storage space monitoring Target Overview This section provides an overview of available targets for Exadata Database Machine with Exadata Cloud. In this section, side by side screen shots are shown highlighting the similarities and differences between the Exadata Cloud Service and Exadata Cloud at Customer. Specific notes are called out for what can be discovered by an Exadata target compared to a database server target, and how Oracle support reports on the infrastructure not visible to the customer. EM can discover databases, database instances, Grid Infrastructure, hosts, Exadata Storage Servers, InfiniBand Network, InfiniBand Switches, and Integrated Lights Out Management (ILOM) consoles from the Exadata Database Machine targets (Figure 6). This gives customers full control of managing all aspects of the Exadata Database Machine, including visibility into unused space on Exadata Storage Servers and a unified view of the storage consumed by all databases on a given Exadata Storage Server. 13 ORACLE ENTERPRISE MANAGER FOR EXADATA CLOUD

Figure 6: Exadata Database Machine EM Targets EM can discover databases, database Instances, and Grid Infrastructure from the agents deployed on the Compute Node VM Host targets of Exadata Cloud (Figure 7). Oracle Cloud Operations monitors and manages the hypervisors supporting the Compute Node VMs, Exadata Storage Servers, InfiniBand Network, InfiniBand Switches, and Integrated Lights Out Management (ILOM) consoles to complete end-to-end management of Exadata Cloud. This arrangement gives customers full monitoring and management of individual databases and Grid Infrastructure, but restricts visibility into the Exadata Storage Cell. For example, customers can see how much space is used and available in a given ASM disk group, but the customer cannot see storage capacity on the Exadata Storage Server that has not been allocated to an ASM disk group. In the context of Exadata Cloud this restriction poses no practical limitation because all of the storage in an Exadata Storage Server is provisioned and available in the ASM disk group in Exadata Cloud deployments. 14 ORACLE ENTERPRISE MANAGER FOR EXADATA CLOUD

Figure 7 Exadata Cloud Cluster Target Host, Database, Grid Infrastructure, and Exadata Storage Server Administration The EM Grid Infrastructure views for Exadata Cloud and Exadata Database Machine provide similar information for cluster databases, database instances, and Grid Infrastructure. Variations in the display of the material are due to the differences in the general purpose targets and the Exadata Database Machine target. Similarly, the EM Cluster Database views for Exadata Cloud (Figure 8) and Exadata Database Machine (Figure 9) are the same. 15 ORACLE ENTERPRISE MANAGER FOR EXADATA CLOUD

Figure 8 Exadata Cloud Cluster Database Target 16 ORACLE ENTERPRISE MANAGER FOR EXADATA CLOUD

Figure 9 Exadata Database Machine Cluster Database Target Both views can tell that the Cluster Database is running on an Exadata platform, however, when the Exadata Storage System Home view is opened for Exadata Cloud (Figure 10) there is no data from the Exadata Storage Servers, while the same view for Exadata Database Machine (Figure 11) shows complete data from the Exadata Storage Servers. This is due to the separation of roles and responsibilities in Exadata Cloud, specifically, Oracle Cloud Operations manages the Exadata Storage Server so the customer s EM view does not have access to the Exadata Storage Server in Exadata Cloud. 17 ORACLE ENTERPRISE MANAGER FOR EXADATA CLOUD

Figure 10 Exadata Storage Server System for Exadata Cloud Figure 11 Exadata Storage Server System for Exadata Database Machine Exadata Cloud vs Exadata Database Machine: Management Best Practices Monitoring best practices are similar for Exadata Cloud and Exadata Database Machine, but management practices are different due to Oracle Cloud Automation in Exadata Cloud deployments. For Oracle Cloud Automation to be aware of configuration changes, such as creating or deleting a database, Oracle Cloud Automation must make the changes. This means that configuration best practices when using EM for Exadata Cloud are to use Oracle Cloud Automation to perform platform management tasks, and to use EM to perform management tasks within the database. In the event that changes are made through EM then subsequent work may be required to reconcile the changes with the Oracle Cloud Automation, or the Oracle Cloud Automation may not function correctly. 18 ORACLE ENTERPRISE MANAGER FOR EXADATA CLOUD

Creating and deleting databases Creating a database using Oracle Cloud Automation is accomplished by defining the database service in a JSON document and then making a REST POST call with the JSON document as the payload. The following code fragments show how to create a database service named JTWB on Exadata Cloud Service exaspendo-006. CreateDatabase.json { "exadatasystemname": "exaspendo", "servicename": "JTWB", "level": "PAAS_EXADATA", "subscriptiontype": "MONTHLY", "version": "12.2.0.1", "edition": "EE_EP", "description": "Created using the REST interface", "clustername": "exaspendo-006", "vmpublickeytext": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAt+c1OteRGailSUknJ9VbBoRvvllw4Th56CYJGUWGkcqTjmki1XAYMiAFrQJx3 updryg9lzsz8socbcdgjlq+bmrvxahwj+0eideqznrbpfhn8wtk2axqlp7kfyzhthannkb/yjxdmaa1ohbl9jl07/ jmvnbxpbhla3rhf4cb/z7m5esnon5s0s2npv/mc3by9sbufo9ivgbglkucgwreyl1kk6s9kgevqfwmsgyevgp4wzb TMoEnQPWnxZJ5Wp49/QSiTa9bjKSQikrdN8si4nJO8bBM9Uk43aAVJBY47SDn9X+zGJJHAWvcwPsfbVGOOAWfxRpz MrtbzJwwDixE0w== oracle@hostname ", "parameters": [ { "type": "db", "adminpassword": "Welcome#1", "sid": "JTWB", "pdbname": "JTWBB", "backupdestination": "NONE", "israc": "yes" } ] } $ curl --post --connect-timeout 2 --user XXX --header "X-ID-TENANT-NAME:a462468" --data @CreateDatabase.json https://dbaas.oraclecloud.com/paas/service/dbcs/api/v1.1/instances/a462468 The EM Guided Discovery Process should be used to add database, listener, and Automatic Storage Management on one of the host targets for Exadata Cloud (Figure 12 through Figure 15) after creating a database with the Cloud Automation Web UI or REST API. The following figures provide an example of how to do this with the EM Web UI. Note, the password for the dbsnmp user is the same as the adminpassword used in the JSON payload to create the database. 19 ORACLE ENTERPRISE MANAGER FOR EXADATA CLOUD

Figure 12 Oracle Database, Listener, and Automatic Storage Target Using Guided Process Figure 13 EM Discovery of Target on Compute Node VM 20 ORACLE ENTERPRISE MANAGER FOR EXADATA CLOUD

Figure 14 Finalizing discovered targets Figure 15 Database System discovery complete Prior to deleting a database, the target should be removed from EM using the EM CLI or EM Web UI. An example of deleting an EM database target via EMCLI is shown below. $ emcli delete_target -name="jeffa.us2.oraclecloud.com" -type="rac_database" - delete_members Deleting a database is performed using the Cloud Automation via a Web UI, or a simple REST DELETE call to the endpoint defined by the database service, as shown below. $ curl -X DELETE --connect-timeout 2 --user XXX --header "X-ID-TENANT-NAME:a462468" https://dbaas.oraclecloud.com/paas/service/dbcs/api/v1.1/instances/a462468/jeffa 21 ORACLE ENTERPRISE MANAGER FOR EXADATA CLOUD

Database Performance and Oracle Automated Workload Repository (AWR) AWR reports pull data directly from Oracle database tables. Since the Oracle database runs within the customer s control, the AWR data is the same for Exadata Database Machine and Exadata Cloud (Figure 16). This feature allows customers to monitor the efficacy of certain Exadata Database Machine features, such as Smart Scan and Flash Cache, in Exadata Cloud deployments using the same methods they use for Exadata Database Machine. 22 ORACLE ENTERPRISE MANAGER FOR EXADATA CLOUD

Figure 16 Exadata Details for Exadata Cloud AWR Report 23 ORACLE ENTERPRISE MANAGER FOR EXADATA CLOUD

IO Resource Management (IORM) IORM is a feature of the Exadata Storage Server and requires access to the Exadata Storage Server for management and monitoring. To maintain the separation of roles and responsibilities between the customer and Oracle, and to provide the customer with all of the Exadata Database Machine features in Exadata Cloud, Oracle Cloud Automation provides methods to safely and effectively manage IORM in Exadata Cloud. IORM may be configured and monitored by the Oracle Cloud web UI (Figure 17 and Figure 18), and by the Exadata Cloud Service REST interface (Figure 19). IORM functionality is identical in Exadata Database Machine and Exadata Cloud deployments. Figure 17 Update IORM using Oracle Cloud Automation Web Interface 24 ORACLE ENTERPRISE MANAGER FOR EXADATA CLOUD

Figure 18 Display and Configure IORM on Exadata Cloud Web UI 25 ORACLE ENTERPRISE MANAGER FOR EXADATA CLOUD

CreateIORM.json { "dbplan": [ { "dbname": "JTWA", "share":"16" } ] } $ curl -X POST --include --connect-timeout 5 --include --user XXX --header "X-ID-TENANT- NAME:a462468" --header "Content-Type:application/json" --data @CreateIORM.json https://dbaas.oraclecloud.com/paas/service/dbcs/api/v1.1/instances/a462468/jtwa $ curl --connect-timeout 2 --user XXX --header "X-ID-TENANT-NAME:a462468" https://dbaas.oraclecloud.com/paas/service/dbcs/api/v1.1/instances/a462468/jtwa/iorm Figure 19 Configure and Monitor IORM using REST API Database Server Operating System Database server operating system views are similar in Exadata Cloud (Figure 20 ) and Exadata Database Machine (Figure 21). Subtle differences in the presentation of the data are present between the views, but equivalent views into resource utilization and operating system details are available. Figure 20 Exadata Compute Node View for Exadata Cloud 26 ORACLE ENTERPRISE MANAGER FOR EXADATA CLOUD

Figure 21 Exadata Compute Node View for Exadata Database Machine Exadata Storage Servers Exadata Cloud deployments do not externalize Exadata Storage Server details to EM. This means there are no Exadata Storage Server views when EM monitors Exadata Cloud, and no direct access to Exadata Storage Server accounting statistics. This does not pose a practical limitation due to the separation of roles and responsibilities between the customer and Oracle. In Exadata Cloud, Oracle Cloud Operations has sole responsibility for maintaining service level agreements on the Exadata Storage Server, and Oracle Cloud Operations performs all requisite monitoring, management, and maintenance of the Exadata Storage Servers. Storage Space Consumption EM has full access to monitor storage space consumption through the ASM target that is discovered through the host agents deployed on the Exadata Cloud Service Compute Node VMs. This target is available on Exadata Cloud (Figure 22) and Exadata Database Machine (Figure 23), and provides a database-by-database view of storage consumption on the Exadata Cloud. The ASM target views should be used for monitoring and management of storage space consumption within the Exadata Cloud Service just like with Exadata Database Machine. 27 ORACLE ENTERPRISE MANAGER FOR EXADATA CLOUD

Figure 22 Exadata Cloud ASM Storage Consumption View Figure 23 Exadata Database Machine ASM Storage Consumption View 28 ORACLE ENTERPRISE MANAGER FOR EXADATA CLOUD

Summary Oracle Enterprise Manager and Oracle Cloud Automation provide a simple way to comprehensively monitor and manage Exadata Cloud. Implementation of Enterprise Manager with Exadata Cloud is accomplished with standard agents for Exadata Cloud at Customer and Exadata Cloud Service with VPN, and with Hybrid Cloud Agents with Exadata Cloud Service without VPN. After the agents are installed and configured, monitoring and management is the same in either deployment model. Differences in roles and responsibilities between the customer and Oracle for Exadata Cloud compared to Exadata Database Machine lead to subtle differences in monitoring and management best practices. In general, monitoring and management of components within the database can be executed with Enterprise Manager, while database deployment operations (create, delete, backup, restore) and Exadata IORM configuration and monitoring should be executed with Oracle Cloud Automation. Special circumstances may require deviation from these processes, and in these case additional management effort may be necessary. Performance monitoring with AWR is the same for Exadata Cloud and Exadata Database Machine, and AWR provides full visibility into Exadata Storage Server performance for customers seeking to understand and optimize how their applications benefit from the Exadata platform. 29 ORACLE ENTERPRISE MANAGER FOR EXADATA CLOUD

Oracle Corporation, World Headquarters Worldwide Inquiries 500 Oracle Parkway Phone: +1.650.506.7000 Redwood Shores, CA 94065, USA Fax: +1.650.506.7200 C O N N E C T W I T H U S blogs.oracle.com/oracle facebook.com/oracle twitter.com/oracle oracle.com Copyright 2018, Oracle and/or its affiliates. All rights reserved. This document is provided for information purposes only, and the contents hereof are subject to change without notice. This document is not warranted to be error-free, nor subject to any other warranties or conditions, whether expressed orally or implied in law, including implied warranties and conditions of merchantability or fitness for a particular purpose. We specifically disclaim any liability with respect to this document, and no contractual obligations are formed either directly or indirectly by this document. This document may not be reproduced or transmitted in any form or by any means, electronic or mechanical, for any purpose, without our prior written permission. Oracle and Java are registered trademarks of Oracle and/or its affiliates. Other names may be trademarks of their respective owners. Intel and Intel Xeon are trademarks or registered trademarks of Intel Corporation. All SPARC trademarks are used under license and are trademarks or registered trademarks of SPARC International, Inc. AMD, Opteron, the AMD logo, and the AMD Opteron logo are trademarks or registered trademarks of Advanced Micro Devices. UNIX is a registered trademark of The Open Group. 0418