On Command Performance Manager 7.0 Lab on Demand Guide

Transcription

1 On Command Performance Manager 7.0 Lab on Demand Guide On Command Performance Manager 7.0 Lab on Demand Guide... 1 Lab Activity: Adding Clusters... 1 Lab Activity: Performance Manager Dashboard... 2 Lab Activity: Cluster Landing Page... 5 Lab Activity: Object Inventory... 8 Lab Activity: Object Landing Page and Performance Explorer Lab Activity Performance Capacity and Available IOPS Charts Lab Activity View and Compare Performance Capacity on nodes in cluster Lab Activity Failover Planning Lab Activity Performance Management Policy Thresholds Lab Activity: Adding Clusters Clustered Data ONTAP is NetApp s flagship software product and the engine that drives the Data Fabric technology vision. Thus, it is paramount to know how the clusters in the environment are performing at any time. Since this is a demonstration database you will not be able to add a cluster. Go through the steps in the Performance Manager instance. Aceess OPM from the Chrome web browser (it will default to the OPM instance at and login with username admin and password Netapp1! This section guides you through the steps required to add an actively running cluster in the lab. Select the Administration page on the right side top panel of Performance Manager Select Data Sources on the lower left panel Select +Add button on the center panel labeled Manage Data Sources Follow the prompts from the add data sources wizard

2 Lab Activity: Performance Manager Dashboard Ideally, storage environments manage themselves without any human intervention. The next best option is a tool indicating what demands attention now. Performance Manager does this by composing a cluster dashboard that first lists clusters that are of the most interest. The order of precedence is first, clusters that can t be reached; second, cluster has one or more new critical events; third, cluster has one or more new warning events last, if the cluster has no new events; the clusters are sorted by highest IOPS.

3 The dashboard also presents other high-level information such as key performance metrics, utilization of the most consumed resources, and color-coded alert status indicators. This section discusses the elements of the Performance Manager dashboard. Select the Dashboard page on the top navigation panel of Performance Manager There is an open issue with the demo database due to which dashboard metrics are not displayed. Information on performance manager dashboard is updated automatically after each five-minute collection interval. The dashboard displays key metrics for each cluster: o The first metric to appear is the latency, the icon area indicates whether any SVMs, volumes, or LUNs have received a new event based on the latency value crossing a threshold setting. o The next metric to appear is the total IOPS, or inputs/outputs per second, showing the processing rate of file or block operations. The bottom area displays the total cluster IOPS for the last five-minute collection period. o The next metric is MBps, or megabytes per second, that is the amount of data read and written in the payload of the operations. The bottom area displays the total cluster throughput for the last five-minute collection period. o Next to appear is Performance Capacity Used metric, this shows whether any nodes or aggregates are overusing their available performance capacity. The bottom area displays the highest performance capacity used value from the busiest node and busiest aggregate. o Performance capacity data is available only when the nodes in a cluster are installed with ONTAP 9.0 or later software. o Next to appear is Utilization which shows whether the resources on any nodes or aggregates are being overused. The bottom area displays the highest utilization value from the busiest node and busiest aggregate.

4 Below each metric appear color-coded status icons associated with each object and metric. When the icon is green with a check icon there are no active alerts for the metric-object pair. When the icon status is yellow with a! icon there are active warning alerts and when the icon status is red with an X icon there are active critical alerts for the metric-object pair. Below each metric appears links to the cluster objects the take you to metric charts showing the metric over time. The links take you to object inventory pages, which are essentially lists, of those cluster objects. Click on the SVMs link to enter the cluster SVM object inventory page. Note that each SVM has a link to that objects landing page. The object landing page will be covered later in this guide. Select the Dashboard Tab at the top of the page to return to the dashboard.

5 Lab Activity: Cluster Landing Page Clustered Data ONTAP is NetApp s flagship software product and the engine that drives the Data Fabric technology vision. Thus, it is paramount to know how the clusters in the environment are performing at any time. The Cluster landing page shows a summary of events and performance. Directly below the summary is an inventory of the managed cluster objects. Following this information is a customizable listing of the most active objects instances in this cluster. From the dashboard, select the View Cluster Details button in the top right corner of the cluster panel. In first panel labeled All Events on this Cluster you see a summary of events broken out by type of event, any new events, and obsolete events, over last 3 days. In the next 2 panels appear key cluster performance metrics labeled IOPS and MBps also over the last 3 days.

6 Below the summary panels is an overview of the cluster where you see the object inventory panel labeled Managed Objects. Note the number of nodes, aggregates, volumes and storage virtual machines defined for this lab. The links below the objects can be followed to their appropriate inventory pages. Explore these links and return to the cluster landing page.

7 The next panel, labeled Top Performers, displays highest or lowest performing storage objects based on the selected performance metric. You can select a time range for viewing the top performers; the selected time range applies to all storage objects. The object order is sorted by the most active object first where the metric shown is the maximum value over the selected time range. Cycle through the available time ranges and metrics using the appropriate pull-down. For example, change the Top 10 Nodes metric from Latency to IOPS. Continue to explore the other metrics and objects. The bar graphs are color-coded. If the counter is not breaching a performance threshold, the counter bar is displayed in blue. If a threshold breach is active (a new event), the bar is displayed in the color for the event: warning events are displayed in yellow and critical events are displayed in red. Performance capacity used metric is available for nodes and aggregates storage objects only when the nodes in a cluster are installed with ONTAP 9.0 or later software. In the screenshot below, the maximum value of Performance capacity used on node opmcapacity-02 as monitored by Performance Manager is 240 in the last 72 hours.

8 Lab Activity: Object Inventory It is useful at times to list and view objects across data centers or an enterprise. The object inventories contain a comprehensive list of all the objects discovered and analyzed by Performance Manager. Columns with object metrics and links to related container objects are also included in the inventory page line items. Managing large numbers of objects is made easier through powerful filters and sorting. Near the top of the page, just above the table heading, note the description of the metrics that appear on this page. Latency, IOPS, MBps, Utilization are based on hourly samples averaged over the previous 72 hours. Select the Storage pull-down menu and cycle through the objects available. Note that the objects inventory lists dynamically update. Select Volumes from the list. Select the Filters pull-down menu. Select the first pull-down in the Filters sub-menu and note the extensive filtering functionality (do not apply any filters though if you do they are simple to remove). Alternate clicks on the IOPS and Latency column heading and note how inventory list is sorted. This is one method to find the most active or most latent volume across many clusters. The demo database can sometimes display Latency, IOPS, MBps as N/A. This is an known issue. Also note the links provided to contain objects for the volumes such as SVMs, aggregates and clusters.

9

10 Click on (X) to remove filter applied. Click on Free Capacity column to sort by highest or lowest free capacity. Also note the links provided to related objects for the volumes such as SVMs, aggregates and clusters.

11 Lab Activity: Object Landing Page and Performance Explorer The Performance Manager object landing page focuses on a specific storage object in which summary and detailed performance information is presented. All storage objects have a landing page and have a similar look and feel. Obviously not all objects are the same, so a cluster landing page has slightly different metrics and views than a volume landing page. However, all landing pages summarize key highlevel metrics for a given storage object over the prior three days. In the example below we navigate to opm-capacity-02 node landing page from Cluster opm-capacity Summary page.

12 opm-capacity-02 node landing page summarize key high-level metrics for this node over the prior three days. The Performance Manager Performance Explorer is a modular component common to all object landing pages where it guides you through exploration and navigation of related objects. You can choose to build charts where you select from a menu of metrics and from time ranges spanning over the retained data for up to 13 months. Performance Manager retains data for the most recent 30 days at 5-minute granularity and the following 12 months at 1-hour granularity Select the Explorer tab on opm-capacity-02 node to access the node performance explorer. The default view and compare value is nodes on same cluster The Node Performance Explorer page provides tracking and comparison of node performance during a specific time period, which helps in troubleshooting and fine-tuning your node performance. You can compare the performance of peer nodes, and aggregates and ports of this node. Using the Node Performance Explorer page, you can: o View threshold-related issues and their details o Investigate and troubleshoot threshold-related issues

13 o Investigate and troubleshoot performance issues Select the Time Range pull-down menu and set the time range as Last 72 hours. Click Apply range. Click on Choose charts: Performance capacity used, Performance capacity used(advanced) and Available IOPS are the new charts available for node storage object with ONTAP 9 and OPM 7.0

14 View the 8 metrics chart. Select the Time Range pull-down menu and select Last 7 days and Last 30 days to view the metrics chart. Observe the node utilization, latency, IOPS and other metrics to help you understand the node resource utilization over the selected time range. Select the pull-down choose charts menu and observe the menu of metrics available for the charts. Note how easily metrics charts can be added and removed. Experiment with selecting different options from the pull down and observe the object list dynamically updating. Events chart will co-relate events on the node to utilization metrics on the same timeline to help in performance troubleshooting and analysis. Select IOPS Advanced chart and hover over the charts to understand the breakdown by read and writes, similarly select MBps Advanced to understand Disk reads, writes over the selected time range.

15

16 Lab Activity Performance Capacity and Available IOPS Charts In today s environment, how does one know if there is or is not enough resource to meet a service? Knowing just the available storage capacity is not enough, but there is a need to know if enough performance capacity is available. This is where Perf. Capacity Used comes to play. Perf. Capacity Used provides visibility into available performance capacity across nodes & aggregates starting with ONTAP 9. It does so by automatically computing an Optimal Point for utilization an indication that going beyond this point would result in undesirable latencies. ONTAP 9 computes this dynamic value automatically and takes into account the workload type. Getting to know how much additional performance capacity is available before getting into latencyrelated problems is critical for priority and latency-sensitive workloads. Perf. Capacity Used enables provisioning as well as cluster-wide load-balancing. Select the Time Range pull-down menu and select Last 72 hours to view the metrics chart. Select the pull-down choose charts menu and select Events, Latency, Utilization, Performance capacity used, Performance capacity used(advanced) and Available IOPS charts.

17 Observe the performance capacity used metrics over the selected time period. Notice the color banding in performance capacity used chart. Click on drop down option in Zoom view to open performance capacity used chart in a new window If the performance capacity used metrics are pre-dominantly in the green zone, this indicates that node resources are under- utilized and there is an opportunity to add additional workloads. (0-80 percent) If the performance capacity used metrics are in yellow zone, this indicates that the node resources are optimally utilized. ( percent) and any additional workload will result in latencies. If the performance capacity used metrics are in red zone, this indicates that the node resources are over utilized ( percent and above) where in the current workloads are experiencing significant increase in latencies.

18 performance capacity used in node opm-capacity-02 in the last 48 hours is predominantly in the green zone indicating the node is under-utilized. Change the time range to reflect last 7 days and Observe the performance capacity used metrics. Other than Sat 12 am to Monday 12 am, the node is in green zone. Use the mouse left click to select the duration between Sat 12 am to Monday 12 am to look into performance capacity used during this time duration. Performance capacity used is between optimal and over utilized between Saturday 12 am and 6 pm.

19 To analyze this further, go back to node performance explorer page open in another tab to look at performance capacity used (Advanced) chart Advanced chart provides a breakdown of performance capacity used on node opm-capacity-02 by user protocol workload and background system processes and performance capacity free on a node to provision new workloads.

20 RAID reconstruct, SnapMirror transfers, storage efficiency processes, disk scrubbing are examples of background system processes. The breakdown by user protocol workload and background system processes will help us understand if performance capacity on node opmcapacity-02 is a result of caused by user protocol workload or background system processes. Click on drop down option in Zoom view to open performance capacity used(advanced) chart in a new window In the performance capacity used Advanced zoom chart, Change the time range to reflect last 7 days and observe that background processes have used almost 15% of performance capacity used during mid nights on a regular basis. Use the mouse left click to select the duration between Sat 12 am to Monday 12 am to look into performance capacity used (Advanced) during this time duration. On node opm-capacity-02 performance capacity used is a result of user protocol workload and background system processes. Performance capacity used reaches an optimum and sometime over-utilized when both user protocol workload and background system processes are running at the same time.

21 Let s go back to node performance explorer page open in another tab to look at Available IOPS chart While performance capacity used chart lets a user know how much performance capacity is free on a node based on the current workloads. Another chart which will help a user when considering whether a node has resources available to take on new workloads is the Available IOPS at a node chart. When the node has performance capacity free or in other words when a node has available performance capacity, the available IOPS chart informs a user how many additional IOPS can the node provide to add new workloads. A key point to remember is for Available IOPS chart to display metrics, a user protocol workload should be running for OPM to compute Available IOPS in node or aggregate. If there is no user workload on a node, Available IOPS chart will not display metrics. Available IOPS takes the FAS system, hardware resources on the node and current workloads into consideration to compute IOPS available on the node. In this example, Available IOPS at 7:50 pm on July 31 st is approximately IOPS with 50% performance capacity free.

22 Lab Activity View and Compare Performance Capacity on nodes in cluster When you have to provision a new workload on the cluster or understand if the workloads are balanced across the nodes in a cluster, you have to understand performance capacity used and available on all the nodes in a cluster. In this section let s view and compare performance capacity on nodes in a cluster to decide on which node to provision a new workload and if workloads are balanced across the nodes in a cluster. From node opm-capacity-02 explorer page, select nodes on same cluster option from view and compare drop down. Other nodes on cluster opm-capacity are displayed. This is a 2 node cluster, opm-capacity-01 being the other node. Average latency, IOPS, MBps and Performance capacity used over the selected time range for the node opm-capacity-01 are displayed. Click on Add to add node opm-capacity-01 performance metrics to the chart, view and compare performance metrics with node opm-capacity-02. Select the Time Range pull-down menu and select Last 30 days to view the metrics chart. Select the pull-down choose charts menu and select Events, Latency, Utilization, Performance capacity used charts. Notice that the chart now displays performance metrics charts for both the nodes in the cluster.

23 Click on drop down option in Zoom view to open performance capacity chart in a new window

24 Use the mouse left click to select the duration between 07/4 to 07/20 to look into performance capacity used during this time duration. In an actual scenario, you have to compare performance capacity used on all nodes in a cluster for the last 72 hours, last 7 days and 30 days before deciding on which node is appropriate to provision a new volume or workload. For this lab, we are considering a particular time range. Performance capacity used for both the nodes is in the green or safe zone for both the nodes for the selected time period, with opm-capacity-01 node displaying higher performance capacity utilization compared to opm-capacity-02 node for the selected time range. Thresholds assigned to nodes will also be displayed in the charts. We will cover thresholds in a later section.

25 Based on this metrics for the selected time range a new workload can be provisioned in opmcapacity-02. We can select aggregates on opm-capacity-02 to view and compare performance metrics charts. This will help us understand which aggregate can be used to provision a new workload. Remove additional object(opm-capacity-01) added to the chart and select Aggregates on this Node from view and compare drop down list.

26 Aggregate hourly averages for the selected time range (last 30 days in this example) are displayed in the table. If the workload is latency sensitive and has ultra-low latency requirements, aggr2_ssd is a better option available based on latency, IOPS currently delivered and performance capacity used metrics. Let s add Aggr4_hybris and aggr2_ssd aggregates and compare aggregate performance characteristics with node opm-capacity-02 Click on drop down option in Zoom view to open performance capacity chart in a new window For the duration between 07/4 to 07/18, performance capacity on aggr2_ssd is hardly used.

27

28 Next, let s navigate to aggregate inventory page to check on free capacity and ascertain disk type information for aggregate From node 02 explorer page, click on Storage Aggregates to navigate to aggregate inventory page.

29 Check if aggr2_ssd has enough capacity to provision a new workload. Click on aggr2_ssd to launch aggr2_ssd object landing page and navigate to information page. aggr2_ssd information page provides you aggr2_ssd aggregate disk type. This is a SSD aggregate.

30 In case, the performance capacity used on nodes 01 and 02 display big differences where one node is over utilized (100% and above) and another node is under-utilized (60% and below) there is an opportunity to view and compare aggregates on over utilized nodes to find out which aggregate is contributing towards over utilization. This will help you understand which volumes can be moved non-disruptively to balance workloads across the nodes in a cluster are balanced. Lab Activity Failover Planning Lab Activity Performance Management Policy Thresholds