VMware vrealize operations Management Pack FOR KVM User Guide
TABLE OF CONTENTS 1. Purpose... 3 2. Introduction to the Management Pack... 3 2.1 How the Management Pack Collects Data... 3 2.2 Data the Management Pack Collects... 3 2.3 Inventory Tree (Traversal Spec)... 3 3. Dashboards... 4 3.1 KVM Overview... 4 3.2 KVM Relationships... 5 3.3 KVM Host Details... 6 3.4 KVM VM Details... 7 4. Views... 8 5. Reports... 9 6. Alerts...10 7. Actions...10 8. Analysis Badges...10 9. Troubleshooting the Management Pack...11 9.1 Troubleshooting an Adapter Instance...11 9.2 Testing Connection Failures...11 9.3 Viewing System Log Files...12 10. Appendix I: Metrics...13 11. Appendix II: Alerts...15 12. Appendix III: Capacity Definitions...15 NOTE: This document supports the version of each product listed, as well as all subsequent versions, until a new edition replaces it. You can find the most up-to-date technical documentation on the Blue Medora support site at: http://support.bluemedora.com. The Blue Medora website also provides the latest product updates. If you have comments about this documentation, submit your feedback to: support@bluemedora.com. 2 Blue Medora VMware vrealize Operations Management Pack for KVM User Guide
1. Purpose The Blue Medora VMware vrealize Operations (vrops) Management Pack for KVM User Guide describes the primary features of the Management Pack for KVM, including dashboards, views, reports, alerts, and metrics that allow users to optimize the monitoring and management of KVM resources from within vrealize Operations. 2. Introduction to the Management Pack The Management Pack for KVM is an embedded adapter for vrealize Operations (vrops) that monitors KVM systems remotely to retrieve performance data regarding KVM resources. This section includes the following topics: How the Management Pack Collects Data Data the Management Pack Collects 2.1 How the Management Pack Collects Data During each data collection cycle, the Management Pack opens a connection to the specified KVM host and queries it to retrieve resource metrics. The collection interval for the adapter instance resource determines how often the Management Pack collects data. The default collection interval is five minutes. 2.2 Data the Management Pack Collects The Management Pack can collect performance data, relationships (associations), and events for the following KVM resources: 1. KVM Host System 2. KVM Virtual Machine 3. KVM Storage Pool 4. KVM Storage Volume 5. KVM Network Figure 1: KVM Architecture Figure 2: KVM Traversal Spec 2.3 Inventory Tree (Traversal Spec) The Inventory Tree (Traversal Spec) feature within vrops allows you to easily navigate your KVM environment. The hierarchical structure implicitly shows relationships among resource kinds and enables quick drill-downs to rootcause issues. 3 Blue Medora VMware vrealize Operations Management Pack for KVM User Guide
3. Dashboards Dashboards are the primary user interface that allow users to monitor KVM resources from within vrealize Operations. The following dashboards are available in the Management Pack: KVM Overview KVM Relationships KVM Host Details KVM VM Details 3.1 KVM Overview The KVM Overview dashboard displays heat maps depicting the overall health of KVM hosts, virtual machines, storage pools, storage volumes, and networks. Figure 3: KVM Overview Dashboard 4 Blue Medora VMware vrealize Operations Management Pack for KVM User Guide
3.2 KVM Relationships The KVM Relationships dashboard allows the user to select a KVM resource from the Environment Overview to view key performance metrics, health, and relationships regarding that resource. Figure 4: KVM Relationships 5 Blue Medora VMware vrealize Operations Management Pack for KVM User Guide
3.3 KVM Host Details The KVM Host Details dashboard allows the user to select a KVM Host to view alerts, memory, health, and relationship information about that resource. Figure 5: KVM Host Details Dashboard 6 Blue Medora VMware vrealize Operations Management Pack for KVM User Guide
3.4 KVM VM Details The KVM VM Details dashboard allows the user to select a KVM Virtual Machine to view alerts, key metrics, health, and relationship information about that resource. Figure 6: KVM VM Details Dashboard 7 Blue Medora VMware vrealize Operations Management Pack for KVM User Guide
4. Views The vrops Management Pack for KVM contains custom views, which allow the user to view statistics of metrics for KVM resources. Views provide a big picture look at resources, as opposed to a more in depth view. Table 1: KVM Views View Type Description KVM Host VMs, Storage and Network Count List KVM Host Overview for VMs, storage, and network KVM Host CPU Usage (%) Distribution Distribution KVM Host CPU Usage (%) Distribution KVM Host Memory Usage (%) Distribution Distribution KVM Host Memory Usage (%) Distribution KVM Host - CPU List Provides a list of KVM Host - CPU information KVM Host - Memory List Provides a list of KVM - Memory information KVM Host Badge Analysis Summary List Provides a list of all the KVM Hosts with analysis answers for Anomalies, Workload, and Faults KVM Storage Pool Badge Analysis Summary List Provides list of all the KVM Storage Pools with analysis answers for Anomalies and Faults KVM Storage Pool List Provides a list of KVM Storage Pool information KVM Network Badge Analysis Summary List Provides a list of all the KVM Networks with analysis answers for Anomalies and Faults KVM VM - Memory List KVM VM - Memory information KVM VM Badge Analysis Forecast Trend List 12 week history and 30 day forecast of selected Virtual Machine with analysis answers for Anomalies and Faults KVM VM Badge Analysis Summary List Provides a list of all KVM VMs with analysis answers for Anomalies, Workload, and Faults KVM VM - CPU List Provides a list of KVM VM - CPU information To access the Management Pack views, go to Environment > KVM and click the desired Object (resource kind). Select the Details tab, then Views. Select the desired view from the list to populate the statistics below. For the full list of views for the Management Pack, go to Home > Content > Views. Figure 7: Accessing KVM Views 8 Blue Medora VMware vrealize Operations Management Pack for KVM User Guide
5. Reports The vrops Management Pack for KVM contains the following custom reports. The reports can be exported and easily shared with key stakeholders in either.pdf or.csv formats. Table 2: KVM Reports REPORT KVM Host Report KVM Storage and Network Report KVM VM Report Description Provides a roll-up of the following counts for a certain host system: Number of persistent VMs Number of running VMs Number of total VMs Number of transient VMs Number of network filters Number of networks Number of storage pools Provides a roll-up of the following metrics for KVM storage and network resources: Storage anomalies Storage faults Storage allocation Storage available Storage capacity Number of storage volumes Network anomalies Network faults Provides a roll-up of the following KVM Virtual Machine metrics: Memory workload Allocated memory Maximum memory Used memory VM anomalies VM workload VM faults CPU workload CPU time Max CPU Number of CPUs Used CPU % To access the Management Packs reports, go to Environment > KVM and click the desired Object (resource kind). Select the Reports tab, then Report Templates. To run the selected report, click the Run Template icon ( ). Figure 8: Accessing KVM Reports 9 Blue Medora VMware vrealize Operations Management Pack for KVM User Guide
6. Alerts The vrops Management Pack for KVM pulls KVM database health indicators and displays them in vrealize Operations as alerts. The critical levels of each alert are closely mapped from KVM to vrops. Refer to Appendix II for the full list of alerts, symptoms, and recommendations provided by this Management Pack. 7. Actions The Management Pack for KVM uses the action framework in vrops to do power functions on your KVM virtual machines: Power On Power Off Shut Off Restart Figure 9: Available Actions for VMs 8. Analysis Badges vrealize Operations Analysis Badges for KVM virtual machines and host systems are populated based on capacity definitions provided by this Management Pack. Refer to Appendix III for the list of capacity definitions. Figure 10: Analysis Badge Example 10 Blue Medora VMware vrealize Operations Management Pack for KVM User Guide
9. Troubleshooting the Management Pack Known troubleshooting information can help you diagnose and correct common problems with the Management Pack for KVM. This section includes the following topics: Troubleshooting an Adapter Instance Testing Connection Failures Viewing System Log Files 9.1 Troubleshooting an Adapter Instance Perform these general troubleshooting steps to diagnose and correct problems with an adapter instance: Edit the adapter instance and click Test Connection to verify the connection to vrops. Refer to section 9.2, Testing Connection Failures. View the collection status and collection state for the adapter instance resource on the Environment Overview page in vrops. Check the adapter and collector logs for errors. Refer to section 9.3, Viewing System Log Files, for details. 9.2 Testing Connection Failures When clicking Test Connection in the Manage Solution window when adding an adapter instance, the following connection errors are possible. 9.2.1 Wrong Credentials Error: Unable to establish a valid connection to target system. Connection authorization failure occurred. Reason: User ID or Password invalid. Action: Ensure the correct Libvirt SSH User Name and vrealize Operations User Name and Password were entered when adding your adapter instance. 9.2.2 Wrong Host Error: Unable to establish a valid connection to target system. Required property is unknown host. Action: Ensure the correct KVM IP address or hostname was entered. 9.2.3 Host Key Verification Failed Error: Unable to establish a valid connection to the target system. Failed to connect to KVM host: Cannot recv data: Host key verification failed.: Connection reset by peer. Action: Ensure the hostname is the same as the hostname in the vrops ~/.ssh/known_hosts file. 9.2.4 SSH Key Missing from KVM Error: Unable to establish a valid connection to the target system. Failed to connect to KVM host: Cannot recv data: Permission denied, please try again. Permission denied, please try again. Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).: Connection reset by peer. Action: Ensure that the public SSH key is in the ~/.ssh/authorized_keys file of the Libvirt SSH user. That is, the SSH key generated on the vrops box was copied successfully onto the KVM box using ssh-copy-id. 11 Blue Medora VMware vrealize Operations Management Pack for KVM User Guide
9.3 Viewing System Log Files You can view KVM adapter errors in the adapter and collector log files. You can view the adapter and collector log files in the vrops user interface or in an external log viewer. The adapter log files are in the $ALIVE_BASE/user/log/adapters/KVMAdapter/ folder. The collector log files are in the $ALIVE_BASE/user/log/ folder. The logging level is set to ERROR by default. To troubleshoot issues, set the logging level to INFO. To view detailed messages, including micro steps, queries, and returned results, set the logging level to DEBUG. You can set the base log level for the collector via Administrator -> Support -> Logs -> Select COLLECTOR folder -> Select Edit Properties icon -> Edit Root logger level. NOTE: If you set the logging level to DEBUG, log files can become large very quickly. Set the logging level to DEBUG only for short periods of time. For complete information about viewing log files and modifying log levels, refer to the vrops online help. 12 Blue Medora VMware vrealize Operations Management Pack for KVM User Guide
10. Appendix I: Metrics The Management Pack for KVM collects the following metrics by KVM Resource Kinds. Table 3: Management Pack Metrics RESOURCE KIND RESOURCE GROUP RESOURCE ATTRIBUTE ATTRIBUTE TYPE KVM Virtual Machine Configuration Name string KVM Virtual Machine Configuration Persistent integer KVM Virtual Machine Configuration OS Type string KVM Virtual Machine Configuration Architecture string KVM Virtual Machine CPU Information Virtual CPUs integer KVM Virtual Machine CPU Information Maximum CPU integer KVM Virtual Machine CPU Information Used CPU float KVM Virtual Machine CPU Information Total CPU integer KVM Virtual Machine CPU Information Max CPU percent integer KVM Virtual Machine CPU Information VM CPU Time float KVM Virtual Machine Memory Information Maximum Memory integer KVM Virtual Machine Memory Information Allocated Memory integer KVM Virtual Machine Memory Information Used Memory integer KVM Virtual Machine Runtime Power State string KVM Virtual Machine Runtime State string KVM Virtual Machine Relationships KVM Host Parent string KVM Virtual Machine Storage IO Errors double KVM Virtual Machine Storage IO Read Requests double KVM Virtual Machine Storage IO Read Throughput double KVM Virtual Machine Storage IO Write Requests double KVM Virtual Machine Storage IO Write Throughput double KVM Virtual Machine Network IO Received Throughput double KVM Virtual Machine Network IO Received Dropped double Packets KVM Virtual Machine Network IO Received Packets double KVM Virtual Machine Network IO Received Errors double KVM Virtual Machine Network IO Sent Throughput double KVM Virtual Machine Network IO Sent Dropped Packets double KVM Virtual Machine Network IO Sent Packets double KVM Virtual Machine Network IO Sent Errors double KVM Host Configuration Name string KVM Host Configuration Total Running VMs integer KVM Host Configuration Total number of VMs integer KVM Host Configuration Total Persistent VMs integer KVM Host Configuration Total Transient VMs integer KVM Host Configuration Total Storage Pools integer 13 Blue Medora VMware vrealize Operations Management Pack for KVM User Guide
RESOURCE KIND RESOURCE GROUP RESOURCE ATTRIBUTE ATTRIBUTE TYPE KVM Host Configuration Total Networks integer KVM Host Configuration Total Network Filters integer KVM Host Configuration Architecture string KVM Host CPU Information Virtual CPUs integer KVM Host CPU Information CPU Cores integer KVM Host CPU Information CPU Sockets integer KVM Host CPU Information CPU Speed per Core integer KVM Host CPU Information Used CPU float KVM Host CPU Information Total CPU integer KVM Host CPU Information Max CPU percent integer KVM Host CPU Information VM CPU Time float KVM Host Memory Information Maximum Memory integer KVM Host Memory Information Used Memory integer KVM Host Runtime Running VMs integer KVM Host Runtime Paused VMs integer KVM Host Runtime Blocked VMs integer KVM Host Runtime Crashed VMs integer KVM Host Runtime None VMs integer KVM Host Runtime Shutdown VMs integer KVM Host Runtime Shutoff VMs integer KVM Host Runtime Total VMs integer KVM Host Relationships KVM Virtual Machine string Children KVM Host Relationships KVM Storage Pool string Children KVM Host Relationships KVM Network Children string KVM Storage Pool Configuration Name string KVM Storage Pool Configuration Volumes integer KVM Storage Pool Configuration Allocation integer KVM Storage Pool Configuration Available integer KVM Storage Pool Configuration Capacity integer KVM Storage Pool Configuration Allocation Percentage float KVM Storage Pool Configuration Persistent integer KVM Storage Pool Configuration Running integer KVM Storage Pool Configuration Accessible string KVM Storage Pool Configuration State string KVM Storage Pool Relationships KVM Host Parent string KVM Storage Pool Relationships KVM Storage Volume string Children KVM Storage Volume Configuration Name string KVM Storage Volume Configuration Path string 14 Blue Medora VMware vrealize Operations Management Pack for KVM User Guide
RESOURCE KIND RESOURCE GROUP RESOURCE ATTRIBUTE ATTRIBUTE TYPE KVM Storage Volume Configuration Allocation integer KVM Storage Volume Configuration Capacity integer KVM Storage Volume Relationships KVM Storage Pool Parent string KVM Network Configuration Name string KVM Network Configuration Bridge Name string KVM Network Configuration Persistent integer KVM Network Configuration Running integer KVM Network Relationships KVM Host Parent string 11. Appendix II: Alerts The vrops Management Pack for KVM creates alerts based on various symptoms that it detects in the environment. See the table below for details regarding each alert. Table 4: Management Pack Alerts NAME Virtual Machine State Blocked Virtual Machine State Crashed Storage Pool State Degraded SYMPTOM Virtual Machine State Blocked Virtual Machine State Crashed Storage Pool State Degraded 12. Appendix III: Capacity Definitions The Management Pack for KVM uses the following capacity definitions, which help determine the value of Analysis Badges for KVM virtual machines and host systems within vrealize Operations (refer to Section 7). Table 5: Capacity Definitions CONTAINER KVM Virtual Machine Memory CPU KVM Host System Memory CPU USE IN WORKLOAD? yes yes yes yes 15 Blue Medora VMware vrealize Operations Management Pack for KVM User Guide
You can find the most up-to-date technical documentation on the Blue Medora support site at: http://support.bluemedora.com. The Blue Medora website also provides the latest product updates. If you have comments about this documentation, submit your feedback to: support@bluemedora.com. Copyright 2015 Blue Medora Inc. All rights reserved. U.S. and international copyright and intellectual property laws protect this product. Blue Medora is a registered trademark or trademark of Blue Medora in the United States and/or other jurisdictions. Blue Medora 3225 N Evergreen Dr. NE Suite 103 Grand Rapids, MI 49525 www.bluemedora.com