VMware vrealize operations Management Pack FOR. PostgreSQL. User Guide

Transcription

1 VMware vrealize operations Management Pack FOR PostgreSQL User Guide

2 TABLE OF CONTENTS 1. Purpose Introduction to the Management Pack How the Management Pack Collects Data Data the Management Pack Collects Inventory Tree (Traversal Spec) Dashboards PostgreSQL Overview PostgreSQL on OS PostgreSQL on VM PostgreSQL IOPS PostgreSQL Top-N Queries Views Reports Alerts Troubleshooting the Management Pack Troubleshooting an Adapter Instance Testing Connection Failures Viewing System Log Files Appendix I: Metrics Appendix II: Alerts...20 NOTE: This document supports the version of each product listed, as well as all subsequent versions, until a new edition replaces it. You can find the most up-to-date technical documentation on the Blue Medora support site at: The Blue Medora website also provides the latest product updates. If you have comments about this documentation, submit your feedback to: support@bluemedora.com. 2 Blue Medora VMware vrealize Operations Management Pack for PostgreSQL User Guide

3 1. Purpose The Blue Medora VMware vrealize Operations (vrops) Management Pack for PostgreSQL User Guide describes the primary features of the Management Pack for PostgreSQL, including dashboards, views, reports, alerts, and metrics that allow users to optimize the monitoring and management of PostgreSQL resources from within vrealize Operations. 2. Introduction to the Management Pack The Management Pack for PostgreSQL is an embedded adapter for vrealize Operations (vrops) that monitors PostgreSQL database systems remotely by creating a JBDC connection to retrieve performance data regarding PostgreSQL resources. This section includes the following topics: How the Management Pack Collects Data Data the Management Pack Collects 2.1 How the Management Pack Collects Data During each data collection cycle, the Management Pack opens a JDBC connection to the specified PostgreSQL database instance and queries it to retrieve resource metrics. The collection interval for the adapter instance resource determines how often the Management Pack collects data. The default collection interval is five minutes. 2.2 Data the Management Pack Collects The Management Pack can collect performance data, relationships (associations), and events for the following PostgreSQL resources: 1. PostgreSQL Adapter Instance 2. PostgreSQL Instance 3. PostgreSQL Database 4. PostgreSQL Table Indexes (if disabled, index and trigger instance metric groups will not be returned) 5. PostgreSQL Function (requires pg_stat_user_functions to be enabled) 6. PostgreSQL Query (requires pg_stat_statments to be enabled) Figure 1: PostgreSQL Architecture Figure 2: Example Traversal Spec 2.3 Inventory Tree (Traversal Spec) The Inventory Tree (Traversal Spec) feature within vrops allows you to easily navigate your PostgreSQL environment. The hierarchical structure implicitly shows relationships among resource kinds and enables quick drill-downs to root-cause issues. 3 Blue Medora VMware vrealize Operations Management Pack for PostgreSQL User Guide

4 3. Dashboards Dashboards are the primary user interface that allow users to monitor PostgreSQL resources from within vrealize Operations. The following dashboards are available in the Management Pack: PostgreSQL Overview PostgreSQL on OS PostgreSQL on VM PostgreSQL IOPS PostgreSQL Top-N Queries 3.1 PostgreSQL Overview The PostgreSQL Overview dashboard displays heat maps depicting the overall health of PostgreSQL databases. Figure 3: PostgreSQL Overview Dashboard 4 Blue Medora VMware vrealize Operations Management Pack for PostgreSQL User Guide

5 3.2 PostgreSQL on OS The PostgreSQL on OS dashboard allows you to select a PostgreSQL database and related operating system in order to view key performance metrics (KPIs) for each. Figure 4: PostgreSQL on OS Dashboard 5 Blue Medora VMware vrealize Operations Management Pack for PostgreSQL User Guide

6 3.3 PostgreSQL on VM The PostgreSQL on VM dashboard allows the user to select a PostgreSQL database and related virtual machine to view key performance indicators (KPIs) for each. Figure 5: PostgreSQL on VM Dashboard 6 Blue Medora VMware vrealize Operations Management Pack for PostgreSQL User Guide

7 3.4 PostgreSQL IOPS The IOPS dashboard allows the user to select a PostgreSQL database to view IO stats for the related database, virtual machine, and datastore. Figure 6: PostgreSQL IOPS Dashboard 7 Blue Medora VMware vrealize Operations Management Pack for PostgreSQL User Guide

8 3.5 PostgreSQL Top-N Queries The Top-N Queries dashboard allows the user to select a PostgreSQL database to view a ranking of the Top 10 slowest queries. The dashboard also allows you to select individual queries from the heat map to view performance metrics for the selected query. Figure 7: PostgreSQL Top-N Queries Dashboard 8 Blue Medora VMware vrealize Operations Management Pack for PostgreSQL User Guide

9 4. Views The vrops Management Pack for PostgreSQL contains custom views, which allow the user to view statistics of metrics for PostgreSQL resources. Views provide a big picture look at resources, as opposed to a more in depth view. Table 1: PostgreSQL Views View Type Description PostgreSQL Database Overview List Provides a overview of database performance metrics. PostgreSQL Instance Overview List Provides an overview of instance performance metrics. PostgreSQL Slowest Queries List Provides a list of slowest queries metrics. PostgreSQL Throughput List Provides a list of throughput metrics. To access the Management Pack views, go to Environment > PostgreSQL and click the desired Object (resource kind). Select the Details tab, then Views. Select the desired view from the list to populate the statistics below. For the full list of views for the Management Pack, go to Home > Content > Views. Figure 8: Accessing PostgreSQL Views 9 Blue Medora VMware vrealize Operations Management Pack for PostgreSQL User Guide

10 5. Reports The vrops Management Pack for PostgreSQL contains the following custom reports. The reports can be exported and easily shared with key stakeholders in either.pdf or.csv formats. Table 2: PostgreSQL Reports REPORT PostgreSQL Databases Report PostgreSQL Instance Report PostgreSQL Slowest Queries Report PostgreSQL Throughput Report Description Corresponds to the view of the same name in section 4, Views. Corresponds to the view of the same name in section 4, Views. Corresponds to the view of the same name in section 4, Views. Corresponds to the view of the same name in section 4, Views. To access the Management Packs reports, go to Environment > PostgreSQL and click the desired Object (resource kind). Select the Reports tab, then Report Templates. To run the selected report, click the Run Template icon ( ). Figure 9: Accessing PostgreSQL Reports 10 Blue Medora VMware vrealize Operations Management Pack for PostgreSQL User Guide

11 6. Alerts The vrops Management Pack for PostgreSQL pulls PostgreSQL database health indicators and displays them in vrealize Operations as alerts. The critical levels of each alert are closely mapped from PostgreSQL to vrops. Refer to Appendix II for the full list of alerts, symptoms, and recommendations provided by this Management Pack. Figure 10: Alert Example 11 Blue Medora VMware vrealize Operations Management Pack for PostgreSQL User Guide

12 7. Troubleshooting the Management Pack Known troubleshooting information can help you diagnose and correct common problems with the Management Pack for PostgreSQL. This section includes the following topics: Troubleshooting an Adapter Instance Testing Connection Failures Viewing System Log Files 7.1 Troubleshooting an Adapter Instance Perform these general troubleshooting steps to diagnose and correct problems with an adapter instance: Edit the adapter instance and click Test Connection to verify the connection to vrops. Refer to section 7.2, Testing Connection Failures. View the collection status and collection state for the adapter instance resource on the Environment Overview page in vrops. Check the adapter and collector logs for errors. Refer to section 7.3, Viewing System Log Files, for details. 7.2 Testing Connection Failures When clicking Test Connection in the Manage Solution window when adding an adapter instance, the following connection errors are possible Wrong Credentials Error: Unable to establish a valid connection to target system. Connection authorization failure occurred. Reason: User ID or Password invalid. Action: Ensure the correct PostgreSQL and vrealize Operations User Name and Password was entered when adding your adapter instance Wrong Host Error: Unable to establish a valid connection to target system. Required property is unknown host. Action: Ensure the correct hostname or IP address of the PostgreSQL instance was entered when adding your adapter instance Wrong Port Error: Unable to establish a valid connection to target system. Connection authorization failure occurred. Error opening socket server <name> on port with message: Connection refused. Action: Check your PostgreSQL database system and ensure the connection port number matches the port number entered (if other than default of 5432) when adding your adapter instance Wrong Database Error: Connection authorization failure occurred. The application server rejected establishment of the connection. An attempt was made to access a database, <name>, which was either not found or does not support transactions. Action: Ensure the database name(s) provided match the PostgreSQL system. Multiple databases should be separated by commas in the Manage Solution window. 12 Blue Medora VMware vrealize Operations Management Pack for PostgreSQL User Guide

13 7.2.5 SSL Not Enabled Error: SSL connection is not enabled. Action: Under Advanced Settings, set SSL mode to be enabled (required) Server Does Not Support SSL Error: The server does not support SSL connections. Action: Under Advanced Settings, set SSL mode setting to Disabled. 7.3 Viewing System Log Files You can view PostgreSQL adapter errors in the adapter and collector log files. You can view the adapter and collector log files in the vrops user interface or in an external log viewer. The adapter log files are in the $ALIVE_BASE/user/log/adapters/PostgreSQLAdapter/ folder. The collector log files are in the $ALIVE_BASE/user/log/ folder. The logging level is set to ERROR by default. To troubleshoot issues, set the logging level to INFO. To view detailed messages, including micro steps, queries, and returned results, set the logging level to DEBUG. You can set the base log level for the collector via Administrator -> Support -> Logs -> Select COLLECTOR folder -> Select Edit Properties icon -> Edit Root logger level. NOTE: If you set the logging level to DEBUG, log files can become large very quickly. Set the logging level to DEBUG only for short periods of time. For complete information about viewing log files and modifying log levels, refer to the vrops online help. 13 Blue Medora VMware vrealize Operations Management Pack for PostgreSQL User Guide

14 8. Appendix I: Metrics The Management Pack for PostgreSQL collects the following metrics by PostgreSQL Resource Kinds. Table 3: Management Pack Metrics RESOURCE KIND RESOURCE GROUP RESOURCE ATTRIBUTE ATTRIBUTE TYPE PostgreSQL Instance Tablespaces General Tablespace Size double PostgreSQL Instance Tablespaces Configuration Tablespace Name string PostgreSQL Instance Tablespaces Configuration Tablespace Location string PostgreSQL Instance Tablespaces Configuration Tablespace Location string PostgreSQL Instance Tablespaces Configuration Tablespace Owner string PostgreSQL Instance Tablespaces Configuration Privileges string PostgreSQL Instance Tablespaces Configuration User Name string PostgreSQL Instance Tablespaces Configuration IP Address string PostgreSQL Instance Tablespaces Configuration Port integer PostgreSQL Instance Tablespaces Configuration Instance Name string PostgreSQL Instance Buffers Buffers Allocated double PostgreSQL Instance Buffers Times Backend Executed Own double fsync PostgreSQL Instance Buffers Times Background Writer Stopped double Due to too Many Buffers PostgreSQL Instance Buffers Buffers Written by Backend double PostgreSQL Instance Buffers Buffers Written by Background double Writer PostgreSQL Instance Buffers Buffers Written During Checkpoint double PostgreSQL Instance Configuration Name string PostgreSQL Instance Configuration Server IP string PostgreSQL Instance Configuration Server Port integer PostgreSQL Instance Configuration Last Time Stats Reset string PostgreSQL Instance Configuration Version string PostgreSQL Instance Checkpoints Scheduled Checkpoints Performed double PostgreSQL Instance Checkpoints Time Synchronizing Checkpoint double Files to Disk PostgreSQL Instance Checkpoints Requested Checkpoints Performed double PostgreSQL Instance Checkpoints Time Writing Checkpoint Files to double Disk PostgreSQL Database Sessions Number of Active Connections integer PostgreSQL Database Sessions Total Sessions integer PostgreSQL Database Sessions Active Sessions integer PostgreSQL Database Sessions Idle Sessions integer PostgreSQL Database Sessions Idle Sessions in Transaction integer PostgreSQL Database Sessions Idle Sessions in Transaction (Aborted) integer 14 Blue Medora VMware vrealize Operations Management Pack for PostgreSQL User Guide

15 RESOURCE KIND RESOURCE GROUP RESOURCE ATTRIBUTE ATTRIBUTE TYPE PostgreSQL Database Sessions Sessions Executing Fastpath integer Function Call PostgreSQL Database Sessions Sessions with Unknown State integer (Track Activities is Disabled) PostgreSQL Database General Canceled Queries Due to Conflicts integer PostgreSQL Database General Deadlock Count integer PostgreSQL Database General Database Size integer PostgreSQL Database General Last Timestamp Stats Reset string PostgreSQL Database Activity Rows Deleted double PostgreSQL Database Activity Rows Returned double PostgreSQL Database Activity Rows Updated double PostgreSQL Database Activity Rows Fetched double PostgreSQL Database Activity Rows Inserted double PostgreSQL Database Configuration Tablespace Name string PostgreSQL Database Configuration Database Name string PostgreSQL Database Configuration Database ID integer PostgreSQL Database Configuration IP Address string PostgreSQL Database Configuration Port integer PostgreSQL Database Conflicts Queries Canceled Due to double Deadlocks PostgreSQL Database Conflicts Queries Canceled Due to Old double Snapshot PostgreSQL Database Conflicts Queries Canceled Due to Lock double Timeouts PostgreSQL Database Conflicts Queries Canceled Due to Dropped double Tablespaces PostgreSQL Database Conflicts Queries Canceled Due to Pinned double Buffers PostgreSQL Database Transactions Transaction Rollbacks double PostgreSQL Database Transactions Transaction Commits double PostgreSQL Database Disk IO Temporary Bytes Written double PostgreSQL Database Disk IO Temporary Files Created double PostgreSQL Database Disk IO Buffer Hit Ratios double PostgreSQL Database Disk IO Block Reads/Buffer Misses double PostgreSQL Database Disk IO Time Spent Writing Data double PostgreSQL Database Disk IO Buffer Hits double PostgreSQL Database Disk IO Time Spent Reading Data double PostgreSQL Database Disk IO Blocks Read by Sequences integer PostgreSQL Database Disk IO Blocks Hit by Sequences integer PostgreSQL Table Triggers Configuration Trigger Enabled Status string PostgreSQL Table Triggers Configuration Trigger ID double PostgreSQL Table Triggers Configuration Trigger Name string 15 Blue Medora VMware vrealize Operations Management Pack for PostgreSQL User Guide

16 RESOURCE KIND RESOURCE GROUP RESOURCE ATTRIBUTE ATTRIBUTE TYPE PostgreSQL Table Triggers Configuration Type of Trigger Fire integer PostgreSQL Table Triggers Configuration Arguments Passed to Trigger string PostgreSQL Table Triggers Configuration Table ID integer PostgreSQL Table Triggers Configuration Table Name string PostgreSQL Table Triggers Configuration Function Name string PostgreSQL Table Triggers Configuration Function ID integer PostgreSQL Table Triggers Configuration IP Address string PostgreSQL Table Triggers Configuration Port integer PostgreSQL Table Indexes Activity Number of Block Reads integer PostgreSQL Table Indexes Activity Number of Table Rows Fetched by integer Scan PostgreSQL Table Indexes Activity Number of Buffer Hits integer PostgreSQL Table Indexes Activity Number of Index Entries Returned integer PostgreSQL Table Indexes Activity Number of Scans integer PostgreSQL Table Indexes Configuration Index ID string PostgreSQL Table Indexes Configuration Index Name string PostgreSQL Table Indexes Configuration Table Name string PostgreSQL Table Indexes Configuration Schema Name string PostgreSQL Table Indexes Configuration Table ID integer PostgreSQL Table Indexes Configuration IP Address string PostgreSQL Table Indexes Configuration Port integer PostgreSQL Table General Table Size integer PostgreSQL Table Activity Number of Rows Updated double PostgreSQL Table Activity Number of Sequential Scans double PostgreSQL Table Activity Last Time Table Analyzed by Auto string Daemon PostgreSQL Table Activity Number of Dead Rows double PostgreSQL Table Activity Last Time Table Vacuumed by Auto string Daemon PostgreSQL Table Activity Number of Rows Deleted double PostgreSQL Table Activity Last Time Table Manually Analyzed string PostgreSQL Table Activity Number of Index Scans double PostgreSQL Table Activity Number of Rows Inserted double PostgreSQL Table Activity Number of Times Table Manually double Vacuumed PostgreSQL Table Activity Number of Times Table Vacuumed double By Auto Daemon PostgreSQL Table Activity Last Time Table Manually string Vacuumed PostgreSQL Table Activity Number of Rows Fetched by Index double Scans PostgreSQL Table Activity Number of Times Table Manually Analyzed double 16 Blue Medora VMware vrealize Operations Management Pack for PostgreSQL User Guide

17 RESOURCE KIND RESOURCE GROUP RESOURCE ATTRIBUTE ATTRIBUTE TYPE PostgreSQL Table Activity Number of Rows Modified Since integer Last Analyzed PostgreSQL Table Activity Number of Times Table Analyzed by double Auto Daemon PostgreSQL Table Activity Rows fetched by Sequential Scans double PostgreSQL Table Activity Number of Live Rows double PostgreSQL Table Activity Number of Rows Hot Updated (No double separate index update requried) PostgreSQL Table Configuration Table ID integer PostgreSQL Table Configuration Tablespace Name string PostgreSQL Table Configuration Database Name string PostgreSQL Table Configuration Table Name string PostgreSQL Table Configuration Table Schema string PostgreSQL Table Configuration IP Address string PostgreSQL Table Configuration Port integer PostgreSQL Table Disk IO Number of Block Reads from double Indexes PostgreSQL Table Disk IO Number of Block Reads double PostgreSQL Table Disk IO Number of Buffer Reads double PostgreSQL Table Disk IO Number of Block Reads from double TOAST Table Indexes PostgreSQL Table Disk IO Number of Buffer Hits from TOAST double Table PostgreSQL Table Disk IO Number of Buffer Hits from Indexes double PostgreSQL Table Disk IO Number of Buffer Hits from TOAST double Table Indexes PostgreSQL Table Disk IO Number of Block Reads from double TOAST Table PostgreSQL Function Activity Total Time Spent Calling This and double All Called Functions PostgreSQL Function Activity Average Total Call Time double PostgreSQL Function Activity Times Called double PostgreSQL Function Activity Time Spent on This Function Alone double (not referenced functions) PostgreSQL Function Configuration Schema Name string PostgreSQL Function Configuration Function Name string PostgreSQL Function Configuration Function ID integer PostgreSQL Function Configuration IP Address string PostgreSQL Function Configuration Port integer PostgreSQL Function Configuration Database Name string PostgreSQL Function Configuration Rank integer PostgreSQL Query Activity Query Text string PostgreSQL Query Activity Total Time double 17 Blue Medora VMware vrealize Operations Management Pack for PostgreSQL User Guide

18 RESOURCE KIND RESOURCE GROUP RESOURCE ATTRIBUTE ATTRIBUTE TYPE PostgreSQL Query Activity Average Time Spent Per Call double PostgreSQL Query Activity Number of Calls double PostgreSQL Query Activity Rows Returned integer PostgreSQL Query Configuration User Name string PostgreSQL Query Configuration Database Name string PostgreSQL Query Configuration IP Address string PostgreSQL Query Configuration Port integer PostgreSQL Query Configuration Rank integer PostgreSQL Query Disk IO Local Block Cache Hits integer PostgreSQL Query Disk IO Shared Block Reads integer PostgreSQL Query Disk IO Shared Blocks Written integer PostgreSQL Query Disk IO Total Time Spent Writing Blocks integer PostgreSQL Query Disk IO Shared Blocks Dirty Read integer PostgreSQL Query Disk IO Local Block Reads integer PostgreSQL Query Disk IO Shared Block Cache Hits integer PostgreSQL Query Disk IO Local Blocks Dirty Read integer PostgreSQL Query Disk IO Total Time Spent Reading Blocks integer PostgreSQL Query Disk IO Local Blocks Written integer 18 Blue Medora VMware vrealize Operations Management Pack for PostgreSQL User Guide

19 9. Appendix II: Alerts The vrops Management Pack for PostgreSQL creates alerts based on various symptoms that it detects in the environment. See the table below for details regarding each alert. Table 4: Management Pack Alerts NAME DESCRIPTION RECOMMENDATION Max Written Clean (Per Second) is Higher than Normal Tablespace Size is Higher than Normal Database Size is Higher than Normal Table Size is Higher than Normal Temp Files Created is Higher than Normal Dead Rows is Higher than Normal Queries Cancelled are Higher than Normal The number of times the background writer has overwritten the maximum number of buffers (when a checkpoint is performed) is much higher than normal. The size of your Database is much higher than normal The size of your Database is much higher than normal The size of your Table is much higher than normal The number of temporary files created is higher than normal. This can cause slower performance and I/O contention. The dead rows for this table are higher than normal. The number of queries that are being cancelled is higher than normal. Consider increasing the value of bgwriter_lru_maxpages in postgresql.conf to increase performance. Consider running a VACUUM to recover disk space. Consider running a VACUUM to recover disk space. Consider running a VACUUM to recover disk space. Consider increasing the work_ mem in the postgresql.conf file. To clear the dead rows, consider running VACUUM FULL or CLUSTER during a maintenance window. Consider enabling hot_standby_ feedback in the postgresql.conf file to avoid cancelled queries. Warning: This could create bloat in the primary database. 19 Blue Medora VMware vrealize Operations Management Pack for PostgreSQL User Guide

20 You can find the most up-to-date technical documentation on the Blue Medora support site at: The Blue Medora website also provides the latest product updates. If you have comments about this documentation, submit your feedback to: Copyright 2015 Blue Medora Inc. All rights reserved. U.S. and international copyright and intellectual property laws protect this product. Blue Medora is a registered trademark or trademark of Blue Medora in the United States and/or other jurisdictions. The PostgreSQL name and logo are trademarks or registered trademarks of The PostgreSQL Global Development Group in the United States and/or other jurisdictions. All other marks and names mentioned herein may be trademarks of their respective companies. Blue Medora 3225 N Evergreen Dr. NE Suite 103 Grand Rapids, MI