Boost your Portal productivity with Monitoring Studio Express. Bertrand Martin Sentry Software

Transcription

1 Boost your Portal productivity with Monitoring Studio Express Bertrand Martin Sentry Software November 26, 2007

2 2 Typical BMC Portal Environment Solutions BPM for Hardware BPM for Servers BPM for Log Management BPM for Databases BPM for Application Servers BMC Portal or Mixed agent-less and PATROL environment Agent-less for simpler or less critical servers PATROL where native agent-less features are not up to the task

3 From the Horses Mouth What BMC Portal Users Say 3 I like the agent-less concept! No agent, and no console! Every new iteration of Portal gives us more features Centralized security management, God bless you!

4 From the Horses Mouth But 4 What about remote LOG file monitoring? I will never use the SDK I just need to do simple and standard monitoring stuff, execute commands, WMI, JMX, SQL, HTTP, etc. My boss wants tightly customized monitoring but doesn t want me to code in Java

5 5 Users Feedback Recap

6 6 How evolution theory applies to BMC Portal PATROL Express ACE (Application Class Editor)

7 7 Monitoring Studio Express BMC Performance Manager Express Monitoring Studio Surely the longest product name ever 49 chars without trademark signs! Nicknamed Monitoring Studio Express Agent-less counterpart of Monitoring Studio KM for PATROL Developed by Sentry Software, available as a BMC product Set of monitoring tools Configurable through Portal s UI No development, release, upgrade process Step 1: Identify your information source: LOG file, output of a command, JMX, SNMP, WBEM, SQL, HTTP Step 2: Specify what you want to look for: Specific strings to be found (or not) Numeric values to be extracted

8 8 Feature Set SNMP Simple polling, tables Remote LOG file monitoring Windows, UNIX/Linux JMX polling Java applications Standalone, WebSphere, WebLogic, JBoss, JOnAS WBEM WMI on Windows, Pegasus on other systems HTTP requests HTTP / HTTPS, authentication, post forms SQL queries MS SQL Server, Oracle, MySql

9 9 Feature Set

10 10 LOG File Analysis Remote monitoring of files Windows, UNIX / Linux Size, Growth, Access Rights, Exists, etc. Supports wildcards (will take the newest file into account) Parse the file content String searches Numeric value extraction Parsing performed either On the Managed Element (CPU++) Or on the R.S.M. (Network++)

11 11 Parsing performed on RSM vs. Managed Element Parsing on the R.S.M. File content goes through telnet/ssh Only new additions since last polling String searches and numeric value extractions performed on the R.S.M. Parsing on the Managed Element Use one awk script per string search and/or numeric value extraction Only the last 10 lines go through the network ( < 1KB) Network Network R.S.M. Managed Element R.S.M. Managed Element

12 12 String Searches Principle Count the number of lines that match a given criteria Matching Line Count parameter Matching Line(s) parameter What you can search for Combination of 2 regular expressions (AND, OR, NOT) Search in a specific column Automatic acknowledgement of alerts Every polling After N hours When another regular expression is found

13 13 Understanding the LOG File Analysis Feature Poll a given file for new lines written since last polling Matching Line Count parameter keeps increasing until it s reset Example Search for [ERROR] (count lines with [ERROR] ) Automatically acknowledge when [RESET] is found Lines written in LOG file Matching Line Count parameter :17:12 [ERROR] A witch has been detected 1 ALARM TRIGGERED :19:13 [INFO] The sky is blue :21:10 [ERROR] A witch has been detected :21:13 [INFO] Grass is green :21:14 [ERROR] A nasty ghost has been detected :23:09 [INFO] Birds can fly (often) :25:02 [INFO] Cats eat birds (not all) :27:17 [RESET] I feel good 0 ALARM CLEARED :29:16 [INFO] I know that I would 0 3

14 14 LOG File Analysis on UNIX / Linux Behind the Scenes Connect to the managed element Find the file to be monitored If a wildcard has been specified Get file information Read the new content Only new content No more than 10MB Parse content String searches Numeric Value Extractions Set parameters in Portal Telnet / SSH find ls head, tail Content sent to RSM awk Parsing on the R.S.M. Max 10 lines sent to R.S.M.

15 15 LOG File Analysis on Windows Behind the Scenes Get file information (WMI) Win32_Directory, CIM_DataFile Read the temporary file through SEN_MS share (NetBIOS) Delete temporary file (WMI) Create an access point on Managed Element (WMI) Create a SEN_MS directory under C:\Windows (%SystemRoot%) if necessary Share the SEN_MS directory if not already done Execute NAWK.Exe to parse the content (WMI) Redirect the output to a temporary file in SEN_MS directory Max 10 lines Set parameters in Portal Check whether necessary files are present on Managed Element (WMI) NAWK.Exe, SEN_MS_Excerpt.Exe Copy them to SEN_MS if necessary Execute SEN_MS_Excerpt to read new content from file (WMI) Redirect the output to a temporary file in SEN_MS directory

16 16 LOG File Example

17 17 LOG File Example

18 18 LOG File Example

19 19 LOG File Example

20 20 JMX Polling Monitor Java applications Instrumented with JMX BPM for Application Servers Monitors the Java Application Server engine Monitoring Studio Express Retrieves metrics from your application, not from the underlying engine Supports: IBM WebSphere BEA WebLogic Sun standard JBoss JOnAS

21 21 JMX How it Works JMX (Java Management Extensions) is a Java instrumentation standard Allows Java developers to easily expose internal metrics of their application Antenna for Java classes: MBeans Accessed through an MBeanServer JMX polling enables accessing an MBeanServer to get the value of MBeans Unfortunately, MBeanServers are implemented in very different ways across different Java Application Servers 1. Specify how to connect to the MBeanServer (Java Application Server) 2. Specify the MBean you want to access Domain name Key property (MBean ID) 3. Specify which attributes (property) to be retrieved A graph is directly built from the value if numeric 4. Search for strings in text values 5. Continue with step 2

22 22 Sentry JMX Browser With Sentry JMX Browser: - Test connection settings to a Java Application Server - Retrieve lists all of the MBeans objects Easy to use GUI - Copy-paste domain name, key property value and attributes name to BMC Portal. Just one interface for all types of JMX application servers

23 23 JMX Example

24 24 SQL Queries Allows you to execute SQL queries on: Oracle Database Servers Microsoft SQL Servers MySQL Servers Parse the result of the SQL query Search for lines that contain / do not contain regular expressions Extract numeric values Ideal to monitor database-based applications Check tables, execute stored procedures, simulate client requests, etc. Based on JDBC

25 25 SQL queries example

26 26 HTTP Requests Send an HTTP request to a Web server Web server, internal & external, Web interface, etc. HTTP or HTTPS (encrypted) Simple GET, or POST a form Analyze the response from the Web server HTTP status code Response time Content returned, user can choose to get: The entire HTTP response (header + HTML page) Only the HTML page Only the text in the page (no HTML tags) Search for strings in the result Extract numeric values and build graphs

27 27 HTTP Requests Example

28 28 Numeric Value Extraction Principle Extract a numeric value from a text Build a numerical graph with alert thresholds Extract From lines matching a given regular expression Retrieve the numeric value located After a specified string Before a specified string In a given column number If several values are found (due matches in several lines) Calculate average, sum, min, max, first or last Specify the expected numerical format (decimal separator, etc.) Rescale for easier representation

29 29 Weather Report for Houston, TX

30 30 W.B.E.M. W.B.E.M. Web Based Enterprise Management Instrumentation standard Created to replace SNMP A data schema (CIM = Common Information Model) A protocol (HTTP or HTTPS) Several implementations WMI from Microsoft (proprietary, CIM over RPC) Pegasus from HP, IBM, Sun, etc. (CIM over HTTP(S), true WBEM) Where do we find WBEM? Windows, Exchange, IIS, SQL Server, etc. Storage Arrays, SANs (SMI-S) VMWare HP-UX, Linux but implementation is poor

31 31 WBEM Polling Support for WMI (CIM over RPC) for Windows Pegasus (CIM over HTTP(S)) for non-windows Specify Credentials Namespace (root/cimv2) WQL query SELECT * FROM Win32_Processor SELECT * FROM CIM_FCPort Analyze the result of the WQL query Search for strings Extract numeric values to build a graph

32 32 S.N.M.P. SNMP Simple Network Management Problem MIB = Management Information Base OID = UDP/161, UDP/162 Polling Simple variables Tables Events Traps Where? Network devices, hardware management agents, operating systems, printers

33 33 SNMP Polling Monitoring Studio Express allows SNMP polling SNMP v1 only No SNMP trap listening Requires a SNMP MIB browser to identify the OID to poll Monitoring Studio Express does not import MIBs Poll Single OID (simple string or numeric value) Table Specify the root OID of the table Specify the columns to be retrieved Parse the result of the SNMP request Search for strings Extract numeric values

34 34 Remote Command Execution Execute a command or script remotely UNIX / Linux (through telnet or SSH) Windows (WMI) Specify The credentials Connect As + Execute As on UNIX / Linux The command line to be executed Parse the result of the command Search for strings Extract numeric values

35 35 Remote Command Execution Example

36 36 Remote Command Execution Example

37 37 Your future BMC Portal Environment Solutions BPM for Hardware BPM for Servers BPM Monitoring Studio BPM for Log Management BPM for Databases BPM for Application Servers BMC Portal Full agent-less environment

38 38 Boost your BMC Portal productivity Add BPM Express Monitoring Studio to your Portal implementation Easily cover 100% of your IT Custom applications Anything for which you don t have an out-of-the-box monitoring solution available Pick up the appropriate tool in the monitoring toolbox LOG files, Commands and scripts, SQL, HTTP, WBEM, JMX, SNMP No development No creation of custom.par files No Java, no XML No maintenance or upgrade Everything is done in Portal s GUI

39 39 Product Availability & Roadmap UserWorld Vancouver 2007 Version Requires BMC Portal RTM Available on 2nd semester of 2008 Version : enhanced performance Version : enhanced GUI January 2008 Version Available as a BMC product USD 240/CPU

40 40 Questions?