IBM Operations Analytics Predictive Insights

Transcription

1 IBM Operations Analytics Predictive Insights Mediation Pack for Spectrum Control Version 1.2 January 2018

2 Agenda Overview Prerequisite Information Spectrum Control Mediation Pack Introduction Spectrum Control Mediation Pack Data and Metrics Installing and Configuring the Spectrum Control Mediation Pack Deploying the Data Model and Data Training Support and Trouble Shooting Operations Analytics Media Resources

3 Overview Spectrum Control provides metric data in CSV format for which the Mediation Pack will use to formulate content into Predictive Insights. IBM Operations Analytics Predictive Insights Mediation Pack for Spectrum Control provides a pre-built model for data ingestion. Predictive Insights creates a performance model that it uses to detect or forecast behavior outside the modeled range, including generating an alarm when an anomalous behavior occurs. Doing so enables organizations to pro-actively avoid system and solution outages before users are impacted. 3

4 Prerequisite Information The Spectrum Control Mediation Pack requires Predictive Insights versions 1.3.3, or to be installed prior to installing the mediation pack. The Spectrum Control Mediation Pack supports Spectrum Control version or higher 4

5 Spectrum Control Solution Overview

6 Spectrum Control Data and Metrics Spectrum Control mediation pack provides metric data in CSV format for which the Mediation Pack will use to formulate content into Predictive Insights. The Spectrum Control mediation pack provides scripts that retrieve the metric from the Spectrum control server every 15 minutes. Data is then sent to a python script on the predictive insight server which then formats the metrics into 5 minute interval CSV files. 6

7 Spectrum Control Performance Metrics Metric Group Name Attributes Metrics StorageSystem Storage System Name Total I/O Rate - overall Write-cache Delay Percentage Total Data Rate Overall Response Time Overall Host Attributed Response Time Percentage Overall Transfer Size Total Back-end I/O Rate Total Back-end Data Rate Overall Back-end Response Time Overall Back-end Queue Time Overall Back-end Transfer Size Total Port I/O Rate Total Port to Host I/O Rate Total Port to Disk I/O Rate Total Port to Local Node I/O Rate Total Port to Remote Node I/O Rate Total Port Data Rate Total Port to Host Data Rate Total Port to Disk Data Rate Total Port to Local Node Data Rate Total Port to Remote Node Data Rate Overall Port to Local Node Response Time Zero Buffer Credit Percentage System CPU Utilization 7

8 Spectrum Control Performance Metrics Metric Group Name Attributes Metrics IOGroups Storage System Name Read Data Rate IO Group name Write Data Rate Read Response Time Write Response Time Metric Group Name Attributes Metrics StoragePorts Storage System Port Send I/O Rate Name Port Name Port Receive I/O Rate Port Send Data Rate Port Receive Data Rate Link Failure Rate Loss of Sync Rate Loss of Signal Rate CRC Error Rate Zero Buffer Credit Percentage Metric Group Name Attributes Metrics Nodes Storage System Name Node Utilization Percentage Node Name System CPU Utilization Zero Buffer Credit Percentage Port to Local Node Send Response Time Port to Remote Node Send Response Time 8

9 Spectrum Control Performance Metrics Metric Group Name Attributes Metrics Volumes Storage System Name Read I/O Rate - overall Volume Name Write I/O Rate - overall Write-cache Delay I/O Rate Read Data Rate Write Data Rate Read Response Time Write Response Time Overall Host Attributed Response Time Percentage Overall Transfer Size Metric Group Name Attributes Metrics HostConnections Storage System Read I/O Rate - overall Host Connection Write I/O Rate - overall Read Data Rate Write Data Rate Read Response Time Write Response Time 9

10 Installing and Configuring

11 Mediation Pack Contents The following directories are contained in the Mediation Pack: SpectrumControl_MedPack_v1.2.0.zip Pack organization /config /on_pi_server /on_spectrum_control_server /windows /AIX /linux /docs /license /bin /on_pi_server /on_spectrum_control_server /windows /AIX /linux /pamodel /etc /sample 11

12 Mediation Pack Contents /config The windows directory in the on_spectrum_control directory contains the allstoragesystems.txt and mediationprops.txt files which are needed for the batch script run.bat on the spectrum control (windows) server along with plink.exe and pscp.exe for transferring file from the windows server to the RHEL Predictive Insights server. The AIX directory in the on_spectrum_control directory contains the allstoragesystems.txt and the mediationprops.txt files which are needed for the bash script run.sh on the spectrum control server. The linux directory in the on_spectrum_control directory contains the allstoragesystems.txt, and the mediationprops.txt files which are needed for the bash script run.sh on the spectrum control server. The on_pi_server directory contains the spectrumcontrol_props.txt and the spectrumcontrol_config.json files, which are required for the python script on the Predictive Insights server. 12

13 Mediation Pack Contents /docs Contains the Users Guide for Mediation Pack of Spectrum Control for deploying and configuring the Mediation Pack. Spectrumctl_MediationPack_UserGuide_v1.2.0.pdf This is a deployment procedural guide to deploy the Spectrum Control mediation pack into the Predictive Insights environment. Spectrumctl_MediationPack_Readme_v1.2.0.txt This is a text document for the deployment procedures of the Spectrum Control mediation pack. /license Text license files for governing the use of the Mediation pack. 13

14 Mediation Pack Contents Continued /bin directory contents on_spctrum_control_server directory: run.bat (Use if Spectrum Control is on Windows), run_aix.sh (Use if Spectrum Control is on AIX), run_linux.sh (Use if Spectrum Control is on Linux): The run.bat or run.sh scripts reside on the spectrum control server. These scripts execute the exportperformancedata script of Spectrum Control to collect the data from the Spectrum Control for the storage systems names that are given in the allstoragesystems.txt file. After successful collection, these scripts transfer the raw files (performance reports) from the Spectrum control server to the Predictive Insights server. After the transfer is complete, the script deletes the raw files from the Spectrum Control directory. Then the run.bat or run.sh executes the Python script on the Predictive Insights server remotely to produce files for ingestion in Predictive Insights. 14

15 Mediation Pack Contents Continued /bin directory contents on_pi_server directory: spectrumcontrol.sh (Bash script to be placed on PI server) This script resides on the Predictive Insights server in the directory of the user s choice. This script executes the Python script from the same directory. The Python script takes the files that have arrived from the Spectrum Control server and converts them into five-minute csv files with the metrics that are configured in the spectrumcontrol_config.json file. spectrumcontrol_generator.py (Python script to be placed on PI server) This Python resides on the PI server in the same directory as the spectrumcontrol.sh script. Users should not edit this script. 15

16 Mediation Pack Contents Continued /pamodel directory contents Core files used in the Mediation Pack representing the Predictive Insights model consisting of all attributes and metric definitions. SpectrumControl_2.pamodel The SpectrumControl_2.pamodel file is a PI model file which consists of all attributes and metric definitions. This file consists of all metric group definitions. Import this file into mediation tool. /sample directory contents Contains a sample CSV file representing the captured data streams that can be used to try the Mediation Pack output in the Operations Analytics Predictive Insights product. There are two five-minute interval files per metric group. 16

17 Configuring the Mediation Pack The following slides describe the steps that are necessary to add the Mediation Pack to your Operations Analytics Predictive Insights system. The first major steps are to setup and configure the scripts that will be executing on the Spectrum Control Server and the Predictive Insights Server. The second major step is to Configure the Data Model. The last step is to create the topic. 17

18 Configuring the Mediation Pack Overview of the Scripts Execution on Spectrum Control and Predictive Insights Servers Every 15 minutes, the run.bat or run.sh script will execute the exportperformancedata.bat or.sh script which comes out of the box with Spectrum Control. The run.bat or run.sh script will form a command to execute by reading mediationprops.txt, allstoragesystems.txt. After execution, the metric files will be stored on the spectrum control server at the location given by user in the mediationprops.txt. These files will be then transferred to the Predictive Insights server as per the path given by the user, followed by deletion of the files from the Spectrum Control server. After a successful transfer, a Python script on the Predictive Insights server will be executed remotely by run.bat or run.sh to produce 5-minute interval files on the PI server. The Python script will take the transferred files from the Spectrum Control server as input files and produce 5-minute files with selected metrics, in the location per the user s preference, given in spectrumcontrol_props.txt file, which resides on the PI server. 18

19 Configuring the Mediation Pack Setting up the scripts on the Spectrum Control Server 1. Copy the files run.sh or run.bat, mediationprops.txt, allstoragesystems.txt on the Spectrum Control server in a new directory from the relevant OS directories of the mediation pack (Upload the plink.exe and pscp.exe if Spectrum Control is running on Windows operating system). 2. Edit the Field descriptions for properties in the mediationprops.txt file as follows: UserName: - The Spectrum Control UserName, given for extraction of the data Password: - Spectrum Control Password Server: - Spectrum Control Server IP/HostName Port: - Spectrum Control Port Number Destination: - Location where Spectrum Control files dump are to be stored on the Spectrum Control server. The user must have read/write permissions to this directory as every 15 minutes, new files are going to be placed along with the deletion of the old files. Script: - The location of the exportperformancedata script on the Windows/AIX Spectrum Control server. restypes: - The metric groups that user wants to be extracted for StorageSystems. (For the StorageSystems given in allstoragesystems.txt file) (e.g. Nodes, Ports, Volumes, StorageSystem, HostConnections, IOGroups etc.) PI_User: - Username of the Predictive Insights server. (Usually scadmin) PI_Password: - Password of the Predictive Insights User. PI_FileLocation: - The location where the transferred files from spectrum control server the user wants to hold every 15 minutes (As spectrum control server, this folder will be temporary location to hold files. Every 15 minutes, Python script will read files from here, and delete after processing). Exec_Command: - The path where the spectrumcontrol.sh executable is placed the PI server 19

20 Configuring the Mediation Pack Setting up the scripts on the Spectrum Control Server (continued) 3. Optionally edit the allstoragesystems.txt file which the user can define a sub list of desired storage systems to retrieve metrics from user s environment. If the user wants to retrieve all storage systems metrics, leave this file blank. 4. Make sure that the plink.exe and pscp.exe are copied to the Spectrum Control server if Spectrum Control is running on a windows operating system. 5. Make sure that the run.bat or run.sh script is copied to the Spectrum Control server. The user should not edit this file. Notes: All the above mentioned files should reside in the same directory on the Spectrum Control server. It is recommended that the user edits the files on native operating system. E.g. Properties file for Spectrum Control Linux server should be edited on Linux OS. In case the file to be placed on UNIX server is edited on Windows server, use the dos2unix command to make the file Unix compatible. 20

21 Configuring the Mediation Pack Setting up the scripts on the Predictive Insights Server 1. Download the anaconda package on the Predictive Insights server. Download the installer in a directory of your choice (login using scadmin): $ wget Make the.sh file executable if it is not already. Execute the downloaded.sh file and follow the prompt, it will ask usual questions agreement etc. When prompted, keep the default installation location or change per user s preference. Make a note of installation location. When asked, Do you wish the installer to prepend the Anaconda3 install location to PATH in your /home/scadmin/.bashrc?, Say No. 2. Copy the spectrumcontrol_config.json, spectrumcontrol_props.txt, from the mediation pack /config/on_pi_server directory and the spectrumcontrol_generator.py, spectrumcontrol.sh from the mediation pack /bin/on_pi_server directory to the Predictive Insights server to a new directory of the user s choice. 21

22 Configuring the Mediation Pack Setting up the scripts on the Predictive Insights Server (continued) 3. Edit the spectrumcontrol_props.txt file inputfilespath: - Path where the files are coming from Spectrum Control Server. This path is same as the PI_FileLocation field in mediationprops.txt file on the Spectrum Control server. outputfilespath: - Path where user wants to store five minute files. This will be the directory for Predictive Insights training (make sure path given here is valid and exists). 4. Edit the spectrumcontrol.sh script file and on line 2, enter the path of ~/anaconda3/bin directory which is been created after installing anaconda package. An example is shown below: ANACONDA3_BIN_DIR=/home/scadmin/anaconda3/bin 5. Make the spectrumcontrol.sh script executable using chmod. 6. After configuring the pack on the Predictive Insights server, make a note of the path pointing to the spectrumcontrol.sh script. Enter this path in Exec_Command variable (the last line) in the mediationprops.txt file. Example: Exec_Command=/home/scadmin/SpectrumExt/spectrum_control/spectrumControl.sh 22

23 Configuring the Mediation Pack Setting up SSH Key for Spectrum Control on Unix SSH keys should be set up between Spectrum Control server and Predictive Insights server before executing run.sh/run.bat script. This is required to automate the file transfer. 1. Create the RSA Key Pair on Spectrum Control server using the following: $ ssh-keygen 2. Type Enter when prompted for storing the keys and passphrase (leave empty). 3. Display the pub key using the following command: $ cat ~/.ssh/id_rsa.pub This will output something like below. ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCt3a9tIeK5rPx9p74/KjEVXa6/OODyRp0QLS/sLp8W6iTxFL+Ug ALZlupVNgFjvRR5luJ9dLHWwc+d4umavAWz708e6Na9ftEPQtC28rTFsHwmyLKvLkzcGkC5+A0NdbiDZLa K3K3wgq1jzYYKT5k+IaNS6vtrx5LDObcPNPEBDt4vTixQ7GZHrDUUk5586IKeFfwMCWguHveTN7ykmo2Ey L2rV7TmYq+eY2ZqqcsoK0fzXMK7iifGXVmuqTkAmZLGZK8a3bPb6VZd7KFum3Ezbu4BXZGp7FVhnOMga u2kyeoh/itkpzpcan+dg3naaziccxnii9b4nssgz3mmy4y7 ostechnix@ubuntuserver 4. Copy the entire contents and go to your PI server s console. Create a directory called ssh in the home directory as shown below. User needs to execute the following commands as root user on the Predictive Insights server. 23 $ mkdir -p ~/.ssh 5. Now, append your client system s public key which you generated in the previous step as shown below: echo {Your_public_key_contents_here} >> ~/.ssh/authorized_keys 6. Restart ssh service on the Predictive Insights Server.

24 Configuring the Mediation Pack Transferring files if Spectrum Control is running on Windows If Spectrum control is on Windows, there are different ways to do automate a transfer. For the current version of the pack, after configuration of mediation pack contents on the Spectrum Control server as well as on the Predictive Insights server: For the first time, the user should save the RSA token. This will allow the script to authenticate from next time without a prompt. 1. Execute run.bat script from the command line. 2. For the first execution, the prompt will ask user if the keys should be stored locally in a cache for future reference. 3. Enter a yes response when prompted. 4. Execute the script again. This time the script should completely execute without any prompts. 24

25 Configuring the Mediation Pack Scheduling the run script via a Cron Job using cron-tab 1. Open a Terminal Window (Command Line). 2. Give the shell script the correct permission. For example, if the script is called run.sh, set permission as follows: chmod 755 run.sh 3. Add new cron job to crontab using the following command: crontab e This opens the vi editor for you if your default editor is vi. You can set a different editor using the following: export EDITOR=emacs Create the cron command using the following syntax: */15 * * * * /path_to_run.sh/run.sh This will execute run.sh on Spectrum Control server every 15 minutes. 25

26 Configuring the Mediation Pack Scheduling the run script using the Windows Scheduler 1. Open the Windows Scheduler. 2. In the Menu Bar, click Action > Create Task. 3. In General Tab Enter the name of the task. Make sure you click Run whether user is logged on or not option. Click Next. 26

27 Configuring the Mediation Pack Scheduling the run script using the Windows Scheduler (continued) 4. In the Triggers tab, enter the time you want to run the script for the first time. In Advanced settings Click Repeat task every. Select 15 minutes from the drop down, select Indefinitely in for a duration of drop down. 5. Click Ok. 27

28 Configuring the Mediation Pack Scheduling the run script using the Windows Scheduler (continued) 6. In the Actions tab, select Start a program from Action drop down. Using Browse button, give the location of run.bat script. Enter the parent folder path in Start in box. 28

29 Configuring the Mediation Pack Scheduling the run script using the Windows Scheduler (continued) 7. In the Conditions tab, based on your server environment, select options which will ensure that the script will always be executed every 15 minutes. Click Ok. 29

30 Configuring the Mediation Pack Scheduling the run script using the Windows Scheduler (continued) 8. In the Settings tab, it is recommended to select the following options. Click Ok. If prompted, enter the password to schedule a task. 9. After scheduling, validate the task is successfully running every 15 minutes. After that validate that five minute interval files are present on the Predictive Insights server in the specified directory (in outputfilespath location, given in the spctrumcontrol_props.txt file). 30

31 Configure Data Modeling - Import 1. Copy the SpectrumControl.pamodel file to the Predictive Insight server where the mediation tool is installed. 2. Run $PI_HOME/bin/mediationtool.sh to the launch mediation tool 3. Go to the File menu and click on the import button. 31

32 Configuring the Data Model - Import 4. Select the Predictive Insights Model in the menu and click on Next 32

33 Configuring the Data Model - Import 5. Select the SpectrumControl_2.pamodel file and click on ok 6. When prompted click on finish to complete the import process 33

34 Configuring the Data Model Data Source 7. Enter the Spectrum Control File System details as shown below. Note make sure the Time Zone is set to UTC. 34

35 Configuring the Data Model Verify Data Source To preview the data in the mediation tool click on the icon shown circled in red. The data will appear at the bottom of the screen. 35

36 Configuring the Data Model Create Topic Use the following steps to define a topic for handling the data flow in the Mediation Pack. 1. Login into the Predictive Insight server as scadmin 2. Change to the $PI_HOME/bin directory 3. Create the topic using the./admin.sh tool../admin.sh create_topic TPC 4../admin.sh set -t=tpc system.aggregation.interval The aggregation interval will depend on data collection interval in the monitoring source. In the command above the interval is set for 5 minutes. 36

37 Deploying the Model and Data Training Process

38 Deploy Mediation Pack Follow these steps to deploy the defined model for representing the data flow in Predictive Insights. 1. Right click on the model file and select the Deploy Model option. 38

39 Deploy Model for Mediation Pack 2. Enter the hostname, database and port number. Deploy model SpectrumControl.pamodel to Predictive Insights system hostname 39

40 Start Data Training Follow these steps to start the training process and test the mediation pack 1. Login into the Predictive Insight server as scadmin 2. Change to the $PI_HOME/bin directory 3. Run /start.sh -t=tpc (to start the topic) 4. Execute the following command:./admin.sh run_extractor_instance t=tpc s= Note: -s start time is based on your warehouse data. 40

41 Review the Data Training Process 1. Once the training has started you will see the events below in the Active event list screen capture. 2. Login in to the console using the following url: 3. User name : ncoadmin 4. Enter the ncoadmin password 5. You can see list events showing status about training process in Active event list. 41

42 Reviewing Anomalies 1. Login in to the console using the following url: 2. User name: ncoadmin 3. Enter the ncoadmin password 4. Navigate to the Detected Anomalies page 42

43 Reviewing Anomalies 5. Right click on an anomaly and select ServiceDiagnosis tool 43

44 Reviewing Anomalies Review the effected metrics and behavior of the metrics for the time period. 44

45 Trouble Shooting and Support To get assistance from the IBM support team, you may open a Problem Management Record (PMR). Describe the problem encountered providing the following information that must be attached to the PMR: Product Name: IBM Operations Analytics Predictive Insights or IBM Operations Analytics Advance Insights Product Version: or higher <Product version(s) on which you are using this Mediation Pack> Mediation Pack: Mediation Pack for Spectrum Control Mediation Pack Version:

46 Trouble Shooting and Support Include the following when opening the PMR : Sample extracted CSV files, which are being ingested into Predictive Insights. Found in folder $PI_HOME/var/spool/topics/<topicname>/extracted/ Data source connectivity status screenshot Predictive Insights log files ($PI_HOME/log/topicname/) when the problem occurred while using the mediation pack. Use the command $PI_HOME/bin/collect.sh -t=<topicname> A screen shot of the error message that is generated while using the mediation pack. A specific use case scenario(s) where problem occurred while using the mediation pack. 46

47 IBM Operations Analytics Media Resources IBM Marketplace Information Covering Benefits Featured Videos Demo Client Case Studies Purchase Information Webinars Information Resources Trials IBM Operations Analytics Community Information Covering Blogs Documentation How-Tos Videos Integrations (Insight and Medication Packs) Forum

48 Notices and disclaimers Copyright 2018 by International Business Machines Corporation (IBM). No part of this document may be reproduced or transmitted in any form without written permission from IBM. U.S. Government Users Restricted Rights use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM. Information in these presentations (including information relating to products that have not yet been announced by IBM) has been reviewed for accuracy as of the date of initial publication and could include unintentional technical or typographical errors. IBM shall have no responsibility to update this information. This document is distributed as is without any warranty, either express or implied. In no event shall IBM be liable for any damage arising from the use of this information, including but not limited to, loss of data, business interruption, loss of profit or loss of opportunity. IBM products and services are warranted according to the terms and conditions of the agreements under which they are provided. IBM products are manufactured from new parts or new and used parts. In some cases, a product may not be new and may have been previously installed. Regardless, our warranty terms apply. savings or other results in other operating environments may vary. References in this document to IBM products, programs, or services does not imply that IBM intends to make such products, programs or services available in all countries in which IBM operates or does business. Workshops, sessions and associated materials may have been prepared by independent session speakers, and do not necessarily reflect the views of IBM. All materials and discussions are provided for informational purposes only, and are neither intended to, nor shall constitute legal or other guidance or advice to any individual participant or their specific situation. It is the customer s responsibility to insure its own compliance with legal requirements and to obtain advice of competent legal counsel as to the identification and interpretation of any relevant laws and regulatory requirements that may affect the customer s business and any actions the customer may need to take to comply with such laws. IBM does not provide legal advice or represent or warrant that its services or products will ensure that the customer is in compliance with any law. Any statements regarding IBM's future direction, intent or product plans are subject to change or withdrawal without notice. Performance data contained herein was generally obtained in a controlled, isolated environments. Customer examples are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual performance, cost, 48 1/30/2018

49 Notices and disclaimers continued Information concerning non-ibm products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products in connection with this publication and cannot confirm the accuracy of performance, compatibility or any other claims related to non-ibm products. Questions on the capabilities of non-ibm products should be addressed to the suppliers of those products. IBM does not warrant the quality of any third-party products, or the ability of any such third-party products to interoperate with IBM s products. IBM expressly disclaims all warranties, expressed or implied, including but not limited to, the implied warranties of merchantability and fitness for a particular, purpose. The provision of the information contained herein is not intended to, and does not, grant any right or license under any IBM patents, copyrights, trademarks or other intellectual property right. IBM, the IBM logo, ibm.com, Aspera, Bluemix, Blueworks Live, CICS, Clearcase, Cognos, DOORS, Emptoris, Enterprise Document Management System, FASP, FileNet, Global Business Services, Global Technology Services, IBM ExperienceOne, IBM SmartCloud, IBM Social Business, Information on Demand, ILOG, Maximo, MQIntegrator, MQSeries, Netcool, OMEGAMON, OpenPower, PureAnalytics, PureApplication, purecluster, PureCoverage, PureData, PureExperience, PureFlex, purequery, purescale, PureSystems, QRadar, Rational, Rhapsody, Smarter Commerce, SoDA, SPSS, Sterling Commerce, StoredIQ, Tealeaf, Tivoli Trusteer, Unica, urban{code}, Watson, WebSphere, Worklight, X-Force and System z Z/OS, are trademarks of International Business Machines Corporation, registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at: /30/2018

50 Thanks!