Copyright ITRS Group Ltd. All rights reserved.

Transcription

1

2 Copyright ITRS Group Ltd. All rights reserved. Information in this document is subject to change without notice. The software described in this document is furnished under a license agreement or nondisclosure agreement. The software may be used or copied only in accordance with the terms of those agreements. No part of this publication may be reproduced, stored in a retrieval system, or transmitted in any form or any means electronic or mechanical, including photocopying and recording for any purpose other than the purchaser's personal use without the written permission of ITRS Group Ltd. ITRS Group Ltd 6th Floor, The Bonhill Building, 15 Bonhill Street, London, EC2A 4DN, UK t: +44 (0)

3 Control-M Monitoring Plug-In Introduction Batches in Control-M are defined as a series of jobs. These jobs have relationships and predefined rules to ensure that the jobs run within a specific time window and only after all of the prerequisites (in conditions) are met. Each job has a job name, and each day, a set of jobs is ordered in to run for that current batch. An instance of any given job on a particular day will be allocated a unique order ID. If the job is run multiple times for the same batch, it has a separate instance count. Architecture The Control-M solution is divided into three separate parts: Job Views Service Monitoring Infrastructure Monitoring Prerequisites The following are required to set up the Control-M Monitoring plug-in: Geneos core components: Active Console, Gateway 2 and Netprobe Instrumentation XML-RPC API Java 1.7+ Control-M plug-in with dependent libs (these are included in the lib subdirectory) Control-M plug-in licence: ControlMMonitor.lic. Please contact support@itrsgroup.com for a trial licence. Page 3 of 18

4 Installation Sampler Set up a sampler. This is set up as an API plug-in. 1. Set the name to Jobs. If you wish to change the name, make sure that it matches the name in the ctmemapi.properties file. 2. Set the plugin type to API. <sampler name="jobs"> <plugin> <api></api> </plugin> </sampler> Netprobe Select a netprobe, preferably on the machine where you will be running the plug-in code. In this example, it s called Control-M. Page 4 of 18

5 Managed Entity Set up a managed entity that joins the probe and the sampler. 1. Set the name to Control-M. If you wish to change the name, make sure that this value is used in the ctmemapi.properties file. 2. Set Options to probe, and select the probe you set up in Netprobe. 3. Reference the sampler you set up in Sampler. <managedentity name="control-m"> <probe ref="control-m"></probe> <sampler ref="jobs"></sampler> </managedentity> Page 5 of 18

6 Control-M Permissions Using the Control-M client, ensure that the user has permissions to view the jobs that you want to see. The easiest way to do this is to add the User to the Browse Group. If you wish to see all the BIM reports, make sure this is set in the Privileges tab: And double-check the Services tab: Page 6 of 18

7 Java The plug-in requires Java 1.7+ (min 1.7.0_15). Make sure Java is correctly configured on the server on which the plug-in will run. Page 7 of 18

8 Control-M Plug-In with Dependent Libs Create a directory on the server where you are running the netprobe you want to use to monitor Control-M. Copy the contents of the tar file to this location. The following is displayed: ControlmMonitor/ ControlmMonitor.jar ctmemapi.properties (You can rename the default.properties file to get you started) BMC_JNI.dll jacorb.properties log4j.properties lib/ antlr jar avalon-framework jar bdit.jar classes.jar commons-codec-1.3.jar concurrent jar emapi.jar jacorb.jar jbcl.jar log4j jar log4j jar logkit-1.2.jar NamingViewer.jar ws-commons-util jar xercesimpl.jar xml-apis.jar xmlrpc-client jar xmlrpc-common jar xmlrpc-server jar xmldata/ EMAPI_700 EMAPI_800 EMAPI_register EMAPI_unregister List_Services retrieve_jobs SOAP_env jobview/ All_jobs Failed_Jobs Running_Jobs Waiting_Jobs Page 8 of 18

9 Plug-In Configuration ctmemapi.properties The plug-in uses the same config file as the Control-M API called ctmemapi.properties. In it, set the connection details for the server. Confirm that the ctmemapi.properties file has the correct settings especially: netprobeserver=localhost * netprobeport=7036 ManagedEntity=Control-M Sampler=Jobs #Instance name of the Control-M server (default is the Hostname of the server on which it resides) com.bmc.ctmem.emapi.gsr.hostname= ** #Location of the xml request files com.bmc.ctmem.emapi.xmldatapath=xmldata username= *** password= *** Each plug-in will monitor only one Control-M server. Note: It is possible to have the netprobe run on a different server than the Control-M monitor process. If the probe is going to run on a different server, then you would have to change localhost to some other hostname. Page 9 of 18

10 This setting corresponds to the Control-M server to connect to, which can be found out from the Control-M client as pictured below. In version 8, you can get these details from the Control-M client that is used to connect to the server: In version 7, you can get these details from the Control-M client once you are logged in: The Control-M server is highlighted in red. Note: It is possible to store passwords in an encrypted format by adding the suffix.encrypted to the setting name in the config file. Page 10 of 18

11 Therefore: password=cleartext would become: password.encrypted= f1wsyimqej5xa0n6hz4pcg== Note: It is possible to encrypt the password using a utility that comes with the plug-in, which is the bdit.jar library, located in the lib folder of the plug-in. Run it and pass in the password on the command line to encrypt the password: java -jar bdit.jar <password> Page 11 of 18

12 jacorb.properties In the jacorb.properties file, it is required to set the naming server and port on line 21 with the following syntax: You can get these details from the Control-M client that is used to connect to the server: The naming server and port are highlighted in yellow. Page 12 of 18

13 Logging Configuration The logging is configured using log4j. By default, it is configured to log to the console and a log file (ControlMMonitor.log) that will roll twice a day (AM and PM). The config files are available in the logconfig directory. Move the file that you wish to use into the main directory and make sure it is called log4j2.xml. There are three logging configurations provided: log4j2.xml - logs INFO and above to logs/controlmmonitor.log and archives the file if it gets larger than 10MB. log4j2.verbose.xml - logs INFO and above to logs/controlmmonitor.log and archives the file if it gets larger than 10MB. Also logs everything to controlmmonitor_debug.log. log4j2-test.xml - sends everything to the console. Licence Place the licence file (ControlMMonitor.lic) into the main directory where the ControlmMonitor.jar file is located. Initialisation To run the ControlMMonitor.jar file: java -Dlog4j.configurationFile=log4j2.xml -jar ControlMMonitor.jar Page 13 of 18

14 Configuration The job views are configured in the xml files in the jobview folder. Each xml document in this folder creates a separate view based on the query defined in the ctmem:search_criterion node. Failed Jobs: <Failed_jobs name="failed jobs" group="control-m"> <ctmem:retrieve_jobs_criterion> <ctmem:include> <ctmem:search_criterion> <ctmem:param> <ctmem:name>status</ctmem:name> <ctmem:operator>eq</ctmem:operator> <ctmem:value>ended Not OK</ctmem:value> </ctmem:param> <ctmem:param> <ctmem:name>odate</ctmem:name> <ctmem:operator>eq</ctmem:operator> <ctmem:value>%%odate</ctmem:value> </ctmem:param> </ctmem:search_criterion> </ctmem:include> </ctmem:retrieve_jobs_criterion> </Failed_jobs> Page 14 of 18

15 View Details Job Views The job view is the main feature of the plug-in. It displays a selection of jobs that are currently ordered into your Control-M schedule. There are several job views that are defined out of the box with the plugin: All Jobs - a list of all the jobs that are currently loaded into the environment. Failed Jobs - a list of all the jobs that have failed in the environment. Running jobs - jobs that have not yet completed. Waiting jobs - jobs that have been held for some reason. All the job views have the same column structure. Their contents are defined by the XML soap messages in the jobview folder. You will be able to use these views to filter the jobs be a series of criteria. For example: Criteria DATA_CENTER APPLICATION APPL_TYPE GROUP_NAME MEMNAME JOB_NAME TASK_TYPE CRITICAL Description The data centre to which the job belongs. The name of the application to which the job s group belongs. The external application on which the job runs. The name of the group to which the job belongs. The name of the file that contains the job script. The name of the job. Type of the job (task) to be performed by Control- M. When selected, resources for the job are reserved exclusively for that job as they become available. When all necessary resources are available, the job is executed. Page 15 of 18

16 Criteria CYCLIC Part_of_BIM_service STATUS DELETE_FLAG Run As User HOSTGROUP START_TIME END_TIME Incond Name Incond Date Outcond Name Outcond Date Description When selected, indicates that the current job is cyclic (it should be rerun at specified intervals). Indicates if the job is included in a Business Service. The job execution status. Job was deleted. The user (user ID) on whose behalf the job is executed. This parameter is used by the Control-M security mechanism. The name of the host or host group on which following iterations of a job is run. The start time of the job. The end time of the job. The name of the in-condition. The date of the in-condition. The name of the out-condition. The date of the out-condition. Page 16 of 18

17 Service Monitoring The plug-in integrates with Batch Impact Manager (BIM) to view active services that are currently running. This allows you to: View the detail of services currently running in BIM. View the summary of jobs in each running service and their status including: Maximum / minimum runtimes SLA breaches Display jobs that are related to a BIM service in a job monitoring view. Note: This functionality is only available if you have purchased the optional add-on, Batch Impact Manager ( Page 17 of 18

18 Infrastructure Monitoring Agent Monitoring To monitor the Control-M agents, an instance of the plug-in needs to run on each server where the Agent runs. All of these plug-ins can communicate with an individual netprobe. The plug-in uses information from the Control-M configuration to display information about the Agents, and it uses the command line tool ag_ping to confirm that the agent can correctly communicate with the Control-M server. Note: To reduce the load on the agent servers and the Control-M API, it is best to remove the job views from all the agent servers except one. Server Monitoring With the features available in the standard Geneos product, you are able to monitor the whole scheduling infrastructure and use the menu commands to go from a selected job to display metrics of the server on which the instance of that job is running. We also provide a template to enable monitoring of the Control-M database. Page 18 of 18