EXPRESSCLUSTER X 3.3. Configuration Example. for Linux SAP NetWeaver. 10/3/2016 4th Edition

Transcription

1 EXPRESSCLUSTER X 3.3 for Linux SAP NetWeaver Configuration Example 10/3/2016 4th Edition

2 Revision History Edition Revised Date Description First 10/1/2012 New manual 2 nd 10/25/2013 Changing the setting of the failover groups of ASCS instance and ERS instance 1.2 Mount Point Usage of the scripts Usage of the recovery scripts 3 rd 5/13/ th 10/3/2016 Adding the file constitution of sample scripts Chapter 3 Bundled scripts Adding notes and restrictions Chapter 4 Notes and Restrictions Adopted to SAP NetWeaver 7.4 and RHEL 7.1 and excluded database setup Adopted to SAP NetWeaver 7.5 and RHEL 7.2 Adding the notes for the start.sh of the exec-hostexec1 and exec-hostexec Usage of the scripts Changing the contents of the bundled scripts and their usage Chapter 3 Bundled scripts 3.2 Custom monitor Usage of the scripts Adding the notes Chapter 4 Notes and Restrictions

3 Copyright NEC Corporation All rights reserved. Disclaimer Information in this document is subject to change without notice. NEC Corporation is not liable for technical or editorial errors or omissions in the information in this document. You are completely liable for all risks associated with installing or using the product as described in this manual to obtain expected results and the effects of such usage. The information in this document is copyrighted by NEC Corporation. No part of this document may be reproduced or transmitted in any form by any means, electronic or mechanical,for any purpose, without the express written permission of NEC Corporation. Trademark Information EXPRESSCLUSTER X is a registered trademark of NEC Corporation. SAP,SAP NetWeaver,and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP AG in Germany and in several other countries all over the world. Linux is a registered trademark or trademark of Linus Torvalds in the United States and other countries. RPM is a trademark of Red Hat, Inc. Oracle and logos are trademarks or registered trademarks of Oracle and/or its affiliates. Novell is a registered trademark of Novell, Inc. in the United State and Japan. SUSE is a registered trademark of SUSE LINUX AG, a group company of U.S. Novell. Other product names and slogans written in this manual are trademarks or registered trademarks of their respective companies.

4 Table of Contents Preface... v Section I Configuration example... 9 Chapter 1 Examplary settings of the environment for SAP NW HA Database for SAP NW Mount Points Floating IP An example of setting OS Sample settings for SAP NW Chapter 2 EXPRESSCLUSTER settings Sample configuration of EXPRESSCLUSTER Configuration example for failover groups Example of the configuration of the Monitor Resources Chapter 3 Bundled scripts Exec resources Usage of the scripts Custom monitor Usage of the scripts Usage of the recovery scripts Chapter 4 Notes and Restrictions iv

5 Preface This document describes the creation of a cluster system described in the document [EXPRESSCLUSTER X 3.3 for Linux SAP NetWeaver System Configuration Guide] and gives an example of settings how to operate. Who Should Use This Guide This manual is intended for administrators, who want to build a cluster system, system engineers who want to provide user support, and maintenance personnel. This manual introduces software whose operation in an EXPRESSCLUSTER environment has been checked. The software and setup examples introduced here are for reference only. They are not meant to guarantee the operation of each software product. The introduced software and the example of setting in this document are just reference infomation. There are not warranty of the each software s behavior. EXPRESSCLUSTER X 3.3 for Linux SAP NetWeaver Documentation Set This guide includes the following two documents: EXPRESSCLUSTER X 3.3 for Linux SAP NetWeaver System Configuration Guide EXPRESSCLUSTER X 3.3 for Linux SAP NetWeaver Configuration Example v

6 Conventions In this guide, Note, Important, Related Information are used as follows: Note: Used when the information given is important, but not related to the data loss and damage to the system and machine Important: Used when the information given is necessary to avoid the data loss and damage to the system and machine. Related Information: Used to describe the location of the information given at the reference destination. The following conventions are used in this guide. Convention Usage Example Bold Indicates graphical objects, such as fields, list boxes, menu selections, buttons, labels, icons, etc. Angled bracket within the command line # Monospace (courier) Monospace bold (courier) Monospace italic (courier) Indicates that the value specified inside of the angled bracket can be omitted. Prompt to indicate that a Linux user has logged on as root user. Indicates path names, commands, system output (message, prompt, etc), directory, file names, functions and parameters. Indicates the value that a user actually enters from a command line. Indicates that users should replace italicized part with values that they are actually working with. In User Name, type your name. On the File menu, click Open Database. clpstat -s [-h host_name] # clpcl -s -a /Linux/3.0/eng/server/ Enter the following: # clpcl -s a rpm i expressclsbuilder -<version_number>- <release_number>.i686.rpm vi

7 Related documents EXPRESSCLUSTER X Documentation Set The EXPRESSCLUSTER X manuals consist of the following four guides. The title and purpose of each guide is described below: EXPRESSCLUSTER X Getting Started Guide This guide is intended for all users. The guide covers topics such as product overview, system requirements, and known problems. EXPRESSCLUSTER X Installation and Configuration Guide This guide is intended for system engineers and administrators who want to build, operate, and maintain a cluster system. Instructions for designing, installing, and configuring a cluster system with EXPRESSCLUSTER are covered in this guide. EXPRESSCLUSTER X Reference Guide This guide is intended for system administrators. The guide covers topics such as how to operate EXPRESSCLUSTER, function of each module, maintenance-related information, and troubleshooting. The guide is supplement to the Installation and Configuration Guide. EXPRESSCLUSTER X Integrated WebManager Administrator s Guide This guide is intended for system administrators who manage cluster systems using EXPRESSCLUSTER with Integrated WebManager, and also intended for system engineers who introduce Integrated WebManager. This guide describes detailed issues necessary for introducing Integrated WebManager in the actual procedures. SAP NetWeaver documents For details of SAP NetWeaver please refer to the official SAP documentation available at Make sure to check the Master Guide and the Installation Guide for NetWeaver according to the database you are installing on. SAP NOTEs # : SAP software on Linux: General information # : SAP support terms and 3rd-party Linux kernel drivers # : Red Hat Enterprise Linux 6.x: Installation and Upgrade # : Red Hat Enterprise Linux 7.x: Installation und Upgrade # : SAP memory management system for 64-bit Linux systems # : Linux: Interpreting the output of the command 'free' # : Determining the hardware key (customer key) # : License key for high availability environment # : License key installation # : Linux UUID solutions # : Application servers cannot be started # : 7.20 EXT Kernel Usage # : Support details for NEC EXPRESSCLUSTER # : NEC EXPRESSCLUSTER X: Rolling Kernel Switch in HA environments Note: Related documents and URL in this guide are subject to change without notice. vii

8 Terminology in this guide Provides information of terminology used in this guide. Terminology This product Configuration Guide Configuration Example Connecter for SAP SAP NW ASCS ERS PAS AAS HANA DA Exclusive Description EXPRESSCLUSTER X for Linux SAP NetWeaver EXPRESSCLUSTER X for Linux SAP NetWeaver System Configuration Guide EXPRESSCLUSTER X for Linux SAP NetWeaver Configuration Example The connecter which links with SAP included in this product. SAP NetWeaver ABAP SAP Central Services Instance Enqueue Replication Server Primary Application Server Additional Application Server The SAP HANA database used for SAP NW Diagnostics Agent Failover group for exclusive control of ASCS/ERS instance viii

9 Section I Configuration example Chapter 1 Examplary settings of the environment for SAP NW Chapter 2 EXPRESSCLUSTER settings Chapter 3 Bundled scripts Chapter 4 Notes and Restrictions Section I Configuration example 9

10 10

11 Chapter 1 Examplary settings of the environment for SAP NW Terminology used in this chapter. Terminology SID DASID INO Description SAP System ID Diagnostics Agent SAP System ID Instance Number 1.1. HA Database for SAP NW Since SAP NW can run on several database technologies, e.g. SAP HANA, SAP MaxDB, IBM DB2, Oracle, Microsoft SQLSERVER, this guide assumes there is already a high available database setup in place. If you need help how create an HA setup for your database scenario please follow related EXPRESSCLUSTER documents on Throughout this document the HA database setup will be referred to as database Mount Points The following shows an example of NFS server shares and according mount points for each node needed. Mount Node#1 / Node#2 NFS Server Symboliclink /usr/sap/<sid>/sys/smpmnt/ <SID> fstab(nfs) /usr/sap/trans /opt/nfsroot/saptrans /sapmnt /opt/nfsroot/sapmnt EXPRESSCLUSTER (NAS resource) /usr/sap/<sid>/ascs<ino> /opt/nfsroot/sapascs Section I Configuration example 11

12 Chapter 1 Examplary settings of the environment for SAP NW 1.3. Floating IP The static and floating IPs in the following table have been used for this configuration: Node#1 Node#2 NFS Server Host Name sap1 sap2 NAS1 Interconnect IP(eth0) / / /24 Interconnect IP(eth1) (for shared disk) / / /24 Floating IP(eth0) managesv: /24 ascssv: /24 12 EXPRESSCLUSTER X for Linux SAP NetWeaver Configuration Example

13 Section I Configuration example 13

14 Chapter 1 Examplary settings of the environment for SAP NW 1.4. An example of setting OS An example of settings for Redhat 7.x is shown below. Setting of SELinux Host Name Status sap1 Disabled sap2 Disabled nas1 Disabled Installation and setting of indispensable software Adding nodes to /etc/hosts (or use DNS) Creating mount points Setting for NFS to be mounted at boot time Setting of kernel parameters Setting of limits.conf # yum groupinstall <Group Name> #Group Name base compat-libraries debugging directory-client hardware-monitoring large-systems network-file-system-client perl-runtime storage-client-multipath x11 # yum install uuidd.x86_64 # systemctl start uuidd # systemctl enable uuidd # vi /etc/hosts nas sap sap managesv ascssv # mkdir -p /sapmnt # mkdir -p /sapmnt/<sid> # mkdir -p /usr/sap/<sid>/ascs<ino> # mkdir -p /usr/sap/trans # ln -s /sapmnt/<sid> /usr/sap/<sid>/sys # vi /etc/fstab nas1:/opt/nfsroot/sapmnt /sapmnt nfs defaults 0 0 nas1:/opt/nfsroot/saptrans /usr/sap/trans nfs defaults 0 0 # vi /etc/sysctl.d/sap.conf # SAP settings kernel.sem= vm.max_map_count= Enter the following to apply the setting. # sysctl --system # vi hard nofile soft nofile Sample settings for SAP NW An overview of hostname, instance name and instance number of SAP NW used in this manual is shown below. Host Name Floating IP Address Note managesv ascssv For ASCS For EXPRESSCLUSTER Management Group 14 EXPRESSCLUSTER X for Linux SAP NetWeaver Configuration Example

15 Instance Parameter name Value of the setting SAP NW SID NEC The instance number 10 ASCS The instance name ASCS10 Host name ascssv The instance number 20 ERS1 The instance name ERS20 The instance number 21 ERS2 The instance name ERS21 The instance number 30 PAS The instance name D30 The instance number 40 AAS The instance name D40 The instance number 97 DA1 The instance name SMDA97 The instance number 96 DA2 The instance name SMDA96 Section I Configuration example 15

16 Chapter 1 Examplary settings of the environment for SAP NW 16 EXPRESSCLUSTER X for Linux SAP NetWeaver Configuration Example

17 Chapter 2 EXPRESSCLUSTER settings 2.1. Sample configuration of EXPRESSCLUSTER An example of settings for EXPRESSCLUSTER is shown below. The following table outlines the settings for creating a cluster environment for SAP NW Configuration example for failover groups Parameter name Cluster configuration Heartbeat Node#1 (Server of master) Node#2 1st group (for WebManager) 1st group resource 2nd group (for ASCS) Cluster name The number of servers 2 The number of failover groups 11 The number of monitor resources 21 Lankhb 2 Lanhb 2 Server name IP address of interconnect (Kernel Mode, Priority1) IP address of interconnect (Kernel Mode, Priority2) IP address of interconnect (User Mode, Priority3) IP address of interconnect (User Mode, Priority4) Server name IP address of interconnect (Kernel Mode, Priority1) IP address of interconnect (Kernel Mode, Priority2) IP address of interconnect (User Mode, Priority3) IP address of interconnect (User Mode, Priority4) Group name Server group of run The number of group resources 1 Group resource name Value of the setting cluster sap sap Failover Management Group Failover is possible on all servers Floating ip resource Management IP IP address Group name Startup Server Startup Attribute Failover Attribute Failback Attribute Failover ASCS-Group Failover is possible on all servers Auto Startup Auto Failover Use the startup server settings Manual Failback Section I Configuration example 17

18 Chapter 2 EXPRESSCLUSTER settings Parameter name Failover Exclusive Attribute Stop Dependent group Value of the setting Normal exclusion ERS1-Group PAS-Group ERS2-Group AAS-Group Wait the Dependent Groups when a Cluster Stops 1st group resource Depth 0 2nd group resource Depth 1 3rd group resource Depth 2 The number of group resources 4 Dependency Group resource name Wait the Dependent Groups when a Server Stops floating ip resource Follow the default dependency fip-ascssv IP address Group resource name Dependency Recovery operation at activation Recovery operation at Deactivation Server name Shared name Mount point File system Group resource name Dependent Resources Recovery operation at activation Recovery operation at Deactivation Details Nas resource nas-ascs Follow the default dependency Retry Count 0 Failover Threshold 1 No operation (not activate next resource) Retry Count at Deactivation 0 Stop the cluster service and shutdown OS nas1 /opt/nfsroot/sapascs /usr/sap/nec/ascs10 nfs Execute resource exec-ascs-sap-instance_nec_10 fip-ascssv nas-ascs Retry Count 0 Failover Threshold 1 No operation (not activate next resource) Retry Count at Deactivation 0 Stop the cluster service and shutdown OS Start path : /root/sample/scripts/sap-ascs-instance/ascs_s tart.sh Stop path : /root/sample/scripts/sap-ascs-instance/ascs_s top.sh 4rd group resource Execute resource Refer to Usage of the scripts for how to specify scripts. 18 EXPRESSCLUSTER X for Linux SAP NetWeaver Configuration Example

19 Parameter name Value of the setting Depth 2 Group resource name exec-ascs-sap-service_nec_10 3rd group (for ERS1) Dependent Resources Recovery operation at activation Recovery operation at Deactivation Details Group name Startup Server Startup Attribute Failover Attribute Failback Attribute Failover Exclusive Attribute Start Dependent group fip-ascssv nas-ascs Retry Count 0 Failover Threshold 1 No operation (not activate next resource) Retry Count at Deactivation 0 Stop the cluster service and shutdown OS Start script / start.sh Stop script / stop.sh Failover ERS1-Group Sap1 Manual Startup Auto Failover Use the startup server settings Auto Failback Off ASCS-Group Stop Dependent group The number of group resources 2 1st group resource Depth 0 2nd group resource Depth 0 Group resource name Dependency Recovery operation at activation Recovery operation at Deactivation Details Group resource name Dependency Recovery operation at activation Recovery operation at Deactivation Details Execute resource exec-ers1-sap-instance_nec_20 Follow the default dependency Retry Count 0 Failover Threshold 1 No operation (not activate next resource) Retry Count at Deactivation 0 Stop the cluster service and shutdown OS Start script / start.sh Stop script / stop.sh Execute resource exec-ers1-sap-service_nec_20 Follow the default dependency Retry Count 0 Failover Threshold 1 No operation (not activate next resource) Retry Count at Deactivation 0 Stop the cluster service and shutdown OS Start path : /root/sap_script/scripts/sap-ers-instance/ers_ Section I Configuration example 19

20 Chapter 2 EXPRESSCLUSTER settings Parameter name Value of the setting start.sh Stop path : /root/sap_script/scripts/sap-ers-instance/ers_ stop.sh 4th group (for PAS) 1st group resource Depth 0 2nd group resource Depth 0 5th group (for ERS2) Group name Startup Server Startup Attribute Failover Attribute Failback Attribute Failover Exclusive Attribute Start Dependent group Stop Dependent group The number of group resources 2 Group resource name Dependency Recovery operation at activation Recovery operation at Deactivation Details Group resource name Dependency Recovery operation at activation Recovery operation at Deactivation Details Group name Startup Server Refer to Usage of the scripts for how to specify scripts. Failover PAS-Group sap1 Auto Startup Auto Failover Use the startup server settings Auto Failback Off ASCS-Group Wait the Dependent Groups when a Cluster Stops Execute resource exec-pas-sap-instance_nec_30 Follow the default dependency Retry Count 0 Failover Threshold 1 No operation (not activate next resource) Retry Count at Deactivation 0 Stop the cluster service and shutdown OS Start script / start.sh Stop script / stop.sh Execute resource exec-pas-sap-service_nec_30 Follow the default dependency Retry Count 0 Failover Threshold 1 No operation (not activate next resource) Retry Count at Deactivation 0 Stop the cluster service and shutdown OS Start script / start.sh Stop script / stop.sh Failover ERS2-Group Sap2 20 EXPRESSCLUSTER X for Linux SAP NetWeaver Configuration Example

21 1st group resource Depth 0 Parameter name Startup Attribute Failover Attribute Failback Attribute Failover Exclusive Attribute Start Dependent group Stop Dependent group The number of group resources 2 Group resource name Dependency Recovery operation at activation Recovery operation at Deactivation Details Value of the setting Manual Startup Auto Failover Use the startup server settings Auto Failback Off ASCS-Group Wait the Dependent Groups when a Cluster Stops Execute resource exec-ers2-sap-instance_nec_21 Follow the default dependency Retry Count 0 Failover Threshold 1 No operation (not activate next resource) Retry Count at Deactivation 0 Stop the cluster service and shutdown OS Start path : /root/sap_script/scripts/sap-ers-instance/ers_ start.sh Stop path : /root/sap_script/scripts/sap-ers-instance/ers_ stop.sh 2nd group resource Depth 0 6th group (for AAS) Group resource name Dependency Recovery operation at activation Recovery operation at Deactivation Details Group name Startup Server Startup Attribute Failover Attribute Failback Attribute Refer to Usage of the scripts for how to specify scripts. Execute resource exec-ers2-sap-service_nec_21 Follow the default dependency Retry Count 0 Failover Threshold 1 No operation (not Deactivate next resource) Retry Count at Deactivation 0 Stop the cluster service and shutdown OS Start script / start.sh Stop script / stop.sh Failover AAS-Group Sap2 Auto Startup Auto Failover Use the startup server settings Auto Failback Section I Configuration example 21

22 Chapter 2 EXPRESSCLUSTER settings 1st group resource Depth 0 2nd group resource Depth 0 7th group (for DA1) 1st group resource Depth 0 Parameter name Failover Exclusive Attribute Start Dependent group Stop Dependent group The number of group resources 2 Group resource name Dependency Recovery operation at activation Recovery operation at Deactivation Details Group resource name Dependency Recovery operation at activation Recovery operation at Deactivation Details Group name Startup Server Startup Attribute Failover Attribute Failback Attribute Failover Exclusive Attribute Value of the setting Off ASCS-Group Wait the Dependent Groups when a Cluster Stops Execute resource exec-aas-sap-instance_nec_40 Follow the default dependency Retry Count 0 Failover Threshold 1 No operation (not activate next resource) Retry Count at Deactivation 0 Stop the cluster service and shutdown OS Start script / start.sh Stop script / stop.sh Execute resource exec-aas-sap-service_nec_40 Follow the default dependency Retry Count 0 Failover Threshold 1 No operation (not activate next resource) Retry Count at Deactivation 0 Stop the cluster service and shutdown OS Start script / start.sh Stop script / stop.sh Failover DA1-Group Sap1 Auto Startup Auto Failover Use the startup server settings Auto Failback Off Start Dependent group Stop Dependent group The number of group resources 2 Group resource name Wait the Dependent Groups when a Cluster Stops Execute resource exec-da1-instance_daa_97 22 EXPRESSCLUSTER X for Linux SAP NetWeaver Configuration Example

23 2nd group resource Depth 0 8th group (for DA2) 1st group resource Depth 0 Parameter name Dependency Recovery operation at activation Recovery operation at Deactivation Details Group resource name Dependency Recovery operation at activation Recovery operation at Deactivation Details Group name Startup Server Startup Attribute Failover Attribute Failback Attribute Failover Exclusive Attribute Value of the setting Follow the default dependency Retry Count 0 Failover Threshold 1 No operation (not activate next resource) Retry Count at Deactivation 0 Stop the cluster service and shutdown OS Start script / start.sh Stop script / stop.sh Execute resource exec-da1-service_daa_97 Follow the default dependency Retry Count 0 Failover Threshold 1 No operation (not activate next resource) Retry Count at Deactivation 0 Stop the cluster service and shutdown OS Start script / start.sh Stop script / stop.sh Failover DA2-Group Sap2 Auto Startup Auto Failover Use the startup server settings Auto Failback Off Start Dependent group Stop Dependent group The number of group resources 2 Group resource name Dependency Recovery operation at activation Recovery operation at Deactivation Details Wait the Dependent Groups when a Cluster Stops Execute resource exec-da2-instance_daa_96 Follow the default dependency Retry Count 0 Failover Threshold 1 No operation (not activate next resource) Retry Count at Deactivation 0 Stop the cluster service and shutdown OS Start script / start.sh Stop script / stop.sh Section I Configuration example 23

24 Chapter 2 EXPRESSCLUSTER settings 2nd group resource Depth 0 9th group (for hostexec1) 1st group resource Depth 0 10th group (for hostexec2) Parameter name Group resource name Dependency Recovery operation at activation Recovery operation at Deactivation Details Group name Startup Server Startup Attribute Failover Attribute Failback Attribute Failover Exclusive Attribute Value of the setting Execute resource exec-da2-service_daa_96 Follow the default dependency Retry Count 0 Failover Threshold 1 No operation (not activate next resource) Retry Count at Deactivation 0 Stop the cluster service and shutdown OS Start script / start.sh Stop script / stop.sh Failover hostexec1-group Sap1 Auto Startup Auto Failover Use the startup server settings Auto Failback Off Start Dependent group Stop Dependent group The number of group resources 1 Group resource name Dependency Recovery operation at activation Recovery operation at Deactivation Details Group name Startup Server Startup Attribute Failover Attribute Failback Attribute Failover Exclusive Attribute Wait the Dependent Groups when a Cluster Stops Execute resource exec-hostexec1 Follow the default dependency Retry Count 0 Failover Threshold 1 No operation (not activate next resource) Retry Count at Deactivation 0 Stop the cluster service and shutdown OS Start script / start.sh Stop script / stop.sh Failover hostexec2-group Sap2 Auto Startup Auto Failover Use the startup server settings Auto Failback Off 24 EXPRESSCLUSTER X for Linux SAP NetWeaver Configuration Example

25 Parameter name Start Dependent group Stop Dependent group The number of group resources 1 Value of the setting Wait the Dependent Groups when a Cluster Stops 1st group resource Depth 0 11th group (for Exclusive1) Group resource name Dependency Recovery operation at activation Recovery operation at Deactivation Details Group name Startup Server Startup Attribute Failover Attribute Failback Attribute Failover Exclusive Attribute Execute resource exec-hostexec2 Follow the default dependency Retry Count 0 Failover Threshold 1 No operation (not activate next resource) Retry Count at Deactivation 0 Stop the cluster service and shutdown OS Start script / start.sh Stop script / stop.sh Failover Exclusive-Group1 Sap1 Auto Startup Auto Failover Use the startup server settings Auto Failback Normal exclusion Start Dependent group Stop Dependent group The number of group resources Wait the Dependent Groups when a Cluster Stops 12th group (for Exclusive2) Group name Startup Server Startup Attribute Failover Attribute Failback Attribute Failover Exclusive Attribute Failover Exclusive-Group2 Sap2 Auto Startup Auto Failover Use the startup server settings Auto Failback Normal exclusion Start Dependent group Stop Dependent group The number of group resources Wait the Dependent Groups when a Cluster Stops Section I Configuration example 25

26 Chapter 2 EXPRESSCLUSTER settings Example of the configuration of the Monitor Resources Parameter name Value of the setting 1st monitor resource (create of default) 2nd monitor resource 3rd monitor resource 4th monitor resource (for ASCS instance ENQ) 5th monitor resource (for ASCS instance MSG) Monitor resource name Monitor resource name Monitor Target Monitor Timing Recovery Action Recovery Target Monitor resource name Monitor Target Monitor Timing Recovery Action Recovery Target Monitor resource name Interval Timeout Retry Count Wait Time to start Monitoring Monitor Timing Monitor Log Output Path Rotate log Rotation Size Normal Return Value 0 Recovery Action Recovery Target Recovery Script Execution Count Maximum Reactivation Count Maximum Failover Count Final Action Monitor resource name Interval Timeout Retry Count Wait Time to start Monitoring Monitor Timing Monitor Log Output Path user mode monitor userw NIC Link Up/Down monitor miiw-eth0 Eth0 Always Executing failover to the recovery target ALL Groups NIC Link Up/Down monitor miiw-eth1 Eth1 Always Executing failover to the recovery target ALL Groups custom monitor genw-ascs-instance-enq 120 sec 2 time Active exec-ascs-sap-instance_nec_10 genw.sh Synchronous /opt/nec/clusterpro/log/genw-ascs-instance-enq.log ON byte Custom settings ASCS-Group 1 time Stop the cluster service and shutdown OS custom monitor genw-ascs-instance-msg 120 sec 2 time Active exec-ascs-sap-instance_nec_10 genw.sh Synchronous /opt/nec/clusterpro/log/genw-ascs-instance-msg.log 26 EXPRESSCLUSTER X for Linux SAP NetWeaver Configuration Example

27 6th monitor resource (for ASCS service) 7th monitor resource (for ERS1 instance) Parameter name Rotate log Rotation Size Normal Return Value 0 Recovery Action Recovery Target Recovery Script Execution Count Maximum Reactivation Count Maximum Failover Count Final Action Monitor resource name Interval Timeout Retry Count Wait Time to start Monitoring Monitor Timing Monitor Log Output Path Rotate log Rotation Size Normal Return Value 0 Recovery Action Recovery Target Recovery Script Execution Count Maximum Reactivation Count Maximum Failover Count Final Action Monitor resource name Interval Timeout Retry Count Wait Time to start Monitoring Monitor Timing Monitor Log Output Path Rotate log Rotation Size Normal Return Value 0 Recovery Action Recovery Target Recovery Script Execution Count Value of the setting ON byte Custom settings ASCS-Group 3 time 1 time No operation custom monitor genw-ascs-service 15 sec 60 sec 1 time Active exec-ascs-sap-service_nec_10 genw.sh Synchronous /opt/nec/clusterpro/log/genw-ascs-service.log ON byte Custom settings exec-ascs-sap-service_nec_10 3 time 1 time No operation custom monitor genw-ers1-instance 120 sec 2 time Active exec-ers1-sap-instance_nec_20 genw.sh Synchronous /opt/nec/clusterpro/log/genw-ers1-instance.log ON byte Custom settings exec-ers1-sap-instance_nec_20 1 time Section I Configuration example 27

28 Chapter 2 EXPRESSCLUSTER settings 8th monitor resource (for ERS1 service) 9th monitor resource (for ERS2 instance) Parameter name Maximum Reactivation Count Maximum Failover Count Final Action User Application [Recovery Script] Timeout [Recovery Script] Monitor resource name Interval Timeout Retry Count Wait Time to start Monitoring Monitor Timing Monitor Log Output Path Rotate log Rotation Size Normal Return Value 0 Recovery Action Recovery Target Recovery Script Execution Count Maximum Reactivation Count Maximum Failover Count Final Action Monitor resource name Interval Timeout Retry Count Wait Time to start Monitoring Monitor Timing Monitor Log Output Path Rotate log Rotation Size Normal Return Value 0 Recovery Action Recovery Target Recovery Script Execution Count Maximum Reactivation Count Maximum Failover Count Final Action Value of the setting No operation /root/sample/genw/ers_mon_preaction_wrapper.sh Refer to Usage of the recovery scripts for how to specify recovery script. 5 sec custom monitor genw-ers1-service 15 sec 60 sec 1 time Active exec-ers1-sap-service_nec_20 genw.sh Synchronous /opt/nec/clusterpro/log/genw-ers1-service.log ON byte Custom settings exec-ers1-sap-service_nec_20 3 time No operation custom monitor genw-ers2-instance 120 sec 2 time Active exec-ers2-sap-instance_nec_21 genw.sh Synchronous /opt/nec/clusterpro/log/genw-ers2-instance.log ON byte Custom settings exec-ers2-sap-instance_nec_21 1 time No operation 28 EXPRESSCLUSTER X for Linux SAP NetWeaver Configuration Example

29 10th monitor resource (for ERS2 service) 11th monitor resource (for PAS instance) 12th monitor resource (for PAS service) Parameter name User Application [Recovery Script] Timeout [Recovery Script] Monitor resource name Interval Timeout Retry Count Wait Time to start Monitoring Monitor Timing Monitor Log Output Path Rotate log Rotation Size Normal Return Value 0 Recovery Action Recovery Target Recovery Script Execution Count Maximum Reactivation Count Maximum Failover Count Final Action Monitor resource name Interval Timeout Retry Count Wait Time to start Monitoring Monitor Timing Monitor Log Output Path Rotate log Rotation Size Normal Return Value 0 Recovery Action Recovery Target Recovery Script Execution Count Maximum Reactivation Count Maximum Failover Count Final Action Monitor resource name Interval Value of the setting /root/sample/genw/ers_mon_preaction_wrapper.sh Refer to Usage of the recovery scripts for how to specify recovery script. 5 sec custom monitor genw-ers2-service 15 sec 60 sec 1 time Active exec-ers2-sap-service_nec_21 genw.sh Synchronous /opt/nec/clusterpro/log/genw-ers2-service.log ON byte Custom settings exec-ers2-sap-service_nec_21 3 time No operation custom monitor genw-pas-instance 120 sec 2 time Active exec-pas-sap-instance_nec_30 genw.sh Synchronous /opt/nec/clusterpro/log/genw-pas-instance.log ON byte Custom settings exec-pas-sap-instance_nec_30 3 time No operation custom monitor genw-pas-service 15 sec Section I Configuration example 29

30 Chapter 2 EXPRESSCLUSTER settings 13th monitor resource (for AAS instance) 14th monitor resource (for AAS service) Parameter name Timeout Retry Count Wait Time to start Monitoring Monitor Timing Monitor Log Output Path Rotate log Rotation Size Normal Return Value 0 Recovery Action Recovery Target Recovery Script Execution Count Maximum Reactivation Count Maximum Failover Count Final Action Monitor resource name Interval Timeout Retry Count Wait Time to start Monitoring Monitor Timing Monitor Log Output Path Rotate log Rotation Size Normal Return Value 0 Recovery Action Recovery Target Recovery Script Execution Count Maximum Reactivation Count Maximum Failover Count Final Action Monitor resource name Interval Timeout Retry Count Wait Time to start Monitoring Monitor Timing Monitor Value of the setting 60 sec 1 time Active exec-pas-sap-service_nec_30 genw.sh Synchronous /opt/nec/clusterpro/log/genw-pas-service.log ON byte Custom settings exec-pas-sap-service_nec_30 3 time No operation custom monitor genw-aas-instance 120 sec 2 time Active exec-aas-sap-instance_nec_40 genw.sh Synchronous /opt/nec/clusterpro/log/genw-aas-instance.log ON byte Custom settings exec-aas-sap-instance_nec_30 3 time No operation custom monitor genw-aas-service 15 sec 60sec 1 time Active exec-aas-sap-service_nec_40 genw.sh Synchronous 30 EXPRESSCLUSTER X for Linux SAP NetWeaver Configuration Example

31 15th monitor resource (for DA1 instance) 16th monitor resource (for DA1 service) Parameter name Log Output Path Rotate log Rotation Size Normal Return Value 0 Recovery Action Recovery Target Recovery Script Execution Count Maximum Reactivation Count Maximum Failover Count Final Action Monitor resource name Interval Timeout Retry Count Wait Time to start Monitoring Monitor Timing Monitor Log Output Path Rotate log Rotation Size Normal Return Value 0 Recovery Action Recovery Target Recovery Script Execution Count Maximum Reactivation Count Maximum Failover Count Final Action Monitor resource name Interval Timeout Retry Count Wait Time to start Monitoring Monitor Timing Monitor Log Output Path Rotate log Rotation Size Normal Return Value 0 Recovery Action Recovery Target Recovery Script Execution Value of the setting /opt/nec/clusterpro/log/genw-aas-service.log ON byte Custom settings exec-aas-sap-service_nec_40 3 time No operation custom monitor genw-da1-instance 120 sec 2 time Active exec-da1-instance_daa_97 genw.sh Synchronous /opt/nec/clusterpro/log/genw-da1-instance.log ON byte Custom settings exec-da1-instance_daa_97 3 time No operation custom monitor genw-da1-service 15 sec 60 sec 1 time Active exec-da1-service_daa_97 genw.sh Synchronous /opt/nec/clusterpro/log/genw-da1-service.log ON byte Custom settings exec-da1-service_daa_97 Section I Configuration example 31

32 Chapter 2 EXPRESSCLUSTER settings 17th monitor resource (for DA2 instance) 18th monitor resource (for DA2 service) 19th monitor resource (for hostexec1) Parameter name Count Maximum Reactivation Count Maximum Failover Count Final Action Monitor resource name Interval Timeout Retry Count Wait Time to start Monitoring Monitor Timing Monitor Log Output Path Rotate log Rotation Size Normal Return Value 0 Recovery Action Recovery Target Recovery Script Execution Count Maximum Reactivation Count Maximum Failover Count Final Action Monitor resource name Interval Timeout Retry Count Wait Time to start Monitoring Monitor Timing Monitor Log Output Path Rotate log Rotation Size Normal Return Value 0 Recovery Action Recovery Target Recovery Script Execution Count Maximum Reactivation Count Maximum Failover Count Final Action Monitor resource name Interval Value of the setting 3 time No operation custom monitor genw-da2-instance 120 sec 2 time Active exec-da2-instance_daa_96 genw.sh Synchronous /opt/nec/clusterpro/log/genw-da2-instance.log ON byte Custom settings exec-da2-instance_daa_96 3 time No operation custom monitor genw-aas-service 15 sec 60 sec 1 time Active exec-da2-service_daa_96 genw.sh Synchronous /opt/nec/clusterpro/log/genw-da2-service.log ON byte Custom settings exec-da2-service_daa_96 3 time No operation custom monitor genw-hostexec1 32 EXPRESSCLUSTER X for Linux SAP NetWeaver Configuration Example

33 20th monitor resource (for hostexec2) Parameter name Timeout Retry Count Wait Time to start Monitoring Monitor Timing Monitor Log Output Path Rotate log Rotation Size Normal Return Value 0 Recovery Action Recovery Target Recovery Script Execution Count Maximum Reactivation Count Maximum Failover Count Final Action Monitor resource name Interval Timeout Retry Count Wait Time to start Monitoring Monitor Timing Monitor Log Output Path Rotate log Rotation Size Normal Return Value 0 Recovery Action Recovery Target Recovery Script Execution Count Maximum Reactivation Count Maximum Failover Count Final Action Value of the setting 120 sec 1 time Active exec-hostctl1 genw.sh Synchronous /opt/nec/clusterpro/log/genw-hostexec1.log ON byte Custom settings exec-hostexec1 3 time No operation custom monitor genw-hostexec2 120 sec 1 time Active exec-hostexec2 genw.sh Synchronous /opt/nec/clusterpro/log/genw-hostexec2.log ON byte Custom settings exec-hostexec2 3 time No operation Section I Configuration example 33

34 Chapter 2 EXPRESSCLUSTER settings 34 EXPRESSCLUSTER X for Linux SAP NetWeaver Configuration Example

35 Chapter 3 Bundled scripts Terminology used in this chapter. Terminology Description SID SAP System ID DASID Diagnostics Agent SAP System ID INO Instance Number start.sh Default script for starting exec resource stop.sh Default script for stopping exec resource genw.sh Default script for custom monitor The bundled scripts on the media are stored in the following directory. media/linux/3.3/common/sample The structure of this directory is shown below. Note: If the as_instance_genw.sh, da_instance_genw.sh and ers_instance_genw.sh are not bundled on the media, you can download them form the support portal (Content ID: CPRO-XLA60-61). Section I Configuration example 35

36 Chapter 3 Bundled scripts 3.1. Exec resources Set the following bundled scripts in a media as exec resources. Bundled scripts are listed below. Folder name File name Use SAP-ASCS-instance ascs_post_handler.sh For exclusive control of ASCS/ERS instance ascs_start.sh For starting ASCS instance ascs_stop.sh For stopping ASCS instance SAP-ERS-instance ers_start.sh For exclusive control of ASCS/ERS instance ers_stop.sh For starting ERS instance exclusive_control.sh For stopping ERS instance SAP-HostExec hostexec_start.sh For starting SapHostExec hostexec_stop.sh For stopping SapHostExec SAP-Instance instance_start.sh For starting instance instance_stop.sh For stopping instance SAP-service service_start.sh For starting service service_stop.sh For stopping service Modify SAP user (SAPUSER), SAP System ID (SID), Diagnostics Agent SAP System ID (DASID) and Instance Number (INO) written in the bundled scripts according to the values setting of your installation of SAP NW. During SAP NW installation instance profiles are automatically created for each instance in the global directory /sapmnt/<sid>/profile as well as in the /usr/sap/<dasid>/profile directory on both nodes. The default naming convention is <SID>_<Instance Name>_<Host Name>. An example of profile path of each instance is listed below. Instance Profile path Example /sapmnt/<sid>/profile/<sid>_<instance Name>_<Host Name> ASCS /sapmnt/nec/profile/nec_ascs10_ascssv ERS1 /sapmnt/nec/profile/nec_ers20_sap1 ERS2 /sapmnt/nec/profile/nec_ers21_sap2 PAS /sapmnt/nec/profile/nec_d30_sap1 AAS /sapmnt/nec/profile/nec_d40_sap2 DA1 /usr/sap/daa/sys/profile/daa_smda97_sap1 DA2 /usr/sap/nec/sys/profile/daa_smda96_sap2 36 EXPRESSCLUSTER X for Linux SAP NetWeaver Configuration Example

37 Usage of the scripts The structure of the table is as follows. Failover group name Exec resource name Description ASCS-Group exec-ascs-sap-instance_nec_10 Copy the files of SAP-ASCS-instance directory to any directory. /root/sample/scripts/sap-ascs-instance Assign the execute permission to ascs_post_handler.sh, ascs_start.sh and ascs_stop.sh. # chmod 700 /root/sample/scripts/sap-ascs-instance/ascs_post_handler.sh # chmod 700 /root/sample/scripts/sap-ascs-instance/ascs_start.sh # chmod 700 /root/sample/scripts/sap-ascs-instance/ascs_stop.sh Modify <ASCS_instance_name> of ascs_start.sh and ascs_stop.sh to the fine name of SAP profile of ASCS. NEC_ASCS10_ascssv Modify <directory_path_of_ascs_post_handler.sh> of ascs_start.sh to the absolute path of the directory where ascs_post_handler.sh is placed. /root/sample/scripts/sap-ascs-instance Modify the SAP_ERS_INO of ascs_start.sh to the sequence of ERS1 instance INO and ERS2 instance INO set in "System Configuration Guide" - "Section 5.2." and - Section 5.6. Use a space for delimiter Open the Propaties window of EXEC resource and select the Details tab. Click User Application in the Dedails tab. Enter the absolute path of ascs_start.sh in Start. Enter the absolute path of ascs_stop.sh in Stop. Start path : /root/sample/scripts/sap-ascs-instance/ascs_start.sh Stop path : /root/sample/scripts/sap-ascs-instance/ascs_stop.sh exec-ascs-sap-service_nec_10 Copy the contents of service_start.sh and service_stop.sh to start.sh and stop.sh respectively. Modify <instance name> to the fine name of SAP profile of ASCS. NEC_ASCS10_ascssv Modify <CLUSTER_instance_resource_name> to the exec resource name setting in in the supplied Configuration Guide document. Section I Configuration example 37

38 Chapter 3 Bundled scripts exec-ascs-sap-instance_nec_10 ERS1-Group exec-ers1-sap-instance_nec_20 Copy the files of SAP- ERS-instance directory to any directory. /root/sample/scripts/sap-ers-instance Assign the execute permission to ers_start.sh, ers_stop.sh and exclusive_control.sh. # chmod 700 /root/sap_script/scripts/sap-ers-instance/ers_start.sh # chmod 700 /root/sap_script/scripts/sap-ers-instance/ers_stop.sh # chmod 700 /root/sap_script/scripts/sap-ers-instance/exclusive_control.sh Modify <ERS_instance_name> of ers_start.sh and ers_stop.sh to the fine name of SAP profile of ERS. NEC_ERS20_sap1 Modify <directory_path_of_exclusive_control.sh> of ers_start.sh and ers_stop.sh to the absolute path of the directory where exclusive_control.sh is placed. /root/sap_script/scripts/sap-ers-instance Modify the SAP_ERS_INO of ers_start.sh and ers_stop.sh to the sequence of ERS1 instance INO and ERS2 instance INO set in "System Configuration Guide" - "Section 5.2." and - Section 5.6. Use a space for delimiter Modify the "EXCLUSIVE_GROUP" of ers_start.sh and ers_stop.sh to the common failover group name for exclusive control set in "System Configuration Guide" - "Section 4.4." Open the Propaties window of EXEC resource and select the Details tab. Click User Application in the Dedails tab. Enter the absolute path of ers_start.sh in Start. Enter the absolute path of ers_stop.sh in Stop. Start path : /root/sap_script/scripts/sap-ers-instance/ers_start.sh Stop path : /root/sap_script/scripts/sap-ers-instance/ers_stop.sh exec-ers1-sap-service_nec_20 Copy the contents of service_start.sh and service_stop.sh to start.sh and stop.sh respectively. Modify <instance name> to the fine name of SAP profile of ERS1. NEC_ERS20_sap1 Modify <CLUSTER_instance_resource_name> to the exec resource name setting in in the supplied Configuration Guide document. 38 EXPRESSCLUSTER X for Linux SAP NetWeaver Configuration Example

39 exec-ers1-sap-instance_nec_20 ERS2-Group exec-ers2-sap-instance_nec_21 Copy the files of SAP- ERS-instance directory to any directory. /root/sample/scripts/sap-ers-instance Assign the execute permission to ers_start.sh, ers_stop.sh and exclusive_control.sh. # chmod 700 /root/sap_script/scripts/sap-ers-instance/ers_start.sh # chmod 700 /root/sap_script/scripts/sap-ers-instance/ers_stop.sh # chmod 700 /root/sap_script/scripts/sap-ers-instance/exclusive_control.sh Modify <ERS_instance_name> of ers_start.sh and ers_stop.sh to the fine name of SAP profile of ERS. NEC_ERS21_sap2 Modify <directory_path_of_exclusive_control.sh> of ers_start.sh and ers_stop.sh to the absolute path of the directory where exclusive_control.sh is placed. /root/sap_script/scripts/sap-ers-instance Modify the SAP_ERS_INO of ers_start.sh and ers_stop.sh to the sequence of ERS1 instance INO and ERS2 instance INO set in "System Configuration Guide" - "Section 5.2." and - Section 5.6. Use a space for delimiter Modify the "EXCLUSIVE_GROUP" of ers_start.sh and ers_stop.sh to the common failover group name for exclusive control set in "System Configuration Guide" - "Section 4.4." Open the Propaties window of EXEC resource and select the Details tab. Click User Application in the Dedails tab. Enter the absolute path of ers_start.sh in Start. Enter the absolute path of ers_stop.sh in Stop. Start path : /root/sap_script/scripts/sap-ers-instance/ers_start.sh Stop path : /root/sap_script/scripts/sap-ers-instance/ers_stop.sh exec-ers2-sap-service_nec_21 Copy the contents of service_start.sh and service_stop.sh to start.sh and stop.sh respectively. Modify <instance name> to the fine name of SAP profile of ERS2. NEC_ERS21_sap2 Modify <CLUSTER_instance_resource_name> to the exec resource name setting in in the supplied Configuration Guide document. Section I Configuration example 39

40 Chapter 3 Bundled scripts exec-ers2-sap-instance_nec_20 PAS-Group exec-pas-sap-instance_nec_30 Copy the contents of instance_start.sh and instance_stop.sh to start.sh and stop.sh respectively. Modify <instance name> to the fine name of SAP profile of PAS. NEC_D30_sap1 exec-pas-sap-service_nec_30 Copy the contents of service_start.sh and service_stop.sh to start.sh and stop.sh respectively. Modify <instance name> to the fine name of SAP profile of PAS. NEC_D30_sap1 Modify <CLUSTER_instance_resource_name> to the exec resource name setting in in the supplied Configuration Guide document. exec-pas-sap-instance_nec_30 AAS-Group exec-aas-sap-instance_nec_40 Copy the contents of instance_start.sh and instance_stop.sh to start.sh and stop.sh respectively. Modify <instance name> to the fine name of SAP profile of AAS. NEC_D40_sap2 exec-aas-sap-service_nec_40 Copy the contents of service_start.sh and service_stop.sh to start.sh and stop.sh respectively. Modify <instance name> to the fine name of SAP profile of AAS. NEC_D40_sap2 Modify <CLUSTER_instance_resource_name> to the exec resource name setting in in the supplied Configuration Guide document. exec-aas-sap-instance_nec_40 DA1-Group exec-da1-instance_nec_97 Copy the contents of instance_start.sh and instance_stop.sh to start.sh and stop.sh respectively. Modify <instance name> to the fine name of SAP profile of DA1. DAA_SMDA97_sap1 exec-da1-service_nec_97 Copy the contents of service_start.sh and service_stop.sh to start.sh and stop.sh respectively. Modify <instance name> to fine name of SAP profile of DA1. 40 EXPRESSCLUSTER X for Linux SAP NetWeaver Configuration Example

41 DAA_SMDA97_sap1 Modify <CLUSTER_instance_resource_name> to the exec resource name setting in in the supplied Configuration Guide document. exec-da1-instance_daa_97 DA2-Group exec-da2-instance_nec_96 Copy the contents of instance_start.sh and instance_stop.sh to start.sh and stop.sh respectively. Modify <instance name> to the fine name of SAP profile of DA1. DAA_SMDA96_sap2 exec-da2-service_nec_96 Copy the contents of service_start.sh and service_stop.sh to start.sh and stop.sh respectively. Modify <instance name> to the fine name of SAP profile of DA1. DAA_SMDA96_sap2 Modify <CLUSTER_instance_resource_name> to the exec resource name setting in in the supplied Configuration Guide document. exec-da2-instance_daa_96 hostexec1-group exec-hostexec1 Copy the contents of hostexec_start.sh and hostexec_stop.sh to start.sh and stop.sh respectively. Use the default path of SAP NW for SAPHOSTEXEC and PROFILE. Note: In SAP NW 7.5 or later environment, activation of the exec-hostexec1 may be failed. In that case, add -restart to the end of the line ${SAPHOSTEXEC} pf=${profile} in the start.sh. hostexec2-group exec-hostexec2 Setting like the above exec-hostexec1. Note: In SAP NW 7.5 or later environment, activation of the exec-hostexec2 may be failed. In that case, add -restart to the end of the line ${SAPHOSTEXEC} pf=${profile} in the start.sh. Section I Configuration example 41

42 Chapter 3 Bundled scripts 3.2. Custom monitor Use the following bundled scripts as custom monitor resources. Bundled scripts are listed below. File name as_instance_genw.sh ascs_enq_genw.sh ascs_msg_genw.sh da_instance_genw.sh ers_instance_genw.sh ers_mon_preaction.sh ers_mon_preaction_wrapper.sh service_genw.sh hostexec_genw.sh Use For monitoring the PAS/AAS instance For monitoring ASCS enqueue server For monitoring ASCS message server For monitoring the DA instance For monitoring the ERS instance Recovery script for monitoring the ERS instance Recovery script for monitoring the ERS instance For monitoring instance service For monitoring Saphostexec Note: If the as_instance_genw.sh, da_instance_genw.sh and ers_instance_genw.sh are not bundled on the media, you can download them form the support portal (Content ID: CPRO-XLA60-61). In the same way as in chapter 3.1,modify SAPUSER, SID (SAP System ID), DASID (Diagnostics agent SAP System ID) and INO (Instance Number) used in the bundled scripts according to the values used during the installation of SAP NW Usage of the scripts The structure of the table is as follows. Custom monitor name Description An example of setting: modifying contents included in <>. genw-ascs-instance-enq Copy the contents of ascs_enq_genw.sh to genw.sh. Modify <instance name> to the fine name of SAP profile of ASCS. NEC_ASCS10_ascssv genw-ascs-instance-msg Copy the contents of ascs_msg_genw.sh to genw.sh. Modify <instance name> to the fine name of SAP profile of ASCS. NEC_ASCS10_ascssv genw-ers1-instance genw-ers2-instance Copy the contents of ers_instance_genw.sh to genw.sh. Modify <instance name> to the fine name of SAP profile which corresponds to each instance. 42 EXPRESSCLUSTER X for Linux SAP NetWeaver Configuration Example