FlexFrame for SAP. Version 5.2A. Installation and Configuration of LVM 1.0 Standard Edition. Edition March 2013 Document Version 1.

Transcription

1 FlexFrame for SAP Version 5.2A Installation and Configuration of LVM 1.0 Standard Edition Edition March 2013 Document Version 1.1

2 Fujitsu Limited Copyright Fujitsu Technology Solutions 2012 FlexFrame and PRIMERGY are trademarks or registered trademarks of Fujitsu Limited in Japan and other countries. SAP and NetWeaver are trademarks or registered trademarks of SAP AG in Germany and in several other countries Linux is a registered trademark of Linus Torvalds SUSE Linux is a registered trademark of Novell, Inc., in the United States and other countries Oracle and Java are trademarks of ORACLE Corporation and/or its affiliates Intel and PXE are registered trademarks of Intel Corporation in the United States and other countries MaxDB is a registered trademark of MySQL AB, Sweden MySQL is a registered trademark of MySQL AB, Sweden NetApp and the Network Appliance logo are registered trademarks and Network Appliance and Data ONTAP are trademarks of NetApp, Inc. in the U.S. and other countries. EMC, CLARiiON, Symmetrix and Celerra are trademarks or registered trademarks of EMC Corporation in the United States and other countries VMware, ESX, ESXi, VMware vcenter, VMware vsphere are registered trademarks or trademarks of VMware, Inc. in the United States and/or other jurisdictions. Ethernet is a registered trademark of XEROX, Inc., Digital Equipment Corporation and Intel Corporation Windows and Word are registered trademarks of Microsoft Corporation All other hardware and software names used are trademarks of their respective companies. All rights, including rights of translation, reproduction by printing, copying or similar methods, in part or in whole, are reserved. Offenders will be liable for damages. All rights, including rights created by patent grant or registration of a utility model or design, are reserved. Delivery subject to availability. Right of technical modification reserved.

3 Contents 1 Introduction Requirements Notational Conventions... 1 Document History Related Documents General Preparations Required Software for LVM Installation Known Issues Documentation Installation and Configuration SAP NW 7.3 Installation Prepare LVM Installation Setup Virtual Interfaces Prepare Installation Directories SCS Instance DB Instance Primary Application Server Instance Support Package Installation LVM Installation Post Installation Activities Performance Setup NetWeaver Initial Setup LVM Initial Setup Installation and Configuration of SAP Host Agent Setup User Exit and Host Profile Start SAP Host Agent Configuration of LVM Setup LVM Pools and Infrastructure Configuration Virtualization Manager Configuration Configure Resources Configure SAP Services Start/Stop/Relocate Services Same SID in Different Pools Troubleshooting Resource Unlock Abbreviations Installation and Configuration of LVM 1.0 Standard Edition

4 Contents 6 Glossary Index

5 1 Introduction 1.1 Requirements This document addresses administrators on FlexFrame environments. We assume that the reader of this document has technical background knowledge in the areas of operating systems Linux, IP networking and SAP basis. 1.2 Notational Conventions The following conventions are used in this manual: Additional information that should be observed. Warning that must be observed. fixed font <fixed font> fixed font Names of paths, files, commands, and system output. Names of variables. User inputs in command examples (if applicable using <> with variables). 1.3 Document History Document Version Changes Date 1.0 First Edition Chapter 3, Related Documents FlexFrame for SAP Administration and Operation FlexFrame for SAP HW Characteristics Quickguides FlexFrame for SAP Management Tool FlexFrame for SAP Installation Guide for SAP Solutions FlexFrame for SAP Installation of a FlexFrame Environment Installation and Configuration of LVM 1.0 Standard Edition 1

6 Contents FlexFrame for SAP myamc.fa_agents Installation and Administration FlexFrame for SAP myamc.fa_messenger Installation and Administration FlexFrame for SAP myamc.fa_logagent Installation and Administration FlexFrame for SAP Network Design and Configuration Guide FlexFrame for SAP Security Guide FlexFrame for SAP Technical White Paper FlexFrame for SAP Upgrading FlexFrame 5.0A or 5.1A to 5.2A ServerView Documentation SUSE Linux Enterprise Server Documentation 2

7 2 General Preparations 2.1 Required Software for LVM Installation SAP NW 7.3 (Java only) with a released DB and OS version and final support packages (only SP for Application Server Java is needed) SAP NW LVM 1.0 final Support Package The final SAP HOST AGENT from The JCE Unlimited Strength Jurisdiction Policy Files 6.0 are available as a free download at: html 2.2 Known Issues 2.3 Documentation The following documents provide detailed information on SAP LVM: This Installation Guide (Fujitsu) The actual SAP documentation is available on or Special SAP LVM notes: , FF52A_Installation_Guide_for_SAP_Solutions (Fujitsu) Before installing SAP NetWeaver on FlexFrame, please refer to the original SAP installation guide. Get the final SAP Notes from: Screenshots in this document could be different from the current Service Pack of LVM1.0. Installation and Configuration of LVM 1.0 Standard Edition 3

8 General Preparations Documentation Sample system for this document: This document refers to the following examples: LVM = SID for NW7.3 (LVM) installation bx620-1 = Host for LVM installation j00lvm = Virtual host name of LVM system cn1 = Control Node 1 bx620-x,vmx-xx = App Nodes L7S = Managed Service 4

9 3 Installation and Configuration First of all you have to decide in which way you want to integrate the LVM in the FlexFrame environment: 1. Install a LVM in every pool (go on with chapter 3.1). 2. Install a LVM once only in any pool, connect other pools via network routing and setup hostnames: Setup hostnames of SAP Services and Resources from your pools (e.g. p1 and p2) to LVM host/pool : bx620-3:/ # getent hosts app01l7s app01l7s.fts.rot.com p2-app01l7s app01l7s.fts.rot.com app01l7s-se p2-app01l7s-se app01l7s-se.fts.rot.com app02l7s app02l7s.fts.rot.com p2-app02l7s app02l7s.fts.rot.com app02l7s-se p2-app02l7s-se app02l7s-se.fts.rot.com dbl7s-se p2-dbl7s-se dbl7s-se.fts.rot.com cil7s cil7s.fts.rot.com p2-cil7s cil7s.fts.rot.com cil7s-se p2-cil7s-se cil7s-se.fts.rot.com Insert all hosts from other pools in /etc/hosts of pool com cn1:/ # cd /FlexFrame/volFF/os/Linux/pool_img/com/etc cn1:/flexframe/volff/os/linux/pool_img/com/etc # vi hosts bx620-1-se bx620-1-st bx bx620-2-se bx620-2-st cn1-com cn cn1-com-se cn1-se cn1-com-st cn1-st cn2-com cn cn2-com-se cn2-se cn2-com-st cn2-st filer2-com-st bx app01l7s app01l7s.fts.rot.com p2-app01l7s app01l7s.fts.rot.com Installation and Configuration of LVM 1.0 Standard Edition 5

10 Installation and Configuration Documentation app01l7s-se p2-app01l7s-se app01l7s-se.fts.rot.com app02l7s app02l7s.fts.rot.com p2-app02l7s app02l7s.fts.rot.com app02l7s-se p2-app02l7s-se app02l7s-se.fts.rot.com dbl7s-se p2-dbl7s-se dbl7s-se.fts.rot.com cil7s cil7s.fts.rot.com p2-cil7s cil7s.fts.rot.com cil7s-se p2-cil7s-se cil7s-se.fts.rot.com vcenter rx rx300-1-se vm vm9-1-se vm vm9-2-se -- INSERT -- Don t forget to update the /etc/hosts for pool (LVM), if you create new hosts or SAP services in your pools! Take care that your vcenter (if existent) is reachable from LVM host! 6

11 SAP NW 7.3 Installation Installation and Configuration 3.1 SAP NW 7.3 Installation Please make sure that the FA Application Agents are stopped on the hosts that you are installing SAP Software on. Please check the FF Installation Guide for SAP Solutions for additional hints installing SAP NW 7.3 in FlexFrame Prepare LVM Installation cn1:/ # ff_sid_adm.pl --op add --pool com --sid LVM --sapversion db MAXDB78: sap scs:01: : sap jc:00: : cn1:/ # ff_sid_adm.pl --op add --pool com --sid DAA --sapversion smd 97:j00lvm cn1:/ # ff_setup_sid_folder.sh -p com -s LVM cn1:/ # ff_setup_sid_folder.sh -p com -s DAA Setup Virtual Interfaces bx620-1: / # ff_service.sh -s LVM -a istart -t db bx620-1: / # ff_service.sh -s LVM -a istart -t scs bx620-1: / # ff_service.sh -s LVM -a istart -t j -i Prepare Installation Directories bx620-1:/ # cd /usr/sap/lvm/ bx620-1:/usr/sap/lvm # mkdir install Installation and Configuration of LVM 1.0 Standard Edition 7

12 Installation and Configuration SAP NW 7.3 Installation bx620-1:/usr/sap/lvm # cd install bx620-1:/usr/sap/lvm/install # mkdir SCS DB J00 bx620-1:/usr/sap/lvm/install # chmod -R 777../install bx620-1:/usr/sap/lvm/install # mount -t nfs filer2-comst:/vol/volff/flexframe/stage /sapcd SCS Instance Path to the SAP Software: /FlexFrame/volFF/FlexFrame/stage/SAP/NW7.3/ bx620-1:/usr/sap/lvm/install # cd SCS bx620-1:/usr/sap/lvm/install/scs # /sapcd/sap/nw7.3/im_kernel/data_units/nw730_im_linux_x86_64_ada/sapi nst -extract keydb.xsl: ok librfcum.so: ok sapjvmmanifest.mf: ok Done bx620-1:/usr/sap/lvm/install/scs # vi sapinst # set umask to prevent unauthorized read umask 022 bx620-1:/usr/sap/lvm/install/scs #./sapinst SAPINST_USE_HOSTNAME=scslvm /sapcd/sap/nw7.3/im_kernel/data_units/nw730_im_linux_x86_64_ada/ product.catalog 8

13 SAP NW 7.3 Installation Installation and Configuration Select under SAP Systems -> Application Server Java -> Distributed System -> Central Services Instance (SCS). Installation and Configuration of LVM 1.0 Standard Edition 9

14 Installation and Configuration SAP NW 7.3 Installation Select Custom mode. Follow up the FlexFrame installation procedure! 10

15 SAP NW 7.3 Installation Installation and Configuration DB Instance Path to the SAP Software: /FlexFrame/volFF/FlexFrame/stage/SAP/NW7.3/ bx620-1: /usr/sap/lvm/install # cd DB bx620-1:/usr/sap/lvm/install/db # /sapcd/sap/nw7.3/im_kernel/data_units/nw730_im_linux_x86_64_ada/sapi nst -extract keydb.xsl: ok librfcum.so: ok sapjvmmanifest.mf: ok Done bx620-1:/usr/sap/lvm/install/db # vi sapinst # set umask to prevent unauthorized read umask 022 bx620-1:/usr/sap/lvm/install/db #./sapinst SAPINST_USE_HOSTNAME=dblvm-se /sapcd/sap/nw7.3/im_kernel/data_units/nw730_im_linux_x86_64_ada/prod uct.catalog Installation and Configuration of LVM 1.0 Standard Edition 11

16 Installation and Configuration SAP NW 7.3 Installation Select SAP Systems -> Application Server Java -> Distributed System -> Database Instance. 12

17 SAP NW 7.3 Installation Installation and Configuration Select Custom mode. Installation and Configuration of LVM 1.0 Standard Edition 13

18 Installation and Configuration SAP NW 7.3 Installation Use FlexFrame path for saplog and sapdata. 14

19 SAP NW 7.3 Installation Installation and Configuration Follow up the FlexFrame installation procedure! Installation and Configuration of LVM 1.0 Standard Edition 15

20 Installation and Configuration SAP NW 7.3 Installation Primary Application Server Instance Path to the SAP Software: /FlexFrame/volFF/FlexFrame/stage/SAP/NW7.3/ bx620-1:/usr/sap/lvm/install # cd J00 bx620-1:/usr/sap/lvm/install/j00 # /sapcd/sap/nw7.3/im_kernel/data_units/nw730_im_linux_x86_64_ada/sapi nst -extract keydb.xsl: ok librfcum.so: ok sapjvmmanifest.mf: ok Done bx620-1:/usr/sap/lvm/install/j00 # vi sapinst # set umask to prevent unauthorized read umask 022 bx620-1:/usr/sap/lvm/install/j00 #./sapinst SAPINST_USE_HOSTNAME=j00lvm /sapcd/sap/nw7.3/im_kernel/data_units/nw730_im_linux_x86_64_ada/prod uct.catalog 16

21 SAP NW 7.3 Installation Installation and Configuration Select under SAP Systems-> Application Server Java -> Distributed System -> Primary Application Server Instance. Installation and Configuration of LVM 1.0 Standard Edition 17

22 Installation and Configuration SAP NW 7.3 Installation Select Custom mode. Follow up the FlexFrame installation procedure! 18

23 SAP NW 7.3 Installation Installation and Configuration Support Package Installation Please install the final Support Packages for NW 7.3 only SP for Application Server Java is needed (minimum SP03). Copy the relevant packages and stack.xml file to the EPS inbox. bx620-1:/ # ssh -X lvmadm@bx620-1 Password: j00lvm:lvmadm 4> cd /usr/sap/lvm/j00/j2ee/jspm j00lvm:lvmadm 5>./go... Installation and Configuration of LVM 1.0 Standard Edition 19

24 Installation and Configuration SAP NW 7.3 Installation Insert password for administrator and press Log On. 20

25 SAP NW 7.3 Installation Installation and Configuration Select Single Support Packages and press button Next. Installation and Configuration of LVM 1.0 Standard Edition 21

26 Installation and Configuration SAP NW 7.3 Installation Press button Next. 22

27 SAP NW 7.3 Installation Installation and Configuration If status is OK press button Start. Installation and Configuration of LVM 1.0 Standard Edition 23

28 Installation and Configuration SAP NW 7.3 Installation Insert password press button Proceed. 24

29 SAP NW 7.3 Installation Installation and Configuration Press button Exit. Installation and Configuration of LVM 1.0 Standard Edition 25

30 Installation and Configuration SAP NW 7.3 Installation Enter password and press button Log On. 26

31 SAP NW 7.3 Installation Installation and Configuration Press button Next. Installation and Configuration of LVM 1.0 Standard Edition 27

32 Installation and Configuration SAP NW 7.3 Installation Enter password and press button Proceed. 28

33 SAP NW 7.3 Installation Installation and Configuration Press button Exit. Installation and Configuration of LVM 1.0 Standard Edition 29

34 Installation and Configuration LVM Installation 3.1 LVM Installation After finishing the NW 7.3 and SP installation successfully, proceed with the LVM installation: Copy the final version of LVM VCM sca files to /usr/sap/trans/eps/in. VCM_ENT is only necessary for LVM Enterprise version. bx620-1:/ # ssh -X lvmadm@bx620-1 Password: bx620-1:lvmadm 4> cd /usr/sap/lvm/j00/j2ee/jspm bx620-1:lvmadm 5>./go... 30

35 LVM Installation Installation and Configuration Insert password for administrator and press Log On. Installation and Configuration of LVM 1.0 Standard Edition 31

36 Installation and Configuration LVM Installation Select New Software Components. Press button Next. 32

37 LVM Installation Installation and Configuration The first component to deploy should be VCMCR4E, therefore set the other components to skip. Press button Next. Installation and Configuration of LVM 1.0 Standard Edition 33

38 Installation and Configuration LVM Installation Check if status is OK and press button Start. 34

39 LVM Installation Installation and Configuration Check if status is DEPLOYED and press button New Deployment. Installation and Configuration of LVM 1.0 Standard Edition 35

40 Installation and Configuration LVM Installation Press button Next. 36

41 LVM Installation Installation and Configuration Press button Next. Installation and Configuration of LVM 1.0 Standard Edition 37

42 Installation and Configuration LVM Installation Check if status is OK and press button Start. 38

43 LVM Installation Installation and Configuration Press button Exit. Installation and Configuration of LVM 1.0 Standard Edition 39

44 Installation and Configuration Post Installation Activities 3.2 Post Installation Activities Performance Setup For getting a better performance and increasing the load for LVM, please check and adjust the parameters of SAP note : chapter 2.1: SAP NW AS Java Engine. bx620-1:/ # cd /usr/sap/lvm/j00/j2ee/configtool bx620-1: /usr/sap/lvm/j00/j2ee/configtool #./configtool.sh... 40

45 Post Installation Activities Installation and Configuration Installation and Configuration of LVM 1.0 Standard Edition 41

46 Installation and Configuration Post Installation Activities 42

47 Post Installation Activities Installation and Configuration Installation and Configuration of LVM 1.0 Standard Edition 43

48 Installation and Configuration Post Installation Activities If all parameters from the SAP note are changed, please press floppy disk symbol to save. 44

49 Post Installation Activities Installation and Configuration Press button OK and Exit. Don t forget to restart the Java Instance in order for the changes to take effect. Installation and Configuration of LVM 1.0 Standard Edition 45

50 Installation and Configuration Post Installation Activities NetWeaver Initial Setup Before you start with LVM configuration you have to finish NetWeaver configuration. Logon to NWA, go to Configuration Management -> Scenarios -> Configuration Wizard and click on the link Functional Unit Configuration UI. 46

51 Post Installation Activities Installation and Configuration Mark the two Functional units and press button Enable Automatically. Before you press enable, make sure that pop-up windows are allowed in your browser otherwise the next window will fail to appear. Installation and Configuration of LVM 1.0 Standard Edition 47

52 Installation and Configuration Post Installation Activities In the new window: Fill in passwords and press button Next. 48

53 Post Installation Activities Installation and Configuration For selecting an ObjectServerName please use the info button. Fill in your choice and press button Next. Installation and Configuration of LVM 1.0 Standard Edition 49

54 Installation and Configuration Post Installation Activities Click on Return to Task List. 50

55 Post Installation Activities Installation and Configuration LVM Initial Setup Go back to Home and start Configuration Wizard again. Installation and Configuration of LVM 1.0 Standard Edition 51

56 Installation and Configuration Post Installation Activities Select Initial setup for LVM and press button Start. 52

57 Post Installation Activities Installation and Configuration Press button Next. Installation and Configuration of LVM 1.0 Standard Edition 53

58 Installation and Configuration Post Installation Activities Type password and press button Next. 54

59 Post Installation Activities Installation and Configuration Type password for sapadm user. Press button Next. Make sure to use sapadm password from FF LDAP! Installation and Configuration of LVM 1.0 Standard Edition 55

60 Installation and Configuration Post Installation Activities Press button Next. 56

61 Post Installation Activities Installation and Configuration Enter the User Name and the Password in the respective fields. From the Group drop down list select the required group name, to associate it with the created user. Press button Next. Installation and Configuration of LVM 1.0 Standard Edition 57

62 Installation and Configuration Post Installation Activities 58

63 Post Installation Activities Installation and Configuration Installation and Configuration of SAP Host Agent Install SAP Host Agent You can find the newest SAPHOSTAGENT.SAR file in the SAP Software Distribution Center of the SAP Service Marketplace ( Download the final version. The following steps have to be done for every pool and OS images. appnode1:/ # mkdir /usr/sap/hostctrl/new appnode1:/ # cd /usr/sap/hostctrl/new Copy the OS relevant SAPHOSTAGENT.SAR file to /usr/sap/hostctrl/new. appnode1:/usr/sap/hostctrl/new # /usr/sap/<sid>/jxx/exe/sapcar -xvf SAPHOSTAGENTXX_XX-xxx.SAR SAPCAR: processing archive SAPHOSTAGENTXX_XX-xxxxx.SAR x hostagent.lst x hostagent.mf. The /etc/init.d/sapinit script will be changed during upgrade. Please take care that the relevant file system is readable for the upgrade/install phase or change it manually. Installation and Configuration of LVM 1.0 Standard Edition 59

64 Installation and Configuration Post Installation Activities. appnode1:/usr/sap/hostctrl/new #./saphostexec upgrade For the first installation use:./saphostexec install. After the installation check please following links (number depends on Linux versions): appnode1: /usr/sap/hostctrl/new # cd /etc/init.d appnode1:/etc/init.d # ls l./rc[3-5].d/*sapinit* lrwxrwxrwx 1 root root 10 May 18 14:58 rc3.d/k01sapinit ->../sapinit lrwxrwxrwx 1 root root 10 May 18 14:58 rc3.d/s15sapinit ->../sapinit lrwxrwxrwx 1 root root 10 May 18 14:58 rc5.d/k01sapinit ->../sapinit lrwxrwxrwx 1 root root 10 May 18 14:58 rc5.d/s15sapinit ->../sapinit Start number should be higher than autofs! /etc/init.d/sapinit: Don t forget to change SAPSERVICE_PATH to SAPSERVICE_PATH=${USRSAP}/sapservices/sapservices Make sure that the SAP Host Agents are started automatically after system reboot! 60

65 Post Installation Activities Installation and Configuration Setup User Exit and Host Profile LVM User Exit works as an interface to the FA Agents. The following steps must be done for every pool and OSimage in /usr/sap/hostctrl/exe. Set the profile parameter 'service/enableremotedeployment = true'. PLEASE NOTE: This feature allows remote clients to deploy, for example, new Host Agent operations or to patch existing operations. If you think that this is a security risk in your environment you can also keep that feature disabled and deploy the configuration files manually. Add following lines to the host_profile: appnode1:/usr/sap/hostctrl/exe # vi host_profile... service/hook/sap_control = /usr/sap/hostctrl/exe/sap_control.sh %p %h %s %n service/hook/db_control = /usr/sap/hostctrl/exe/db_control.sh %p %h %s %t service/enableremotedeployment = true Create sap_control.sh: appnode1:/usr/sap/hostctrl/exe # vi sap_control.sh #!/bin/bash # User Exit Script for LVM in FF (instances) echo "Running User Exit Script" echo "/ ---- " $0 $* " ---- /" FF="/FlexFrame/scripts/ff_service.sh s $3 a $1" case $1 in "prestart") case $2 in *"ci"*) $FF t ci Installation and Configuration of LVM 1.0 Standard Edition 61

66 Installation and Configuration Post Installation Activities exit_code=$? ;; *"jc"*) $FF t jc exit_code=$? ;; *"ascs"*) $FF t ascs exit_code=$? ;; *"scs"*) $FF t scs exit_code=$? ;; *"app"*) $FF t app i $4 exit_code=$? ;; *"j"$4*) $FF t j i $4 exit_code=$? ;; *"ers"*) $FF t ers i $4 exit_code=$? ;; *"bobj"*) $FF t bobj exit_code=$? ;; *"cms"*) $FF t cms exit_code=$? ;; *"mdss"*) $FF t mdss i $4 exit_code=$? ;; *"mds"*) $FF t mds i $4 62

67 Post Installation Activities Installation and Configuration exit_code=$? ;; *"mdis"*) $FF t mdis i $4 exit_code=$? ;; *"trx"*) $FF t trx i $4 exit_code=$? ;; esac echo "/ PRESTART position executed /" if [ $exit_code -ge 1 -a $exit_code -le 4 ];then exit 4 else exit $exit_code fi ;; "prestop") case $2 in *"ci"*) $FF t ci exit_code=$? ;; *"jc"*) $FF t jc exit_code=$? ;; *"ascs"*) $FF t ascs exit_code=$? ;; *"scs"*) $FF t scs exit_code=$? ;; *"app"*) $FF t app i $4 Installation and Configuration of LVM 1.0 Standard Edition 63

68 Installation and Configuration Post Installation Activities exit_code=$? ;; *"j"$4*) $FF t j i $4 exit_code=$? ;; *"ers"*) $FF t ers i $4 exit_code=$? ;; *"bobj"*) $FF t bobj exit_code=$? ;; *"cms"*) $FF t cms exit_code=$? ;; *"mdss"*) $FF t mdss i $4 exit_code=$? ;; *"mds"*) $FF t mds i $4 exit_code=$? ;; *"mdis"*) $FF t mdis i $4 exit_code=$? ;; *"trx"*) $FF t trx i $4 exit_code=$? ;; esac echo "/ PRESTOP position executed /" if [ $exit_code -ge 1 -a $exit_code -le 4 ]; then exit 4 else 64

69 Post Installation Activities Installation and Configuration exit $exit_code fi ;; esac exit 0 Create db_control.sh: appnode1:/usr/sap/hostctrl/exe # vi db_control.sh #!/bin/bash # User Exit Script for LVM in FF (databases) echo "Running User Exit Script" echo "/ ---- " $0 $* " ---- /" FF="/FlexFrame/scripts/ff_service.sh s $3 a $1" case $1 in "prestart") case $2 in *"lc"*) $FF t db exit_code=$? ;; *"db"*) $FF t db exit_code=$? ;; esac echo "/ PRESTART position executed /" if [ $exit_code -ge 1 -a $exit_code -le 4 ]; then exit 4 else exit $exit_code fi Installation and Configuration of LVM 1.0 Standard Edition 65

70 Installation and Configuration Post Installation Activities ;; "prestop") case $2 in *"lc"*) $FF t db exit_code=$? ;; *"db"*) $FF t db exit_code=$? ;; esac echo "/ PRESTOP position executed /" if [ $exit_code -ge 1 -a $exit_code -le 4 ]; then exit 4 else exit $exit_code fi ;; esac exit 0 appnode1:/usr/sap/hostctrl/exe # chmod 750 sap_control.sh db_control.sh appnode1:/usr/sap/hostctrl/exe # chown root:root sap_control.sh db_control.sh Start SAP Host Agent As of Note : For Linux a PAM authentication policy is required. Please check or create the following file: 66

71 Configuration of LVM Installation and Configuration # vi /etc/pam.d/sapstartsrv auth sufficient pam_unix2.so auth required pam_unix_auth.so account sufficient pam_unix2.so account required pam_unix_auth.so # Start/Restart SAP Host Agent on every host in every pool. appnode1:/usr/sap/hostctrl/exe #./saphostexec restart 3.3 Configuration of LVM Installation and Configuration of LVM 1.0 Standard Edition 67

72 Installation and Configuration Configuration of LVM This chapter describes how configure LVM. See also: Use the following URL: e.g. First, logon to LVM: Setup LVM 68

73 Configuration of LVM Installation and Configuration Click on Setup icon. Installation and Configuration of LVM 1.0 Standard Edition 69

74 Installation and Configuration Configuration of LVM Switch to General Settings -> Engine Settings and press Edit button. Marking Enable user exit scripts is mandatory for using FA_Agents. Please use the right password for sapadm from FF LDAP. After setting up above press button Save. 70

75 Configuration of LVM Installation and Configuration Pools and Infrastructure Configuration Navigate to Configuration icon and select tab Pools. Switch to Edit mode, click on Add and enter your pool(s). Then click on button Save. Installation and Configuration of LVM 1.0 Standard Edition 71

76 Installation and Configuration Configuration of LVM Switch to Infrastructure tab. Select Network and switch to Edit mode. 72

77 Configuration of LVM Installation and Configuration Click on Add and enter the required data. Installation and Configuration of LVM 1.0 Standard Edition 73

78 Installation and Configuration Configuration of LVM Press button Next. 74

79 Configuration of LVM Installation and Configuration Then click on Save button. Installation and Configuration of LVM 1.0 Standard Edition 75

80 Installation and Configuration Configuration of LVM Repeat these steps to insert all Client and Server networks of all pools. 76

81 Configuration of LVM Installation and Configuration Installation and Configuration of LVM 1.0 Standard Edition 77

82 Installation and Configuration Configuration of LVM Virtualization Manager Configuration If you don t have a Virtualization Manager (e,g, vcenter), skip this chapter. Navigate to Virtualization Managers. Press button Add. 78

83 Configuration of LVM Installation and Configuration Select VMware and press button Next. Installation and Configuration of LVM 1.0 Standard Edition 79

84 Installation and Configuration Configuration of LVM Fill in your connection information to your vcenter and press Test Connection button to check your connection to vcenter. Press button Next. 80

85 Configuration of LVM Installation and Configuration Press button Save. Installation and Configuration of LVM 1.0 Standard Edition 81

86 Installation and Configuration Configuration of LVM In the Virtualization Overview (Operations -> Virtualization) ESX Servers and VM s are now visible and useable. 82

87 Configuration of LVM Installation and Configuration Configure Resources Add Resources Navigate back to Configuration ->Resources: Press button Add Resources. Installation and Configuration of LVM 1.0 Standard Edition 83

88 Installation and Configuration Configuration of LVM There are several methods to collect and configure resources into LVM. Select e.g. Detect Using Host and Instance Agent. Please make sure that the SAP Host Agent is started on every resource. 84

89 Configuration of LVM Installation and Configuration Fill in your Host Names separated by comma. Press button Detect and button Next. Installation and Configuration of LVM 1.0 Standard Edition 85

90 Installation and Configuration Configuration of LVM Select corresponding pool and press button Next. 86

91 Configuration of LVM Installation and Configuration Press button Save. Installation and Configuration of LVM 1.0 Standard Edition 87

92 Installation and Configuration Configuration of LVM For another example Add Resources and select Virtualization Manager as source. Select your Virtualization Manager e.g. vcenter. Press button Retrieve and button Next. 88

93 Configuration of LVM Installation and Configuration Assign the corresponding pool and press button Next. Installation and Configuration of LVM 1.0 Standard Edition 89

94 Installation and Configuration Configuration of LVM Press button Save. 90

95 Configuration of LVM Installation and Configuration Make Resources LVM enable Select the first one and press button Edit. Installation and Configuration of LVM 1.0 Standard Edition 91

96 Installation and Configuration Configuration of LVM Activate Managed, Operational and select the required Pool, if not preselected. Test the connection to server by pressing button Test Connection. Click on button Next. 92

97 Configuration of LVM Installation and Configuration For resource control you can select SAPS for your server e.g To configure network: Press Retrieve & Add Interfaces from Host Agent. Remove all interfaces except the relevant Client and Server LAN The example above shows VLANs. For VMs it is eth1, eth2. Please check which one is Client or Server LAN. Press button Next. Installation and Configuration of LVM 1.0 Standard Edition 93

98 Installation and Configuration Configuration of LVM With Mass Configuration you can select servers with equal conditions (e.g. equal blades) and configure them in one step by pressing the button Save & Apply Mass Configuration. 94

99 Configuration of LVM Installation and Configuration Here you can select different server options. Go on with button Apply. Installation and Configuration of LVM 1.0 Standard Edition 95

100 Installation and Configuration Configuration of LVM 96

101 Configuration of LVM Installation and Configuration If you have configured all resources you could check them by clicking on tab Resources (Operations -> Resources). Select a resource and press button Monitoring Data to refresh the information. Installation and Configuration of LVM 1.0 Standard Edition 97

102 Installation and Configuration Configuration of LVM Configure SAP Services Add Services Please make sure that all SAP services you want to detect are up and running! For using ERS instances in LVM, you have to provide the virtual hostnames with IP-addresses. Navigate back to Configuration -> Services. Press the button Add Services. 98

103 Configuration of LVM Installation and Configuration There are several methods to collect services. Select e.g. Detect on Managed Resources as source. Select the resource where the services you want to detect are running. Press button Detect and then button Next. Installation and Configuration of LVM 1.0 Standard Edition 99

104 Installation and Configuration Configuration of LVM Check if the correct pool is selected. Press button Auto Assign and then button Next. 100

105 Configuration of LVM Installation and Configuration Press button Save. Installation and Configuration of LVM 1.0 Standard Edition 101

106 Installation and Configuration Configuration of LVM Make Services LVM enable Select the row with the database of the new system and press Edit button. 102

107 Configuration of LVM Installation and Configuration Here you can add Additional Information and Test DB Connection. Also it s possible to manage a Solution Manager Diagnostic Agent, if it s available. Go on with button Next. Installation and Configuration of LVM 1.0 Standard Edition 103

108 Installation and Configuration Configuration of LVM Select AC-Enabled and select Network. Press Retrieve from Host Agent to select the operating system. You can also fill in Requirements for SAPS, Memory or a Preferred Host. Press button Next. 104

109 Configuration of LVM Installation and Configuration Select Automounter in the Mount Points configuration. Press button Next. Installation and Configuration of LVM 1.0 Standard Edition 105

110 Installation and Configuration Configuration of LVM Press button Save or use Save & Mass Configuration, if you have similar service configurations. 106

111 Configuration of LVM Installation and Configuration Select the row for the central instance and press button Edit. Installation and Configuration of LVM 1.0 Standard Edition 107

112 Installation and Configuration Configuration of LVM Here you can add Additional Information and Test Connection to the instance agent. Also it s possible to manage a Solution Manager Diagnostic Agent. Go on with button Next. If you have the same SID for a SAP System in different pools, it is necessary to have a Universal Unique ID for those systems see SAP Note and chapter Same SID in Different Pools of this document. 108

113 Configuration of LVM Installation and Configuration Select AC-Enabled. Add virtual host name for Server LAN and select corresponding networks. Press Retrieve from Host Agent to select the operating system. You can also fill in requirements for SAPS, Memory or a Preferred Host. Press button Next. Installation and Configuration of LVM 1.0 Standard Edition 109

114 Installation and Configuration Configuration of LVM Select Automounter and press button Next. 110

115 Configuration of LVM Installation and Configuration Press button Save or use button Save & Apply Mass Configuration, if you have similar service configurations. Go on configuring managed services like the examples above. Installation and Configuration of LVM 1.0 Standard Edition 111

116 Installation and Configuration Start/Stop/Relocate Services 3.4 Start/Stop/Relocate Services Switch to Operations -> Services tab. Here you are able to start/stop and relocate the configured services. Therefore select the service row you like to operate on. 112

117 Installation and Configuration There is more help available under the link Help! Installation and Configuration of LVM 1.0 Standard Edition 113

118 Installation and Configuration Same SID in Different Pools 3.5 Same SID in Different Pools Stop all instances of SID (L7S) e.g. First L7S system is running in pool p1 (Nothing changed) Second L7S system is running in pool p2. LVM is running in pool com. Modify hostname in pool specifc /etc/hosts of pool com and p2. cn1:/flexframe/volff/os/linux/pool_img/com/etc # vi hosts j00lvm j00lvm.mycompany.com j00lvm-se j00lvm-se.mycompany.com p2-app01l7s p2-app01l7s.mycompany.com p2-app01l7s-se p2-app01l7s-se.mycompany.com p2-app02l7s p2-app02l7s.mycompany.com p2-app02l7s-se p2-app02l7s-se.mycompany.com p2-cil7s p2-cil7s.mycompany.com p2-cil7s-se p2-cil7s-se.mycompany.com p2-dbl7s-se p2-dbl7s-se.mycompany.com cn1:/flexframe/volff/os/linux/pool_img/p2/etc # vi hosts cn2-p2-se p2-app01l7s p2-app01l7s.mycompany.com p2-app01l7s-se p2-app01l7s-se.mycompany.com p2-app02l7s p2-app02l7s.mycompany.com p2-app02l7s-se p2-app02l7s-se.mycompany.com p2-cil7s p2-cil7s.mycompany.com p2-cil7s-se p2-cil7s-se.mycompany.com p2-dbl7s-se p2-dbl7s-se.mycompany.com bx Create uuid: bx620-12:~ # uuidgen e3147c55-239c d6-4b1fa299cadb Change DEFAULT profile of system L7S in pool p2: dbl7s-se:l7sadm 53> vi DEFAULT.PFL SAPSYSTEMNAME = L7S 114

119 Same SID in Different Pools Installation and Configuration SAPGLOBALHOST = p2-cil7s login/system_client = 001 SAPDBHOST = p2-dbl7s-se j2ee/dbtype = sap j2ee/dbname = L7S j2ee/dbhost = p2-dbl7s-se j2ee/dbadminurl = rdisp/bufrefmode = sendon,exeauto DIR_PUT = /usr/sap/$(sapsystemname)/put # # SAP Message Server for ABAP # rdisp/mshost = p2-cil7s rdisp/msserv = sapmsl7s rdisp/msserv_internal = 3900 # # SAP Message Server for ABAP # system/uuid = e3147c55-239c d6-4b1fa299cadb Change instance and start profiles of system L7S in pool p2. dbl7s-se:l7sadm 54> mv L7S_DVEBMGS00_cil7s L7S_DVEBMGS00_p2-cil7s dbl7s-se:l7sadm 55> vi L7S_DVEBMGS00_p2-cil7s SAPSYSTEMNAME = L7S SAPSYSTEM = 00 INSTANCE_NAME = DVEBMGS00 DIR_CT_RUN = $(DIR_EXE_ROOT)/run DIR_EXECUTABLE = $(DIR_INSTANCE)/exe SAPLOCALHOST = p2-cil7s exe/saposcol = $(DIR_CT_RUN)/saposcol dbl7s-se:l7sadm 56> mv START_DVEBMGS00_cil7s START_DVEBMGS00_p2-cil7s dbl7s-se:l7sadm 55> vi START_DVEBMGS00_p2-cil7s SAPSYSTEMNAME = L7S SAPSYSTEM = 00 INSTANCE_NAME = DVEBMGS00 DIR_CT_RUN = $(DIR_EXE_ROOT)/run DIR_EXECUTABLE = $(DIR_INSTANCE)/exe Installation and Configuration of LVM 1.0 Standard Edition 115

120 Installation and Configuration Same SID in Different Pools SAPLOCALHOST = p2-cil7s DIR_PROFILE = /sapmnt/l7s/profile _PF = $(DIR_PROFILE)/L7S_DVEBMGS00_p2-cil7s SETENV_00 = LD_LIBRARY_PATH=$(DIR_LIBRARY):%(LD_LIBRARY_PATH) Repeat above step for all instances and start profiles of system L7S in pool p2. Check and change if there are some SID specific entries in the sapservices file of pool p2: bx620-12:/usr/sap/sapservices # vi sapservices LD_LIBRARY_PATH=/usr/sap/L7S/DVEBMGS00/exe:$LD_LIBRARY_PATH; export LD_LIBRARY_PATH; /usr/sap/l7s/dvebmgs00/exe/sapstartsrv pf=/usr/sap/l7s/sys/profile/start_dvebmgs00_p2-cil7s -D -u l7sadm LD_LIBRARY_PATH=/usr/sap/L7S/D01/exe:$LD_LIBRARY_PATH; export LD_LIBRARY_PATH; /usr/sap/l7s/d01/exe/sapstartsrv pf=/usr/sap/l7s/sys/profile/start_d01_p2-app01l7s -D -u l7sadm Start all instances interfaces of L7S in pool p2 e.g.: bx620-12: ff_service.sh -s L7S -a istart -t db INFO: Version of ff_service.sh: INFO: SAP version found: SAP-7.0 INFO: server_lan interface vlan24: is (already) up INFO: Exit code: 0 (no error) Start all instances of L7S in pool p2 e.g.: dbl7s-se:l7sadm 53> startsap DVEBMGS00 p2-cil7s Checking ADA db Database Database is not available via R3trans Running /usr/sap/l7s/sys/exe/run/startdb Now you can go on with chapter Configure SAP Services. 116

121 Resource Unlock Troubleshooting 4 Troubleshooting 4.1 Resource Unlock If error messages like Ressource could not be locked are displayed or some resources are not available, Installation and Configuration of LVM 1.0 Standard Edition 117

122 Troubleshooting Resource Unlock Go to NWA -> Problem Management -> Locks and release locks. 118

123 Resource Unlock Troubleshooting Often it s also helpful to restart the routing-service. Press Refresh button for routing service or start and stop application. Installation and Configuration of LVM 1.0 Standard Edition 119

124

125 5 Abbreviations ABAP ACC ACI ACPI APM APO CIFS DHCP ERP ESF EULA FAA FC FSC FTP IP LAN LDAP LUN LVM MAC MINRA NAS NDMP NIC NVRAM Advanced Business Application Programming Adaptive Computing Controller Adaptive Computing Infrastructure Advanced Configuration and Power Interface Advanced Power Management Advanced Planner & Optimizer Common Internet File System Dynamic Host Configuration Protocol Enterprise Resource Planning Enhanced System Facility End User License Agreement FlexFrame Autonomous Agent Fiber Channel FlexFrame Software Container, name part used for Images and CDs/DVDs File Transfer Protocol Internet Protocol Local Area Network Lightweight Directory Access Protocol Logical Unit Number Landscape Virtualization Management Media Access Control Minimal Read Ahead Network Attached Storage Network Data Management Protocol Network Interface Card Non-Volatile Random Access Memory Installation and Configuration of LVM 1.0 Standard Edition 121

126 Abbreviations OBP OLTP ONTAP OSS POST PXE PY RAID RARB RDBMS RHEL RSB SCS SAP BW SAPGUI SAPOSS SID SLD SLES SMB SMC SPOC TELNET TFTP UDP UPS VLAN VTOC Open Boot Prom On-Line Transaction Processing Open Network Technology for Appliance Products Open Source Software Power-On Self Test Preboot Execution Environment PRIMERGY Redundant Array of Independent (or Inexpensive) Disks Reverse Address Resolution Protocol Relational Database Management System Red Hat Enterprise Linux Remote Service Board System Console Software SAP Business Warehouse SAP Graphical User Interface SAP Online System Service System Identifier System Landscape Directory SuSE Linux Enterprise Server Server Message Block System Management Console Single Point Of Control Telecommunications Network Trivial File Transfer Protocol User Datagram Protocol Uninterruptible Power Supply Virtual Local Area Network Virtual Table Of Contents 122

127 Abbreviations WAN WAS WAFL XSCF Wide Area Network Web Application Server Write Anywhere File Layout Extended System Control Facility Installation and Configuration of LVM 1.0 Standard Edition 123

128

129 6 Glossary Advanced Business Application Programming (ABAP) Proprietary programming language of SAP. Advanced Power Management (APM) A standard for power saving and management in computers. Application Agent A software program for monitoring and managing applications. Application Node (AN) A host for applications (e.g. SAP instances db, ci, agate, wgate, app etc.). This definition includes Application Servers as well as Database Servers. Automounter The automounter is an NFS utility that automatically mounts directories on an NFS client as they are needed, and unmounts them when they are no longer needed. Autonomous Agent Central system management and high availability software component of FlexFrame. Blade A special form factor for computer nodes. BRBACKUP SAP backup and restore tools. Client LAN Virtual network segment within FlexFrame, used for client-server traffic. Common Internet File System (CIFS) A protocol for the sharing of file systems (same as SMB). Computing Node From the SAP ACI perspective: A host that is used for applications. Control Agent A software program for monitoring and managing nodes within FlexFrame. Control LAN Virtual network segment within FlexFrame, used for system management traffic. Installation and Configuration of LVM 1.0 Standard Edition 125

130 Glossary Control Node (CN) A physical computer system, controlling and monitoring the entire FlexFrame landscape and running shared services in the rack (dhcp, tftp, ldap etc.). Control Station An Application Node running SAP LVM. Dynamic Host Configuration Protocol (DHCP) DHCP is a protocol for assigning dynamic IP addresses to devices on a network. Dynamic Host Configuration Protocol (DHCP) server A DHCP server provides configuration parameters specific to the DHCP client host, required by the host to participate on the Internet. Enterprise Resource Planning (ERP) Enterprise Resource Planning systems are management information systems that integrate and automate many of the business practices associated with the operations or production aspects of a company. Ethernet A Local Area Network which supports data transfer rates of 10 Megabits per second. Fiber Channel Fibre Channel is a serial computer bus intended for connecting high-speed storage devices to computers. Filer Network attached storage for file systems. FlexFrame for mysap Business Suite FlexFrame for mysap Business Suite is a radically new architecture for mysap environments. It exploits the latest business-critical computing technology to deliver major cost savings for SAP customers. Gigabit Ethernet A Local Area Network which supports data transfer rates of 1 Gigabit (1,024 Megabits) per second. Host name Name of a physical server as seen from outside the network. One physical server may have multiple host names. Image In the FlexFrame documentation, Image is used as a synonym for Hard Disk Image. 126

131 Glossary Internet Protocol (IP) Address A unique number used by computers to refer to each other when sending information through networks using the Internet Protocol. Landscape Virtualization Management (LVM) SAP system for monitoring and controlling SAP landscapes. Lightweight Directory Access Protocol (LDAP) Protocol for Accessing on-line directory services. Local Area Network (LAN) A computer network that spans a relatively small area. Most LANs are confined to a single building or group of buildings. However, one LAN can be connected to other LANs over any distance via telephone lines and radio waves. A system of LANs connected in this way is called a Wide Area Network (WAN). Local host name The name of the node (physical computer); it can be displayed and set using the command /bin/hostname. Logical Unit Number (LUN) An address for a single (SCSI) disk drive. MaxDB A relational database system from mysql (formerly ADABAS and SAPDB). Media Access Control (MAC) address An identifier for network devices, usually unique. The MAC address is stored physically on the device. mysap Business Suite The main ERP software produced of SAP AG. NDMPcopy NDMPcopy transfers data between Filers using the Network Data Management Protocol (NDMP). Netboot A boot procedure for computers where the operating system is provided via a network instead of local disks. Netweaver SAP NetWeaver is the technical foundation of mysap Business Suite solutions. Network Appliance Filer See Filer. Installation and Configuration of LVM 1.0 Standard Edition 127

132 Glossary Network Attached Storage (NAS) A data storage device that is connected via a network to one or multiple computers. Network File System (NFS) A network protocol for network-based storage access. Network Interface Card (NIC) A hardware device that allows computer communication via networks. Node A physical computer system controlled by an OS. Node name The name of a physical node as returned by the command uname n. Each node name within a FlexFrame environment must be unique. Non-Volatile Random Access Memory (NVRAM) A type of memory that retains its contents when the power is turned off. On-Line Transaction Processing Transaction processing via computer networks. OpenLDAP An Open Source LDAP Service Implementation. Open Network Technology for Appliance Products The operating system of Network Appliance Filers. Open Source Software (OSS) Software that is distributed free of charge under an open source license, such as the GNU General Public License. Oracle RAC A cluster database by Oracle Corporation. Physical host Name of a physical computer system (node). Power-On Self Test (POST) Part of a computer's boot process; automatic testing of diverse hardware components. Preboot Execution Environment An environment that allows a computer to boot from a network resource without having a local operating system installed. PRIMERGY Fujitsu's i386-based server product line. 128

133 Glossary Red Hat Enterprise Linux Linux distribution by Red Hat, Inc., targeting business customers. Reverse Address Resolution Protocol (RARP) A protocol allowing resolution of an IP address corresponding to a MAC address. SAP Service In FlexFrame: SAP Service and DB Services. SAP service script An administration script for starting and stopping an SAP application on a virtual host. SAP Solution Manager Service portal for the implementation, operation and optimization of an SAP solution. SAPLogon Front-end software for SAPGUI. SAPRouter Router for SAP services like SAPGUI or SAPTELNET. Server A physical host (hardware), same as node. Service A software program providing functions to clients. Service type The type of an application or service (db, ci, app, agate, wgate etc.). Single Point of Control In FlexFrame: One user interface to control a whole FlexFrame environment. Storage LAN A virtual LAN segment within a FlexFrame environment, carrying the traffic to the Filer. SuSE Linux Enterprise Server A Linux distribution by Novell, specializing in server installations. Trivial File Transfer Protocol A simple form of the File Transfer Protocol (FTP). TFTP uses the User Datagram Protocol (UDP) and provides no security features. It is often used by servers to boot diskless workstations, X-terminals, and routers. TFTP server A simple FTP implementation. Installation and Configuration of LVM 1.0 Standard Edition 129

134 Glossary Virtual host Before an application starts, the virtual host name is assigned to the physical host where the application is to run. From the application's perspective, it always runs on the same virtual host, even if the application is moved to another physical host. The following rule forms the host names of virtual services: <service_type>[<id>]<sid>[<-lan type] where <service_type> can be one of: ci - central instance (ABAP) db - database instance app - application instance (ABAP) ascs - ABAP SAP central services instance scs - JAVA SAP central services instance jc - JAVA central instance j - JAVA application instance <ID> is a number from 00 to 96 (except: 2, 25, 43, 72, 89) for the service types app and j only. It is empty for other service types. <SID> is the system ID of an SAP system. <LAN type> -se empty string Server LAN Client LAN This host name formation rule for virtual services is mandatory in version 3.2 of the FlexFrame solution. Some components rely on this rule. Within a FlexFrame environment, each node name must be unique. However, each node may have multiple host names that are derived from the node name by a defined naming rule. In SAP environments host names are currently limited to 13 alphanumeric characters including the hyphen ( - ). The first character must be a letter. In the SAP environment host names are case-sensitive. (See SAP Note No ) Virtual Local Area Network A VLAN is a logically segmented network mapped over physical hardware according to the IEEE 802.1q standard. 130