FlexFrame for SAP Version 5.1A Installation and Configuration of ACC 7.3 Edition November 2011 Document Version 1.0
Fujitsu Limited Copyright Fujitsu Technology Solutions 2011 FlexFrame and PRIMERGY are trademarks or registered trademarks of Fujitsu Limited in Japan and other countries. SAP and NetWeaver are trademarks or registered trademarks of SAP AG in Germany and in several other countries Linux is a registered trademark of Linus Torvalds SUSE Linux is a registered trademark of Novell, Inc., in the United States and other countries Oracle and Java are trademarks of ORACLE Corporation and/or its affiliates Intel and PXE are registered trademarks of Intel Corporation in the United States and other countries MaxDB is a registered trademark of MySQL AB, Sweden MySQL is a registered trademark of MySQL AB, Sweden NetApp and the Network Appliance logo are registered trademarks and Network Appliance and Data ONTAP are trademarks of NetApp, Inc. in the U.S. and other countries. EMC, CLARiiON, Symmetrix and Celerra are trademarks or registered trademarks of EMC Corporation in the United States and other countries VMware, ESX, ESXi, VMware vcenter, VMware vsphere are registered trademarks or trademarks of VMware, Inc. in the United States and/or other jurisdictions. Ethernet is a registered trademark of XEROX, Inc., Digital Equipment Corporation and Intel Corporation Windows and Word are registered trademarks of Microsoft Corporation All other hardware and software names used are trademarks of their respective companies. All rights, including rights of translation, reproduction by printing, copying or similar methods, in part or in whole, are reserved. Offenders will be liable for damages. All rights, including rights created by patent grant or registration of a utility model or design, are reserved. Delivery subject to availability. Right of technical modification reserved.
Contents 1 Introduction... 1 1.1 Requirements... 1 1.2 1.3 Notational Conventions... 1 Document History... 1 2 General Preparations... 3 2.1 2.2 Required Software for ACC Installation... 3 Known Issues... 3 2.3 Documentation... 3 3 Installation of ACC... 5 3.1 SAP NW 7.2 for CE Installation... 5 3.1.1 SCS Instance... 6 3.1.2 DB Instance... 8 3.1.3 Primary Application Server Instance... 11 3.1.4 Support Package Installation... 12 3.2 ACC Installation... 23 3.3 Post Installation Activities... 28 3.3.1 Performance Setup... 28 3.3.2 NetWeaver Initial Setup... 33 3.3.3 ACC Initial Setup... 38 4 Configuration of ACC... 45 4.1 4.1.1 User Administration for ACC Users... 45 Install SAPHOSTAGENT... 46 4.1.2 Set up User Exit... 47 4.1.3 4.1.4 Register Hosts... 54 Start SAPHOSTAGENT... 55 4.2 Configure the Adaptive Computing Landscape... 57 4.2.1 4.2.2 General Settings... 57 Pools, Networks and Characteristics Configuration... 60 4.2.3 Virtualization Manager Configuration... 63 4.2.4 4.2.5 Configure Resources... 65 Make Resources ACC enable... 70 4.2.6 Configure Services... 77 4.2.7 4.3 Make Services ACC enable... 80 Start/Stop/Relocate Services... 90 4.4 Same SID in Different Pools... 91
Contents 5 Troubleshooting... 95 5.1 J2EE Server is Restarting... 95 5.2 5.3 J2EE Engine Start Problem... 96 Resource Unlock... 98 6 Abbreviations... 101 7 Glossary... 105 8 Index... 112 2 FlexFrame for SAP7.3
1 Introduction 1.1 Requirements This document addresses administrators on FlexFrame environments. We assume that the reader of this document has technical background knowledge in the areas of operating systems Linux, IP networking and SAP basis. 1.2 Notational Conventions The following conventions are used in this manual: Additional information that should be observed. Warning that must be observed. fixed font <fixed font> fixed font Names of paths, files, commands, and system output. Names of variables. User inputs in command examples (if applicable using <> with variables). 1.3 Document History Document Version Changes Date 1.0 First Edition 2011-09-02 FlexFrame for SAP7.3 1
2 General Preparations 2.1 Required Software for ACC Installation SAP NW 7.2 for CE with a released DB and OS version and final support packages (only SP for Application Server Java is needed) http://service.sap.com/swdc SAP NW ACC 7.3 final Support Package http://service.sap.com/swdc The final SAPHOSTAGENT from http://service.sap.com/swdc The JCE Unlimited Strength Jurisdiction Policy Files 6.0 are available as a free download at Sun Microsystems: http://java.sun.com/javase/downloads All services to be managed with ACC must have the SAP instance agent running (How to see note: 1285185). 2.2 Known Issues 2.3 Documentation The following documents provide detailed information on SAP ACC: This Installation Guide (Fujitsu) For actual SAP ACC documentation please check on http://www.sdn.sap.com/irj/sdn/adaptive Special ACC notes: 1462332,1375863 and 1285185 FF51A_Installation_Guide_for_SAP_Solutions (Fujitsu) Before installing SAP NetWeaver on FlexFrame, please refer to the original SAP installation guide. Get the final SAP Notes from the SAPNET: http://service.sap.com Please make sure that the FA Application Agents are stopped on the host that you are installing SAP Software on. FlexFrame for SAP7.3 3
General Preparations Documentation Sample system for this document: This document refers to the following examples: A73 = SID for NW7.2 for CE (ACC) installation bx920-1 = Host for ACC installation j00a73 = Virtual host name of ACC system cn1 = Control Node 1 bx920-x,vmx-xx = App Nodes L7S = Managed Service 4 FlexFrame for SAP7.3
3 Installation of ACC First of all you have to decide in which way you want to integrate the ACC in your FlexFrame environment: 1. Install ACC in every FlexFrame pool. 2. Install ACC in a Common pool with network routing to all other pools (Security restrictions!) The decision is important for the ACC pool configuration. See section Pools, Networks and Characteristics Configuration on page 61. Install SAP NW 7.2 for CE + SP and the ACC final Service Pack in FlexFrame. Please keep in mind with this installation you have to install the Diagnostic Agent System. Don t forget to prepare a java only instance with ff_sid_adm.pl..- - smd in the FlexFrame environment. 3.1 SAP NW 7.2 for CE Installation Please make sure that the FA Application Agents are stopped on the hosts that you are installing SAP Software on. Please check the FF Installation Guide for SAP Solutions for additional hints installing SAP NW 7.2 for CE in FlexFrame. FlexFrame for SAP7.3 5
Installation of ACC SAP NW 7.2 for CE Installation 3.1.1 SCS Instance Under Application Server Java -> Distributed System select Central Services Instance (SCS). 6 FlexFrame for SAP7.3
SAP NW 7.2 for CE Installation Installation of ACC Select Custom mode. Follow up the normal installation procedure! FlexFrame for SAP7.3 7
Installation of ACC SAP NW 7.2 for CE Installation 3.1.2 DB Instance Go on with normal installation procedure step Database Instance e.g.maxdb. 8 FlexFrame for SAP7.3
SAP NW 7.2 for CE Installation Installation of ACC Use FF location for saplog and sapdata. FlexFrame for SAP7.3 9
Installation of ACC SAP NW 7.2 for CE Installation Follow up the normal installation procedure! 10 FlexFrame for SAP7.3
SAP NW 7.2 for CE Installation Installation of ACC 3.1.3 Primary Application Server Instance Go on with normal installation procedure step Primary Application Server Instance: FlexFrame for SAP7.3 11
Installation of ACC SAP NW 7.2 for CE Installation 3.1.4 Support Package Installation Please read the relevant SAP note if you aren t confirm with JSPM. Please install the final Support Packages for NW 7.2 CE only SP for Application Server Java is needed. Copy the relevant packages and stack.xml file to the EPS inbox. bx920-1:/ # ssh -X a73adm@bx920-1 Password: j00a73:a73adm 4> cd /usr/sap/a73/j00/j2ee/jspm j00a73:a73adm 5>./go... 12 FlexFrame for SAP7.3
SAP NW 7.2 for CE Installation Installation of ACC Insert password for Administrator and press Log On. FlexFrame for SAP7.3 13
Installation of ACC SAP NW 7.2 for CE Installation Select above and press Next. 14 FlexFrame for SAP7.3
SAP NW 7.2 for CE Installation Installation of ACC Press Next. FlexFrame for SAP7.3 15
Installation of ACC SAP NW 7.2 for CE Installation If status is ok press Start. 16 FlexFrame for SAP7.3
SAP NW 7.2 for CE Installation Installation of ACC Insert password press Proceed. FlexFrame for SAP7.3 17
Installation of ACC SAP NW 7.2 for CE Installation Press Exit. 18 FlexFrame for SAP7.3
SAP NW 7.2 for CE Installation Installation of ACC Enter password and Log On. FlexFrame for SAP7.3 19
Installation of ACC SAP NW 7.2 for CE Installation Press Next. 20 FlexFrame for SAP7.3
SAP NW 7.2 for CE Installation Installation of ACC Enter password and press Proceed. FlexFrame for SAP7.3 21
Installation of ACC SAP NW 7.2 for CE Installation Press Exit. 22 FlexFrame for SAP7.3
ACC Installation Installation of ACC 3.2 ACC Installation After finishing the NW7.2 CE installation and SP successfully, proceed with the ACC installation: Copy the final version of ACC7.3 LMACC0X_1-..sca file to /usr/sap/trans/eps/in. bx920-1:/ # ssh -X a73adm@bx920-1 Password: bx920-1:a73adm 4> cd /usr/sap/a73/j00/j2ee/jspm bx920-1:a73adm 5>./go Press Log On. FlexFrame for SAP7.3 23
Installation of ACC ACC Installation Select New Software Components. Press Next. 24 FlexFrame for SAP7.3
ACC Installation Installation of ACC Press Next. FlexFrame for SAP7.3 25
Installation of ACC ACC Installation Check if status is OK and press Start. 26 FlexFrame for SAP7.3
ACC Installation Installation of ACC Check if status is DEPLOYED and press Exit. FlexFrame for SAP7.3 27
Installation of ACC Post Installation Activities 3.3 Post Installation Activities 3.3.1 Performance Setup For getting a better performance and increasing the load for ACC please check and adjust the parameters of SAP Note 1285185: chapter 3.1: SAP NW AS Java Engine. bx920-1:/ # cd /usr/sap/a73/j00/j2ee/configtool bx920-1:/usr/sap/a73/j00/j2ee/configtool #./configtool.sh... 28 FlexFrame for SAP7.3
Post Installation Activities Installation of ACC FlexFrame for SAP7.3 29
Installation of ACC Post Installation Activities 30 FlexFrame for SAP7.3
Post Installation Activities Installation of ACC FlexFrame for SAP7.3 31
Installation of ACC Post Installation Activities If all parameters from the SAP note are changed please press Diskette symbol to save and don t forget to restart the Java Instance in order for the changes to take effect. 32 FlexFrame for SAP7.3
Post Installation Activities Installation of ACC 3.3.2 NetWeaver Initial Setup Before you start with ACC configuration you have to finish NetWeaver configuration. Logon to NWA, go to Configuration Management -> Scenarios -> Configuration Wizard and click on the link Functional Unit Configuration UI. FlexFrame for SAP7.3 33
Installation of ACC Post Installation Activities Mark the two Functional units and press Enable automatically button. 34 FlexFrame for SAP7.3
Post Installation Activities Installation of ACC Fill in passwords and press Next. FlexFrame for SAP7.3 35
Installation of ACC Post Installation Activities As of note 1285185 chapter: 3.2, it s recommended to have a local SLD for ACC. For selecting an ObjectServerName please use the Info button. Fill in your choice and press Next. 36 FlexFrame for SAP7.3
Post Installation Activities Installation of ACC Click on Return to Task List. FlexFrame for SAP7.3 37
Installation of ACC Post Installation Activities 3.3.3 ACC Initial Setup Go back to Home and start configuration wizard again. Select Initial setup for ACC and press Start. 38 FlexFrame for SAP7.3
Post Installation Activities Installation of ACC Select Custom and press Next. FlexFrame for SAP7.3 39
Installation of ACC Post Installation Activities Type in password and press Next. 40 FlexFrame for SAP7.3
Post Installation Activities Installation of ACC Select below and press Next. FlexFrame for SAP7.3 41
Installation of ACC Post Installation Activities Press Next. 42 FlexFrame for SAP7.3
Post Installation Activities Installation of ACC Enter the user name and the password in the respective fields. From the Group drop down list select the required group name (ACC_SUPERADMIN, ACC_ADMIN, ACC_OPERATOR and ACC_READONLY), to associate it with the created user. Press Next. FlexFrame for SAP7.3 43
Installation of ACC Post Installation Activities 44 FlexFrame for SAP7.3
User Administration for ACC Users Configuration of ACC 4 Configuration of ACC 4.1 User Administration for ACC Users The NW CE 7.2 Security Guide can be found here: http://help.sap.com/nwce72 Here you can find a lot about users, roles, groups. Login to the user administration page: http://j00a73:50000/nwa/identity. For using accadmin as login user in SLD (Chapter: Register Hosts) please add group Administrators and press Save. After creating a new user, don t forget to login to change the password! FlexFrame for SAP7.3 45
Configuration of ACC User Administration for ACC Users 4.1.1 Install SAPHOSTAGENT You can find the newest SAPHOSTAGENT.SAR in the SAP Software Distribution Center of the SAP Service Marketplace (http://service.sap.com/swdc). Log on with your SAP Service Marketplace ID and go to the following folder: In the navigation bar, choose Download Support Packages and Patches Entry by Application Group SAP Technology Components SAP HOST AGENT SAP HOST AGENT 7.20 <operating system>. Download the final version. These steps have to be done for every pool and for OS images. appnode1:/# mkdir /usr/sap/hostctrl/new appnode1:/# cd /usr/sap/hostctrl/new Copy the OS relevant SAPHOSTAGENT file to /usr/sap/hostctrl/new. appnode1:/usr/sap/hostctrl/new # /sapmnt/a73/exe/uc/linux86_64/sapcar -xvf SAPHOSTAGENTXX_XXxxx.SAR SAPCAR: processing archive SAPHOSTAGENTXX_XX-xxxxx.SAR x hostagent.lst x hostagent.mf The /etc/init.d/sapinit script will be changed during upgrade please take care that the relevant file system is readable for the upgrade/install phase or copy it manually. appnode1:/usr/sap/hostctrl/new #./saphostexec upgrade For the first installation use./saphostexec install. After that please check following links: appnode1:/# cd /etc/init.d appnode1:/etc/init.d # ls l./rc[3-5].d/*sapinit* lrwxrwxrwx 1 root root 10 May 18 14:58 rc3.d/k08sapinit ->../sapinit lrwxrwxrwx 1 root root 10 May 18 14:58 rc3.d/s14sapinit ->../sapinit lrwxrwxrwx 1 root root 10 May 18 14:58 rc5.d/k08sapinit ->../sapinit lrwxrwxrwx 1 root root 10 May 18 14:58 rc5.d/s14sapinit ->../sapinit 46 FlexFrame for SAP7.3
User Administration for ACC Users Configuration of ACC /etc/init.d/sapinit, don t forget to change SAPSERVICE_PATH to SAPSERVICE_PATH=${USRSAP}/sapservices/sapservices 4.1.2 Set up User Exit ACC User Exit works as an interface to the FA Agents. This must be done for every pool and OS-image in /usr/sap/hostctrl/exe. Add following 2 lines to the host_profile: appnode1:/usr/sap/hostctrl/exe # vi host_profile... service/hook/sap_control = /usr/sap/hostctrl/exe/sap_control.sh %p %h %s %n service/hook/db_control = /usr/sap/hostctrl/exe/db_control.sh %p %h %s %t FlexFrame for SAP7.3 47
Configuration of ACC User Administration for ACC Users Create sap_control.sh : appnode1:/usr/sap/hostctrl/exe # vi sap_control.sh #!/bin/bash # User Exit Script for ACC (instances) echo "Running User Exit Script" echo "/ ---- " $0 $* " ---- /" FF="/FlexFrame/scripts/ff_services.sh s $3 a $1" case $1 in "prestart") case $2 in *"ci"*) $FF t ci exit_code=$? ;; *"jc"*) $FF t jc exit_code=$? ;; *"ascs"*) $FF t ascs exit_code=$? ;; *"scs"*) $FF t scs exit_code=$? ;; *"app"*) $FF t app i $4 exit_code=$? ;; *"j"$4*) $FF t j i $4 exit_code=$? ;; *"ers"*) $FF t ers i $4 exit_code=$? ;; *"bobj"*) 48 FlexFrame for SAP7.3
User Administration for ACC Users Configuration of ACC $FF t bobj exit_code=$? ;; *"cms"*) $FF t cms exit_code=$? ;; *"mdss"*) $FF t mdss i $4 exit_code=$? ;; *"mds"*) $FF t mds i $4 exit_code=$? ;; *"mdis"*) $FF t mdis i $4 exit_code=$? ;; *"trx"*) $FF t trx i $4 exit_code=$? ;; esac echo "/ PRESTART position executed /" if [ $exit_code -ge 1 -a $exit_code -le 4 ];then exit 4 else exit $exit_code fi ;; "prestop") case $2 in *"ci"*) $FF t ci exit_code=$? ;; *"jc"*) $FF t jc FlexFrame for SAP7.3 49
Configuration of ACC User Administration for ACC Users exit_code=$? ;; *"ascs"*) $FF t ascs exit_code=$? ;; *"scs"*) $FF t scs exit_code=$? ;; *"app"*) $FF t app i $4 exit_code=$? ;; *"j"$4*) $FF t j i $4 exit_code=$? ;; *"ers"*) $FF t ers i $4 exit_code=$? ;; *"bobj"*) $FF t bobj exit_code=$? ;; *"cms"*) $FF t cms exit_code=$? ;; *"mdss"*) $FF t mdss i $4 exit_code=$? ;; *"mds"*) $FF t mds i $4 exit_code=$? ;; *"mdis"*) $FF t mdis i $4 50 FlexFrame for SAP7.3
User Administration for ACC Users Configuration of ACC exit_code=$? ;; *"trx"*) $FF t trx i $4 exit_code=$? ;; esac echo "/ PRESTOP position executed /" if [ $exit_code -ge 1 -a $exit_code -le 4 ]; then exit 4 else exit $exit_code fi ;; esac exit 0 FlexFrame for SAP7.3 51
Configuration of ACC User Administration for ACC Users Create db_control.sh : appnode1:/usr/sap/hostctrl/exe # vi db_control.sh #!/bin/bash # User Exit Script for ACC database echo "Running User Exit Script" echo "/ ---- " $0 $* " ---- /" FF="/FlexFrame/scripts/ff_services.sh s $3 a $1" case $1 in "prestart") case $2 in *"lc"*) $FF t db exit_code=$? ;; *"db"*) $FF t db exit_code=$? ;; esac echo "/ PRESTART position executed /" if [ $exit_code -ge 1 -a $exit_code -le 4 ]; then exit 4 else exit $exit_code fi ;; "prestop") case $2 in *"lc"*) $FF t db exit_code=$? ;; *"db"*) $FF t db exit_code=$? 52 FlexFrame for SAP7.3
User Administration for ACC Users Configuration of ACC ;; esac echo "/ PRESTOP position executed /" if [ $exit_code -ge 1 -a $exit_code -le 4 ]; then exit 4 else exit $exit_code fi ;; esac exit 0 appnode1:/usr/sap/hostctrl/exe # chmod 750 sap_control.sh db_control.sh appnode1:/usr/sap/hostctrl/exe # chown root:root sap_control.sh db_control.sh FlexFrame for SAP7.3 53
Configuration of ACC User Administration for ACC Users 4.1.3 Register Hosts Create a sldreg connection file: appnode1:/usr/sap/hostctrl/exe # cd /usr/sap/hostctrl/exe appnode1:/usr/sap/hostctrl/exe # export LD_LIBRARY_PATH=/usr/sap/hostctrl/exe:$LD_LIBRARY_PATH appnode1:/usr/sap/hostctrl/exe #./sldreg configure slddest.cfg Use configuration file 'slddest.cfg' for output! Please specify the HTTP connect information: [User, Password, Host, Port, HTTP/HTTPS] User Name : accadmin # Must be a member of administrator group Password : ******** Verify Password : ******** Server Host : j00a73 # ACC host with SLD Port [80,443,1024..65535]: 50000 Use HTTPS? (y/n): n =================== Entered Information =================== User: accadmin Passwd: (secret) Host: j00a73 Port: 50000 HTTPS: n =================== Write this information to secure file 'slddest.cfg'? [y=yes/n=no/q=quit] y Fri Feb 22 10:15:45 2008 Renamed file 'slddest.cfg' to 'slddest.cfg.20080222101545' Fri Feb 22 10:15:45 2008 Writing data to encrypted file 'slddest.cfg' Fri Feb 22 10:15:45 2008 Data written to secured data file 'slddest.cfg' Fri Feb 22 10:15:45 2008 Using destination file 'slddest.cfg'. Fri Feb 22 10:15:45 2008 No key file 'slddest.cfg.key' used. Fri Feb 22 10:15:45 2008 Use encryted destination file 'slddest.cfg' as data source 54 FlexFrame for SAP7.3
User Administration for ACC Users Configuration of ACC Fri Feb 22 10:15:45 2008 Configuration data successfully stored in file: slddest.cfg The sldreg connectfile must be done for every OS-image in every pool. 4.1.4 Start SAPHOSTAGENT For Linux images only: As of Note 1285185: For Linux a PAM authentication policy is required. Please create the following file: appnode1:/ # vi /etc/pam.d/sapstartsrv auth sufficient pam_unix2.so # For SLES9 only auth required pam_unix_auth.so # For SLES9 only account sufficient pam_unix2.so # For SLES9 only account required pam_unix_acct.so # For SLES9 only auth requisite pam_unix_auth.so nullok # For SLES10 only Start/Restart SAPHostAgent on every host in every pool appnode1:/usr/sap/hostctrl/exe #./saphostexec restart Check if the hosts (e.g. bx600-5) are registered in the SLD: http://j00a73:50000/sld FlexFrame for SAP7.3 55
Configuration of ACC User Administration for ACC Users Select Technical Systems -> Type: Computer Systems. 56 FlexFrame for SAP7.3
Configure the Adaptive Computing Landscape Configuration of ACC 4.2 Configure the Adaptive Computing Landscape This chapter describes how ACC make the landscape adaptive. See also the Configuring the Adaptive Computing Landscape on http://help.sap.com/saphelp_nwacc73/helpdata/de/index.htm also http://help.sap.com/saphelp_nwacc73/helpdata/en/49/6104ca90ab2009e10000000a421 89C/frameset.htm 4.2.1 General Settings Use the following URL: http://<acc_host>:<port>/acc First, logon to ACC. FlexFrame for SAP7.3 57
Configuration of ACC Configure the Adaptive Computing Landscape Switch to Configuration tab. Click on ACC in General Settings. 58 FlexFrame for SAP7.3
Configure the Adaptive Computing Landscape Configuration of ACC Switch to Engine Settings and Press Edit button. Marking Execute user exit scripts is mandatory for using FA_Agents. Please use the right password for sapadm from LDAP! To get a license key for multiple database services please follow SAP Note 919135. After setting up above press Save button! FlexFrame for SAP7.3 59
Configuration of ACC Configure the Adaptive Computing Landscape 4.2.2 Pools, Networks and Characteristics Configuration Navigate to Pools,Networks,and Characteristics Configuration and select tab Pools. The pool names depend on your decision in which way you have installed ACC in a FlexFrame enviroment: 1. ACC pools like FlexFrame groups of hardware: so you have install ACC in every FlexFrame pool. 2. ACC pools like FlexFrame pools : so you have install ACC in a Common pool with network routing to all other pools (Security restrictions!) Switch to Edit mode, click on Add and enter the required data. Then click on Save. 60 FlexFrame for SAP7.3
Configure the Adaptive Computing Landscape Configuration of ACC Select tab Networks and switch to Edit mode, click on Add and enter the required data (depends on the step before and on how many FlexFrame pools you have in your ACC landscape e.g. Client LAN p1, Server LAN p1, Cient LAN p2,.). Then click on Save. FlexFrame for SAP7.3 61
Configuration of ACC Configure the Adaptive Computing Landscape You use this procedure to create new characteristics similar to pool, hierarchy, and so on (which are delivered as standard) and to group the services and resources according to these characteristics. The grouping functionality also makes the mass operations easier to handle. You should define the attributes for the characteristics according to the needs of each company. For example, a company that is located in different time zones could require systems to be started/stopped or relocated in a certain time zone. Due to these needs, in ACC you can now define new characteristics, characteristic values, and the assignment of services and resources to it. 62 FlexFrame for SAP7.3
Configure the Adaptive Computing Landscape Configuration of ACC 4.2.3 Virtualization Manager Configuration Navigate back to Configuration -> Virtualization Manager Configuration. Press Add and select VMware -> Next. Fill in your connection information to your vcenter and press Test Connection button to check your connection to vcenter if successfully press Save button. FlexFrame for SAP7.3 63
Configuration of ACC Configure the Adaptive Computing Landscape In the Virtualization Overview your ESX Servers and VM s are now visible and useable. 64 FlexFrame for SAP7.3
Configure the Adaptive Computing Landscape Configuration of ACC 4.2.4 Configure Resources Navigate back to Configuration -> Landscape Configuration -> Resources to see the servers that are already registered if you have done Step (Register Hosts) and (Start SAPHostAgent). Those are the hosts which are found in the SLD. You can also add resources via Add Resources button by resource detection. FlexFrame for SAP7.3 65
Configuration of ACC Configure the Adaptive Computing Landscape Put in Host Names and press Detect Now button and Next. Please make sure that the Host Agent is started. 66 FlexFrame for SAP7.3
Configure the Adaptive Computing Landscape Configuration of ACC Select corresponding Pool and press Save. FlexFrame for SAP7.3 67
Configuration of ACC Configure the Adaptive Computing Landscape For another example Add Resources and select Virtualization Manager as Source and your Virtualization Manager. Press Retrieve and Next. 68 FlexFrame for SAP7.3
Configure the Adaptive Computing Landscape Configuration of ACC Assign the right pools and Press Save. FlexFrame for SAP7.3 69
Configuration of ACC Configure the Adaptive Computing Landscape 4.2.5 Make Resources ACC enable Select the first one and press Edit button. Activate AC Managed and select the required Pool. Test the connection to server by pressing Test Connection. Click on Next. 70 FlexFrame for SAP7.3
Configure the Adaptive Computing Landscape Configuration of ACC FlexFrame for SAP7.3 71
Configuration of ACC Configure the Adaptive Computing Landscape Select AC Enabled and AC Operational. For resource control you can select SAPS for your server e.g. 2000. To configure network: Press Retrieve & Add Interfaces from Host Agent. Remove all interfaces except the relevant Client and Server LAN. The example above shows vlan s. For VM s it is eth1, eth2. Please check which one is Client or Server LAN. Press Next. With Mass Configuration you can select servers with equal conditions and configure them in one step by pressing the Save & Apply Mass Configuration button. 72 FlexFrame for SAP7.3
Configure the Adaptive Computing Landscape Configuration of ACC FlexFrame for SAP7.3 73
Configuration of ACC Configure the Adaptive Computing Landscape Here you can select different server options. Go on with button Apply. 74 FlexFrame for SAP7.3
Configure the Adaptive Computing Landscape Configuration of ACC FlexFrame for SAP7.3 75
Configuration of ACC Configure the Adaptive Computing Landscape If you have configured all servers you could check them by clicking on tab Resources. Select a resource and press first the Validate Resource Configuration button and then Refresh Monitoring Data button. 76 FlexFrame for SAP7.3
Configure the Adaptive Computing Landscape Configuration of ACC 4.2.6 Configure Services 4.2.6.1 Detect Services by ACC Please make sure that all services you want to detect are up and running! Navigate back to Configuration -> Services. Press the Add Services button. FlexFrame for SAP7.3 77
Configuration of ACC Configure the Adaptive Computing Landscape Fill in the Host Names where the service you want to detect is running. Press Detect Now button and then Next button. 78 FlexFrame for SAP7.3
Configure the Adaptive Computing Landscape Configuration of ACC Press Auto Assign and Save button. FlexFrame for SAP7.3 79
Configuration of ACC Configure the Adaptive Computing Landscape 4.2.7 Make Services ACC enable Select the row with the database of the new system and press Edit button. 80 FlexFrame for SAP7.3
Configure the Adaptive Computing Landscape Configuration of ACC Here you can add Additional Information and test the database admin credentials while pressing the Test Credentials button. Go on with button Next. FlexFrame for SAP7.3 81
Configuration of ACC Configure the Adaptive Computing Landscape Select AC Enabled and select Network. Press Retrieve from Host Agent to select the operating system. You can also fill in Requirements for SAPS, Memory or a Preferred Host. Press Next button to go on. 82 FlexFrame for SAP7.3
Configure the Adaptive Computing Landscape Configuration of ACC Select Automounter in the Mount Point Configuration. FlexFrame for SAP7.3 83
Configuration of ACC Configure the Adaptive Computing Landscape Press Save button or use Mass Configuration if you have similar service configurations. 84 FlexFrame for SAP7.3
Configure the Adaptive Computing Landscape Configuration of ACC Select the row for the central instance and press Edit button. FlexFrame for SAP7.3 85
Configuration of ACC Configure the Adaptive Computing Landscape Here you can add Additional Information and test the instance agent connection while pressing the Test Connection button. Also it s possible to configure a Solution Manager Diagnostic Agent, if it s available. Go on with button Next. If you have the same SID for a SAP System in different pools, it is necessary to have a Universal Unique ID for those systems see SAP Note 1438774 and chapter Same SID in different pools of this document. 86 FlexFrame for SAP7.3
Configure the Adaptive Computing Landscape Configuration of ACC Select AC Enabled and select Network. Add virtual host name for Server LAN. Press Retrieve from Host Agent to select the operating system. You can also fill in Requirements for SAPS, Memory or a Preferred Host. Press Next. FlexFrame for SAP7.3 87
Configuration of ACC Configure the Adaptive Computing Landscape Select Automounter and press Next. 88 FlexFrame for SAP7.3
Configure the Adaptive Computing Landscape Configuration of ACC Press Save button or use Mass Configuration if you have similar service configurations. Go on to configure managed services like the example above. FlexFrame for SAP7.3 89
Configuration of ACC Start/Stop/Relocate Services 4.3 Start/Stop/Relocate Services Switch to Services tab. Here you are able to start/stop and relocate the configured services. Therefore select the service row you like to operate on. There is more help available at http://help.sap.com/saphelp_nwacc73/helpdata/en/index.htm 90 FlexFrame for SAP7.3
Same SID in Different Pools Configuration of ACC 4.4 Same SID in Different Pools Stop all instances of SID. Modify ip name in /etc/hosts of ACC host and pool specifc /etc/hosts: bx920-1:/etc # vi hosts. 10.50.12.52 jca73 jca73.mycompany.com 10.50.14.52 jca73-se jca73-se.mycompany.com 10.50.22.25 p2-app01l7s p2-app01l7s.mycompany.com 10.50.24.25 p2-app01l7s-se p2-app01l7s-se.mycompany.com 10.50.22.26 p2-app02l7s p2-app02l7s.mycompany.com 10.50.24.26 p2-app02l7s-se p2-app02l7s-se.mycompany.com 10.50.22.23 p2-cil7s p2-cil7s.mycompany.com 10.50.24.23 p2-cil7s-se p2-cil7s-se.mycompany.com 10.50.24.24 p2-dbl7s-se p2-dbl7s-se.mycompany.com cn1:/flexframe/volff/os/linux/pool_img/p2/etc # vi hosts 10.50.24.5 cn2-p2-se 10.50.22.25 p2-app01l7s p2-app01l7s.mycompany.com 10.50.24.25 p2-app01l7s-se p2-app01l7s-se.mycompany.com 10.50.22.26 p2-app02l7s p2-app02l7s.mycompany.com 10.50.24.26 p2-app02l7s-se p2-app02l7s-se.mycompany.com 10.50.22.23 p2-cil7s p2-cil7s.mycompany.com 10.50.24.23 p2-cil7s-se p2-cil7s-se.mycompany.com 10.50.24.24 p2-dbl7s-se p2-dbl7s-se.mycompany.com 10.50.22.1 bx920-11 Create uuid: bx920-12:~ # uuidgen e3147c55-239c-4566-82d6-4b1fa299cadb FlexFrame for SAP7.3 91
Configuration of ACC Same SID in Different Pools Change DEFAULT profile: dbl7s-se:l7sadm 53> vi DEFAULT.PFL SAPSYSTEMNAME = L7S SAPGLOBALHOST = p2-cil7s login/system_client = 001 SAPDBHOST = p2-dbl7s-se j2ee/dbtype = sap j2ee/dbname = L7S j2ee/dbhost = p2-dbl7s-se j2ee/dbadminurl = http://p2-dbl7s-se:9999/webdbm?server=p2-dbl7sse&database=l7s&user=control rdisp/bufrefmode = sendon,exeauto DIR_PUT = /usr/sap/$(sapsystemname)/put #----------------------------------------------------------------- ------ # SAP Message Server for ABAP #----------------------------------------------------------------- ------ rdisp/mshost = p2-cil7s rdisp/msserv = sapmsl7s rdisp/msserv_internal = 3900 #----------------------------------------------------------------- ------ # SAP Message Server for ABAP #----------------------------------------------------------------- ------ system/uuid = e3147c55-239c-4566-82d6-4b1fa299cadb Change instance and start profiles: dbl7s-se:l7sadm 54> mv L7S_DVEBMGS00_cil7s L7S_DVEBMGS00_p2-cil7s dbl7s-se:l7sadm 55> vi L7S_DVEBMGS00_p2-cil7s SAPSYSTEMNAME = L7S SAPSYSTEM = 00 INSTANCE_NAME = DVEBMGS00 DIR_CT_RUN = $(DIR_EXE_ROOT)/run DIR_EXECUTABLE = $(DIR_INSTANCE)/exe SAPLOCALHOST = p2-cil7s exe/saposcol = $(DIR_CT_RUN)/saposcol 92 FlexFrame for SAP7.3
Same SID in Different Pools Configuration of ACC dbl7s-se:l7sadm 56> mv START_DVEBMGS00_cil7s START_DVEBMGS00_p2- cil7s dbl7s-se:l7sadm 55> vi START_DVEBMGS00_p2-cil7s SAPSYSTEMNAME = L7S SAPSYSTEM = 00 INSTANCE_NAME = DVEBMGS00 DIR_CT_RUN = $(DIR_EXE_ROOT)/run DIR_EXECUTABLE = $(DIR_INSTANCE)/exe SAPLOCALHOST = p2-cil7s DIR_PROFILE = /sapmnt/l7s/profile _PF = $(DIR_PROFILE)/L7S_DVEBMGS00_p2-cil7s SETENV_00 = LD_LIBRARY_PATH=$(DIR_LIBRARY):%(LD_LIBRARY_PATH) Repeat above step for all instance and start profiles! Check and change if there are some SID specific entries in the sapservices file: bx920-12:/usr/sap/sapservices # vi sapservices LD_LIBRARY_PATH=/usr/sap/L7S/DVEBMGS00/exe:$LD_LIBRARY_PATH; export LD_LIBRARY_PATH; /usr/sap/l7s/dvebmgs00/exe/sapstartsrv pf=/usr/sap/l7s/sys/profile/start_dvebmgs00_p2-cil7s -D -u l7sadm LD_LIBRARY_PATH=/usr/sap/L7S/D01/exe:$LD_LIBRARY_PATH; export LD_LIBRARY_PATH; /usr/sap/l7s/d01/exe/sapstartsrv pf=/usr/sap/l7s/sys/profile/start_d01_p2-app01l7s -D -u l7sadm Start all instances interfaces e.g.: bx920-12:/ ff_service.sh -s L7S -a istart -t db INFO: Version of ff_service.sh: 1.20.2.19 INFO: SAP version found: SAP-7.0 INFO: server_lan interface vlan24:1 10.50.24.24 is (already) up INFO: Exit code: 0 (no error) FlexFrame for SAP7.3 93
Configuration of ACC Same SID in Different Pools Start all instances e.g.: dbl7s-se:l7sadm 53> startsap DVEBMGS00 p2-cil7s Checking ADA db Database ------------------------------ Database is not available via R3trans Running /usr/sap/l7s/sys/exe/run/startdb Now you can go on with chapter Service configuration. 94 FlexFrame for SAP7.3
5 Troubleshooting 5.1 J2EE Server is Restarting License key problem server0 restarts. jcoac:oacadm 52> cd /usr/sap/oac/jc04/j2ee/admin/logviewerstandalone jcoac:oacadm 57>./logviewer.sh java version "1.4.2_05" Java(TM) 2 Runtime Environment, Standard Edition (build 1.4.2_05- b04) Java HotSpot(TM) Client VM (build 1.4.2_05-b04, mixed mode) A valid license key is missing. Use NWA to bring in a valid licence key file. FlexFrame for SAP7.3 95
Troubleshooting J2EE Engine Start Problem 5.2 J2EE Engine Start Problem If server0 in jcmon tool is always in phase Starting Framework or Starting Applications please change VM parameter java.security.egd to file /dev/./urandom like below and press Set: Please take care for the dot in the path name. 96 FlexFrame for SAP7.3
J2EE Engine Start Problem Troubleshooting Press Diskette symbol to save and restart java instance (server0): FlexFrame for SAP7.3 97
Troubleshooting Resource Unlock 5.3 Resource Unlock If error messages like Ressource konnte nicht gesperrt werden are displayed or some resources are not available 98 FlexFrame for SAP7.3
Resource Unlock Troubleshooting then go to NWA -> Problem Management -> Locks and release locks: Often it s also helpful to restart the routing-service. Press Refresh Button for routing service or start and stop application. FlexFrame for SAP7.3 99
Troubleshooting Resource Unlock 100 FlexFrame for SAP7.3
6 Abbreviations ABAP ACC ACI ACPI APM APO CIFS DHCP ERP ESF EULA FAA FC FSC FTP IP LAN LDAP LUN MAC MINRA NAS NDMP NIC NVRAM OBP Advanced Business Application Programming Adaptive Computing Controller Adaptive Computing Infrastructure Advanced Configuration and Power Interface Advanced Power Management Advanced Planner & Optimizer Common Internet File System Dynamic Host Configuration Protocol Enterprise Resource Planning Enhanced System Facility End User License Agreement FlexFrame Autonomous Agent Fiber Channel FlexFrame Software Container, name part used for Images and CDs/DVDs File Transfer Protocol Internet Protocol Local Area Network Lightweight Directory Access Protocol Logical Unit Number Media Access Control Minimal Read Ahead Network Attached Storage Network Data Management Protocol Network Interface Card Non-Volatile Random Access Memory Open Boot Prom FlexFrame for SAP7.3 101
Abbreviations OLTP ONTAP OSS POST PXE PY RAID RARB RDBMS RHEL RSB SCS SAP BW SAPGUI SAPOSS SID SLD SLES SMB SMC SPOC TELNET TFTP UDP UPS VLAN VTOC WAN On-Line Transaction Processing Open Network Technology for Appliance Products Open Source Software Power-On Self Test Preboot Execution Environment PRIMERGY Redundant Array of Independent (or Inexpensive) Disks Reverse Address Resolution Protocol Relational Database Management System Red Hat Enterprise Linux Remote Service Board System Console Software SAP Business Warehouse SAP Graphical User Interface SAP Online System Service System Identifier System Landscape Directory SuSE Linux Enterprise Server Server Message Block System Management Console Single Point Of Control Telecommunications Network Trivial File Transfer Protocol User Datagram Protocol Uninterruptible Power Supply Virtual Local Area Network Virtual Table Of Contents Wide Area Network 102 FlexFrame for SAP7.3
Abbreviations WAS WAFL XSCF Web Application Server Write Anywhere File Layout Extended System Control Facility FlexFrame for SAP7.3 103
7 Glossary Adaptive Computing Controller (ACC) SAP system for monitoring and controlling SAP environments. Advanced Business Application Programming (ABAP) Proprietary programming language of SAP. Advanced Power Management (APM) A standard for power saving and management in computers. Application Agent A software program for monitoring and managing applications. Application Node (AN) A host for applications (e.g. SAP instances db, ci, agate, wgate, app etc.). This definition includes Application Servers as well as Database Servers. Automounter The automounter is an NFS utility that automatically mounts directories on an NFS client as they are needed, and unmounts them when they are no longer needed. Autonomous Agent Central system management and high availability software component of FlexFrame. Blade A special form factor for computer nodes. BRBACKUP SAP backup and restore tools. Client LAN Virtual network segment within FlexFrame, used for client-server traffic. Common Internet File System (CIFS) A protocol for the sharing of file systems (same as SMB). Computing Node From the SAP ACI perspective: A host that is used for applications. Control Agent A software program for monitoring and managing nodes within FlexFrame. FlexFrame for SAP7.3 105
Glossary Control LAN Virtual network segment within FlexFrame, used for system management traffic. Control Node (CN) A physical computer system, controlling and monitoring the entire FlexFrame landscape and running shared services in the rack (dhcp, tftp, ldap etc.). Control Station An Application Node running SAP ACC. Dynamic Host Configuration Protocol (DHCP) DHCP is a protocol for assigning dynamic IP addresses to devices on a network. Dynamic Host Configuration Protocol (DHCP) server A DHCP server provides configuration parameters specific to the DHCP client host, required by the host to participate on the Internet. Enterprise Resource Planning (ERP) Enterprise Resource Planning systems are management information systems that integrate and automate many of the business practices associated with the operations or production aspects of a company. Ethernet A Local Area Network which supports data transfer rates of 10 Megabits per second. Fiber Channel Fibre Channel is a serial computer bus intended for connecting high-speed storage devices to computers. Filer Network attached storage for file systems. FlexFrame for mysap Business Suite FlexFrame for mysap Business Suite is a radically new architecture for mysap environments. It exploits the latest business-critical computing technology to deliver major cost savings for SAP customers. Gigabit Ethernet A Local Area Network which supports data transfer rates of 1 Gigabit (1,024 Megabits) per second. Host name Name of a physical server as seen from outside the network. One physical server may have multiple host names. 106 FlexFrame for SAP7.3
Glossary Image In the FlexFrame documentation, Image is used as a synonym for Hard Disk Image. Internet Protocol (IP) Address A unique number used by computers to refer to each other when sending information through networks using the Internet Protocol. Lightweight Directory Access Protocol (LDAP) Protocol for accessing on-line directory services. Local Area Network (LAN) A computer network that spans a relatively small area. Most LANs are confined to a single building or group of buildings. However, one LAN can be connected to other LANs over any distance via telephone lines and radio waves. A system of LANs connected in this way is called a Wide Area Network (WAN). Local host name The name of the node (physical computer); it can be displayed and set using the command /bin/hostname. Logical Unit Number (LUN) An address for a single (SCSI) disk drive. MaxDB A relational database system from mysql (formerly ADABAS and SAPDB). Media Access Control (MAC) address An identifier for network devices, usually unique. The MAC address is stored physically on the device. mysap Business Suite The main ERP software produced of SAP AG. NDMPcopy NDMPcopy transfers data between Filers using the Network Data Management Protocol (NDMP). Netboot A boot procedure for computers where the operating system is provided via a network instead of local disks. Netweaver SAP NetWeaver is the technical foundation of mysap Business Suite solutions. Network Appliance Filer See Filer. FlexFrame for SAP7.3 107
Glossary Network Attached Storage (NAS) A data storage device that is connected via a network to one or multiple computers. Network File System (NFS) A network protocol for network-based storage access. Network Interface Card (NIC) A hardware device that allows computer communication via networks. Node A physical computer system controlled by an OS. Node name The name of a physical node as returned by the command uname n. Each node name within a FlexFrame environment must be unique. Non-Volatile Random Access Memory (NVRAM) A type of memory that retains its contents when the power is turned off. On-Line Transaction Processing Transaction processing via computer networks. OpenLDAP An Open Source LDAP Service Implementation. Open Network Technology for Appliance Products The operating system of Network Appliance Filers. Open Source Software (OSS) Software that is distributed free of charge under an open source license, such as the GNU General Public License. Oracle RAC A cluster database by Oracle Corporation. Physical host Name of a physical computer system (node). Power-On Self Test (POST) Part of a computer's boot process; automatic testing of diverse hardware components. Preboot Execution Environment An environment that allows a computer to boot from a network resource without having a local operating system installed. PRIMERGY Fujitsu's i386-based server product line. 108 FlexFrame for SAP7.3
Glossary Red Hat Enterprise Linux Linux distribution by Red Hat, Inc., targeting business customers. Reverse Address Resolution Protocol (RARP) A protocol allowing resolution of an IP address corresponding to a MAC address. SAP Service In FlexFrame: SAP Service and DB Services. SAP service script An administration script for starting and stopping an SAP application on a virtual host. SAP Solution Manager Service portal for the implementation, operation and optimization of an SAP solution. SAPLogon Front-end software for SAPGUI. SAPRouter Router for SAP services like SAPGUI or SAPTELNET. Server A physical host (hardware), same as node. Service A software program providing functions to clients. Service type The type of an application or service (db, ci, app, agate, wgate etc.). Single Point of Control In FlexFrame: One user interface to control a whole FlexFrame environment. Storage LAN A virtual LAN segment within a FlexFrame environment, carrying the traffic to the Filer. SuSE Linux Enterprise Server A Linux distribution by Novell, specializing in server installations. Trivial File Transfer Protocol A simple form of the File Transfer Protocol (FTP). TFTP uses the User Datagram Protocol (UDP) and provides no security features. It is often used by servers to boot diskless workstations, X-terminals, and routers. TFTP server A simple FTP implementation. FlexFrame for SAP7.3 109
Glossary Virtual host Before an application starts, the virtual host name is assigned to the physical host where the application is to run. From the application's perspective, it always runs on the same virtual host, even if the application is moved to another physical host. The following rule forms the host names of virtual services: <service_type>[<id>]<sid>[<-lan type] where <service_type> can be one of: ci - central instance (ABAP) db - database instance app - application instance (ABAP) ascs - ABAP SAP central services instance scs - JAVA SAP central services instance jc - JAVA central instance j - JAVA application instance <ID> is a number from 00 to 96 (except: 2, 25, 43, 72, 89) for the service types app and j only. It is empty for other service types. <SID> is the system ID of an SAP system. <LAN type> -se empty string Server LAN Client LAN This host name formation rule for virtual services is mandatory in version 3.2 of the FlexFrame solution. Some components rely on this rule. Within a FlexFrame environment, each node name must be unique. However, each node may have multiple host names that are derived from the node name by a defined naming rule. In SAP environments host names are currently limited to 13 alphanumeric characters including the hyphen ( - ). The first character must be a letter. In the SAP environment host names are case-sensitive. (See SAP Note No. 611361) Virtual Local Area Network A VLAN is a logically segmented network mapped over physical hardware according to the IEEE 802.1q standard. 110 FlexFrame for SAP7.3
Glossary Virtualization Virtualization means the separation of hardware and processes. In a virtualized environment (FlexFrame), a process can be moved between hardware nodes while staying transparent to the user and application. FlexFrame for SAP7.3 111
8 Index A abbreviations 101 ACC installation 5 ACC users user administration 45 D document history 1 documentation 3 G general preparations 3 glossary 105 L landscape making adaptive 57 N notational conventions 1 P post installation activities 28 R required software 3 S SLD configuration 57 T troubleshooting 95 FlexFrame for SAP7.3 112