Zenoss Resource Mnger Instlltion Guide Relese 5.2.3 Zenoss, Inc. www.zenoss.com
Zenoss Resource Mnger Instlltion Guide Copyright 2017 Zenoss, Inc. All rights reserved. Zenoss nd the Zenoss logo re trdemrks or registered trdemrks of Zenoss, Inc., in the United Sttes nd other countries. All other trdemrks, logos, nd service mrks re the property of Zenoss or other third prties. Use of these mrks is prohiited without the express written consent of Zenoss, Inc., or the third-prty owner. Amzon We Services, AWS, nd EC2 re trdemrks of Amzon.com, Inc. or its ffilites in the United Sttes nd/or other countries. Flsh is registered trdemrk of Adoe Systems Incorported. Orcle, the Orcle logo, Jv, nd MySQL re registered trdemrks of the Orcle Corportion nd/or its ffilites. Linux is registered trdemrk of Linus Torvlds. RitMQ is trdemrk of Pivotl Softwre, Inc. SNMP Informnt is trdemrk of Grth K. Willims (Informnt Systems, Inc.). Syse is registered trdemrk of Syse, Inc. Tomct is trdemrk of the Apche Softwre Foundtion. VMwre is registered trdemrk or trdemrk of VMwre, Inc. in the United Sttes nd/or other jurisdictions. Windows is registered trdemrk of Microsoft Corportion in the United Sttes nd other countries. All other compnies nd products mentioned re trdemrks nd property of their respective owners. Prt Numer: 1052.17.100 Zenoss, Inc. 11305 Four Points Drive Bldg 1 - Suite 300 Austin, Texs 78726 2
Contents Aout this guide...5 Supported operting environments...8 Chpter 1: Instlling Resource Mnger... 9 Instlling the Resource Mnger templte...9 Optionl: Importing Resource Mnger imges... 10 Deploying Resource Mnger... 10 Chpter 2: Instlling Resource Mnger in high-vilility cluster...12 Instlling the Resource Mnger templte...12 Importing Resource Mnger imges...12 Deploying Resource Mnger... 13 Prt I: Applince deployments... 15 Chpter 3: Instlling Control Center mster host... 16 Creting virtul mchine... 16 Configuring the Control Center host...19 Edit connection... 20 Set system hostnme...22 Adding the mster host to resource pool... 23 Deploying Resource Mnger... 24 Chpter 4: Instlling delegte hosts... 25 Creting virtul mchine... 25 Configuring the virtul mchine...28 Edit connection... 29 Set system hostnme...31 Editing the /etc/hosts file...32 Chpter 5: Configuring multi-host Control Center cluster...34 Enling NTP on Microsoft Hyper-V guests...34 Adding hosts to the defult resource pool... 38 Chpter 6: Configuring ZooKeeper ensemle...39 ZooKeeper nd Control Center... 39 Understnding the configurtion process... 39 Configuring the mster host s ZooKeeper node...41 Configuring delegte host A s ZooKeeper node... 42 Configuring delegte host B s ZooKeeper node... 44 Instlling the ZooKeeper imge for Docker Engine... 45 3
Strting ZooKeeper ensemle... 46 Updting delegte hosts...47 Appendix A: Prepring to instll without internet ccess...49 Downloding Resource Mnger imge files... 49 Stging the Resource Mnger service definition...49 Stging Docker Engine imge files...50 4
Aout this guide Aout this guide Zenoss Resource Mnger Instlltion Guide provides detiled procedures for instlling Zenoss Resource Mnger (Resource Mnger). Relted Resource Mnger pulictions Title Zenoss Resource Mnger Administrtion Guide Zenoss Resource Mnger Configurtion Guide Zenoss Resource Mnger Instlltion Guide Zenoss Resource Mnger Plnning Guide Zenoss Resource Mnger Relese Notes Zenoss Resource Mnger Upgrde Guide Description Provides n overview of Resource Mnger rchitecture nd fetures, s well s procedures nd exmples to help use the system. Provides required nd optionl configurtion procedures for Resource Mnger, to prepre your deployment for monitoring in your environment. Provides detiled informtion nd procedures for creting deployments of Control Center nd Resource Mnger. Provides oth generl nd specific informtion for prepring to deploy Resource Mnger. Descries known issues, fixed issues, nd ltereking informtion not lredy provided in the pulished documenttion set. Provides detiled informtion nd procedures for upgrding deployments of Resource Mnger. Additionl informtion nd comments If you hve technicl questions out this product tht re not nswered in this guide, plese visit the Zenoss Support site or contct Zenoss Support. Zenoss welcomes your comments nd suggestions regrding our documenttion. To shre your comments, plese send n emil to docs@zenoss.com. In the emil, include the document title nd prt numer. The prt numer ppers t the end of the list of trdemrks, t the front of this guide. Chnge history The following list ssocites document prt numers nd the importnt chnges to this guide since the previous relese. Some of the chnges involve fetures or content, ut others do not. For informtion out new or chnged fetures, refer to the Zenoss Resource Mnger Relese Notes. 1052.17.100 (5.2.3) Add chpter for high-vilility instlltions. New procedures for instlling the pplince with Hyper-V. Updte relese numers. 1052.17.58 (5.2.2) Remove procedure for dding storge for ckups (no longer required for pplinces). 1052.17.044 (5.2.1) Updte relese numers. 5
Zenoss Resource Mnger Instlltion Guide 1052.16.335 (5.2.0) Add section detiling the supported operting environments. Remove procedures for instlling Control Center clusters. Tht informtion is now in the Control Center Instlltion Guide. Remove the high-vilility chpters. High-vilility instlltions re now performed y Zenoss personnel. Remove the pplince instlltion chpters. The chpters will e replced when the pplinces re ville. The instructions for downloding nd instlling the softwre rtifcts for offline deployments re now in n ppendix. 1052.16.316 Updte relese numers. 1052.16.291 Updte relese numers. 1052.16.277 Updte relese numers. 1052.16.264 Updte relese numers. 1052.16.257 Added supported operting environments nd updted relese numers. 1052.16.207 Updte relese numers. 1052.16.176 Updte relese numers. 1052.16.153 Updte relese numers. 1052.16.146 Updte relese numers. 1052.16.125 Refine the procedure for creting the ppliction dt thin pool. 1052.16.118 Add support for Resource Mnger 5.1.2. Add sustep to crete the docker override directory. 1052.16.111 Add this document chnge history. Add chpters descriing how to instll the Resource Mnger pplince. Chpters re orgnized into prts. Docker configurtion steps now dd the storge driver flg (-s devicempper) to the /etc/ sysconfig/docker file. Docker needs longer strtup timeout vlue, to work round known Docker issue with the devicempper driver. Docker configurtion steps now include dding TimeoutSec=300. Rther thn editing /li/systemd/system/docker.service, Docker configurtion steps now include dding systemd override file. Add symlink to /tmp in /vr/li/docker. Updte the commnds for strting nd testing ZooKeeper ensemle. 6
Aout this guide Add procedure for updting the SERVICED_ZK vlue on delegte hosts tht re not memers of ZooKeeper ensemle. Add reference topic for the ZooKeeper vriles required on hosts in Control Center cluster. Add procedures for configuring n NTP server nd clients for offline deployments. Add step to instll the Nmp Nct pckge, which is used to check ZooKeeper ensemle sttus. 1052.16.060 Plnning informtion is now in the Zenoss Resource Mnger Plnning Guide. Informtion out how to strt nd configure Resource Mnger is now in the Zenoss Resource Mnger Configurtion Guide. New procedures re included, for instlling without internet ccess, nd for instlling high-vilility deployments. 7
Zenoss Resource Mnger Instlltion Guide Supported operting environments The Resource Mnger ppliction is deployed in nd mnged y Control Center. The supported operting environments of Resource Mnger re the environments tht Control Center supports t given relese. The following sections identify the supported operting environments of Resource Mnger. Resource Mnger, Control Center, nd operting systems The following tle identifies the supported comintions of Resource Mnger, Control Center, nd operting system releses. Resource Mnger Relese Control Center Relese Host OS 5.2.0, 5.2.1, 5.2.2, 5.2.3 1.2.0, 1.2.1, 1.2.2, 1.2.3, 1.3.0, 1.3.1 RHEL/CentOS 7.1, 7.2, or 7.3 (64-it) 5.1.9, 5.1.10 1.1.9, 1.2.0 RHEL/CentOS 7.1 or 7.2 (64-it) 5.1.8 1.1.5, 1.1.6, 1.1.7. 1.1.8, 1.1.9 RHEL/CentOS 7.1 or 7.2 (64-it) 5.1.7 1.1.5, 1.1.6, 1.1.7, 1.1.8 RHEL/CentOS 7.1 or 7.2 (64-it) 5.1.6 (internl relese only) (none) (none) 5.1.4, 5.1.5 1.1.5, 1.1.6, 1.1.7 RHEL/CentOS 7.1 or 7.2 (64-it) 5.1.3 1.1.2, 1.1.3, 1.1.5 RHEL/CentOS 7.1 or 7.2 (64-it) 5.1.2 1.1.2, 1.1.3 RHEL/CentOS 7.1 or 7.2 (64-it) 5.1.1 1.1.1, 1.1.2 RHEL/CentOS 7.1 or 7.2 (64-it) Hypervisors Hypervisor Versions VMwre vsphere 5.0, 5.1, 5.5, 6.0 Microsoft Hyper-V Version 2.0 with Windows Server 2008 R2 SP1 Version 3.0 with Windows Server 2012 nd 2012 R2 Pulic cloud pltforms Amzon We Services (AWS) is fully supported. Microsoft Azure is supported only for collector pools. Deploying full Control Center cluster to operte Resource Mnger is NOT supported on Microsoft Azure. Supported clients nd rowsers Resource Mnger supports the sme client operting systems nd we rowsers tht Control Center supports. For more informtion, refer to Control Center documenttion. 8
Instlling Resource Mnger Instlling Resource Mnger 1 This chpter descries how to instll Resource Mnger on Control Center cluster. For more informtion out creting Control Center cluster, refer to the following documents: Control Center Plnning Guide Zenoss Resource Mnger Plnning Guide Control Center Instlltion Guide If you re instlling on Control Center cluster tht does not hve internet ccess, perform the procedures in Prepring to instll without internet ccess on pge 49, nd then perform the procedures in this chpter. Instlling the Resource Mnger templte Use this procedure to instll the Resource Mnger service definition templte on the Control Center mster host. If you re instlling on Control Center cluster tht does not hve internet ccess, perform the procedures in Prepring to instll without internet ccess on pge 49 nd then perform this procedure. 1 Log in to the Control Center mster host s root, or s user with superuser privileges. 2 Instll the Resource Mnger templte file. With internet ccess: yum --enlerepo=zenoss-stle instll -y zenoss-resmgr-service-5.2.3 Without internet ccess: yum instll -y /tmp/zenoss-resmgr-service-5.2.3.norch.rpm The templte file is stored in /opt/serviced/templtes. 3 Authenticte to the Docker Hu repository. Replce Userwith the nme of your Docker Hu ccount. docker login -u User The docker service prompts you for the pssword of the Docker Hu ccount, nd sves hsh of the credentils in the $HOME/.docker/config.json file (root user ccount). 9
Zenoss Resource Mnger Instlltion Guide Optionl: Importing Resource Mnger imges Use this procedure to import the Resource Mnger imges into the locl registry. This procedure is only required on Control Center cluster tht does not hve internet ccess. For more informtion, see Prepring to instll without internet ccess on pge 49. 1 Log in to the Control Center mster host s root, or s user with superuser privileges. 2 Chnge directory to /root. cd /root 3 Import the imges. The imges re contined in self-extrcting rchive files. for imge in instll-*.run do echo -n "$imge: "./$imge done Importing egins when you press the y key. If you press y nd then press Enter, the current imge is imported, ut the next one is not. 4 List the imges in the registry. docker imges The result should include one imge for ech rchive file. 5 Optionl: Delete the rchive files. rm -i./instll-*.run Deploying Resource Mnger Use this procedure to dd the Resource Mnger ppliction to Control Center, nd to pull ppliction imges into the locl registry. 1 Log in to the Control Center mster host s user with serviced CLI privileges. 2 Add the Resource Mnger ppliction templte to Control Center. serviced templte dd /opt/serviced/templtes/zenoss*.json On success, the serviced commnd returns the templte ID. 3 Identify the resource pool to which the host elongs. serviced host list 4 Deploy the ppliction. Replce Templte-ID with the identifier Resource Mnger templte Replce Pool with the nme of the resource pool to which the mster host elongs (single-host system) or to which the delegte hosts elong (multi-host system) 10
Instlling Resource Mnger Replce Deployment with nme for this deployment (for exmple, Test or Production) serviced templte deploy Templte-ID Pool Deployment Control Center pulls Resource Mnger imges into the locl registry, or just tgs the imges. Resource Mnger is redy to e configured for your environment. For more informtion, refer to the Zenoss Resource Mnger Configurtion Guide. 11
Zenoss Resource Mnger Instlltion Guide Instlling Resource Mnger in highvilility 2 cluster This chpter descries how to instll Resource Mnger on high-vilility Control Center cluster. For more informtion out creting high-vilility Control Center cluster, refer to the Control Center Instlltion Guide for High-Avilility Deployments. Note Perform the procedures in Prepring to instll without internet ccess on pge 49 nd then strt the procedures in this chpter. Instlling the Resource Mnger templte Use this procedure to instll the Resource Mnger service definition templte on Control Center mster host node. Perform this procedure on oth mster host nodes. 1 Log in to the Control Center mster host s root, or s user with superuser privileges. 2 Instll the Resource Mnger templte file. yum instll -y /tmp/zenoss-resmgr-service-5.2.3.norch.rpm The templte file is stored in /opt/serviced/templtes. Importing Resource Mnger imges Use this procedure to import the Resource Mnger imges into the locl registry. Perform this procedure on oth mster host nodes. 1 Log in to the Control Center mster host s root, or s user with superuser privileges. 2 Chnge directory to /root. cd /root 3 Import the imges. The imges re contined in self-extrcting rchive files. for imge in instll-*.run do echo -n "$imge: "./$imge done 12
Instlling Resource Mnger in high-vilility cluster Importing egins when you press y. If you press y nd then press Enter, the current imge is imported, ut the next one is not. 4 List the imges in the registry. docker imges The result should include one imge for ech rchive file. 5 Optionl: Delete the rchive files. rm -i./instll-*.run Deploying Resource Mnger Use this procedure to instll the Resource Mnger templte nd then deploy the ppliction. 1 Use the virtul hostnme (HA-Virtul-Nme) or virtul IP ddress (HA-Virtul-IP) of the high-vilility cluster to strt Bsh shell on the Control Center mster host s root, or s user with superuser privileges. 2 Disply the pulic hostnme of the current node. unme -n The result is either Primry-Pulic-Nme or Secondry-Pulic-Nme. 3 Plce the other node in stndy mode. This voids potentil conflicts nd errors in the event of n unexpected serviced shutdown during the initil deployment. Replce Other-Node-Hostnme with the pulic hostnme of the other node: pcs cluster stndy Other-Node-Hostnme 4 Add the Resource Mnger ppliction templte to Control Center. serviced templte dd /opt/serviced/templtes/zenoss*.json On success, the serviced commnd returns the templte ID. 5 Identify the resource pool to which the mster host elongs. serviced host list 6 Deploy the ppliction. Replce Templte-ID with the identifier Resource Mnger templte Replce Pool with the nme of the resource pool to which the mster host elongs (single-host system) or to which the delegte hosts elong (multi-host system) Replce Deployment with nme for this deployment (for exmple, Test or Production) serviced templte deploy Templte-ID Pool Deployment Control Center tgs the Resource Mnger imges. 7 Restore the cluster. 13
Zenoss Resource Mnger Instlltion Guide Replce Stndy-Node-Hostnme with the pulic hostnme of the node tht is in stndy mode: pcs cluster unstndy Stndy-Node-Hostnme Resource Mnger is redy to e configured for your environment. For more informtion, refer to the Zenoss Resource Mnger Configurtion Guide. Note In high-vilility deployments, the mrid-events nd mrid-model services must e in the sme resource pool s the mster host nodes. A procedure for moving the services from their defult pool is provided in the Zenoss Resource Mnger Configurtion Guide. 14
Applince deployments Prt I: Applince deployments The chpters in this prt descrie how to instll the Resource Mnger pplince, pre-configured virtul mchine tht is redy to deploy to your hypervisor. The instructions include vriety of options for customizing your deployment for your environment. 15
Zenoss Resource Mnger Instlltion Guide Instlling Control Center mster host 3 This chpter descries how to instll Resource Mnger pplince pckge s Control Center mster host. The procedures in this chpter configure Control Center mster host tht functions s oth mster nd delegte. Perform the procedures in this chpter whether you re configuring single-host or multi-host deployment. (For more informtion out configuring multi-host deployment, see Configuring multi-host cluster.) Creting virtul mchine You cn crete virtul mchine for the Resource Mnger pplince with VMwre vsphere or Microsoft Hyper-V. Choose one of the procedures in this section. Creting virtul mchine with vsphere To perform this tsk, you need: A VMwre vsphere client Permission to downlod Resource Mnger softwre from the Zenoss Support site This procedure instlls Resource Mnger mster OVA pckges s virtul mchine mnged y vsphere Server version 5.5.0, using VMwre vsphere Client 5.5.0. The procedure is slightly different with different versions of VMwre vsphere Client. There re two seprte OVA pckges, one for the mster host nd one for delegtes. 1 Downlod the Resource Mnger mster host OVA file from the Zenoss Support site to your worksttion. 2 Use the VMwre vsphere Client to log in to vcenter s root, or s user with superuser privileges, nd then disply the Home view. 16
Instlling Control Center mster host Figure 1: vsphere client Home view 3 From the File menu, select Deploy OVF Templte. 4 In the Source pnel, specify the pth of the Resource Mnger mster pckge, nd then click Next. 5 In the OVF Templte Detils pnel, click Next. 6 In the Nme nd Loction pnel, provide nme nd loction for the server. In the Nme field, enter new nme or use the defult. In the Inventory Loction re, select dt center for the virtul mchine. c Click Next. 7 In the Host / Cluster pnel, select host system, nd then click Next. 8 In the Storge pnel, select storge system with sufficient spce for your deployment, nd then click Next. 9 In the Disk Formt pnel, select Thin Provison, nd then click Next. 10 In the Redy to Complete pnel, review the deployment settings, nd then click Finish. Do not check Power on fter deployment. 11 Nvigte to the new virtul mchine's Getting Strted or Summry t, nd then click Edit virtul mchine settings. 12 Optionl: Updte the memory ssigned to the mchine. In the Virtul Mchine Properties dilog ox, select Memory in the Hrdwre tle. In the Memory Configurtion re, set the Memory Size field to 16GB (multi-host deployments) or 32GB (single-host deployments). For single-host deployments, you cn ssign greter mount of RAM. 13 Optionl: Updte the numer of CPU sockets ssigned to the mchine, if desired. Only 4 CPUs re needed for multi-host deployments. In the Virtul Mchine Properties dilog ox, select CPUs in the Hrdwre tle. Set the Numer of virtul sockets field to 4 (multi-host deployments), nd set the Numer of cores per socket field to 1. 14 At the ottom of the Virtul Mchine Properties dilog ox, click OK. 15 On the new virtul mchine's Getting Strted t, click Power on virtul mchine, nd then click the Console t. Creting virtul mchine with Hyper-V To perform this tsk, you need: A Microsoft Remote Desktop Connection Administrtor privileges on Microsoft Hyper-V server Permission to downlod Resource Mnger softwre from the Zenoss Support site 17
Zenoss Resource Mnger Instlltion Guide This procedure instlls the Resource Mnger pplince s virtul mchine mnged y Microsoft Hyper-V. There re seprte ISO files for the mster host nd delegtes. In this procedure, you downlod nd instll the mster ISO file. A seprte procedure provides instructions for instlling delegtes. 1 Use Microsoft Remote Desktop Connection to log in to Hyper-V host s Administrtor, or s user with Administrtor privileges. 2 Downlod the Resource Mnger ISO file from the Zenoss Support site to the Hyper-V host. Choose the mster ISO file. 3 Open Hyper-V Mnger. 4 In the left nvigtion pne, choose server to host the virtul mchine. 5 From the Actions pne, choose New > Virtul Mchine. 6 In the Specify Nme nd Loction pnel, provide nme for the virtul mchine, nd then click Next. 7 In the Specify Genertion pnel, select Genertion 1, nd then click Next. 8 In the Assign Memory pnel, specify memory informtion s follows: In Strtup memory: For multi-host deployments, enter 16384 (16GB). For single-host deployments, enter 32768 (32GB). Check Use Dynmic Memory for this virtul mchine. c Click Next. 9 In the Configure Networking pnel's Connection field, choose virtul switch, nd then click Next. 10 In the Connect Virtul Hrd Disk pnel, crete new disk on which to instll the guest operting system, s follows: Choose Crete virtul hrd disk. Specify nme. c In the Size field, enter 30. d Click Next. In lter step, you will crete dditionl disks. 11 In the Instlltion Options pnel, ccess the ISO file s follows: c Choose Instll n operting system from ootle CD/DVD-ROM. Choose Imge file (.iso). Specify or rowse to the loction of the ISO imge file. Choose the mster ISO file. d Click Next. 12 In the Summry pnel, review the description, nd then click Finish. Hyper-V Mnger cretes the new virtul mchine, nd then closes the New Virtul Mchine Wizrd. 13 In the Hyper-V Mnger Virtul Mchines re, choose the new virtul mchine, right-click, nd then choose Settings. 14 In the Hrdwre re of the Settings window, configure s follows: c Ensure tht the virtul hrd disk tht you creted is ttched to n IDE controller. A Hyper-V guest mchine cn only oot from n IDE drive. Choose Processor. In Numer of virtul processors, enter the following vlue for your deployment type: Multi-host deployment: 4 Single-host deployment: 8 d Click Apply. 15 Crete dditionl virtul hrd disks s follows: 18
Instlling Control Center mster host c d e f g h i j In the Hrdwre re of the Settings window, choose ny controller nd loction tht will ccommodte the disk. In the controller re on the right, choose Hrd Drive, nd then click Add. In the Hrd Drive re, choose Virtul hrd disk, nd then click New. In the New Virtul Hrd Disk Wizrd: 1 Nvigte to the Choose Disk Formt pnel. 2 Choose VHDX. 3 Click Next. In the Choose Disk Type pnel, choose Dynmiclly expnding, nd then click Next. In the Specify Nme nd Loction pnel, enter the disk nme, nd then click Next. In the Configure Disk pnel: 1 Choose Crete new lnk virtul hrd disk. 2 In the Size field, enter 50. 3 Click Next. In the Summry pnel, verify the description, nd then click Finish. In the Settings window, click Apply. Repet these susteps to crete virtul hrd disks sized s follows: 150GB 50GB 200GB 16GB 16GB When viewed from the Linux system, the disks might e reordered; however, the instlltion is not ffected y disk order. k In the Settings dilog ox, click Apply, nd then click OK. 16 In the Hyper-V Mnger Virtul Mchines re, choose the new virtul mchine, right-click, nd then choose Strt. Figure 2: Strting virtul mchine 17 In the Hyper-V Mnger Virtul Mchines re, choose the new virtul mchine, nd then right-click, nd then choose Connect. 18 In the Virtul Mchine Connection window, press Enter. The pplince instlltion process tkes out 15 minutes, nd should complete with no dditionl input. Disregrd the Fst TSC clirtion filure messge. Configuring the Control Center host Perform this procedure immeditely fter creting nd strting Control Center host. All Control Center deployments must include one system configured s the mster host. 19
Zenoss Resource Mnger Instlltion Guide 1 Gin ccess to the console interfce of the Control Center host through your hypervisor console interfce. Figure 3: Initil hypervisor console login prompt 2 Log in s the root user. The initil pssword is provided in the console. 3 The system prompts you to enter new pssword for root. Note Psswords must include minimum of eight chrcters, with t lest one chrcter from three of the following chrcter clsses: uppercse letter, lowercse letter, digit, nd specil. 4 The system prompts you to enter new pssword for ccuser. The ccuser ccount is the defult ccount for gining ccess to the Control Center rowser interfce. Edit connection The defult configurtion for network connections is DHCP. To configure sttic IPv4 ddressing, perform this procedure. To nvigte in the text user interfce (TUI): To move forwrd or ckwrd through options, press the rrow keys or press T or Shift+T. To disply menu or choose n option, press Enter. 1 Gin ccess to the Control Center host, through the console interfce of your hypervisor, or through remote shell utility such s PuTTY. 2 Log in s the root user. 20
Instlling Control Center mster host 3 Select the NetworkMnger TUI menu s follows: In the Applince Administrtion menu, select Configure Network nd DNS, nd then press Enter. 4 On the NetworkMnger TUI menu, select Edit connection, nd then press Enter. The TUI displys the connections tht re ville on this host. Figure 4: Exmple: Aville connections Note Do not modify the docker0 connection. 5 Select the virtul connection, nd then press Enter. 21
Zenoss Resource Mnger Instlltion Guide Figure 5: Exmple: Edit Connection screen 6 Optionl: If the IPv4 CONFIGURATION re is not visile, select its disply option (<Show>), nd then press Enter. 7 In the IPv4 CONFIGURATION re, select <Automtic>, nd then press Enter. Figure 6: Exmple: IPv4 Configurtion options 8 Configure sttic IPv4 networking s follows: Select Mnul, nd then press Enter. Select <Add> next to Addresses, nd then press Enter. c In the Addresses field, enter n IPv4 ddress for the virtul mchine, nd then press Enter. d Repet the preceding two steps for the Gtewy nd DNS servers fields. 9 Select <OK> t the ottom of the Edit Connection screen, nd then press Enter. 10 On the NetworkMnger TUI screen, use the T key to select the <Quit> option, nd then press the Return key to go ck to the Applince Administrtion menu. 11 Reoot the operting system s follows: c In the Applince Administrtion menu, select Reoot / Poweroff System. Select Reoot. Select OK, nd then press Enter. Set system hostnme The defult hostnme is zsd-mster for the Resource Mnger mster host nd is zsd-delegte for the Resource Mnger delegte host. To chnge the defult hostnme, perform this procedure. 1 Gin ccess to the Control Center host, through the console interfce of your hypervisor, or through remote shell utility such s PuTTY. 2 Select the NetworkMnger TUI menu s follows: In the Applince Administrtion menu, select Configure Network nd DNS, nd then press Enter. 22
Instlling Control Center mster host 3 Disply the hostnme entry field. In the NetworkMnger TUI menu, select Set system hostnme. Press T to select OK, nd then press Enter. 4 In the Hostnme field, enter the hostnme or fully qulified domin nme. 5 Press T twice to select OK, nd then press Enter. 6 In the confirmtion dilog ox, press Enter. 7 Reoot the operting system s follows: c In the Applince Administrtion menu, select Reoot / Poweroff System. Select Reoot. Select OK, nd then press Enter. Adding the mster host to resource pool This procedure dds the Control Center mster host to the defult resource pool, or to new resource pool, nmed mster. 1 Gin ccess to the Control Center host, through the console interfce of your hypervisor, or through remote shell utility such s PuTTY. 2 Strt commnd-line session s root s follows: In the Applince Administrtion menu, select Root Shell. Select Run, nd then press Enter. The menu is replced y commnd prompt similr to the following exmple: [root@hostnme ~]# 3 Optionl: Crete new resource pool, if necessry. For single-host deployments, skip this step. For multi-host deployments with t lest two delegte hosts, perform this step. serviced pool dd mster 4 Add the mster host to resource pool. 23
Zenoss Resource Mnger Instlltion Guide For single-host deployments, dd the mster host to the defult resource pool. For multi-host deployments with t lest two delegte hosts, dd the mster host to the mster resource pool. Replce Hostnme-Or-IP with the hostnme or IP ddress of the Control Center mster host, nd replce Resource-Pool with defult or mster: serviced host dd Hostnme-Or-IP:4979 Resource-Pool If you enter hostnme, ll hosts in your Control Center cluster must e le to resolve the nme, either through n entry in /etc/hosts, or through nmeserver on your network. Deploying Resource Mnger This procedure dds the Resource Mnger ppliction to the list of pplictions tht Control Center mnges. 1 Gin ccess to the Control Center host, through the console interfce of your hypervisor, or through remote shell utility such s PuTTY. 2 Strt commnd-line session s root s follows: In the Applince Administrtion menu, select Root Shell. Select Run, nd then press Enter. The menu is replced y commnd prompt similr to the following exmple: [root@hostnme ~]# 3 Add the Zenoss.resmgr ppliction to Control Center. mypth=/opt/serviced/templtes serviced templte dd $mypth/zenoss-resmgr-*.json On success, the serviced commnd returns the templte ID. 4 Deploy the ppliction. Replce Templte-ID with the templte identifier returned in the previous step, nd replce Deployment-ID with nme for this deployment (for exmple, Dev or Test): serviced templte deploy Templte-ID defult Deployment-ID Control Center tgs Resource Mnger imges in the locl registry. If you re instlling single-host deployment, proceed to the Zenoss Resource Mnger Configurtion Guide. 24
Instlling delegte hosts Instlling delegte hosts 4 This chpter descries how to instll pplince-sed delegtes. You cn dd s mny delegtes s you need to Control Center cluster. Creting virtul mchine You cn crete virtul mchine for the Resource Mnger delegte pplince with VMwre vsphere or Microsoft Hyper-V. Choose one of the procedures in this section. Creting virtul mchine with vsphere To perform this tsk, you need VMwre vsphere client. This procedure instlls the Resource Mnger delegte OVA pckge s virtul mchine mnged y vsphere Server version 5.5.0, using VMwre vsphere Client 5.5.0. The procedure is slightly different with different versions of VMwre vsphere Client. 1 Downlod the Resource Mnger delegte OVA file from the Zenoss Support site to your worksttion, if necessry. 2 Use the VMwre vsphere Client to log in to vcenter s root, or s user with superuser privileges, nd then disply the Home view. Figure 7: vsphere client Home view 25
Zenoss Resource Mnger Instlltion Guide 3 From the File menu, select Deploy OVF Templte. 4 In the Source pnel, specify the pth of the Resource Mnger pckge, nd then click Next. 5 In the OVF Templte Detils pnel, click Next. 6 In the Nme nd Loction pnel, provide nme nd loction for the server. s follows, nd then click Next. In the Nme field, enter new nme. In the Inventory Loction re, select dt center for the virtul mchine. 7 In the Host / Cluster pnel, select host system, nd then click Next. 8 In the Storge pnel, select storge system with sufficient spce for the virtul mchine, nd then click Next. 9 In the Disk Formt pnel, select Thin Provison, nd then click Next. 10 In the Redy to Complete pnel, review the deployment settings, nd then click Finish. Do not check Power on fter deployment. 11 Nvigte to the new virtul mchine's Getting Strted or Summry t, nd then click Edit virtul mchine settings. 12 Updte the memory ssigned to the mchine s follows: In the Virtul Mchine Properties dilog ox, select Memory in the Hrdwre tle. In the Memory Configurtion re, set the Memory Size field to 32GB. c At the ottom of the Virtul Mchine Properties dilog ox, click OK. 13 On the new virtul mchine's Getting Strted t, click Power on virtul mchine. Creting virtul mchine with Hyper-V To perform this tsk, you need: A Microsoft Remote Desktop Connection Administrtor privileges on Microsoft Hyper-V server Permission to downlod Resource Mnger softwre from the Zenoss Support site This procedure instlls the Resource Mnger pplince s virtul mchine mnged y Microsoft Hyper-V. There re seprte ISO files for the mster host nd delegtes. In this procedure, you downlod nd instll the delegte ISO file. A seprte procedure provides instructions for instlling the mster. 1 Use Microsoft Remote Desktop Connection to log in to Hyper-V host s Administrtor, or s user with Administrtor privileges. 2 Downlod the Resource Mnger ISO file from the Zenoss Support site to the Hyper-V host. Choose the delegte ISO file. 3 Open Hyper-V Mnger. 4 In the left nvigtion pne, choose server to host the virtul mchine. 5 From the Actions pne, choose New > Virtul Mchine. 6 In the Specify Nme nd Loction pnel, provide nme for the virtul mchine, nd then click Next. 7 In the Specify Genertion pnel, select Genertion 1, nd then click Next. 8 In the Assign Memory pnel, specify memory informtion s follows: In Strtup memory, enter 32768 (32GB). Check Use Dynmic Memory for this virtul mchine. c Click Next. 9 In the Configure Networking pnel's Connection field, choose virtul switch, nd then click Next. 10 In the Connect Virtul Hrd Disk pnel, crete new disk on which to instll the guest operting system, s follows: Choose Crete virtul hrd disk. 26
Instlling delegte hosts Specify nme. c In the Size field, enter 30. In lter step, you will crete dditionl disks. 11 In the Instlltion Options pnel, ccess the ISO file s follows: c Choose Instll n operting system from ootle CD/DVD-ROM. Choose Imge file (.iso). Specify or rowse to the loction of the ISO imge file. Choose the delegte ISO file. d Click Next. 12 In the Summry pnel, review the description, nd then click Finish. Hyper-V Mnger cretes the new virtul mchine, nd then closes the New Virtul Mchine Wizrd. 13 In the Hyper-V Mnger Virtul Mchines re, choose the new virtul mchine, right-click, nd then choose Settings. 14 In the Hrdwre re of the Settings window, configure s follows: Ensure tht the virtul hrd disk tht you creted is ttched to n IDE controller. A Hyper-V guest mchine cn only oot from n IDE drive. Choose Processor. c In Numer of virtul processors, enter 8, nd then click Apply. 15 Crete dditionl virtul hrd disks s follows: c In the Hrdwre re of the Settings window, choose ny controller nd loction tht will ccommodte the disk. In the Hrd Drive re, choose Virtul hrd disk, nd then click New. In the New Virtul Hrd Disk Wizrd: d e f 1 Nvigte to the Choose Disk Formt pnel. 2 Choose VHDX. 3 Click Next. In the Choose Disk Type pnel, choose Dynmiclly expnding, nd then click Next. In the Specify Nme nd Loction pnel, enter the disk nme, nd then click Next. In the Configure Disk pnel: g h 1 Choose Crete new lnk virtul hrd disk. 2 In the Size field, enter 50. 3 Click Next. In the Settings window, click Apply. Repet these susteps to crete two more 16GB virtul hrd disks. When viewed from the Linux system, the disks might e reordered; however, the instlltion is not ffected y disk order. i In the Settings dilog ox, click Apply, nd then click OK. 16 In the Hyper-V Mnger Virtul Mchines re, choose the new virtul mchine, right-click, nd then choose Strt. 27
Zenoss Resource Mnger Instlltion Guide Figure 8: Strting virtul mchine 17 In the Hyper-V Mnger Virtul Mchines re, choose the new virtul mchine, nd then right-click, nd then choose Connect. 18 In the Virtul Mchine Connection window, press Enter. The pplince instlltion process tkes out 15 minutes, nd should complete with no dditionl input. Disregrd the Fst TSC clirtion filure messge. Configuring the virtul mchine This procedure configures the new virtul mchine s delegte host. 1 Gin ccess to the console interfce of the Control Center host through your hypervisor console interfce. Figure 9: Initil hypervisor console login prompt 2 Log in s the root user. The initil pssword is provided in the console. 3 The system prompts you to enter new pssword for root. Note Psswords must include minimum of eight chrcters, with t lest one chrcter from three of the following chrcter clsses: uppercse letter, lowercse letter, digit, nd specil. 4 The system prompts you to enter new pssword for ccuser. The ccuser ccount is the defult ccount for gining ccess to the Control Center rowser interfce. 5 In the IP field, enter the hostnme, fully qulified domin nme, or IPv4 ddress of the mster host. 28
Instlling delegte hosts Note If you enter the hostnme or fully qulified domin nme of the mster host, you need n entry in the /etc/hosts file of the delegte host, or nmeserver on your network, tht resolves the nme to its IPv4 ddress. Press T to select Ok, nd then press Enter. The system reoots. Edit connection The defult configurtion for network connections is DHCP. To configure sttic IPv4 ddressing, perform this procedure. To nvigte in the text user interfce (TUI): To move forwrd or ckwrd through options, press the rrow keys or press T or Shift+T. To disply menu or choose n option, press Enter. 1 Gin ccess to the Control Center host, through the console interfce of your hypervisor, or through remote shell utility such s PuTTY. 2 Log in s the root user. 3 Select the NetworkMnger TUI menu s follows: In the Applince Administrtion menu, select Configure Network nd DNS, nd then press Enter. 29
Zenoss Resource Mnger Instlltion Guide 4 On the NetworkMnger TUI menu, select Edit connection, nd then press Enter. The TUI displys the connections tht re ville on this host. Figure 10: Exmple: Aville connections Note Do not modify the docker0 connection. 5 Select the virtul connection, nd then press Enter. Figure 11: Exmple: Edit Connection screen 6 Optionl: If the IPv4 CONFIGURATION re is not visile, select its disply option (<Show>), nd then press Enter. 7 In the IPv4 CONFIGURATION re, select <Automtic>, nd then press Enter. 30
Instlling delegte hosts Figure 12: Exmple: IPv4 Configurtion options 8 Configure sttic IPv4 networking s follows: Select Mnul, nd then press Enter. Select <Add> next to Addresses, nd then press Enter. c In the Addresses field, enter n IPv4 ddress for the virtul mchine, nd then press Enter. d Repet the preceding two steps for the Gtewy nd DNS servers fields. 9 Select <OK> t the ottom of the Edit Connection screen, nd then press Enter. 10 On the NetworkMnger TUI screen, use the T key to select the <Quit> option, nd then press the Return key to go ck to the Applince Administrtion menu. 11 Reoot the operting system s follows: c In the Applince Administrtion menu, select Reoot / Poweroff System. Select Reoot. Select OK, nd then press Enter. Set system hostnme The defult hostnme is zsd-mster for the Resource Mnger mster host nd is zsd-delegte for the Resource Mnger delegte host. To chnge the defult hostnme, perform this procedure. 1 Gin ccess to the Control Center host, through the console interfce of your hypervisor, or through remote shell utility such s PuTTY. 2 Select the NetworkMnger TUI menu s follows: In the Applince Administrtion menu, select Configure Network nd DNS, nd then press Enter. 3 Disply the hostnme entry field. In the NetworkMnger TUI menu, select Set system hostnme. Press T to select OK, nd then press Enter. 4 In the Hostnme field, enter the hostnme or fully qulified domin nme. 5 Press T twice to select OK, nd then press Enter. 31
Zenoss Resource Mnger Instlltion Guide 6 In the confirmtion dilog ox, press Enter. 7 Reoot the operting system s follows: c In the Applince Administrtion menu, select Reoot / Poweroff System. Select Reoot. Select OK, nd then press Enter. Editing the /etc/hosts file This procedure is optionl. Perform this procedure only if you use hostnmes or fully qulified domin nmes insted of IPv4 ddresses, nd only fter ll delegte hosts re instlled nd renmed. Perform this procedure on the Control Center mster host nd on ech delegte host. 1 Gin ccess to the Control Center host, through the console interfce of your hypervisor, or through remote shell utility such s PuTTY. 2 Strt commnd-line session s root s follows: In the Applince Administrtion menu, select Root Shell. Select Run, nd then press Enter. The menu is replced y commnd prompt similr to the following exmple: [root@hostnme ~]# 3 Open the /etc/hosts file in text editor. The following steps use the nno editor. Strt the editor. nno /etc/hosts Figure 13: Exmple nno session Use the up-rrow nd down-rrow keys to select lines, nd the right-rrow nd left-rrow keys to select chrcters on line. 32
Instlling delegte hosts c d Optionl: On delegte hosts, the file might include two entries with the sme IP ddress. Remove the first of the two entries, which mps the IP ddress to the zsd-mster hostnme. Add entries for the Control Center mster host nd for ech delegte host. Sve the file nd exit the editor. To sve, press Control-o. To exit, press Control-x. 4 Return to the Applince Administrtion menu. exit 5 Exit the Applince Administrtion menu. Use the down-rrow key to select Exit. Press T, nd then press Enter. 33
Zenoss Resource Mnger Instlltion Guide Configuring multi-host Control Center 5 cluster This chpter descries how to configure n pplince-sed multi-host Control Center cluster. A multi-host Resource Mnger deployment includes one Control Center mster host nd one or more delegte hosts. Zenoss recommends deploying t lest two delegte hosts, to enle creting ZooKeeper ensemle. Tsk Procedure Instll mster host Instlling Control Center mster host on pge 16 Instll delegte hosts Instlling delegte hosts on pge 25 Add delegte hosts to the cluster Adding hosts to the defult resource pool on pge 38 Crete ZooKeeper ensemle Configuring ZooKeeper ensemle on pge 39 Crete privte NTP server (Hyper-V only) Enling NTP on Microsoft Hyper-V guests on pge 34 Add delegte hosts to the cluster Adding hosts to the defult resource pool on pge 38 Enling NTP on Microsoft Hyper-V guests Note The procedures in this section re required only for multi-host deployments running s Microsoft Hyper-V guests. VMwre vsphere guests use n hourly cron jo to synchronize their system clocks with the host. Like most distriuted pplictions, Control Center requires common time source. The procedures in this section enle NTP to synchronize the system clocks of ll hosts in your Control Center cluster. Configure NTP to rely on time source s follows, depending on internet ccess of the hosts in your Control Center cluster: If ll hosts cn ccess the internet, configure NTP to rely on pulic time servers. If no host cn ccess the internet, configure NTP to rely on privte mster server. Configuring NTP for pulic time servers (Hyper-V only) This procedure uses the defult configurtion of NTP to synchronize system clocks with pulic time servers. If ll hosts in the Control Center cluster cn ccess the internet, repet this procedure on ech host in the cluster, strting with the Control Center mster host. 34
Configuring multi-host Control Center cluster 1 Gin ccess to the Control Center host, through the console interfce of your hypervisor, or through remote shell utility such s PuTTY. 2 Strt commnd-line session s root s follows: In the Applince Administrtion menu, select Root Shell. Select Run, nd then press Enter. The menu is replced y commnd prompt similr to the following exmple: [root@hostnme ~]# 3 Stop Control Center. systemctl stop serviced 4 Synchronize the system clock nd enle the NTP demon. Set the system time. c d ntpd -gq Enle the ntpd demon. systemctl enle ntpd Configure ntpd to strt when the system strts. Currently, n unresolved issue ssocited with NTP prevents ntpd from restrting correctly fter reoot, nd the following commnds provide workround to ensure tht it does. echo "systemctl strt ntpd" >> /etc/rc.d/rc.locl chmod +x /etc/rc.d/rc.locl Strt ntpd. systemctl strt ntpd 5 Strt Control Center. systemctl strt serviced Configuring n NTP mster server (Hyper-V only) This procedure configures n NTP mster server on the Control Center mster host. Perform this procedure only if the host does not hve internet ccess. 1 Gin ccess to the Control Center host, through the console interfce of your hypervisor, or through remote shell utility such s PuTTY. 2 Strt commnd-line session s root s follows: In the Applince Administrtion menu, select Root Shell. Select Run, nd then press Enter. The menu is replced y commnd prompt similr to the following exmple: [root@hostnme ~]# 35
Zenoss Resource Mnger Instlltion Guide 3 Crete ckup of the NTP configurtion file. cp -p /etc/ntp.conf /etc/ntp.conf.orig 4 Edit the NTP configurtion file s follows: Open /etc/ntp.conf with text editor. Replce ll lines in the file with the following lines: # Use the locl clock server 127.127.1.0 prefer fudge 127.127.1.0 strtum 10 driftfile /vr/li/ntp/drift rodcstdely 0.008 # Give loclhost full ccess rights restrict 127.0.0.1 c # Grnt ccess to client hosts restrict ADDRESS_RANGE msk NETMASK nomodify notrp Replce ADDRESS_RANGE with the rnge of IPv4 network ddresses tht re llowed to query this NTP server. For exmple, the following IP ddresses re ssigned to the hosts in Control Center cluster: 203.0.113.10 203.0.113.11 203.0.113.12 203.0.113.13 For the preceding ddresses, the vlue for ADDRESS_RANGE is 203.0.113.0. d Replce NETMASK with the IPv4 network msk tht corresponds with the ddress rnge. For exmple, the network msk for 203.0.113.0 is 255.255.255.0. e Sve the file nd exit the editor. 5 Stop Control Center. systemctl stop serviced 6 Enle nd strt the NTP demon s follows: Enle the ntpd demon. c systemctl enle ntpd Configure ntpd to strt when the system strts. Currently, n unresolved issue ssocited with NTP prevents ntpd from restrting correctly fter reoot, nd the following commnds provide workround to ensure tht it does. echo "systemctl strt ntpd" >> /etc/rc.d/rc.locl chmod +x /etc/rc.d/rc.locl Strt ntpd. systemctl strt ntpd 36
Configuring multi-host Control Center cluster 7 Strt Control Center. systemctl strt serviced Configuring NTP clients (Hyper-V only) This procedure configures delegtes to synchronize their clocks with the NTP server on the Control Center mster host. Perform this procedure only if the delegtes do not hve internet ccess. Repet this procedure on ech delegte in your Control Center cluster. 1 Gin ccess to the Control Center host, through the console interfce of your hypervisor, or through remote shell utility such s PuTTY. 2 Strt commnd-line session s root s follows: In the Applince Administrtion menu, select Root Shell. Select Run, nd then press Enter. The menu is replced y commnd prompt similr to the following exmple: [root@hostnme ~]# 3 Crete ckup of the NTP configurtion file. cp -p /etc/ntp.conf /etc/ntp.conf.orig 4 Edit the NTP configurtion file s follows: Open /etc/ntp.conf with text editor. Replce ll lines in the file with the following lines: # Point to the mster time server server MASTER_ADDRESS restrict defult ignore restrict 127.0.0.1 restrict MASTER_ADDRESS msk 255.255.255.255 nomodify notrp noquery driftfile /vr/li/ntp/drift c Replce oth instnces of MASTER_ADDRESS with the IPv4 ddress of the host where the NTP server is running (the Control Center mster host). d Sve the file nd exit the editor. 5 Stop Control Center. systemctl stop serviced 6 Synchronize the clock with the mster server. ntpd -gq 7 Enle nd strt the NTP demon s follows: Enle the ntpd demon. systemctl enle ntpd Configure ntpd to strt when the system strts. 37
Zenoss Resource Mnger Instlltion Guide Currently, n unresolved issue ssocited with NTP prevents ntpd from restrting correctly fter reoot, nd the following commnds provide workround to ensure tht it does. c echo "systemctl strt ntpd" >> /etc/rc.d/rc.locl chmod +x /etc/rc.d/rc.locl Strt ntpd. systemctl strt ntpd 8 Strt Control Center. systemctl strt serviced Adding hosts to the defult resource pool This procedure dds one or more hosts to the defult resource pool. 1 Gin ccess to the Control Center host, through the console interfce of your hypervisor, or through remote shell utility such s PuTTY. 2 Strt commnd-line session s root s follows: In the Applince Administrtion menu, select Root Shell. Select Run, nd then press Enter. The menu is replced y commnd prompt similr to the following exmple: [root@hostnme ~]# 3 Add nd register delegte host. Replce Hostnme-Or-IP with the hostnme or IP ddress of the delegte host to dd nd include the register flg to uthenticte the delegte host: serviced host dd Hostnme-Or-IP:4979 defult --register If you enter hostnme, ll hosts in your Control Center cluster must e le to resolve the nme through n entry in /etc/hosts or through nmeserver on your network. 4 Repet the preceding commnd for ech delegte in your Control Center cluster. 38
Configuring ZooKeeper ensemle Configuring ZooKeeper ensemle 6 This chpter descries how to crete ZooKeeper ensemle (cluster) for multi-host Control Center deployment tht includes minimum of three hosts. If your deployment includes just one host or two hosts, skip this chpter. ZooKeeper nd Control Center Control Center relies on Apche ZooKeeper to distriute nd mnge ppliction services. ZooKeeper mintins the definitions of ech service nd the list of services ssigned to ech host. The scheduler, which runs on the mster host, determines ssignments nd sends them to the ZooKeeper node tht is serving s the ensemle leder. The leder replictes the ssignments to the other ensemle nodes, so tht the other nodes cn ssume the role of leder if the leder node fils. All of the hosts in Control Center cluster retrieve ssignments nd service definitions from the ZooKeeper ensemle leder nd then strt services in Docker continers s required. So, the Control Center configurtion files of ll Control Center cluster hosts must include definition for the SERVICED_ZK vrile, which specifies the ZooKeeper endpoints of the ensemle nodes. Additionl vriles re required on ensemle nodes. A ZooKeeper ensemle requires minimum of three nodes, which is sufficient for most environments. An odd numer of nodes is recommended nd n even numer of nodes is strongly discourged. A five-node ensemle improves filover protection during mintennce windows ut lrger ensemles yield no enefits. The Control Center mster host is lwys n ensemle node. All ensemle nodes should e on the sme sunet. Understnding the configurtion process The procedures in this chpter instruct you to crete temporry vriles tht re used s uilding locks, to construct Control Center configurtion vriles ccurtely. You ppend the Control Center vriles to /etc/ defult/serviced, nd then edit the file to move the vriles to more pproprite loctions. The most importnt temporry vriles specify the IP ddress or hostnme of ech host in the ZooKeeper ensemle. The following tle identifies these importnt vriles, the nmes nd vlues of which must e identicl on every Control Center cluster host. Vrile nme Plceholder vlue Actul vlue node1 Mster The IP ddress or hostnme of the mster host. node2 Delegte-A The IP ddress or hostnme of delegte host A. 39