Monitoring and Alerting. VMware Validated Design 4.0 VMware Validated Design for Software-Defined Data Center 4.0

Transcription

1 VMwre Vlidted Design 4.0 VMwre Vlidted Design for Softwre-Defined Dt Center 4.0

2 You cn find the most up-to-dte technicl documenttion on the VMwre wesite t: If you hve comments out this documenttion, sumit your feedck to VMwre, Inc Hillview Ave. Plo Alto, CA Copyright VMwre, Inc. All rights reserved. Copyright nd trdemrk informtion. VMwre, Inc. 2

3 Contents Aout VMwre Vlidted Design Monitoring nd Alerting 4 1 Enling Alerts in vrelize Log Insight 5 View the Full List of Alerts for Mngement Product 6 Enle the Alerts for vsphere Resources 7 Enle the Alerts for Storge Resources 12 Enle the Alerts for vsan 17 Enle the Alerts for vsphere Networking 22 Enle the Alerts for NSX for vsphere 27 Enle the Alerts for vrelize Opertions Mnger 32 Enle the Alerts for vrelize Automtion 36 Enle the Alerts for vrelize Orchestrtor 41 2 Creting Custom SDDC vrelize Opertions Dshords 47 Crete the SDDC Cpcity Dshord 47 Configure Dshord tht Provides n Overview of SDDC Opertion 54 3 Configure vrelize Opertions Mnger to Notify of SDDC Issues 64 Crete Notifictions in vrelize Opertions Mnger 64 List of Notifictions for vrelize Opertions Mnger 67 4 Monitor vsphere Dt Protection Jos y Emil 72 5 Configure vrelize Automtion System Notifiction Events 75 VMwre, Inc. 3

4 Aout VMwre Vlidted Design Monitoring nd Alerting VMwre Vlidted Design Monitoring nd Alerting provides step-y-step instructions out configuring vrelize Opertions Mnger nd vrelize Log Insight for monitoring of the opertions in the SDDC. This documenttion lso discusses enling notifictions out issues in your environment nd operting softwre-defined dt center (SDDC) sed on the VMwre Vlidted Design for Softwre-Defined Dt Center. After you deploy the Softwre-Defined Dt Center from this VMwre Vlidted Design, you cn monitor the prmeters tht re most importnt for environment mngement y using set of dshords for lerts nd log events. Intended Audience The VMwre Vlidted Design Monitoring nd Alerting documenttion is intended for cloud rchitects, infrstructure dministrtors, cloud dministrtors nd cloud opertors who re fmilir with nd wnt to use VMwre softwre to deploy in short time nd mnge n SDDC tht meets the requirements for cpcity, sclility, ckup nd restore, nd extensiility for disster recovery support. Required VMwre Softwre VMwre Vlidted Design Monitoring nd Alerting is complint nd vlidted with certin product versions. See VMwre Vlidted Design Relese Notes for more informtion out supported product versions. VMwre, Inc. 4

5 Enling Alerts in vrelize Log Insight 1 Use the vrelize Log Insight known event signture engine to monitor key events. You cn use set of lerts to send to vrelize Opertions Mnger nd vi SMTP for opertions tem notifiction. The integrtion etween vrelize Log Insight nd vrelize Opertions Mnger llows for implementing the following cross-product event trcking: Sending lerts from vrelize Log Insight to vrelize Opertions Mnger, which utomticlly mps them to the trget ojects Lunching in context from vrelize Opertions Mnger oject to the ojects logs in vrelize Log Insight Lunching in context from vrelize Log Insight event to the ojects in vrelize Opertions Mnger For pplictions tht re filed over etween regions, such s vrelize Automtion nd vrelize Opertions Mnger, configure lerting in oth regions to void missing ny lerts when pplictions move etween regions. Procedure 1 View the Full List of Alerts for Mngement Product Explore the lerts nd queries tht re ville in vrelize Log Insight for the mngement products in the SDDC such s vsphere, NSX for vsphere, vrelize Automtion, nd so on. The lerts nd queries re hndled y the content pcks for these products. 2 Enle the Alerts for vsphere Resources Use the uilt-in prolem nd lert signtures in vrelize Log Insight for ESXi host nd vcenter Server to enle lerts out issues. 3 Enle the Alerts for Storge Resources Use the inuilt prolem nd lert signtures in vrelize Log Insight for storge monitoring. 4 Enle the Alerts for vsan Use the uilt-in prolem nd lert signtures in vrelize Log Insight for vsan monitoring. 5 Enle the Alerts for vsphere Networking Use the inuilt prolem nd lert signtures in vrelize Log Insight for networking to enle lerts out issues. VMwre, Inc. 5

6 6 Enle the Alerts for NSX for vsphere Use the inuilt prolem nd lert signtures in vrelize Log Insight for NSX for vsphere. 7 Enle the Alerts for vrelize Opertions Mnger Use the uilt-in prolem nd lert signtures in vrelize Log Insight for vrelize Opertions Mnger. 8 Enle the Alerts for vrelize Automtion Use the inuilt prolem nd lert signtures in vrelize Log Insight for vrelize Automtion. 9 Enle the Alerts for vrelize Orchestrtor Use the inuilt prolem nd lert signtures in vrelize Log Insight for vrelize Orchestrtor. View the Full List of Alerts for Mngement Product Explore the lerts nd queries tht re ville in vrelize Log Insight for the mngement products in the SDDC such s vsphere, NSX for vsphere, vrelize Automtion, nd so on. The lerts nd queries re hndled y the content pcks for these products. Procedure 1 Open the vrelize Log Insight user interfce. Open We rowser nd go to the following URL. Region Region A Region B vrelize Log Insight URL Log in using the following credentils. Setting User nme Pssword Vlue dmin vrli_dmin_pssword VMwre, Inc. 6

7 2 Locte the content pck for the mngement product. In the vrelize Log Insight UI, click the configurtion drop-down menu icon nd select Content Pcks. c Under Instlled Content Pcks, select the pck. Click Alerts or Queries to view the full list of lerts for the product. Enle the Alerts for vsphere Resources Use the uilt-in prolem nd lert signtures in vrelize Log Insight for ESXi host nd vcenter Server to enle lerts out issues. For sic monitoring the vsphere components, use the following lerts: Tle 1 1. vsphere Alerts in vrelize Log Insight Alert Nme Purpose Severity *** CRITICAL *** Hrdwre: Physicl event detected Hrdwre: Fulty memory detected *** CRITICAL *** ESX/ESXi: Core dump detected The purpose of this widget is to notify when the following physicl hrdwre events hve een detected, which indictes hrdwre prolem. Under most norml conditions, this widget should return no results. The following types of hrdwre events re returned: Advnced Progrmmle Interrupt Controller (APIC) Mchine Check Exception (MCE) Non-Mskle Interrupt (NMI) During the previous oot of n ESXi host fulty memory ws detected. Unless corresponding corrected messge is seen, the memory should e replced. A core dump hs een detected, which indictes the filure of component in ESX/ESXi. This issue my led to VM crshes nd/or host PSODs. Criticl Criticl Criticl VMwre, Inc. 7

8 Tle 1 1. vsphere Alerts in vrelize Log Insight (Continued) Alert Nme Purpose Severity *** CRITICAL *** ESX/ESXi: Stopped logging *** CRITICAL *** ESX/ESXi: RAM disk / inode tle is full ESX/ESXi: HA isolted events y hostnme vcenter Server: HA connection filure detected The purpose of this lert is to notify when n ESXi host hs stopped sending syslog to remote server. A root file system hs reched its resource pool limit. Vrious dministrtive ctions depend on the ility to write files to vrious prts of the root file system nd might fil if the RAM disk nd/or inode tle is full. During helth check, HA determined tht host ws isolted. Depending on how HA is configured this my men tht VMs hve een filed over from the isolted host. A HA cluster hs detected one or more unresponsive ESXi hosts. If the host(s) re mrked s ded, then VMs running on those hosts will e migrted to other systems. Criticl Criticl Criticl Criticl Procedure 1 Open the vrelize Log Insight user interfce. Open We rowser nd go to the following URL. Region Region A Region B vrelize Log Insight URL Log in using the following credentils. Setting User nme Pssword Vlue dmin vrli_dmin_pssword 2 In the vrelize Log Insight user interfce, click Interctive Anlytics. 3 Click the icon nd select Mnge Alerts. VMwre, Inc. 8

9 4 Select the lerts tht re relted to vsphere. In the serch ox of the Alerts dilog ox, enter Hrdwre, ESX/ESXi or vcenter Server s serch phrse Select the following lerts from the results. Alert vcenter Server: HA connection filure detected Hrdwre: Fulty memory detected *** CRITICAL *** ESX/ESXi: Core dump detected *** CRITICAL *** ESX/ESXi: Stopped logging *** CRITICAL *** Hrdwre: Physicl event detected *** CRITICAL *** ESX/ESXi: RAM disk / inode tle is full ESX/ESXi: HA isolted events y hostnme VMwre, Inc. 9

10 5 Enle the lerts. In the Alerts dilog ox, click Enle. In the Enle Alerts dilog ox, configure the following lert settings nd click Enle. Setting Region A Region B Emil Emil ddress to send lerts to Emil ddress to send lerts to Send to vrelize Opertions Mnger Selected Selected Fllck Oject SFO01 LAX01 Criticlity criticl criticl VMwre, Inc. 10

11 6 In the Alerts dilog ox, set the Rise n lert option for ech enled lert. Click the Edit utton on the first enled vsphere lert. In the Edit Alert dilog ox, under Rise n lert, select On ny mtch, nd click Sve. VMwre, Inc. 11

12 c d Repet the steps for the other enled lerts. Close the Alerts dilog ox. 7 Repet the steps on to enle the lerts for the LAX01 dt center. Enle the Alerts for Storge Resources Use the inuilt prolem nd lert signtures in vrelize Log Insight for storge monitoring. For monitoring storge in the Softwre-Defined Dt Center, you cn use the following lerts in vrelize Log Insight: Tle 1 2. Storge Alerts in vrelize Log Insight Alert Nme Purpose Severity *** CRITICAL *** Storge: All Pths Down (APD) *** CRITICAL *** Storge: VSAN device offline Storge: NFS connectivity issue Storge: NFS lock file issue One or more dtstores hs experienced n All Pths Down (APD) outge sitution. This indictes tht one or more dtstores is or ws unville. As result of this issue, VMs re or were unville nd ESX/ESXi hosts my hve een disconnected from vcenter Server. This issue requires immedite ttention. A Virtul SAN storge device tht cks up the dtstores might fil. This occurs due to fulty device firmwre, physicl medi, or storge controller or when certin storge devices re not redle or writele. Typiclly, such filures re irreversile. In some instnces, permnent dt loss might lso occur, especilly when dt is not replicted on other nodes efore filure. Virtul SAN utomticlly recovers dt when new devices re dded to the storge cluster, unless dt lost is permnent. The purpose of this lert is to notify when n NFS connectivity issue ws detected. This mens n NFS dtstore is or ws unville. Do to this issue, one or more VMs my e unville. The purpose of this lert is to notify when n NFS lock file issue hs een detected. Stle NFS lock files cn prevent VMs from powering on. Criticl Criticl Criticl VMwre, Inc. 12

13 Tle 1 2. Storge Alerts in vrelize Log Insight (Continued) Alert Nme Purpose Severity Storge SCSI Pth ded Storge: Snpshot consolidtion required The purpose of this lert is to notify when SCSI pth hs ecome unville. Assuming multiple pths re in use nd the other pths re online this mens reduced redundncy nd performnce. If ll pths to storge device ecome unville then VMs running on the storge device will ecome unville. The purpose of this lert is to notify when snpshot consolidtion is required. A filed snpshot consolidtion opertion tht is not mnully ddressed cn led to full dtstore. Criticl Criticl Procedure 1 Open the vrelize Log Insight user interfce. Open We rowser nd go to the following URL. Region Region A Region B vrelize Log Insight URL Log in using the following credentils. Setting User nme Pssword Vlue dmin vrli_dmin_pssword 2 In the vrelize Log Insight user interfce, click Interctive Anlytics. 3 Click the icon nd select Mnge Alerts. VMwre, Inc. 13

14 4 Select the lerts tht re storge relted. In the serch ox of the Alerts dilog ox, enter storge s serch phrse. Select the following lerts from the results. Alert *** CRITICAL *** Storge: All Pths Down (APD) *** CRITICAL *** Storge: VSAN device offline Storge: NFS connectivity issue Storge: NFS lock file issue Storge SCSI Pth ded Storge: Snpshot consolidtion required VMwre, Inc. 14

15 5 Enle the lerts. In the Alerts dilog ox, click Enle. In the Enle Alerts dilog ox, configure the following lert settings nd click Enle. Setting Region A Region B Emil Emil ddress to send lerts to Emil ddress to send lerts to Send to vrelize Opertions Mnger Selected Selected Fllck Oject SFO01 LAX01 Criticlity criticl criticl VMwre, Inc. 15

16 6 In the Alerts dilog ox, set the Rise n lert option for ech enled lert. Click the Edit utton on the first enled Storge Resources lert. In the Edit Alert dilog ox, under Rise n lert, select On ny mtch, nd click Sve. VMwre, Inc. 16

17 c d Repet the steps for the other enled lerts. Close the Alerts dilog ox. 7 Repet the steps on to enle lerts for the LAX01 dt center. Enle the Alerts for vsan Use the uilt-in prolem nd lert signtures in vrelize Log Insight for vsan monitoring. For monitoring vsan in the Softwre-Defined Dt Center, you cn use the following lerts in vrelize Log Insight: VMwre, Inc. 17

18 Tle 1 3. vsan Alerts in vrelize Log Insight Alert Nme Purpose Severity VSAN - SSD helth chnge to unhelthy stte VSAN - Configurtion filure - Insufficient spce VSAN - Device offline VSAN - Oject component stte chnged to degrded This lert will fire when the stte of ny SSD chnges to unhelthy. The reson could e either ecuse of permnent disk filure, disk decommissioning, node shutdown, etc. This lert indictes tht we cnnot crete configurtion for new oject(vm) in the VSAN cluster ecuse sufficient spce is not ville in the cluster. If we see this error, plese check the error logs nd try the provisioning opertion fter dding new hosts/disks. This lrm will trigger if prticulr device goes offline. In this cse, plese check the device configurtion nd other cluster stte. This lert will e triggered when VSAN oject stte chnges to degrded stte Check the stte of the dpters, disks nd network settings ssocited with the VSAN cluster. Criticl Criticl Criticl Criticl Procedure 1 Open the vrelize Log Insight user interfce. Open We rowser nd go to the following URL. Region Region A Region B vrelize Log Insight URL Log in using the following credentils. Setting User nme Pssword Vlue dmin vrli_dmin_pssword 2 In the vrelize Log Insight user interfce, click Interctive Anlytics. 3 Click the icon nd select Mnge Alerts. VMwre, Inc. 18

19 4 Select the lerts tht re vsan relted. In the serch ox of the Alertsdilog ox, enter vsn s serch phrse. Select the following lerts from the results. Alert VSAN - SSD helth chnge to unhelthy stte VSAN - Configurtion filure - Insufficient spce VSAN - Device offline VSAN - Oject component stte chnged to degrded VMwre, Inc. 19

20 5 Enle the lerts. In the Alerts dilog ox, click Enle. In the Enle Alerts dilog ox, configure the following lert settings, nd click Enle. Setting Region A Region B Emil Emil ddress to send lerts to Emil ddress to send lerts to Send to vrelize Opertions Mnger Selected Selected Fllck Oject SFO01 LAX01 Criticlity criticl criticl VMwre, Inc. 20

21 6 In the Alerts dilog ox, set the Rise n lert option for ech enled lert. Click the Edit utton on the first enled vsan lert. In the Edit Alert dilog ox, under Rise n lert, select On ny mtch, nd click Sve. VMwre, Inc. 21

22 c d Repet the steps for the other enled lerts. Close the Alerts dilog ox. 7 Repet the steps on to enle lerts for the LAX01 dt center. Enle the Alerts for vsphere Networking Use the inuilt prolem nd lert signtures in vrelize Log Insight for networking to enle lerts out issues. For sic monitoring the vsphere networking components, use the following lerts: VMwre, Inc. 22

23 Tle 1 4. vsphere Networking Alerts in vrelize Log Insight Alert Nme Purpose Severity Network: ESXi physicl NIC down Network: ESX/ESXi uplink redundncy lost Network: Out of Memory ESX/ESXi hs reported tht physicl NIC hs ecome unville. Assuming other NICs re still online this indictes lck of redundncy nd potentil performnce impct. If ll physicl NICs for vswitch/dvswitch re unville then communiction prolems to VMs nd/or the ESX/ESXi host my e possile. Only one physicl NIC is currently connected, one more filure will result in loss of connectivity. Under certin circumstnces hosts with NetQueue enled, my run out of memory when using jumo frmes (MTU is 9000 ytes). Out of memory conditions could led to lost connectivity etween vcenter Server, NFS dtstores, nd the virtul mchine level. Criticl Criticl Criticl Procedure 1 Open the vrelize Log Insight user interfce. Open We rowser nd go to the following URL. Region Region A Region B vrelize Log Insight URL Log in using the following credentils. Setting User nme Pssword Vlue dmin vrli_dmin_pssword 2 In the vrelize Log Insight user interfce, click Interctive Anlytics. 3 Click the icon nd select Mnge Alerts. VMwre, Inc. 23

24 4 Select the lerts tht re relted to vsphere networking. In the serch ox of the Alerts dilog ox, enter network s serch phrse. Select the following lerts from the results. Alert Network: Out of Memory Network: ESX/ESXi uplink redundncy lost Network: ESXi physicl NIC down VMwre, Inc. 24

25 5 Enle the lerts. In the Alerts dilog ox, click Enle. In the Enle Alerts dilog ox, configure the following lert settings nd click Enle. For defult oject, you select the dt center for the region. Setting Region A Region B Emil Emil ddress to send lerts to Emil ddress to send lerts to Send to vrelize Opertions Mnger Selected Selected Fllck Oject SFO01 LAX01 Criticlity criticl criticl VMwre, Inc. 25

26 6 In the Alerts dilog ox, set the Rise n lert option for ech enled lert. Click the Edit utton on the first enled Network lert. In the Edit Alert dilog ox, under Rise n lert, select On ny mtch, nd click Sve. VMwre, Inc. 26

27 c d Repet the steps for the other enled lerts. Close the Alerts dilog ox. 7 Repet the steps on to enle lerts for the LAX01 dt center. Enle the Alerts for NSX for vsphere Use the inuilt prolem nd lert signtures in vrelize Log Insight for NSX for vsphere. For monitoring the NSX for vsphere configurtion in the Softwre-Defined Dt Center, you cn use the following lerts in vrelize Log Insight: Tle 1 5. NSX Alerts in vrelize Log Insight Alert Nme Purpose Severity VMW_NSX_Mnger - Host Communiction Errors VMW_NSX_VXLAN dtplne lost connection to controller This event will e generted when NSX Mnger fils to receive hertet from UserWorld Agent on the host within the threshold period. The output is grouped y host-id. The host-id cn e found from vcenter. This lert indictes VXLAN dtplne lost connection to controller. Criticl Criticl VMwre, Inc. 27

28 Tle 1 5. NSX Alerts in vrelize Log Insight (Continued) Alert Nme Purpose Severity VMW_NSX_VXLAN configurtion issue VMW_NSX_Firewll criticl errors This lert is generted when VXLAN configurtion pushed to host efore host ws prep'ed - host must e reooted to initilize configurtion in correct order. Recommendtion: Investigte the sttus of VXLAN instlltion in NSX. Firewll criticl events: This is vsm side event if host filed to respond with in time out window This is vsm side event if vsm filed while provisioning firewll rule This is vsm side event if vsm filed to send exclude list updte Filed to receive/prse/updte firewll config. Key vlue will hve context info like genertion numer nd lso other deugging info Criticl Procedure 1 Open the vrelize Log Insight user interfce. Open We rowser nd go to the following URL. Region Region A Region B vrelize Log Insight URL Log in using the following credentils. Setting User nme Pssword Vlue dmin vrli_dmin_pssword 2 In the vrelize Log Insight user interfce, click Interctive Anlytics. 3 Click the icon nd select Mnge Alerts. VMwre, Inc. 28

29 4 Select the lerts tht re relted to vsphere. In the serch ox of the Alerts dilog ox, enter nsx s serch phrse. Select the following lerts from the results. Alert VMW_NSX_Mnger - Host Communiction Errors VMW_NSX_VXLAN dtplne lost connection to controller VMW_NSX_VXLAN configurtion issue VMW_NSX_Firewll criticl errors VMwre, Inc. 29

30 5 Enle the lerts. In the Alerts dilog ox, click Enle. In the Enle Alerts dilog ox, configure the following lert settings, nd click Enle. For defult oject, you select the NSX Mnger instnce for the mngement cluster in the region. Setting Region A Region B Emil Emil ddress to send lerts to Emil ddress to send lerts to Send to vrelize Opertions Mnger Selected Selected Fllck Oject mgmt01nsxm01.sfo01 mgmt01nsxm51.lx01 Criticlity criticl criticl VMwre, Inc. 30

31 6 In the Alerts dilog ox, set the Rise n lert option for ech enled lert. Click the Edit utton on the first enled NSX for vsphere lert. VMwre, Inc. 31

32 In the Enle Alerts dilog ox, under Rise n lert, select On ny mtch, nd click Sve. c d Repet the steps for the other enled lerts. Close the Alerts dilog ox. 7 Repet the steps on to enle lerts for the mgmt01nsxm51.lx01 NSX Mnger instnce. Enle the Alerts for vrelize Opertions Mnger Use the uilt-in prolem nd lert signtures in vrelize Log Insight for vrelize Opertions Mnger. For monitoring the vrelize Opertions Mnger deployment in the Softwre-Defined Dt Center, you cn use the following lerts in vrelize Log Insight: Tle 1 6. vrelize Opertions Mnger Alerts in vrelize Log Insight Alert Nme Purpose Severity vrops: VC stts query timed out occurred vrops: Out of Memory errors occurred The purpose of this lert is to notify when vrops instnce is not le to get the dt ck from vcenter instnce within the 5 minute intervl nd the metrics ck up nd get dropped with the error: Communiction Error: com.integrien.dpter.vmwre.vccollector.collectmetrics - Vc stts query timed out (ms): This is usully due to intermittent connection issues with the vcenter nd hosts or down to the network not le to hndle the request nd timing out. This lert gets generted when OutOfMemoryError: Jv hep spce occurs. This could indicte memory issues nd could led to degrdtion in performnce. Criticl Criticl VMwre, Inc. 32

33 Procedure 1 Open the vrelize Log Insight user interfce. Open We rowser nd go to the following URL. Region Region A Region B vrelize Log Insight URL Log in using the following credentils. Setting User nme Pssword Vlue dmin vrli_dmin_pssword 2 In the vrelize Log Insight user interfce, click Interctive Anlytics. 3 Click the icon nd select Mnge Alerts. 4 Select the lerts tht re relted to vrelize Opertions Mnger. In the serch ox of the Alerts dilog ox, enter vrops s serch phrse. Select the following lerts from the results. Alert vrops: VC stts query timed out occurred vrops: Out of Memory errors occurred VMwre, Inc. 33

34 5 Enle the lerts. In the Alerts dilog ox, click Enle. In the Enle Alerts dilog ox, configure the following lert settings nd click Enle. For defult oject, you select the vrelize Opertions Mnger mster node. Setting Region A Region B Emil Emil ddress to send lerts to Emil ddress to send lerts to Send to vrelize Opertions Mnger Selected Selected Fllck Oject vrops-mstrn-01 vrops-mstrn-01 Criticlity criticl criticl VMwre, Inc. 34

35 6 In the Alerts dilog ox, set the Rise n lert option for ech enled lert. Click the Edit utton on the first enled vrelize Opertions Mnger lert. In the Edit Alert dilog ox, under Rise n lert, select On ny mtch, nd click Sve. VMwre, Inc. 35

36 c d Repet the steps for the other enled lerts. Close the Alerts dilog ox. 7 Repet the steps on to enle lerts for the vrelize Opertions Mnger mster node vrops-mstrn-01. Enle the Alerts for vrelize Automtion Use the inuilt prolem nd lert signtures in vrelize Log Insight for vrelize Automtion. For monitoring the vrelize Automtion deployment in the Softwre-Defined Dt Center, you cn use the following lerts in vrelize Log Insight. VMwre, Inc. 36

37 Tle 1 7. vrelize Automtion Alerts in vrelize Log Insight Alert Nme Purpose Severity *** CRITICAL *** vra CAFE service unville! A vra CAFE service hs ecome unville. This my hppen ecuse: A service hs filed - if the service does not utomticlly restrt this my impct vra's ility to function A service is locked nd cnnot response t the moment - this my indicte incresed lod within the environment vra is strting nd certin dependencies of the component re not ville yet - this issue should cler utomticlly s ll services come online Criticl *** CRITICAL *** vra disk is full Windows host(s) hve disk tht is t cpcity. If disk spce runs out completely, it will impct the Infrstructure services provided y IS component of vra nd the Infrstructure t will ecome unville from the vra UI. Criticl *** CRITICAL *** vra IS Services Stopped A vra service hs ecome unville. This my hppen ecuse: A service hs filed - if the service does not utomticlly restrt this my impct vra's ility to function A service is locked nd cnnot response t the moment - this my indicte incresed lod within the environment Mngement Agent- in n HA deployment, only ONE Mngement Agent instnce should e running. If more thn one is running, this will cuse issues with norml functioning of the system. Criticl VMwre, Inc. 37

38 Procedure 1 Open the vrelize Log Insight user interfce. Open We rowser nd go to the following URL. Region Region A Region B vrelize Log Insight URL Log in using the following credentils. Setting User nme Pssword Vlue dmin vrli_dmin_pssword 2 In the vrelize Log Insight user interfce, click Interctive Anlytics. 3 Click the icon nd select Mnge Alerts. 4 Select the lerts tht re relted to vrelize Automtion. In the serch ox of the Alerts dilog ox, enter vr s serch phrse. Select the following lerts from the results. Alert *** CRITICAL *** vra CAFE service unville! *** CRITICAL *** vra disk is full *** CRITICAL *** vra IS Services Stopped VMwre, Inc. 38

39 5 Enle the lerts. In the Alerts dilog ox, click Enle. In the Enle Alerts dilog ox, configure the following lert settings nd click Enle. For defult oject, you select the first vrelize Automtion Applince. Setting Region A Region B Emil Emil ddress to send lerts to Emil ddress to send lerts to Send to vrelize Opertions Mnger Selected Selected Fllck Oject vr01svr01 vr01svr01 Criticlity criticl criticl VMwre, Inc. 39

40 6 In the Alerts dilog ox, set the Rise n lert option for ech enled lert. Click the Edit utton on the first enled vrelize Automtion lert. In the Edit Alert dilog ox, under Rise n lert, select On ny mtch, nd click Sve. VMwre, Inc. 40

41 c d Repet the steps for the other enled lerts. Close the Alerts dilog ox. 7 Repet the steps on to enle lerts for vrelize Automtion in Region B. Enle the Alerts for vrelize Orchestrtor Use the inuilt prolem nd lert signtures in vrelize Log Insight for vrelize Orchestrtor. For monitoring the vrelize Orchestrtor deployment in the Softwre-Defined Dt Center, you cn use the following lerts in vrelize Log Insight. VMwre, Inc. 41

42 Tle 1 8. vrelize Orchestrtor Alerts in vrelize Log Insight Alert Nme Purpose Severity vro: Orchestrtor STANDBY Alert vro: Invlid Login Alert vro: Orchestrtor Reoot Alert vro: Workflow Modifiction Alert vro: Orchestrtor Workflow Filure Alert vro: Configurtion Modifiction Alert The Orchestrtor server stte switched to STANDBY mode. In generl there could e two resons: There re enough RUNNING nodes in the cluster nd current node will sty on stndy plying role of ck-up node witing to switch to RUNNING stte if needed. Prolems with criticl components s dtse or uthentiction provider hs een detected which prevents the norml functioning of the server node. The current node is considered unhelthy. The server will monitor tht criticl components nd try to recover s soon s the prolems re solved. The current work won't ccept ny new requests nd ll its workflows will e resumed on other helthy nodes. Filed login ttempt hs een detected. The reson could e wrong credentils used to login to the server or there could e mlicious ttempt to ccess the server. Orchestrtor server hs een strted or reooted. The cuse could e plnned reoot or result of unwnted ction. The content of some workflow hs een modified. This could e plnned workflow content updte or result of unwnted mlicious ctions. Orchestrtor workflow run filures hve een detected. This could e due to infrstructure prolems with externl systems. Some modifictions in the configurtion elements of the Orchestrtor hve een detected. Criticl Criticl Criticl Criticl Criticl Criticl Procedure 1 Open the vrelize Log Insight user interfce. Open We rowser nd go to the following URL. Region Region A Region B vrelize Log Insight URL Log in using the following credentils. Setting User nme Pssword Vlue dmin vrli_dmin_pssword 2 In the vrelize Log Insight user interfce, click Interctive Anlytics. 3 Click the icon nd select Mnge Alerts. VMwre, Inc. 42

43 4 Select the lerts tht re relted to vrelize Orchestrtor. In the serch ox of the Alerts dilog ox, enter vro s serch phrse. Select the following lerts from the results. Alert vro: Orchestrtor STANDBY Alert vro: Invlid Login Alert vro: Orchestrtor Reoot Alert vro: Workflow Modifiction Alert vro: Orchestrtor Workflow Filure Alert vro: Configurtion Modifiction Alert VMwre, Inc. 43

44 5 Enle the lerts. In the Alerts dilog ox, click Enle. In the Enle Alerts dilog ox, configure the following lert settings nd click Enle. For defult oject, you select the first vrelize Orchestrtor virtul pplince. Setting Region A Region B Emil Emil ddress to send lerts to Emil ddress to send lerts to Send to vrelize Opertions Mnger Selected Selected Fllck Oject vr01vro01 vr01vro01 Criticlity criticl criticl VMwre, Inc. 44

45 6 In the Alerts dilog ox, set the Rise n lert option for ech enled lert. Click the Edit utton on the first enled vrelize Orchestrtor lert. In the Edit Alert dilog ox, under Rise n lert, select On ny mtch, nd click Sve. c d Repet the steps for the other enled lerts. Close the Alerts dilog ox. VMwre, Inc. 45

46 7 Repet the steps on to enle lerts for vrelize Orchestrtor in Region B. VMwre, Inc. 46

47 Creting Custom SDDC vrelize 2 Opertions Dshords Monitoring the Softwre-Defined Dt Center (SDDC) is criticl to the helth of the environment. You crete custom vrelize Opertions Mnger dshords to provide centrlized SDDC dshords. Using such dshords simplifies monitoring the helth of the SDDC s opposed to hving to switch etween multiple product-specific dshords. To crete custom dshords, verify tht you hve deployed vrelize Opertions Mnger ccording to implementtion guides. You must hve the following mngement pcks instlled nd configured: vrelize Opertions Mnger Mngement Pck for VMwre vsphere vrelize Opertions Mnger Mngement Pck for NSX-vSphere vrelize Opertions Mnger Mngement Pck for vrelize Automtion vrelize Opertions Mnger Mngement Pck for Storge Devices vrelize Opertions Mnger Mngement Pck for Log Insight Procedure 1 Crete the SDDC Cpcity Dshord In the SDDC, monitor the trends in the CPU nd memory consumption on the ESXi hosts nd the storge cpcity of the dtstores from common dshord. 2 Configure Dshord tht Provides n Overview of SDDC Opertion Crete dshord in vrelize Opertions Mnger where you cn monitor the ojects of the SDDC mngement stck. Crete the SDDC Cpcity Dshord In the SDDC, monitor the trends in the CPU nd memory consumption on the ESXi hosts nd the storge cpcity of the dtstores from common dshord. VMwre, Inc. 47

48 Procedure 1 Log in to vrelize Opertions Mnger y using the dministrtion console. Open We rowser nd go to Log in using the following credentils. Setting User nme Pssword Vlue dmin vrops_dmin_pssword 2 On the Home pge, from the Actions menu select Crete Dshord. 3 In the Dshord Configurtion section of the New Dshord dilog ox, configure the following settings. Setting Nme Is defult Vlue SDDC Cpcity Trends No 4 Add widgets to the dshord. Expnd the Widget List section. Drg three Scoreord widgets to the lyout pne on the right. VMwre, Inc. 48

49 5 Configure the first Scoreord widget to show metrics for CPU usge. In the upper-right corner of the first Scoreord widget, click the Edit icon. Configure the following settings t the top of the Edit Scoreord dilog ox. Scoreord Widget Setting Title Refresh Content Refresh Intervl Self Provider Show Oject Nme Show Sprkline Vlue SDDC CPU Usge On 300s On On On c Click the Oject Types t, nd dd the metrics tht this widget displys. Oject Type Setting Adpter Type Oject Type Vlue vcenter Adpter Host System d e In the metrics pne on the right, enter Cpcity Usge in the serch ox, nd press Enter. In the serch result, expnd the CPU metric ctegory nd doule-click the Cpcity Usge (%) metric to dd it to the list of metrics tht the widget displys. VMwre, Inc. 49

50 f In the metrics list, doule-click ech of the following collection options, customize it nd click Updte. Collection Setting Color Method Vlue Custom Yellow Bound 60 Ornge Bound 75 Red Bound 90 g In the Edit Scoreord dilog ox, click Sve. 6 Configure the second Scoreord widget to show metrics for memory usge. In the upper-right corner of the second Scoreord widget, click the Edit icon. Configure the following settings t the top of the Edit Scoreord dilog ox. Scoreord Widget Setting Title Refresh Content Refresh Intervl Self Provider Show Oject Nme Show Sprkline Vlue SDDC Memory Overview On 300s On On On VMwre, Inc. 50

51 c Click the Oject Types t, nd dd the metrics tht this widget displys. Oject Type Setting Adpter Type Oject Type Vlue vcenter Adpter Host System d In the metrics pne on the right, enter Usge / Usle in the serch ox, nd press Enter. e f In the serch result, expnd the Memory metric ctegory nd doule-click the Usge/Usle (%) metric to dd it to the list of metrics tht the widget displys. In the metrics list, doule-click ech of the following collection options, customize it nd click Updte. Collection Setting Color Method Vlue Custom Yellow Bound 70 Ornge Bound 80 Red Bound 90 g In the Edit Scoreord dilog ox, click Sve. VMwre, Inc. 51

52 7 Configure the third Scoreord widget to show metrics for storge usge. In the upper-right corner of the third Scoreord widget, click the Edit icon. Configure the following settings t the top of the Edit Scoreord dilog ox. Scoreord Widget Setting Title Refresh Content Refresh Intervl Self Provider Show Oject Nme Show Sprkline Vlue SDDC Storge Consumption On 300s On On On c Click the Oject Types t, nd dd the metrics tht this widget displys. Oject Type Setting Adpter Type Oject Type Vlue vcenter Adpter Dtstore d In the metrics pne on the right, enter Used Spce in the serch ox, nd press Enter. e f g In the serch result, expnd the Cpcity metric ctegory nd doule-click the Used Spce (%) metric to dd it to the list of metrics tht the widget displys. In the metrics pne on the right, enter Numer of VMs in the serch ox nd press Enter. In the serch result, expnd the Summry metric ctegory nd doule-click the Totl Numer of VMs metric to dd the numer of VMs in the dtstore to the list of metrics in the widget. VMwre, Inc. 52

53 h In the metrics list t the ottom, doule-click ech metric row, customize the following collection ttriute for the metric nd click Updte. Collection Setting Color Method Vlue Custom Yellow Bound 60 Ornge Bound 70 Red Bound 80 i In the Edit Scoreord dilog ox, click Sve. 8 In the New Dshord dilog ox, click Sve. The SDDC Cpcity Trends dshord ecomes ville on the Home pge of the vrelize Opertions Mnger user interfce. VMwre, Inc. 53

54 Configure Dshord tht Provides n Overview of SDDC Opertion Crete dshord in vrelize Opertions Mnger where you cn monitor the ojects of the SDDC mngement stck. Procedure 1 Crete n Appliction for vrelize Log Insight Crete n ppliction in vrelize Opertions Mnger to group the monitoring dt out the virtul mchines of vrelize Log Insight. 2 Crete n Appliction for vrelize Orchestrtor Crete n ppliction in vrelize Opertions Mnger to group the monitoring dt for the virtul mchines of vrelize Orchestrtor. 3 Collect the SDDC Ojects in Group Crete custom group for ech mngement ppliction to monitor the helth of the entire ppliction stck s opposed to individul virtul mchine helth. 4 Configure Dshord tht Provides n Overview of the SDDC Stte Crete centrl dshord tht you cn use to trck the overll stte of the SDDC. VMwre, Inc. 54

55 Crete n Appliction for vrelize Log Insight Crete n ppliction in vrelize Opertions Mnger to group the monitoring dt out the virtul mchines of vrelize Log Insight. vrelize Opertions Mnger uilds n ppliction to determine how your environment is ffected when one or more components in n ppliction experiences prolems. You cn lso monitor the overll helth nd performnce of the ppliction. vrelize Opertions Mnger collects dt from the components in the ppliction nd displys the results in summry dshord for ech ppliction with rel-time nlysis for ny or ll of the components. Becuse the Mngement Pck for vrelize Log Insight does not collect monitoring dt out the virtul mchines of the vrelize Log Insight deployment, you crete n ppliction to wtch their stte. Procedure 1 Log in to vrelize Opertions Mnger y using the dministrtion console. Open We rowser nd go to Log in using the following credentils. Setting User nme Pssword Vlue dmin vrops_dmin_pssword 2 In the left pne of vrelize Opertions Mnger, click the Environment menu nd click the Applictions t. 3 On the Applictions t, click the Add icon to dd n ppliction. 4 In the Add Appliction dilog ox, select Custom nd click OK. 5 In the Appliction Mngement dilog ox, in the Appliction text ox enter vrelize Log Insight. VMwre, Inc. 55

56 6 In the Tiers pne, click Add Tier, enter Log Insight VMs s the Tier Nme nd click Updte. 7 In the ojects list underneth, enter vrli in the serch ox, nd press Enter. 8 Select the virtul mchine ojects of vrelize Log Insight nd drg them to the Tier Ojects pne. Region A VMs vrli-mstr-01 vrli-wrkr-01 vrli-wrkr-02 Region B VMs vrli-mstr-51 vrli-wrkr-51 vrli-wrkr-52 9 Click Sve. Crete n Appliction for vrelize Orchestrtor Crete n ppliction in vrelize Opertions Mnger to group the monitoring dt for the virtul mchines of vrelize Orchestrtor. vrelize Opertions Mnger uilds n ppliction to determine how your environment is ffected when one or more components in n ppliction experiences prolems. You cn lso monitor the overll helth nd performnce of the ppliction. vrelize Opertions Mnger collects dt from the components in the ppliction nd displys the results in summry dshord for ech ppliction with rel-time nlysis for ny or ll of the components. Becuse the Mngement Pck for vrelize Automtion does not collect monitoring dt out the virtul mchines of the vrelize Orchestrtor cluster, you crete n ppliction to wtch their stte. VMwre, Inc. 56

57 Procedure 1 Log in to vrelize Opertions Mnger y using the dministrtion console. Open We rowser nd go to Log in using the following credentils. Setting User nme Pssword Vlue dmin vrops_dmin_pssword 2 In the left pne of vrelize Opertions Mnger, click the Environment menu nd click the Applictions t. 3 On the Applictions t, click the Add icon to dd n ppliction. 4 In the Add Appliction dilog ox, select Custom nd click OK. 5 In the Appliction Mngement dilog ox, in the Appliction text ox enter vrelize Orchestrtor. 6 In the Tiers pne, click Add Tier, enter Orchestrtor VMs s the Tier Nme nd click Updte. 7 In the ojects list underneth, enter vr01vro01 in the serch ox nd press Enter. 8 Select the virtul mchine ojects of vrelize Orchestrtor nd drg them to the Tier Ojects pne. vr01vro01 vr01vro01 9 Click Sve. VMwre, Inc. 57

58 Collect the SDDC Ojects in Group Crete custom group for ech mngement ppliction to monitor the helth of the entire ppliction stck s opposed to individul virtul mchine helth. Procedure 1 Log in to vrelize Opertions Mnger y using the dministrtion console. Open We rowser nd go to Log in using the following credentils. Setting User nme Pssword Vlue dmin vrops_dmin_pssword 2 In the left pne of vrelize Opertions Mnger, click the Environment menu. 3 Click the Groups t, nd click the Add icon to dd custom group. 4 In the New group dilog ox, enter SDDC Mngement in the Nme text ox. 5 From the Group Type drop-down menu, select Function. 6 Expnd the Define memership criteri section. 7 To dd the vrelize Automtion ojects, from the Select the Oject Type tht mtches ll of the following criteri drop-down menu, select vrelize Automtion MP > vrelize Automtion MP Instnce. 8 Click Add nother criteri set nd repet Step 7 to dd ech of the following oject types representing the other mngement pplictions in the SDDC. vcenter Adpter > vsphere World NSX-vSphere Adpter > NSX-vSphere Environment vrelize Opertions Adpter > vrelize Opertions Cluster VMwre, Inc. 58

59 9 Expnd the Ojects to lwys include section. 10 Add the following vrelize Log Insight nd vrelize Orchestrtor ppliction ojects. Under Filtered ojects, expnd Custom Groups nd select Applictions. Select vrelize Log Insight nd vrelize Orchestrtor, nd click the Add utton to dd the ppliction ojects to Ojects to lwys include list on the right. 11 Click OK. VMwre, Inc. 59

60 Configure Dshord tht Provides n Overview of the SDDC Stte Crete centrl dshord tht you cn use to trck the overll stte of the SDDC. The SDDC overview dshord hs the following two spects: Disply the min indictors for the stte of CPU, memory, connectivity nd storge in the mngement cluster tht hosts the mngement pplictions. Show the overll stte of the mngement pplictions in the SDDC. You use the SDDC Mngement custom group tht represents common oject for ll mngement pplictions. The SDDC dshord consists of the following widgets: Twelve hetmp widgets showing hetmps of the compute resources in the SDDC. You rrnge the hetmp widgets in three rows nd four columns. Hetmp widgets re leled Hetmp X.Y where X is the row numer nd Y is the column numer in the dshord. One helth chrt widget Tle 2 1. Configurtion of the Hetmp Widgets in the First Row of the SDDC Dshord Widget Setting Hetmp 1.1 Hetmp 1.2 Hetmp 1.3 Hetmp 1.4 Title Physicl CPU Remining Physicl Memory Remining Mngement VM CPU Used Mngement VM CPU Contention Refresh Content On On On On Refresh Intervl 300s 300s 300s 300s Nme Mngement Hosts Mngement Hosts Mngement VMs Mngement VMs Group y vcenter Adpter > Dtcenter vcenter Adpter > Dtcenter vcenter Adpter > Dtcenter vcenter Adpter > Dtcenter Then y Mode Instnce Instnce Instnce Instnce Oject type vcenter Adpter > Host System vcenter Adpter > Host System vcenter Adpter > Virtul Mchine vcenter Adpter > Virtul Mchine Attriute type CPU > Cpcity Remining (%) Memory > Cpcity Remining (%) CPU > Usge (%) CPU > CPU Contention (%) Min Vlue (Color) 0 (red) 0 (red) 80 (green) 0 (green) Mx Vlue (Color) 25 (green) 25 (green) 100 (red) 2 (red) Filter - - Adpter Instnces > vcenter Server > mgmt01vc01-sfo01 Adpter Instnces > vcenter Server > mgmt01vc51-lx01 Adpter Instnces > vcenter Server > mgmt01vc01-sfo01 Adpter Instnces > vcenter Server > mgmt01vc51-lx01 VMwre, Inc. 60

61 Tle 2 2. Configurtion of the Hetmp Widgets in the Second Row of the SDDC Dshord Widget Setting Hetmp 2.1 Hetmp 2.2 Hetmp 2.3 Hetmp 2.4 Title Physicl Network I/O Physicl Dropped Pckets Mngement VM Memory Used Mngement VM Swp Rte Refresh Content On On On On Refresh Intervl 300s 300s 300s 300s Nme Mngement Hosts Mngement Hosts Mngement VMs Mngement VMs Group y vcenter Adpter > Dtcenter vcenter Adpter > Dtcenter vcenter Adpter > Dtcenter vcenter Adpter > Dtcenter Then y Mode Instnce Instnce Instnce Instnce Oject type vcenter Adpter > Host System vcenter Adpter > Host System vcenter Adpter > Virtul Mchine vcenter Adpter > Virtul Mchine Attriute type Network I/O > Demnd (%) Network I/O > Pckets Dropped Memory > Usge (%) Memory > Swpped (KB) Min Vlue (Color) 80 (green) 0 (green) 50 (green) 0 (green) Mx Vlue (Color) 100 (red) 1 (red) 90 (red) 1 (red) Filter - - Adpter Instnces > vcenter Server > mgmt01vc01-sfo01 Adpter Instnces > vcenter Server > mgmt01vc51- lx01 Adpter Instnces > vcenter Server > mgmt01vc01-sfo01 Adpter Instnces > vcenter Server > mgmt01vc51-lx01 Tle 2 3. Configurtion of the Hetmp Widgets in the Third Row of the SDDC Dshord Widget Setting Hetmp 3.1 Hetmp 3.2 Hetmp 3.3 Hetmp 3.4 Title Storge VSAN Ltency Storge NFS Ltency Mngement VM Storge Ltency Mngement VM Disk Free Refresh Content On On On On Refresh Intervl 300s 300s 300s 300s Nme Dtstores Dtstores Mngement VMs Mngement VMs Group y Storge Devices > VirtulSAN Dtstore Storge Devices > NFS Volume vcenter Adpter > Dtcenter vcenter Adpter > Dtcenter Then y Mode Instnce Instnce Instnce Instnce Oject type Storge Devices > VirtulSAN Dtstore Storge Devices > NFS Volume vcenter Adpter > Virtul Mchine vcenter Adpter > Virtul Mchine Attriute type Host Specific Metrics > Write Ltency (ms) Derived Sttistics > Inferred Ltency Virtul Disk > Red Ltency (ms) Disk Spce > Cpcity Remining (%) VMwre, Inc. 61

62 Tle 2 3. Configurtion of the Hetmp Widgets in the Third Row of the SDDC Dshord (Continued) Widget Setting Hetmp 3.1 Hetmp 3.2 Hetmp 3.3 Hetmp 3.4 Min Vlue (Color) 0 (green) 0 (green) 0 (green) 5 (red) Mx Vlue (Color) 30 (red) 30 (red) 30 (red) 20 (green) Filter - - Adpter Instnces > vcenter Server > mgmt01vc01-sfo01 Adpter Instnces > vcenter Server > mgmt01vc51-lx01 Adpter Instnces > vcenter Server > mgmt01vc01-sfo01 Adpter Instnces > vcenter Server > mgmt01vc51-lx01 Tle 2 4. Configurtion of the Helth Chrt Widget in the SDDC Dshord Helth Widget Setting Title Refresh Content Refresh Intervl Self Provider Mode Order By Vlue Mngement Applictions On 300s On Children Vlue Asc Pgintion numer 15 Period Length Metric Lst 6 hours Helth Procedure 1 Log in to vrelize Opertions Mnger y using the dministrtion console. Open We rowser nd go to Log in using the following credentils. Setting User nme Pssword Vlue dmin vrops_dmin_pssword 2 On the Home pge, from the Actions menu select Crete Dshord nd in the Dshord Configurtion section of the New Dshord dilog ox, configure the following settings. Dshord Setting Nme Is defult Vlue SDDC Overview Yes VMwre, Inc. 62

63 3 Add widgets to the dshord. c Expnd the Widget List section. Drg 12 Hetmp widgets to the lyout pne on the right, mke three rows with four columns nd lign them so tht they re ll pproximtely equl in size. Drg Helth Chrt widget to the lyout pne on the right. 4 Configure the hetmp widgets. In the upper-right corner of ech widget, click the Edit icon nd configure the widget. In the Edit Hetmp dilog ox, configure the settings of the hetmp widget nd click Sve. 5 Configure the Helth Chrt widget. In the upper-right corner of the widget, click the Edit icon nd configure the widget. In the Edit Helth Chrt dilog ox, configure the settings of the Helth Chrt widget. c From the ojects list t the ottom, expnd Function nd select the SDDC Mngement custom group nd click Sve. 6 In the New Dshord dilog ox, click Sve. The SDDC Overview dshord ecomes ville on the Home pge of the vrelize Opertions Mnger user interfce. VMwre, Inc. 63

64 Configure vrelize Opertions Mnger to Notify of SDDC Issues 3 Crete set of notifictions in vrelize Opertions Mnger so tht dt center opertors receive lerts out issues in the SDDC min functions. Crete Notifictions in vrelize Opertions Mnger Crete emil notifictions in vrelize Opertions Mnger so tht the SDDC opertors know of issues in the min monitoring prmeters of the environment. List of Notifictions for vrelize Opertions Mnger Configure vrelize Opertions Mnger to send emil notifictions out importnt lerts in the SDDC. Crete Notifictions in vrelize Opertions Mnger Crete emil notifictions in vrelize Opertions Mnger so tht the SDDC opertors know of issues in the min monitoring prmeters of the environment. You crete set of notifictions of importnt lerts in the SDDC. See List of Notifictions for vrelize Opertions Mnger. Procedure 1 Log in to vrelize Opertions Mnger y using the dministrtion console. Open We rowser nd go to Log in using the following credentils. Setting User nme Pssword Vlue dmin vrops_dmin_pssword 2 In the left pne of vrelize Opertions Mnger, click Content nd click the Notifictions t. VMwre, Inc. 64

65 3 On the Notifictions t, click the Add icon nd configure the following notifiction settings in the Add Rule dilog ox. Notifiction Setting Nme Method Instnce Recipients Vlue Virtul mchine is projected to run out of disk spce Stndrd Emil Plugin Rinpole Alert Mil Rely Filtering Criteri Scope Oject Type Oject Type vcenter Adpter > Virtul Mchine 4 Configure the trigger for the notifiction. In the Filtering Criteri section of the Add Rule dilog ox, select from the Notifiction Trigger drop-down menu. Click the Select n utton. VMwre, Inc. 65

66 c d In the serch ox of the s dilog ox, enter disk spce nd press Enter. Select the Virtul mchine is projected to run out of disk spce lert definition nd click Select. 5 In the Add Rule dilog ox, click Sve. 6 Repet the steps to crete the other SDDC notifictions. VMwre, Inc. 66

67 List of Notifictions for vrelize Opertions Mnger Configure vrelize Opertions Mnger to send emil notifictions out importnt lerts in the SDDC. You define notifictions from the Content > Notifictions pge in vrelize Opertions user interfce. See Crete Notifictions in vrelize Opertions Mnger. Notifiction Delivery Properties When you define notifictions from vrelize Opertions Mnger, use the following properties to direct them y emil to the opertions tem in your orgniztion. Tle 3 1. Delivery Properties of vrelize Opertions Mnger Notifictions Notifiction Delivery Property Method Instnce Recipients Vlue Stndrd Emil Plugin Rinpole Alert Mil Rely vrops@rinpole.com Virtul Mchine nd Host Notifictions Crete notifictions for most importnt virtul mchines nd ESXi host issues. Tle 3 2. VM nd Host Notifictions in SDDC Notifiction Nme Scope Trigger Virtul mchine is projected to run out of disk spce 1 Oject Type 2 vcenter Adpter > Virtul Mchine Virtul mchine is projected to run out of disk spce Virtul mchine hs CPU contention cused y co-stop 1 Oject Type 2 vcenter Adpter > Virtul Mchine Virtul mchine hs CPU contention due to multi-vcpu scheduling issues (co-stop) cused y too mny vcpus Virtul mchine hs unexpected high CPU worklod 1 Oject Type 2 vcenter Adpter > Virtul Mchine Virtul mchine hs unexpected high CPU worklod Virtul mchine hs unexpected high memory worklod 1 Oject Type 2 vcenter Adpter > Virtul Mchine Virtul mchine hs unexpected high memory worklod Virtul mchine hs disk I/O ltency prolem cused y snpshots 1 Oject Type 2 vcenter Adpter > Virtul Mchine Virtul mchine hs disk I/O ltency prolem cused y snpshots Virtul Mchine is running out of disk spce 1 Oject Type 2 vcenter Adpter > Virtul Mchine Virtul Mchine is running out of disk spce VMwre, Inc. 67

68 Tle 3 2. VM nd Host Notifictions in SDDC (Continued) Notifiction Nme Scope Trigger Virtul mchine hs lrge disk snpshots 1 Oject Type 2 vcenter Adpter > Virtul Mchine Virtul mchine hs lrge disk snpshots Not enough resources for vsphere HA to strt the virtul mchine 1 Oject Type 2 vcenter Adpter > Virtul Mchine Not enough resources for vsphere HA to strt the virtul mchine vsphere HA cnnot perform filover opertion for the virtul mchine 1 Oject Type 2 vcenter Adpter > Virtul Mchine vsphere HA cnnot perform filover opertion for the virtul mchine Host hs CPU contention cused y overpopultion of virtul mchines 1 Oject Type 2 vcenter Adpter > Host System Host hs CPU contention cused y overpopultion of virtul mchines Host hs memory contention cused y overpopultion of virtul mchines 1 Oject Type 2 vcenter Adpter > Host System Host hs memory contention cused y overpopultion of virtul mchines vsphere DRS enled cluster hs CPU contention cused y overpopultion of virtul mchines 1 Oject Type 2 vcenter Adpter > Cluster Compute Resource DRS-enled cluster hs CPU contention cused y overpopultion of virtul mchines vsphere DRS enled cluster hs unexpected high CPU worklod 1 Oject Type 2 vcenter Adpter > Cluster Compute Resource DRS-enled cluster hs unexpected high CPU worklod vsphere DRS enled cluster hs memory contention cused y overpopultion of virtul mchines 1 Oject Type 2 vcenter Adpter > Cluster Compute Resource DRS-enled cluster hs memory contention cused y overpopultion of virtul mchines vsphere DRS enled cluster hs unexpected high memory worklod nd contention 1 Oject Type 2 vcenter Adpter > Cluster Compute Resource DRS-enled cluster hs unexpected high memory worklod nd contention vsphere HA filover resources re insufficient 1 Oject Type 2 vcenter Adpter > Cluster Compute Resource vsphere High Avilility (HA) filover resources re insufficient Networking Notifictions Crete notifictions for most importnt networking issues in distriuted switches nd NSX components. VMwre, Inc. 68

69 Tle 3 3. Networking Notifictions in SDDC Nme Scope Notifiction Trigger Distriuted switch configurtion is out of sync 1 Oject Type 2 vcenter Adpter > vsphere Distriuted Switch Distriuted Switch configurtion is out of sync Host NSX messging infrstructure is reporting n issue 1 Oject Type 2 vcenter Adpter > Host System Host's NSX messging infrstructure is reporting n issue NSX Mnger resource usge is high 1 Oject Type 2 NSX-vSphere Adpter > NSXvSphere Mnger Mnger resource usge is high NSX Mnger API clls re filing 1 Oject Type 2 NSX-vSphere Adpter > NSXvSphere Mnger Mnger API clls re filing VXLAN segment rnge hs een exhusted 1 Oject Type 2 NSX-vSphere Adpter > NSXvSphere Mnger VXLAN segment rnge hs een exhusted Less thn three NSX Controllers re ctive 1 Oject Type 2 NSX-vSphere Adpter > NSXvSphere Controller Cluster Less thn three controllers re ctive Edge resource usge is high 1 Oject Type 2 NSX-vSphere Adpter > NSXvSphere Edge Edge resource usge is high High Avilility is not configured correctly on the Edge 1 Oject Type 2 NSX-vSphere Adpter > NSXvSphere Edge High Avilility is not configured correctly on the Edge High Avilility is not configured correctly on the Edge Edge VM is not responding to helth check 1 Oject Type 2 NSX-vSphere Adpter > NSXvSphere Edge Edge VM is not responding to helth check One or more Lod Blncer pool memers re down 1 Oject Type 2 NSX-vSphere Adpter > NSXvSphere Edge One or more Lod Blncer pool memers re down Storge Notifictions Crete notifictions of most importnt storge issues. VMwre, Inc. 69

70 Tle 3 4. Storge Notifictions in SDDC Nme Scope Notifiction Trigger Dtstore is running out of disk spce 1 Oject Type 2 vcenter Adpter > Dtstore Dtstore is running out of disk spce Dtstore is projected to run out of disk spce 1 Oject Type 2 vcenter Adpter > Dtstore Dtstore is projected to run out of disk spce Virtul SAN cluster prtitioned 1 Oject Type 2 Storge Devices > Virtul SAN Cluster VirtulSAN cluster prtitioned Notifictions out vrelize Opertions Mnger Crete notifictions of most importnt issues in the opertion of vrelize Opertions Mnger. Tle 3 5. Notifictions of vrelize Opertions Mnger Issues Notifiction Nme Scope Trigger One or more vrelize Opertions services on node re down 1 Oject Type 2 vrelize Opertions Adpter > vrelize Opertions Node One or more vrelize Opertions services on node re down Disk spce on vrelize Opertions Mnger node is low 1 Oject Type 2 vrelize Opertions Adpter > vrelize Opertions Node Disk spce on node is low Node processing queue is cking up 1 Oject Type 2 vrelize Opertions Adpter > vrelize Opertions Node Node processing queue is cking up FSDB filed to repir corrupted files 1 Oject Type 2 vrelize Opertions Adpter > vrelize Opertions Fsd Fsd filed to repir corrupted files FSDB overlod 1 Oject Type 2 vrelize Opertions Adpter > vrelize Opertions Fsd Fsd high lod Numer of ojects monitored y this vrelize Opertions Mnger node exceeds the configured limit. Possile loss of dt 1 Oject Type 2 vrelize Opertions Adpter > vrelize Opertions Anlytics Numer of Ojects eing monitored y this vrelize Opertions Node exceeds the configured limit. Possile loss of dt Remote Collector one or more vrelize Opertions services re down 1 Oject Type 2 vrelize Opertions Adpter > vrelize Opertions Remote Collector One or more vrelize Opertions services on remote collector re down VMwre, Inc. 70

71 Tle 3 5. Notifictions of vrelize Opertions Mnger Issues (Continued) Notifiction Nme Scope Trigger Remote Collector not reporting correct numer of services 1 Oject Type 2 vrelize Opertions Adpter > vrelize Opertions Remote Collector Remote Collector not reporting correct numer of services vrelize Opertions Cluster processes might e out of memory 1 Oject Type 2 vrelize Opertions Adpter > vrelize Opertions Cluster vrelize Opertions Cluster processes my not hve enough memory VMwre, Inc. 71

72 Monitor vsphere Dt 4 Protection Jos y Emil vsphere Dt Protection supports emil notifictions out the sttus of ckup jos. Configure vsphere Dt Protection to send dily emils. You cn regulrly check them s prt of your dily monitoring ctivities. Procedure 1 Log in to vcenter Server y using the vsphere We Client. Open We rowser nd go to the following URL. Region Region A Region B vcenter Server URL Log in using the following credentils. Setting User nme Pssword Vlue dministrtor@vsphere.locl vsphere_dmin_pssword 2 On the vsphere We Client Home pge, click the VDP icon. 3 On the Welcome to vsphere Dt Protection pge, select the region-specific vsphere Dt Protection instnce from the VDP Applince drop-down menu nd click Connect. Region Region A Region B vsphere Dt Protection Instnce mgmt01vdp01 mgmt01vdp51 4 On the Configurtion t, click the Emil utton nd click Edit. VMwre, Inc. 72

73 5 Configure the following settings for emil notifiction nd click Sve. Emil Notifiction Settings Region A Region B Enle vsphere Dt Protection lrm emil notifiction Selected Selected Enle emil reports Selected Selected Send time 6:00 AM 6:00 AM Send dy(s) All dys All dys Enle the CSV ttchment in emil report Selected Selected Outgoing mil server FQDN of the mil server FQDN of the mil server From ddress vdp-mgmt-01@rinpole.com vdp-mgmt-51@rinpole.com To ddresses(es) sddc-dmin@rinpole.com sddc-dmin@rinpole.com VMwre, Inc. 73

74 6 Click the Send test emil hyperlink nd verify tht you receive the test emil. 7 Click Sve. 8 Repet the steps to configure vsphere Dt Protection in Region B to send dily emil messges. VMwre, Inc. 74

75 Configure vrelize Automtion 5 System Notifiction Events You cn receive utomtic notifictions for severl types of events, such s the successful completion of ctlog request or required pprovl. System dministrtors cn configure glol emil servers tht hndle emil notifictions. Tennt dministrtors cn override the system defult servers, or dd their own servers if no glol servers re specified. Tennt dministrtors select which events, lso known s scenrios, trigger notifictions. Ech component, such s the service ctlog or IS, cn define events tht cn trigger notifictions. Ech user cn choose whether to receive notifictions. Users either receive ll notifictions configured y the tennt dministrtor or no notifictions, they do not hve the fine-grined control over which notifictions to receive. Prerequisites Verify tht vrelize Automtion hs the inound nd outound emil servers configured. See Configure the Defult Emil Servers in Region A in VMwre Vlidted Design Deployment Guide for Region A. Procedure 1 Log in to the vrelize Automtion Rinpole portl. Open We rowser nd go to Log in using the following credentils. Setting User nme Pssword Domin Vlue itc-tenntdmin itc-tenntdmin_pssword Rinpole.locl 2 On the Home pge of the vrelize Automtion mngement console, click the Administrtion t nd click Notifictions. VMwre, Inc. 75

76 3 Configure the scenrios to receive notifictions out. By defult ll scenrios re ctive. c On the Notifictions pge, select Scenrios in the nvigtor. If you do not wnt to e lerted on scenrio, select it nd click the Suspend utton. Verify tht ech of the scenrios you wnt to receive notifictions out is Active. VMwre, Inc. 76

77 4 Suscrie to notifictions from vrelize Automtion. Click Preferences next to the ITAC-TenntAdmin user nme. c Under Notifictions, select English (United Sttes) from the Lnguge drop-down menu. Select Enled next to the Emil protocol, click Apply nd click Close. Notifictions re now enled for the ITAC-TenntAdmin ccount. VMwre, Inc. 77