DELL EMC VxRAIL NETWORK GUIDE

Transcription

1 WHITE PAPER - DELL EMC VxRAIL NETWORK GUIDE Physical and Lgical Netwrk Cnsideratins and Planning ABSTRACT This is a planning and cnsideratin guide fr VxRail Appliances. It can be used t understand better the netwrking required fr VxRail implementatin. This whitepaper des nt replace the requirement fr implementatin services with VxRail Appliances and shuld nt be used in an attempt t implement the required netwrking fr VxRail Appliances. Nvember 2017

2 TABLE OF CONTENTS Intended Use and Audience... 4 Intrductin t VxRail... 4 Decisin Regarding vcenter Server... 4 Planning Yur Netwrk... 5 Physical Netwrk... 5 VxRail Clusters, Appliances and Ndes... 5 Netwrk Switch... 7 Tplgy and Cnnectins Wrkstatin/Laptp Out-f-Band Management (ptinal) Befre Cabling VxRail Appliances Step 1: Plan Lgical Netwrk Step 1A. Reserve VLANs (Best Practice) Step 1B. System Time Zne, NTP Server DNS Server Step 1C. Management ESXi Hstnames and IP Addresses vcenter Server VxRail Manager and Netwrking Passwrds Step 1D. vmtin and vsan Step 1E. Slutins Step 1F. Wrkstatin/Laptp Step 2: Set Up Switch Step 2A. Understanding Switch Cnfiguratin Netwrk Traffic Inter-switch Cmmunicatin Disable Link Aggregatin vsphere Security Recmmendatins Step 2B. Cnfigure VLANs n Yur Switch(es) Step 2C. Cnfirm Yur Cnfiguratin After Planning and Switch Setup Unassigned Physical Prts Netwrk Segregatin VxRail Netwrk Planning Guide

3 VxRail Setup Checklist Appendix A: NSX Supprt n VxRail Appendix B: VxRail Open Prts Requirement Appendix C VxRail Firewall Rules & ACI Cntracts Diagram Netwrk Planning Guide

4 Intended Use and Audience This guide discusses the essential netwrk details fr VxRail deplyment planning purpses nly. It als intrduces best practices, recmmendatins, and requirements fr bth physical and virtual netwrk envirnments. The guide has been prepared fr anyne invlved in planning, installing, and maintaining VxRail, including Dell EMC field engineers and custmer system and netwrk administratrs. This guide shuld nt be used t perfrm the actual installatin and set-up f VxRail. Please wrk with yur Dell EMC service representative t perfrm the actual installatin. Intrductin t VxRail Dell EMC VxRail Appliances are a hyper-cnverged infrastructure (HCI) slutin that cnslidates cmpute and strage int a single, highly available, netwrk-ready unit. With careful planning, VxRail Appliances can be rapidly deplyed int an existing envirnment, and the infrastructure is immediately available t deply applicatins and services. VxRail is nt a server. It is an appliance. The G Series cnsists f up t fur ndes in a single appliance, all ther mdels based n Dell EMC PwerEdge Servers are a single nde per appliance. A 10GbE switch (r a 1GbE switch fr certain mdels f VxRail) is required. A wrkstatin/laptp fr the VxRail user interface is als required. VxRail has a simple, scale-ut architecture, leveraging VMware vsphere and VMware vsan t prvide server virtualizatin and sftware-defined strage. Fundamental t the VxRail clustered architecture is netwrk cnnectivity. It is thrugh the lgical and physical netwrks that individual ndes act as a single system prviding scalability, resiliency and wrklad balance. The VxRail sftware bundle is preladed nt hardware and cnsists f the fllwing cmpnents (specific sftware versins nt shwn): VxRail Manager VMware vcenter Server VMware vrealize Lg Insight VMware vsan Dell EMC Secure Remte Supprt (ESRS)/VE Als preladed is VMware vsphere; hwever, licenses are required and can be purchased thrugh Dell EMC, VMware r yur preferred VMware reseller partner. The VxRail Appliances als includes licenses fr sftware that can be dwnladed, installed and cnfigured: Dell EMC RecverPint fr Virtual Machines (RP4VM) - 15 Full Licenses per G-series appliance chassis r 5 Full Licenses per all ther single nde per chassis VxRail series appliances VxRail is fully cmpatible with ther sftware in the VMware ecsystem, including VMware NSX. Refer t the VMware Prduct Interperability Matrixes fr specific versins f NSX supprted n vsphere specific versins. Decisin Regarding vcenter Server A VxRail Cluster s virtual infrastructure is managed by a single vcenter Server instance, either VxRail vcenter Server r Custmer Supplied vcenter Server. When a VxRail Appliance is deplyed, the vcenter deplyment type is selected and is difficult t change. If a custmer wants t make a change, fr VxRail versins 3.5 and it wuld require a factry reset and all data wuld need t be wiped frm the VxRail Appliance and reinstallatin wuld be required. T migrate a VxRail running vcenter Server t a Custmer Supplied vcenter requires an RPQ. Fr VxRail , , , and there is a detailed migratin prcedure available. Refer t the Dell EMC VxRail vcenter Server Planning Guide fr details. 4 Netwrk Planning Guide

5 Planning Yur Netwrk The netwrk cnsideratins are n different frm thse f any enterprise IT infrastructure: availability, perfrmance, and extensibility. VxRail Appliances are delivered ready t deply and attach t any 10GbE netwrk infrastructure and use IPv4 and IPv6. Sme mdels with single prcessrs are available fr 1GbE netwrks. Mst prductin VxRail netwrk tplgies use dual tp-f-the-rack (TR) switches t eliminate the switch as a single pint f failure. Fllw all f the netwrk prerequisites described in this dcument; therwise, VxRail will nt install prperly, and it will nt functin crrectly in the future. If yu have separate teams fr netwrk and servers in yur data center, yu will need t wrk tgether t design the netwrk and cnfigure the switch(es). If yur site is behind a firewall, make sure all necessary prts are pen, as demnstrated in Appendix B and C. Physical Netwrk This sectin describes the physical cmpnents fund in a VxRail cluster: VxRail clusters, appliances and ndes Netwrk switch Tplgy and cnnectins Wrkstatin/laptp Out-f-band management (ptinal) VxRail Clusters, Appliances and Ndes VxRail starts with a minimum f 3 ndes (either in a single G-series chassis r three individual appliance ndes fr all ther mdels) cnnected t ne r mre netwrk switches, deplyed t frm a VxRail cluster that cntains the vsan envirnment. A maximum f 64 VxRail ndes can be in a VxRail cluster. The internal disks n each nde cmbine t create a VxRail datastre that is shared acrss all the ndes in the cluster. Within the cluster, multiple netwrks may serve different functins r types f traffic. The cluster is managed by a single instance f VxRail Manager and vcenter Server. A lgical tag in each nde and chassis is used t display the identity f the appliance in VxRail Manager. These tags are 11 alphanumeric characters that uniquely identify the appliance. Please review the physical pwer, space and cling requirements fr yur expected resiliency level. The fllwing illustratins shw pssible cnfiguratins f a VxRail Appliance. idrac prt 10 GbE Prts Figure 1. VxRail P and V Series n 14th Generatin Edge Servers, shwing 4x10GbE prts 5 Netwrk Planning Guide

6 idrac prt 10 GbE Prts Figure 2. VxRail S Series nde n 14th generatin Dell EMC PwerEdge, shwing 4x10GbE prts idrac prt 10 GbE Prts Figure 3. VxRail E Series nde n 14th generatin Dell EMC PwerEdge, shwing 4x10GbE prts idrac prt 10 GbE Prts 1 GbE Prts NOTE: Figure 4. The 2x10GbE prts will aut-negtiate t 1GbE when used with 1GbE netwrking VxRail E, P, S and V Series nde n 13th generatin Dell EMC PwerEdge, shwing the 10GbE and 1GbE prts 6 Netwrk Planning Guide

7 Figure 5. VxRail G Series appliance with fur ndes, shwing the 10GbE prts n each nde Figure 6. BMC prt 1GbE prts prt VxRail G Series appliance with fur ndes, shwing the 1GbE prts n each nde Netwrk Switch VxRail is bradly cmpatible with mst custmer netwrks and switches. VxRail ndes cmmunicate ver ne r mre custmer-prvided netwrk switch(es), typically a tp-f-rack switch. One example is the Dell EMC Switch S4048 (mre details n planning cnfiguratin specific t that switch can be fund in DELL EMC Switch Cnfiguratin Guide fr VxRail.) Switch requirements: The switch(es) cnnected directly t VxRail Appliances must supprt multicast n 10GbE prts fr all mdels f VxRail except fr the mdels that utilize 1GbE fr their primary netwrking as specified: VxRail Releases prir t Release 4.5.0: bth IPv4 and IPv6 multicast pass-thrugh must be supprted. Layer 3 multicast is nt required. VxRail Releases starting with Release 4.5.0: IPv6 multicast pass-thrugh and IPv4 unicast must be supprted. 1 Be sure t have access t the manufacturer s dcumentatin fr yur specific switch(es). Keep in mind that while a Tp-f-rack switch can wrk, it is a ptential single pint f failure. We recmmend using dual tp-f-the-rack (TR) switches. 1 vsan n lnger requires multicast, but is using unicast instead. 7 Netwrk Planning Guide

8 Prt availability: Figure 7. VxRail 14 th Generatin Nde Cnnectivity Summary E, P, S and V Series (14th Generatin Dell EMC PwerEdge Servers) Each VxRail nde cmes with a Netwrk Daughter Card (NDC) cnsisting f 4x10GbE in either SFP+ r RJ-45 NIC prts. Fur crrespnding prts are required fr each VxRail nde n ne r mre 10GbE switch(es). One additinal prt n the switch r ne lgical path n the VxRail management VLAN is required fr a wrkstatin/laptp t access the VxRail user interface fr the cluster. Fr the V, P, and S series, additinal PCI-e NICs can be added t the nde, in either SFP+ r RJ45 interface. VxRail initializatin prcess will nt tuch an additinal PCI-e NIC. Custmers can use the prts fr their wn purpses such as VM netwrks, iscsi, r NFS, etc. 8 Netwrk Planning Guide

9 Figure 8. VxRail Pre-14 th Generatin Nde Cnnectivity Summary E, P, S and V Series (13th Generatin Dell EMC PwerEdge Servers) Each VxRail nde cmes with a Netwrk Daughter Card (NDC) cnsisting f 2x10GbE + 2x1GbE in either SFP+ r RJ-45 NIC prts. The 2x10GbE prts will aut-negtiate t 1GbE when used with 1GbE netwrking. Tw (2) crrespnding prts are required fr each VxRail nde n ne r mre 10GbE switch(es) when utilizing 10GbE as the primary netwrking speed. Fur (4) crrespnding prts are required fr each VxRail nde n ne r mre 1GbE switch(es) when utilizing 1GbE netwrking n the single prcessr mdes. (Nte: The P and V series d nt ffer any single prcessr cnfiguratins.) One (1) additinal prt n the switch r ne lgical path n the VxRail management VLAN is required fr a wrkstatin/laptp t access the VxRail user interface fr the cluster. Up t three additinal PCI-e NIC can be added t the nde, except single prcessr E The interface can be either SFP+ r RJ45. - VxRail initializatin prcess will nt tuch PCI-e NIC. Custmers can use the prts fr their wn purpses such as VM netwrks, iscsi, r NFS, etc. This restrictin nly applies t VxRail In an E, P, S, and V series VxRail Appliances utilizing 10GbE, the 1GbE NIC prts must be discnnected during VxRail initializatin, nde additin and nde replacement. G Series VxRail ndes with 10GbE prts ships with either tw SFP+ r RJ-45 NIC prts. Tw (2) crrespnding prts are required fr each VxRail nde n ne r mre 10GbE switch(es). Six (6) prts are needed fr a three-nde initial cnfiguratin. 9 Netwrk Planning Guide

10 VxRail ndes with 1GbE prts ships with fur RJ-45 NIC prts. Fur (4) crrespnding prts are required fr each VxRail nde n ne r mre 1GbE switch(es). Twelve (12) prts are needed fr a three-nde initial cnfiguratin. One (1) additinal prt n the switch r ne lgical path n the VxRail management VLAN is required fr a wrkstatin/laptp t access the VxRail user interface fr the cluster. Cable requirements: VxRail ndes with RJ-45 prts require CAT5 r CAT6 cables. CAT6 cables are included with every VxRail VxRail ndes with SFP+ prts require ptics mdules (transceivers) and ptical cables, r Twinax Direct-Attach- Cpper (DAC) cables. These cables and ptics are nt included; yu must supply yur wn. The NIC and switch cnnectrs and cables must be n the same wavelength. Please review the lgical switch cnfiguratin requirements in the next sectin f this dcument. Tplgy and Cnnectins Varius netwrk tplgies fr switch(es) and VLANs are pssible with VxRail Appliances. Cmplex prductin envirnments will have multiple cre switches and VLANs. A site diagram shwing the prpsed netwrk cmpnents and cnnectivity is highly recmmended befre cabling and pwering n VxRail Appliances. Be sure t fllw yur switch vendr s best practices fr perfrmance and availability. Fr example, packet buffer banks may prvide a way t ptimize yur netwrk with yur wiring layut. Decide if yu plan t use ne r tw switches fr VxRail. One switch is acceptable and is ften seen in test/develpment r remte/branch ffice (ROBO) envirnments. Hwever, tw r mre switches are used fr high availability and failver in prductin envirnments because VxRail is an entire sftware-defined data center in a bx if ne switch fails yu are at risk f lsing availability f hundreds f virtual machines. Figure 9. Rear view f ne deplyment f a VxRail Appliance cnnected t tw 10GbE switches and a separate switch fr ut-f-band management. This is a 13th generatin PwerEdge server. 10 Netwrk Planning Guide

11 Fr 13th generatin PwerEdge servers in the E, P, S and V series VxRail Appliances utilizing 1GbE with tw switches, the switches must be intercnnected. Wrkstatin/Laptp A wrkstatin/laptp with a web brwser fr the VxRail user interface is required. It must be either plugged int the switch r able t lgically reach the VxRail management VLAN frm elsewhere n yur netwrk; fr example, a jump server ( Dn t try t plug yur wrkstatin/laptp directly int a server nde n a VxRail Appliance; plug it int yur netwrk r switch and make sure that it is lgically cnfigured t reach VxRail. Yu will use a brwser fr the VxRail user interface. The latest versins f Firefx, Chrme, and Internet Explrer 10+ are all supprted. If yu are using Internet Explrer 10+ and an administratr has set yur brwser t cmpatibility mde fr all internal websites (lcal web addresses), yu will get a warning message frm VxRail. Cntact yur administratr t whitelist URLs mapping t the VxRail user interface. Out-f-Band Management (ptinal) If the VxRail Appliances are lcated at a data center that yu cannt access easily, we recmmend setting up an utf-band management switch t facilitate direct cmmunicatin with each nde. Fr E, P, S and V Series Based n PwerEdge Servers: T use ut-f-band management, cnnect the internal Dell Remte Access Cntrller (idrac) prt t a separate switch t prvide physical netwrk separatin. Default values, capabilities, and recmmendatins fr ut-f-band management are prvided with server hardware infrmatin. The default cnfiguratin is: Username: rt Passwrd: calvin Yu will need t reserve an IP address fr each idrac in yur VxRail cluster (ne per nde). Fr G-Series (and VxRail Appliances Prir t VxRail 4.0): T use ut-f-band management, cnnect the BMC prt n each nde t a separate switch t prvide physical netwrk separatin. Default values, capabilities, and recmmendatins fr ut-f-band management are prvided with server hardware infrmatin. The default cnfiguratin is via DHCP with: Username: UserId Passwrd: Passw0rd! NOTE: Case sensitive and using a zer in place f a lwercase in the passwrd The <ApplianceID> can be fund n a pullut tag lcated in frnt f the chassis. The default hstnames shuld be as fllws: BMC interface nde 1: hstname = <ApplianceID>-01 BMC interface nde 2: hstname = <ApplianceID>-02 BMC interface nde 3: hstname = <ApplianceID>-03 BMC interface nde 4: hstname = <ApplianceID> Netwrk Planning Guide

12 Befre Cabling VxRail Appliances Step 1: Plan Lgical Netwrk VxRail is nt a simple server but is an entire data center in a bx. Cnsequently, the netwrk and virtualizatin teams need t meet in advance t plan VxRail s netwrk architecture. Use the VxRail Setup Checklist and the VxRail t help create yur netwrk plan. References t rws in this dcument are t rws in the VxRail. Once yu set up VxRail Appliances, the cnfiguratin cannt be changed easily. Cnsequently, we strngly recmmend that yu take care during this planning phase t decide n the cnfiguratins that will wrk mst effectively fr yur rganizatin. A VxRail cluster cnsists f three r mre VxRail ndes starting in VxRail 4.0 and fur r mre VxRail ndes in earlier releases. VxRail clusters can scale ut t 64 ESXi hsts all n ne vsan datastre, backed by a single vcenter Server and VxRail Manager. Deplyment, cnfiguratin, and management are handled by VxRail, allwing the cmpute capacity and the vsan datastre t grw autmatically. VxRail Manager autmatically discvers the new nde and cnfigures the new nde, and autmatically adds the new nde t default vsphere Distributed Switch. vcenter prpagates the prt grups f default VDS t the new nde. Hwever, if custmers manually add a new VDS/VSS, r add unused physical netwrk adapter(s) t default/new VDS/VSS, then they need t cnfigure the netwrk n the new nde manually. At this time all VxRail ndes in a cluster must be the same hardware series. Yu will be making decisins in the fllwing areas: Step 1A. Reserve VLANs (best practice) Step 1B. System Step 1C. Management Step 1D. vmtin and vsan Step 1E. Slutins Step 1F. Wrkstatin/laptp Step 1A. Reserve VLANs (Best Practice) VxRail grups traffic in the fllwing categries: management, vsphere vmtin, vsan, and Virtual Machine. Traffic islatin n separate VLANs is highly recmmended (but nt required) in VxRail. If yu are using multiple switches, cnnect them via VLAN trunked interfaces and ensure that all VLANs used fr VxRail are carried acrss the trunk fllwing the requirements in this user guide. Management traffic includes all VxRail, vcenter Server, and ESXi cmmunicatin. The management VLAN als carries traffic fr vrealize Lg Insight. All management traffic shuld be untagged and must be able t g ver a Native VLAN n yur switch, r yu will nt be able t build VxRail and cnfigure the ESXi hsts. Special cases can allw yu t tag management traffic in ne f tw ways: 1. Cnfigure each VxRail prt n yur switch t tag the management traffic and rute it t the desired VLAN. 2. Alternately, yu can cnfigure a custm management VLAN t allw tagged management traffic after yu pwer n each nde, but befre yur run VxRail initial cnfiguratin. Yur Dell EMC service representative will take care f this during installatin. In VxRail Appliances, vsphere vmtin and vsan traffic cannt be ruted. This traffic will be tagged fr the VLANs yu specify in VxRail initial cnfiguratin. Dedicated VLANs are preferred t divide virtual machine traffic. VxRail will create ne r mre VM Netwrks fr yu, based n the name and VLAN ID pairs that yu specify. Then when yu create VMs in vsphere Web Client, yu 12 Netwrk Planning Guide

13 can easily assign the virtual machine t the VM Netwrk(s) f yur chice. Fr example, yu culd have ne VLAN fr Develpment, ne fr Prductin, and ne fr Staging. Rw 1 Rw 36 Rw 40 Rws Enter the management VLAN ID fr VxRail, ESXi, and vcenter Server. If yu d nt plan t have a dedicated management VLAN and will accept this traffic as untagged, enter 0 r Native VLAN. Enter a VLAN ID fr vsphere vmtin. (Enter a 0 in the VLAN ID field fr untagged traffic) Enter a VLAN ID fr vsan. (Enter a 0 in the VLAN ID field fr untagged traffic) Enter a Name and VLAN ID pair fr each VM netwrk yu want t create. Yu must create at least ne VM Netwrk. (Enter a 0 in the VLAN ID field fr untagged traffic) NOTE: If yu have multiple independent VxRail clusters, we recmmend using different VLAN IDs fr vsan traffic and management traffic acrss multiple VxRail clusters t reduce netwrk traffic cngestin. Step 1B. System VxRail can cnfigure cnnectins t external servers in yur netwrk. Time Zne, NTP Server A time zne is required. It is cnfigured n vcenter Server and each ESXi hst. An NTP server is nt required, but it is recmmended. If yu prvide an NTP server, vcenter Server will be cnfigured t use it. If yu d nt prvide at least ne NTP server, VxRail uses the time that is set n ESXi hst #1 (regardless f whether the time is crrect r nt). A prxy server is ptinal and nly applies t VxRail mdels prir t 3.5. If yu have a prxy server n yur netwrk and vcenter Server needs t access services utside f yur netwrk, supply the IP address, prt, username, and passwrd. Rw 3 Rw 4 Rws 6 and 7 Enter yur time zne. Enter the hstname(s) r IP address(es) f yur NTP server(s). Enter the prxy server IP address, prt, username, and passwrd. DNS Server One r mre external DNS servers are required when using a Custmer Supplied vcenter Server. When using a VxRail vcenter Server, ne r mre external DNS servers are required starting in VxRail even in islated envirnments. When using yur crprate DNS server(s) fr VxRail, be sure t add the hstnames and IP addresses fr VxRail Manager, vcenter Server, Lg Insight, and each ESXi hst (see the naming scheme in ESXi Hstnames and IP 13 Netwrk Planning Guide

14 Addresses) prir t VxRail initial cnfiguratin. vmtin and vsan IP addresses are nt cnfigured fr ruting by VxRail, s there are n hstnames t enter in the DNS server. Example f VxRail hstnames and IP addresses cnfigured n a DNS server: esxi-hst01.lcaldmain.lcal esxi-hst02.lcaldmain.lcal esxi-hst03.lcaldmain.lcal esxi-hst04.lcaldmain.lcal vxrail.lcaldmain.lcal vcserver.lcaldmain.lcal lginsight.lcaldmain.lcal Releases prir t VxRail with a VxRail vcenter Server deplyed did nt require a DNS server in an islated envirnment. During initial cnfiguratin, VxRail sets up the VxRail vcenter Server t reslve hstnames t the DNS server. If yu are in an islated envirnment, yu will need t use the DNS server that is built int VxRail vcenter Server. T manage VxRail via yur wrkstatin/laptp, cnfigure yur laptp s netwrk settings t use the vcenter Server IP address (Rw 15) fr DNS. VxRail s IP addresses and hstnames are cnfigured fr yu. Make sure that the DNS IP address is accessible frm the netwrk t which VxRail is cnnected and functining prperly. Fr Releases prir t VxRail 4.5.0, if the DNS server requires access via a gateway that is nt reachable during initial cnfiguratin, d nt enter a DNS IP address. Instead, add a DNS server after yu have cnfigured VxRail using VMware KB Rw 5 Enter the IP address(es) fr yur DNS server(s). This is required starting in VxRail It is als required when using a Custmer Supplied vcenter Server. Fr releases prir t 4.5.0, leave blank in an islated envirnment when using the VxRail vcenter Server. Step 1C. Management VxRail des nt have a single hstname. Yu must cnfigure the hstnames fr each ESXi hst, VxRail Manager, and vcenter Server. Yu must cnfigure the IP addresses fr VxRail, vcenter Server, and yur ESXi hsts. When selecting yur IP addresses, yu must make sure that nne f them cnflict with existing IP addresses in yur netwrk. Als, make sure that these IP addresses can reach ther hsts in yur netwrk. Yu cannt easily change the IP addresses after yu have cnfigured VxRail. ESXi Hstnames and IP Addresses All ESXi hstnames in a VxRail cluster are defined by a naming scheme that cmprises: an ESXi hstname prefix (an alphanumeric string), a separatr ( Nne r a dash - ), an iteratr (Alpha, Num X, r Num 0X), an ffset 2 (empty r numeric), a suffix 3 (empty r alphanumeric string with n.) and a dmain. The Preview field shwn during VxRail initial cnfiguratin is an example f the hstname f the first ESXi hst. Fr example, if the prefix is hst, the separatr is Nne, the iteratr is Num 0X, the ffset is empty, and the suffix is lab, and the dmain is lcal, the first ESXi hstname wuld be hst01lab.lcal. The dmain is als autmatically applied t the vcenter Server and VxRail virtual machines. (Example: my-vcenter.lcal). 2 Offset is available starting in VxRail Release It is nly applicable when the iteratr is numeric. 3 Suffix is available starting in VxRail Release Netwrk Planning Guide

15 Example 1 Example 2 Example 3 Prefix hst myname esxi-hst Separatr Nne - - Iteratr Num 0X Num X Alpha Offset 4 Suffix lab Dmain lcal cllege.edu cmpany.cm Resulting hstname hst01.lcal myname-4lab.cllege.edu esxi-hst-a.cmpany.cm There are three r mre ESXi hsts in yur initial cluster and each requires an IP address. If yu plan t scale ut with additinal ndes in this VxRail cluster within the first few weeks after installatin, we recmmend yu allcate extra IP addresses fr each f the ESXi, vmtin, and vsan IP pls when yu initially cnfigure VxRail (three extra IP addresses per nde). Then when yu add ndes t a cluster, yu will nly need t enter the ESXi and VxRail / vcenter Server passwrds. Rws 8-13 Rws 14 and 15 Enter an example f yur desired ESXi hst-naming scheme. Be sure t shw yur desired prefix, separatr, iteratr, ffset, suffix and dmain. Enter the starting and ending IP addresses fr the ESXi hsts - a cntinuus IP range is required, with a minimum f 4 IPs. vcenter Server A new feature intrduced in VxRail 3.5 is the ability t jin a cmpatible Custmer Supplied vcenter Server envirnment, hsted utside f the VxRail cluster. This allws a remte central vcenter Server t manage multiple VxRail clusters. Each VxRail envirnment appears within vcenter Server as a cluster f hsts cnfigured with a vsan datastre. Optinally, if yu want VxRail t create a new VxRail vcenter Server, yu will need t specify a hstname and IP address fr yur VxRail vcenter Server and Platfrm Services Cntrller (PSC) virtual machines. (Rws 16-19) If yu want VxRail t jin an existing Custmer Supplied vcenter Server, yu will need t: Determine if yur Custmer Supplied vcenter Server is cmpatible with yur VxRail Versin. VxRail 3.5 and vsphere 6.0 U2 VxRail 4.0.x and vsphere 6.0 U3b VxRail 4.5.x and vsphere 6.5 U1a Knw whether yur Custmer Supplied vcenter Server has an embedded r Custmer Supplied Platfrm Services Cntrller. If the PSC is Custmer Supplied, enter the PSC FQDN (Rw 20). Knw the Custmer Supplied vcenter Server FQDN (Rw 21), Single Sign-n dmain (SSO) (Rw 22). (Optinal) Create a VxRail nn-admin user and passwrd fr initial deplyment (Rw 23). Tw new rles will be created and assigned t this user by yur Dell EMC Representative. Create r re-use a VxRail management user and passwrd (Rw 24) fr this VxRail cluster n the Custmer Supplied vcenter Server. This user must be created with n permissins and n rles. Create r select an existing datacenter (Rw 25) n the Custmer Supplied vcenter Server. Specify the name f the cluster (Rw 26) that will be created by VxRail in the selected datacenter when the cluster is built. This name must be unique and nt used anywhere in the datacenter n the Custmer Supplied vcenter Server. 15 Netwrk Planning Guide

16 Starting with Release 3.5, the tp-level dmain f the Custmer Supplied vcenter Server and PSC must be publicly knwn, such as.cm,.net,.edu,.lcal, and many cuntry-specific suffixes. Mst f thse listed in this reference are supprted: VxRail vcenter Server (deplyed when VxRail is built) Rw 16 Enter an alphanumeric string fr the new vcenter Server hstname. The dmain specified in Rw 11 will be appended. Rw 17 Enter the IP address f the new vcenter Server. Rw 18 Enter an alphanumeric string fr the new Platfrm Services Cntrller hstname. The dmain specified in Rw 11 will be appended. Rw 19 Enter the IP address f the new Platfrm Services Cntrller. Custmer Supplied vcenter Server Rw 20 Enter the FQDN f the Custmer Supplied Platfrm Services Cntrller (PSC) in the hstname. In the user interface, there is a checkbx fr Custmer Supplied PSC. Leave this rw blank if the PSC is embedded in the Custmer Supplied vcenter Server. Rw 21 Enter the FQDN f the Custmer Supplied vcenter Server in the hstname field. Rw 22 Enter the Single Sign-n (SSO) dmain fr the Custmer Supplied vcenter Server. (Fr example vsphere.lcal) Rw 23 Rw 24 Enter the administrative username/passwrd fr the Custmer Supplied vcenter Server. Optinally create a VxRail nn-admin user n the Custmer Supplied vcenter Server and enter the VxRail nn-admin username/passwrd here. Create r re-use the VxRail management user with n permissins and n rles fr this cluster. Enter the full VxRail management username/passwrd. (Fr example, cluster1-manager@vsphere.lcal) Rw 25 G t the Custmer Supplied vcenter Server and select r create a datacenter. Enter the name f a datacenter n the Custmer Supplied vcenter Server. Rw 26 Enter the name f the cluster that will be created by VxRail. VxRail Manager and Netwrking Yu must specify the hstname and IP address fr the VxRail Manager virtual machine. In additin, yu must specify the subnet mask and gateway that VxRail Manager, vcenter Server, and the ESXi hsts all share. 16 Netwrk Planning Guide

17 We d nt recmmend using the default VxRail initial IP address ( /24) as yur permanent VxRail IP address (Rw 26) because if yu add mre ndes t the VxRail cluster later r if yu create mre clusters, the initial IP addresses will cnflict with the existing cluster s IP address. Rw 27 Enter an alphanumeric string fr the VxRail Manager hstname. Rw 28 Enter the IP address fr VxRail Manager after it is cnfigured. We recmmend that yu d nt use the default /24 Rws 29 and 30 Enter the subnet mask and gateway fr all management IP addresses. Passwrds Starting in VxRail , yu can specify a different rt passwrd fr each ESXi hst in the cluster. Prir t that, the same rt passwrd was used fr all the ESXi hsts. Yu must als specify ne passwrd fr the VxRail Manager virtual machine. Unless yu are using a Custmer Supplied vcenter Server, the VxRail Manager and vcenter Server virtual machines will have the same administrative passwrd. Passwrds must cntain between 8 and 20 characters with at least ne lwercase letter, ne uppercase letter, ne numeric character, and ne special character. Fr mre infrmatin abut passwrd requirements, see the vsphere passwrd dcumentatin and vcenter Server passwrd dcumentatin. Fr ESXi hsts, the username is rt; the pre-cnfiguratin passwrd is Passw0rd! and the pst-cnfiguratin passwrd is the ne yu set in VxRail initial cnfiguratin (Rw 29). Fr VxRail Manager and the VxRail vcenter Server, the username fr bth user interfaces is administratr@vsphere.lcal and the cnsle username is rt. The pre-cnfiguratin passwrd fr VxRail is Passw0rd! and the pst-cnfiguratin passwrd is the ne yu set in VxRail initial cnfiguratin (Rw 30). Rws 31 and 32 Please check that yu knw yur passwrds in these rws, but fr security reasns, we suggest that yu d nt write them dwn. Step 1D. vmtin and vsan vsphere vmtin and vsan each require at least three IP addresses fr the initial cluster. Because VxRail supprts up t 64 ndes in a cluster, yu can allcate up t 64 vmtin IP addresses and 64 vsan IP addresses. 17 Netwrk Planning Guide

18 Rws 33 and 34 Enter the starting and ending IP addresses fr vsphere vmtin a cntinuus IP range is required, with a minimum f 4 IPs. Ruting is nt cnfigured fr vmtin. Rw 35 Enter the subnet mask fr vmtin. Rws 37 and 38 Enter the starting and ending IP addresses fr vsan a cntinuus IP range is required, with a minimum f 4 IPs. Ruting is nt cnfigured fr vsan. Rw 39 Enter the subnet mask fr vsan. Step 1E. Slutins VxRail is deplyed with vrealize Lg Insight. Alternately, yu may chse t use yur third-party syslg server(s). If yu chse t use vrealize Lg Insight, it will always be available by pinting a brwser t the cnfigured IP address with the username, admin. (If yu ssh t Lg Insight instead f pinting yur brwser t it, the username is rt.) The passwrd, in either case, is the same passwrd that yu specified fr VxRail Manager/VxRail vcenter Server (Rw 30). NOTE: The IP address fr Lg Insight must be n the same subnet as VxRail and vcenter Server. Rws 43 and 44 r Rw 45 Enter the hstname and IP address fr vrealize Lg Insight r the hstname(s) f yur existing third-party syslg server(s). Step 1F. Wrkstatin/Laptp T access the VxRail fr the first time, yu must use the temprary VxRail initial IP address that was pre-cnfigured, typically /24. Yu will change this IP address during VxRail initial cnfiguratin t yur desired permanent address fr yur new VxRail cluster. Example Cnfiguratin VxRail Wrkstatin/laptp IP address/netmask IP address Subnet mask Gateway Initial (temprary) / Pst-cnfiguratin (permanent) / Yur wrkstatin/laptp will need t be able t reach bth the VxRail initial IP address (Rw 2) and yur selected permanent VxRail IP address (Rw 26). VxRail initial cnfiguratin will remind yu that yu may need t recnfigure yur wrkstatin/laptp netwrk settings t access the new IP address. It may be pssible t give yur wrkstatin/laptp r yur jump server tw IP addresses, which allws fr a smther experience. Depending n yur wrkstatin/laptp, this can be implemented in several ways (such as dual-hming r multi-hming). Otherwise, change the IP address n yur wrkstatin/laptp when instructed t and then return t VxRail Manager. 18 Netwrk Planning Guide

19 If yu cannt reach the VxRail initial IP address, Dell EMC supprt team can cnfigure a custm IP address, subnet mask, and gateway. Furthermre, if a custm management VLAN ID will be used fr VxRail ther than VLAN 1 (VLAN 1 is the default management VLAN ID fr mst switches), make sure the wrkstatin/laptp can als access this management VLAN. Rw 2 Please enter the VxRail initial IP address. Enter /24 if yu can reach this address n yur netwrk. Otherwise, enter yur custm IP address, subnet mask, and gateway. Step 2: Set Up Switch Fr VxRail t functin prperly, yu must cnfigure the prts that VxRail will use n yur switch befre yu plug in VxRail ndes and turn them n. Set up yur switch by fllwing these steps: Step 2A. Understanding switch cnfiguratin Step 2B. Cnfigure VLANs n yur switch(es) Step 2C. Cnfirm yur cnfiguratin Step 2A. Understanding Switch Cnfiguratin Be sure t fllw yur switch vendr s best practices fr perfrmance and availability. Prts n a switch perate in ne f the fllwing mdes: Access mde The prt accepts nly untagged packets and distributes the untagged packets t all VLANs n that prt. This is typically the default mde fr all prts. Trunk mde When this prt receives a tagged packet, it passes the packet t the VLAN specified in the tag. T cnfigure the acceptance f untagged packets n a trunk prt, yu must first cnfigure a single VLAN as a Native VLAN. A Native VLAN is when yu cnfigure ne VLAN t use as the VLAN fr all untagged traffic. Tagged-access mde The prt accepts nly tagged packets. Netwrk Traffic Fr 13th generatin PwerEdge Servers, each VxRail nde will utilize either tw 10GbE netwrk prts r fur 1GbE netwrk prts (Nte: the 10GbE prts n the VxRail mdels in the E and S Series with single prcessrs will autnegtiate t 1GbE). Each prt must be cnnected t a switch that supprts IPv6 multicast, and fr releases prir t VxRail 4.5.0, IPv4 multicast must als be supprted. Fr 14th generatin PwerEdge Servers, each VxRail nde will utilize the fur 10GbE netwrk prts. (Nte: the 10GbE prts n the VxRail mdels in the E and S Series with single prcessrs will aut-negtiate t 1GbE if a 1GbE switch is used). Each prt must be cnnected t a switch that supprts IPv6 multicast. 19 Netwrk Planning Guide

20 2x10GbE Traffic Cnfiguratin VxRail traffic n the E, P, S and V Series 10GbE NICs is separated as fllws: Traffic Type Requirements UPLINK1(10Gb) UPLINK2(10Gb) UPLINK3 UPLINK4 NIOC Shares VMNIC0 VMNIC1 N VMNIC N VMNIC Management IPv6 multicast Active Standby Unused Unused 20 vsphere vmtin Active Standby Unused Unused 50 vsan VxRail starting with 4.5 (IPv4 unicast) VxRail prir t 4.5 (IPv4 multicast) Standby Active Unused Unused 100 Virtual Machines Active Standby Unused Unused 30 VxRail traffic n the G Series and mdels prir t VxRail GbE NICs is separated as fllws: Traffic Type Requirements 1 st 10GbE NIC 2 nd 10GbE NIC NIOC Shares Management IPv6 multicast Active Standby 20 vsphere vmtin Active Standby 50 vsan IPv4 multicast Standby Active 100 Virtual Machines Active Standby 30 1GbE Traffic Cnfiguratin VxRail traffic n the G Series 1GbE NICs is separated as fllws: Traffic Type Requirements UPLINK1 (1Gb) VMNIC0 UPLIINK2(1Gb) VMNIC1 UPLINK3(1Gb) VMNIC2 UPLINK4(1Gb) VMNIC3 NIOC Shares Management IPv6 multicast Active Standby Unused Unused 40 vsphere vmtin Unused Unused Standby Active 50 vsan VxRail starting with 4.5 (IPv4 unicast) VxRail prir t 4.5 (IPv4 multicast) Unused Unused Active Standby 100 Virtual Machines Standby Active Unused Unused Netwrk Planning Guide

21 VxRail traffic n the E and S Series 1GbE NICs is separated as fllws: Traffic Type Requirements UPLINK1(1Gb) VMNIC2 UPLINK2(1Gb) VMNIC3 UPLINK3(1Gb) VMNIC0 UPLINK4(1Gb) VMNIC1 NIOC Shares Management IPv6 multicast Standby Active Unused Unused 40 vmtin Unused Unused Standby Active 50 vsan Virtual Machines VxRail starting with 4.5 (IPv4 unicast) VxRail prir t 4.5 (IPv4 multicast) Unused Unused Active Standby 100 Active Standby Unused Unused 60 VxRail traffic n mdels prir t VxRail 4.0 1GbE NICs is separated as fllws: Traffic Type Requirements UPLINK1 (1Gb) VMNIC0 UPLIINK2(1Gb) VMNIC1 UPLINK3(1Gb) VMNIC2 UPLINK4(1Gb) VMNIC3 NIOC Shares Management IPv6 multicast Standby Active Unused Unused 40 vsphere vmtin Unused Unused Standby Active 50 vsan IPv4 multicast Unused Unused Active Standby 100 Virtual Machines Active Standby Unused Unused 60 Multicast Traffic VxRail Management VLAN IPv6 multicast is required fr the VxRail management VLAN. The netwrk switch(es) that cnnect t VxRail must allw fr pass-thrugh f multicast traffic n the VxRail Management VLAN. Multicast is nt required n yur entire netwrk, just n the prts cnnected t VxRail. Why multicast? VxRail Appliances have n backplane, s cmmunicatin between its ndes is facilitated via the netwrk switch. This cmmunicatin between the ndes uses VMware Ludmuth aut-discvery capabilities, based n the RFC-recgnized "Zer " prtcl. New VxRail ndes advertise themselves n a netwrk using the VMware Ludmuth service, which uses IPv6 multicast. This IPv6 multicast cmmunicatin is strictly limited t the management VLAN that the ndes use fr cmmunicatin. VxRail creates very little traffic via IPv6 multicast fr autdiscvery and management. It is recmmended t limit traffic further n yur switch t enable MLD Snping and MLD Querier. If MLD Snping is enabled, then MLD Querier must be enabled. If MLD Snping is disabled, then MLD Querier must be disabled. 21 Netwrk Planning Guide

22 vsan VLAN (Fr Releases prir t VxRail 4.5.0) Prir t VxRail 4.5.0, IPv4 multicast supprt is required fr the vsan VLAN. The netwrk switch(es) that cnnect t VxRail must allw fr pass-thrugh f multicast traffic n the vsan VLAN. Multicast is nt required n yur entire netwrk, just n the prts cnnected t VxRail. There are tw ptins t handle vsan IPv4 multicast traffic. Either limit multicast traffic by enabling bth IGMP Snping and IGMP Querier r disable bth f these features. We recmmend enabling bth IGMP Snping and IGMP Querier if yur switch supprts them. IGMP Snping sftware examines IGMP prtcl messages within a VLAN t discver which interfaces are cnnected t hsts r ther devices interested in receiving this traffic. Using the interface infrmatin, IGMP Snping can reduce bandwidth cnsumptin in a multi-access LAN envirnment t avid flding an entire VLAN. IGMP Snping tracks prts that are attached t multicast-capable ruters t help manage IGMP membership reprt frwarding. It als respnds t tplgy change ntificatins. Disabling IGMP Snping may lead t additinal multicast traffic n yur netwrk. IGMP Querier sends ut IGMP grup membership queries n a timed interval, retrieves IGMP membership reprts frm active members, and allws updates t grup membership tables. By default, mst switches enable IGMP Snping but disable IGMP Querier. Yu will need t change the settings if this is the case. If IGMP Snping is enabled, then IGMP Querier must be enabled. If IGMP Snping is disabled, then IGMP Querier must be disabled. If yur switch des nt supprt IGMP Snping r MLD Snping, VxRail multicast traffic will be bradcast in ne bradcast dmain per VLAN. There is minimal impact n netwrk verhead as management traffic is nminal. Fr questins n yur switch handles multicast traffic, cntact yur switch vendr. Unicast Traffic (Starting in VxRail Release 4.5.0) vsan VLAN Starting in VxRail Release 4.5.0, all vsan traffic uses unicast. This change helps t reduce netwrk cnfiguratin cmplexity and simplifies switch cnfiguratin. Inter-switch Cmmunicatin In a multi-switch envirnment, cnfigure the prts used fr inter-switch cmmunicatin t carry IPv6 multicast traffic fr the VxRail management VLAN. Likewise, cnfigure the prts t carry IPv4 traffic (unicast starting in VxRail Release and multicast in prir releases) between switches fr the vsan VLAN. Cnsult yur switch manufacturer s dcumentatin fr hw t d this. Disable Link Aggregatin D nt use link aggregatin, including prtcls such as LACP and EtherChannel, n any prts directly cnnected t VxRail Appliances. VxRail Appliances use active/standby cnfiguratin (NIC teaming) fr netwrk redundancy. Hwever, LACP culd be enabled n nn-system prts, such as additinal NIC prts r 1G prts, fr user traffic. vsphere Security Recmmendatins Security recmmendatins fr vsphere shuld be fllwed can be fund in General Netwrk Security Recmmendatins vsphere 6.5 r General Netwrk Security Recmmendatins vsphere 6.0. In particular, ensure that physical switch prts are cnfigured with Prtfast if spanning tree is enabled. Because VMware virtual switches d nt supprt STP, physical switch prts cnnected t an ESXi hst must have Prtfast cnfigured if spanning tree is enabled t avid lps within the physical switch netwrk. If Prtfast is nt set, ptential perfrmance and cnnectivity issues might arise. 22 Netwrk Planning Guide

23 Step 2B. Cnfigure VLANs n Yur Switch(es) Nw that yu understand the switch requirements, it is time t cnfigure yur switch(es). The VxRail netwrk can be cnfigured with r withut VLANs. Fr perfrmance and scalability, it is highly recmmended t cnfigure VxRail with VLANs. As listed in the VxRail Setup Checklist, yu will be cnfiguring the fllwing VLANs: Management VLAN (recmmended is untagged/native): make sure that IPv6 multicast is cnfigured/enabled n the management VLAN. vsan VLAN: starting in VxRail 4.5.0, make sure that IPv4 unicast mde is used fr vsan traffic. Fr earlier releases, make sure that IPv4 multicast is cnfigured/enabled n the vsan VLAN (enabling IGMP snping and querier is highly recmmended). vsphere vmtin VLAN VM Netwrks VLANs Figure 10. VxRail VLAN cnfiguratin, G Series. Using the VxRail cnfigure each switch prt that will be cnnected t a VxRail nde: Cnfigure the Management VLAN (Rw 1) n the switch prts. If yu entered Native VLAN, then set the prts n the switch t accept untagged traffic and tag it t the custm management VLAN ID. Untagged management traffic is the recmmended management VLAN setting n VxRail. Yu must set the management VLAN t allw IPv6 multicast traffic t pass thrugh. Depending n the type f switch yu have, yu may need t turn n IPv6 and multicast directly n the prt r n the VLAN. Be sure t review the previus sectin, Step 2A. Understanding Switch Cnfiguratin, and cnsult the switch manufacturer fr further instructins n hw t cnfigure these settings. Cnfigure a vsphere vmtin VLAN (Rw 34) n the switch prts. Cnfigure a vsan VLAN (Rw 38) n the switch prts fr release prir t VxRail Release 4.5.0, set t allw IPv4 multicast traffic t pass thrugh. Starting in VxRail Release 4.5.0, set t allw IPv4 unicast traffic t pass thrugh. Cnfigure the VLANs fr yur VM Netwrks (Rws 39-41) n the switch prts. 23 Netwrk Planning Guide

24 Step 2C. Cnfirm Yur Cnfiguratin Sme netwrk cnfiguratin errrs cannt be recvered frm, and yu will need VxRail supprt t reset t factry defaults. When VxRail is reset t factry defaults, all data is lst. Please cnfirm yur switch setting in this step. Read yur vendr instructins fr yur switch: a. Cnfirm that IPv4 multicast (VxRail release prir t 4.5.0) r unicast (VxRail Release and beynd) and IPv6 multicast are enabled fr the VLANs described in this dcument. b. If yu have tw r mre switches, cnfirm that IPv4 multicast/unicast and IPv6 multicast traffic is transprted between them. c. Remember that management traffic will be untagged n the native VLAN n yur switch unless all ESXi hsts have been custmized fr a specific management VLAN. Netwrk design and accessibility: a. Cnfirm that yu can ping r pint t the VxRail initial IP address (Rw 2). b. Cnfirm that yur DNS server(s) are reachable unless yu are in an islated envirnment in VxRail releases prir t (Rw 5). The DNS server must be reachable frm the VxRail, vcenter Server, and ESXi netwrk addresses. Then update yur DNS server with all VxRail hstnames and IP addresses. c. Cnfirm that yur management gateway IP address is accessible (Rw 26). d. If yu have cnfigured NTP servers, prxy servers, r a third-party syslg server, cnfirm that yu can reach them frm all f yur cnfigured VxRail IP addresses. After Planning and Switch Setup If yu have successfully fllwed all f the previus steps, yur netwrk setup is cmplete, and yu are ready t cnnect and initialize yur VxRail Appliance. These steps are dne by Dell EMC service representatives. They are included here t help yu understand the cmplete prcess. Step 1. Step 2. Step 3. Step 4. Step 5. Rack and cable the VxRail Appliance. After the ndes are cabled, pwer n all three r fur initial ndes in yur VxRail cluster. D nt turn n any ther VxRail ndes until yu have cmpleted the full cnfiguratin f the first three r fur ndes. Cnnect a wrkstatin/laptp t access the VxRail initial IP address n yur selected management VLAN. It must be either plugged int the switch r able t lgically reach the VxRail management VLAN frm elsewhere n yur netwrk. Use the VxRail Pre-Engagement Questinnaire prvided by the Dell EMC service representative t autmatically generate the JSON-frmatted cnfiguratin file using the VxRail. Brwse t the VxRail initial IP address (Rw 2); fr example, Click Get Started. Then if yu agree, accept the VxRail End-User License Agreement (EULA). Step 6. Click Cnfiguratin File t uplad a JSON-frmatted cnfiguratin file that yu have created in Step 3. Step 7. Step 8. Step 9. Click the Review First r Validate buttn. VxRail verifies the cnfiguratin data, checking fr cnflicts. After validatin is successful, click the Build VxRail buttn. The new IP address fr VxRail will be displayed. Click Start Cnfiguratin. Ignre any brwser messages abut security (fr example, by clicking Advanced and Prceed. ) NOTE: Yu may need t manually change the IP settings n yur wrkstatin/laptp t be n the same subnet as the new VxRail IP address (Rw 26). NOTE: If yur wrkstatin/laptp cannt cnnect t the new IP address that yu cnfigured, yu will get a message t fix yur netwrk and try again. If yu are unable t cnnect t the new IP address after 20 minutes, VxRail will revert t its un-cnfigured state and yu will need t re-enter yur cnfiguratin at the initial IP address (Rw 2). 24 Netwrk Planning Guide

25 NOTE: After the build prcess starts, if yu clse yur brwser, yu will need t brwse t the new IP address (Rw 26). Step 10. Prgress is shwn as VxRail is built. VxRail implements services, creates the new ESXi hsts, and sets up vcenter Server, vmtin, and vsan. When yu see the Hray! page, VxRail is built. Click the Manage VxRail buttn t cntinue t VxRail management. Yu shuld als bkmark this IP address in yur brwser fr future use. Step 11. Cnfigure yur crprate DNS server fr all VxRail hstnames and IP addresses unless yu are in an islated envirnment in VxRail releases prir t Step 12. Cnnect t VxRail Manager using either the VxRail Manager IP address (Rw 26) r the fully-qualified dmain name (FQDN) (Rw 25) that yu cnfigured n yur DNS server (e.g., Unassigned Physical Prts Fr VxRail mdels based n Dell PwerEdge servers, VxRail Manager will nt manage the ptinal prts n the PCIe NIC. Custmers can cnfigure the additinal prts in vcenter fr nn-vxrail system traffics, such as VM netwrks, iscsi, NFS, etc. The supprted peratins include: Create a new vsphere Standard Switch(VSS), and cnnect unused prts t the VSS. Cnnect unused prts t the default vsphere Distributed Switch. Create a new vsphere Distributed Switch(VDS), add VxRail ndes t the new VDS, and cnnect their unused netwrk prts t the VDS. Create new VMKernel adapters and enable services f IP Strage and vsphere Replicatin. Create new VM Netwrks. Starting with VxRail , renaming the default VDS. Starting with VxRail , renaming the default prt grup. Custmers need t fllw VMware s fficial instructins/prcedures fr the abve peratins. NOTE: D NOT mve VxRail system traffic t these prts. VxRail system traffic includes the management, vsan, vcenter Server and vmtin Netwrks. Unsupprted Operatins: Migrating VxRail system traffic t ther prt grups. Netwrk Segregatin Sme custmers may want t separate VM netwrks and vsphere management netwrk. They can leverage thse unused prts t enfrce netwrk segregatin. Please be sure t wrk with yur Dell EMC implementatin and supprt teams t ensure these additinal prts are cabled and set-up in the apprpriate rder as prescribed by Dell EMC. 25 Netwrk Planning Guide

26 VxRail The Dell EMC service representative will use a VxRail Pre-Site Installatin tl with the fllwing infrmatin: Rw Categry Descriptin 1 VxRail Management VLAN ID The recmmended is untagged traffic n the Native VLAN. If yu want the hst t send nly tagged frames, manually cnfigure the VLAN n each ESXi hst using DCUI, and set tagging fr yur management VLAN n yur switch befre yu deply VxRail. 2 VxRail initial IP If yu cannt reach the default ( /24), set an alternate IP address 3 System Glbal settings Time zne 4 NTP server(s) 5 DNS server(s) 6 Prxy settings IP address and prt 7 Username and passwrd 8 Management ESXi ESXi hstname prefix 9 hstnames and Separatr 10 IP addresses Iteratr 11 Offset 12 Suffix 13 Dmain 14 ESXi starting address fr IP pl 15 ESXi ending address fr IP pl 16 vcenter Server vcenter Server hstname 17 Leave blank if vcenter Server IP address 18 Custmer Platfrm Services Cntrller hstname 19 Supplied VC Platfrm Services Cntrller IP address 20 Custmer Supplied vcenter Server Leave blank if Custmer Supplied Platfrm Services Cntrller (PSC) Hstname (FQDN) Leave blank if PSC is VxRail PSC 21 Custmer Supplied vcenter Server hstname (FQDN) 22 Custmer Supplied vcenter Server SSO dmain 23 VxRail VC admin username/passwrd r the newly created VxRail nn-admin username and passwrd 24 New VxRail management username and passwrd 25 Custmer Supplied datacenter name 26 New cluster name 27 VxRail Manager VxRail hstname 28 VxRail IP address 29 Netwrking Subnet mask 30 Gateway 31 Passwrds ESXI rt passwrds. Can be different fr each hst starting with Release VxRail Manager and VxRail vcenter Server administratr@vsphere.lcal 33 vmtin Starting address fr IP pl 34 Ending address fr IP pl 35 Subnet mask 36 VLAN ID 37 vsan Starting address fr IP pl 38 Ending address fr IP pl 39 Subnet mask 40 VLAN ID 41 VM (unlimited VM Netwrk name and VLAN ID 42 Netwrks number) VM Netwrk name and VLAN ID 43 Slutins Lgging vrealize Lg Insight hstname 44 vrealize Lg Insight IP address 45 Syslg server (instead f Lg Insight) 26 Netwrk Planning Guide

27 VxRail Setup Checklist Physical Netwrk VxRail cluster: Decide if yu want t plan fr additinal ndes beynd the initial three (r fur)-nde cluster. Yu can have up t 64 ndes in a VxRail cluster Netwrk switch: Ensure yur switch prvides the cnnectivity ptin yu chse in the Netwrk Switch sectin. Check cable requirements. Tplgy: Decide if yu will have a single r multiple switch setup fr redundancy. Wrkstatin/laptp: Any perating system with a brwser t access the VxRail user interface. The latest versins f Firefx, Chrme, and Internet Explrer 10+ are all supprted. Out-f-band Management (ptinal): One available prt that supprts 100Mbps fr each VxRail nde. Lgical Netwrk Reserve VLANs System Management vmtin and vsan Slutins Wrkstatin Set up Switch One management VLAN with IPv6 multicast fr traffic frm VxRail, vcenter Server, ESXi (recmmended is untagged/native). One VLAN with IPv4 unicast (starting with VxRail 4.5.0) r IPv4 multicast (prir t Release 4.5.0) fr vsan traffic. One VLAN fr vsphere vmtin. One r mre VLANs fr yur VM Netwrk(s). Time zne. Hstname r IP address f the NTP server(s) n yur netwrk (recmmended). IP address f the DNS server(s) n yur netwrk (required, except in islated envirnments). Optinal: IP address, prt, username, and passwrd f yur prxy server. Decide n yur ESXi hst naming scheme. Reserve three r mre cntiguus IP addresses fr ESXi hsts. Decide if yu will use a vcenter Server that is Custmer Supplied r new t yur VxRail cluster. VxRail vcenter Server: Decide n hstnames fr vcenter Server and PSC and reserve tw IP addresses. Custmer Supplied vcenter Server: Determine PSC, hstname, administratin user, and datacenter. Create a VxRail management user. Decide n a VxRail cluster name. (Optinal) Create a VxRail nnadmin user. Decide n a hstname and reserve ne IP address fr VxRail Manager. Determine IP address f the default gateway and subnet mask. Select a rt passwrd fr each ESXi hsts in the VxRail cluster. Prir t VxRail Release , all ESXi hsts use a single rt passwrd. Select a single passwrd fr VxRail and VxRail vcenter Server. Reserve three r mre cntiguus IP addresses and a subnet mask fr vsphere vmtin. Reserve three r mre cntiguus IP addresses and a subnet mask fr vsan. T use vrealize Lg Insight: Reserve ne IP address and decide n the hstname. T use an existing syslg server: Get the hstname r IP address f yur third-party syslg server. Cnfigure yur wrkstatin/laptp t reach the VxRail initial IP address. Make sure yu als knw hw t cnfigure it t reach the VxRail Manger IP address after cnfiguratin. Cnfigure yur selected management VLAN (recmmended is untagged/native). Cnfirm that IPv6 multicast is cnfigured/enabled n the management VLAN. Cnfigure yur selected VLANs fr vsan, vsphere vmtin, and VM Netwrks. In multi-switch envirnments, cnfigure the management and vsan VLANs t carry the multicast and unicast traffic respectively between switches. Cnfirm cnfiguratin and netwrk access. 27 Netwrk Planning Guide

28 Appendix A: NSX Supprt n VxRail VxRail supprts VMware NSX sftware-defined netwrking (SDN) thrugh vcenter Server. vcenter Server ffers a fully integrated ptin fr SDN and netwrk-layer abstractin with NSX. The NSX netwrk-virtualizatin platfrm delivers fr netwrking what VMware delivers fr cmpute and strage. In much the same way that server virtualizatin allws peratrs t prgrammatically create, snapsht, delete, and restre sftware-based virtual machines (VMs) n demand, NSX enables virtual netwrks t be created, saved, deleted, and restred n demand withut requiring recnfiguratin f the physical netwrk. The result fundamentally transfrms the datacenter netwrkperatinal mdel, reduces netwrk-prvisining time frm days r weeks t minutes, and dramatically simplifies netwrk peratins. NSX is a nn-disruptive slutin that is deplyed n any IP netwrk, including existing datacenter netwrk designs r next-generatin fabric architectures frm any netwrking vendr. With netwrk virtualizatin, the functinal equivalent f a netwrk hypervisr reprduces the cmplete set f Layer 2 t Layer 7 netwrking services (e.g., switching, ruting, access cntrl, firewalling, QS, and lad balancing) in sftware. Just as VMs are independent f the underlying x86 hardware platfrm and allw IT t treat physical hsts as a pl f cmpute capacity, virtual netwrks are independent f the underlying IP netwrk hardware and allw IT t treat the physical netwrk as a pl f transprt capacity that can be cnsumed and repurpsed n demand. NSX crdinates ESXi s vswitches and the netwrk services pushed t them fr cnnected VMs t effectively deliver a platfrm r netwrk hypervisr fr the creatin f virtual netwrks. Similar t the way that a virtual machine is a sftware cntainer that presents lgical cmpute services t an applicatin, a virtual netwrk is a sftware cntainer that presents lgical netwrk services lgical switches, lgical ruters, lgical firewalls, lgical lad balancers, lgical VPNs and mre t cnnected wrklads. These netwrk and security services are delivered in sftware and require nly IP packet frwarding frm the underlying physical netwrk. T cnnected wrklads, a virtual netwrk lks and perates like a traditinal physical netwrk. Wrklads see the same Layer 2, Layer 3, and Layers 4-7 netwrk services that they wuld in a traditinal physical cnfiguratin. It s just that these netwrk services are nw lgical instances f distributed sftware mdules running in the hypervisr n the lcal hst and applied at the vswitch virtual interface. The fllwing NSX cmpnents are illustrated in Figure 11: NSX vswitch perates in ESXi server hypervisrs t frm a sftware abstractin layer between servers and the physical netwrk. NSX Cntrller is an advanced, distributed state management system that cntrls virtual netwrks and verlays transprt tunnels. It is the central cntrl pint fr all lgical switches within a netwrk and maintains infrmatin f all virtual machines, hsts, lgical switches, and VXLANs. NSX Edge prvides netwrk-edge security and gateway services t islate a virtualized netwrk. Yu can install NSX Edge either as a lgical (distributed) ruter r as a services gateway. NSX Manager is the centralized netwrk management cmpnent f NSX, installed as a virtual appliance n an ESXi hst. 28 Netwrk Planning Guide

29 Figure 11. NSX cmpnent infrmatin flw: NSX Manager, NSX Cntrller, NSX Edge, NSX vswitch One NSX Manager maps t a single vcenter Server and multiple NSX Edge, vshield Endpint, and NSX Data Security instances. Befre yu install NSX in yur vcenter Server envirnment, cnsider yur netwrk cnfiguratin and resurces using the chart belw. NSX Resurce Requirements: Memry Disk Space vcpu NSX Manager 12GB 60GB 4 NSX Edge: Cmpact Large Extra Large Quad Large 512MB 1GB 8GB 1GB 512MB 512MB 4.5GB (with 4GB swap) 512MB vshield Endpint 1GB 4GB 2 NSX Data Security 512MB 6GB per ESXi hst 1 In a VxRail cluster, the key benefits f NSX are cnsistent, simplified netwrk management and peratins, plus the ability t leverage cnnected wrklad mbility and placement. With NSX, cnnected wrklads can freely mve acrss subnets and availability znes. Their placement is nt dependent n the physical tplgy and availability f physical netwrk services in a given lcatin. Everything a VM needs frm a netwrking perspective is prvided by NSX, wherever it resides physically. It is n lnger necessary t ver-prvisin server capacity within each applicatin/netwrk pd. Instead, rganizatins can take advantage f available resurces wherever they re lcated, thereby allwing greater ptimizatin and cnslidatin f resurces. VxRail easily inserts int existing NSX envirnments and prvide NSX awareness s netwrk administratrs can leverage simplified netwrk administratin. See the VMware NSX Design Guide fr NSX best practices and design cnsideratins. Fr additinal infrmatin related t NSX, refer t the fllwing materials: VMware NSX Netwrk Virtualizatin Platfrm Technical White Paper at NSX-Netwrk-Virtualizatin-Platfrm-WP.pdf Reference Design Guide: VMware NSX fr vsphere at 29 Netwrk Planning Guide

30 Appendix B: VxRail Open Prts Requirement The fllwing tables list the prts that set during VxRail initializatin. Please cnsult with yur Dell EMC r reseller rep fr mre infrmatin. Descriptin Surce Device(s) Destinatin Device(s) L4 Prtcl Prt DNS VMware vcenter Servers, Platfrms Services Cntrllers, ESRS Gateway VMs, Hst ESXi Management Interface, NSX Managers, Dell idrac prt, TR Switch Management DNS Server(s) UDP 53 ESX VMWare Agent Manager fr VIB installatin (NSX) ESXi hst mdules t NSX Cntrllers Hst ESXi Management Interface VMware vcenter Servers TCP 80 Hst ESXi Management Interface NSX Cntrllers TCP 1234 Hst ESXi Management Administratrs Hst ESXi Management Interface Hst ESXi Management Administratrs Hst ESXi Management Interface TCP 427, 902 UDP 902 Hst ESXi Management Hst ESXi Management Interface Administratrs TCP & UDP 902 GUI/Web Interfaces Administratrs VMware vcenter Servers, NSX Managers, Hst ESXi Management Interface, Dell idrac prt, vrealize LgInsight, VxRail Manager VMware KVM Administratrs Hst ESXi Management Interface TCP 80, 443 TCP 2068, 80 LDAP VMware Platfrm Service Cntrller vapps, Hst ESXi Management Interface, VMware vcenter Servers, Dell idrac prt, Hst ESXi Management Interface LDAP Server TCP 389, 636 Managed Hsts t vcenter Hst ESXi Management Interface VMware vcenter Servers TCP 6501, 6502, 5989, 6500, 8000, 8001, 5988, 5989, 5353, 902, 443 Managed Hsts t vcenter (Heartbeat) Hst ESXi Management Interface VMware vcenter Servers UDP Netwrk Planning Guide

31 Descriptin Surce Device(s) Destinatin Device(s) L4 Prtcl Prt NTP Client Hst ESXi Management Interface, NSX Managers, NSX Cntrllers, Dell idrac prt, vrealize LgInsight, VMware vcenter Servers, VxRail Manager, TR Switch Management NTP Server(s) UDP 123 Radius Radius Client IPs Radius Server TCP 1645, 1646, 1812, 1813 RDP Administratrs VMware vcenter Servers, VMware Platfrm Service Cntrller vapps TCP 3389 SMTP Dell idrac prt, ESRS Gateway VMs, vrealize LgInsight, ESRS Plicy Manager, Cisc TR Switch Management SMTP Server (s) TCP 25 SNMP Plling SNMP Server (s) Hst ESXi Management Interface, Dell idrac prt, TR Switch Management UDP 161 SNMP Traps Hst ESXi Management Interface, Dell idrac prt, TR Switch Management SNMP Servers UDP 162 NSX Manager t Cntrllers NSX Managers NSX Cntrllers TCP 443 NSX Manager t hsts, management cnnectin NSX Managers Hst ESXi Management Interface TCP 443, 902 NSX Manager t hsts, management cnnectin NSX Managers NSX vcenter Servers TCP 443, 902 NSX User Wrld Agent cnnectin NSX Cntrllers Hst ESXi Management Interface TCP 8672 NSX vib Install (Only if VDR instances are assciated with the hst) NSX DLR Hst ESXi Management Interface UDP 6999 NSX Manager Messaging & Distributed Firewall Cmms Hst ESXi Management Interface NSX Managers TCP 80, 5671 SSH & SCP Administratrs Hst ESXi Management Interface, ESRS Gateway VMs, NSX Cntrllers, NSX Managers, Dell idrac prt, vrealize Lg Insight, TR Switch Management TCP Netwrk Planning Guide

32 Descriptin Surce Device(s) Destinatin Device(s) L4 Prtcl Prt SYSLOG NSX Managers, NSX vcenter Servers, NSX Cntrllers, Hst ESXi Management Interface, vrealize Lg Insight, TR Switch Management Syslg Server TCP 514 System prt fr SSHD vcenter Server Appliance nly VMware vcenter Servers Administratrs TCP/UDP 22 TACACS Clients Custmer Preference TACACS Server TCP 49 vcenter t Managed Hsts (CIM XMLm DPM, VC Agent,Data) VMware vcenter Servers Hst ESXi Management Interface TCP 80, 443, 5989, 902 vcenter t Managed Hsts (DPM & Heartbeat) VMware vcenter Servers Hst ESXi Management Interface UDP 623, 902 Layer 3 vmtin Hst ESXi Management Interface Hst ESXi Management Interface TCP 8000 vsphere Clients t vcenter Server Administratrs VMware vcenter Servers TCP 80, 443, 9443, 10080, 10443, 8443, 8080, 5480 vrealize Operatins vrealize Operatins Manager VMware vcenter Servers TCP VC6.0 t Active Directry Server VMware vcenter Servers Active Directry Server TCP 88 VxRail t ESRS Gateway VMs VxRail Manager ESRS Gateway VMs TCP 21, 25, 9443 ESRS GW t VxRail Manager ESRS Gateway VMs VxRail Manager TCP 21, 22, , 25, 443, 8118, 9443 ESRS Plicy Manager GUI Administratrs ESRS Plicy Manager TCP 8090, 8443 (Cnfigurable) ESRS V3 FTPS ESRS Gateway VMs ESRS V3 FTPS Servers: Public Internet IP addresses ESRS V3 ESRS Gateway VMs ESRS V3 Glbal Access Servers: Public Internet IP addresses TCP 990 TCP 443, 8443 ESRS Management Administratrs ESRS Gateway VMs TCP 22, 9443 ESRS Gateway VMs t VxRail Manager ESRS Gateway VMs VxRail Manager TCP 21, 22, , 25, 443, 8118, Netwrk Planning Guide

33 Descriptin Surce Device(s) Destinatin Device(s) L4 Prtcl Prt idrac Access Administratrs Dell idrac TCP 22, 80, 443, 623, 5900, 5901 VxRail Internet Access VxRail Manager Prxy Server TCP 8080 VSAN Stretched Cluster VSAN Witness VxRail Nde VSAN Interface UDP 12345, 23451, VSAN Stretched Cluster VSAN Witness VxRail Nde VSAN Interface TCP 2233 VSAN Stretched Cluster VSAN Witness vcenter Server TCP 8080 VSAN Stretched Cluster VxRail Nde VSAN Interface VSAN Witness UDP 12345, 23451, VSAN Stretched Cluster VxRail Nde VSAN Interface VSAN Witness TCP 2233 VSAN Stretched Cluster Hst ESXi Management Interface VMware vcenter Servers TCP 8080 VSAN Stretched Cluster VMware vcenter Servers VSAN Witness TCP 8080 VSAN Stretched Cluster VMware vcenter Servers Hst ESXi Management Interface TCP 8080 References: VMware vsphere Prts TCP and UDP Prts required t access VMware vcenter Server, VMware ESXi and ESX hsts, and ther netwrk cmpnents (VMware KB ) VMware vsan Cnfiguring Virtual SAN Netwrk ESRS Prt Requirements EMC Secure Remte Service Release 3.24 Rev 01 Prt Requirements ESRS Public IP Addresses What IP addresses are used by the EMC Secure Remte Services (EMC KB ) idrac - Integrated Dell Remte Access Cntrller 9 - idrac7 Prt Infrmatin 33 Netwrk Planning Guide

34 Appendix C VxRail Firewall Rules & ACI Cntracts Diagram This diagram shws a typical VxRail deplyment tplgy, in which the majr prts are displayed fr their respective usage between VxRail cmpnents. Learn mre abut Dell EMC VxRail Appliances Cntact a Dell EMC Expert View mre resurces Jin the with #VxRail 34 Netwrk Planning Guide. All Rights Reserved. Dell, EMC and ther trademarks are trademarks f Dell Inc. r its subsidiaries. Other trademarks may be trademarks f their respective wners. Reference Number: H