HPE 8GB NVDIMM User Guide

Transcription

1 HPE 8GB NVDIMM User Guide fr HPE PrLiant Gen9 Servers Abstract This dcument includes installatin, maintenance, and cnfiguratin infrmatin fr HPE 8GB NVDIMMs and is fr the persn wh installs, administers, and trubleshts servers and strage systems. Hewlett Packard Enterprise assumes yu are qualified in the servicing f cmputer equipment and trained in recgnizing hazards in prducts with hazardus energy levels. Part Number: December 2016 Editin: 3

2 Cpyright 2016 Hewlett Packard Enterprise Develpment LP The infrmatin cntained herein is subject t change withut ntice. The nly warranties fr Hewlett Packard Enterprise prducts and services are set frth in the express warranty statements accmpanying such prducts and services. Nthing herein shuld be cnstrued as cnstituting an additinal warranty. Hewlett Packard Enterprise shall nt be liable fr technical r editrial errrs r missins cntained herein. Links t third-party websites take yu utside the Hewlett Packard Enterprise website. Hewlett Packard Enterprise has n cntrl ver and is nt respnsible fr infrmatin utside the Hewlett Packard Enterprise website. Windws Server is either registered trademarks r trademarks f Micrsft Crpratin in the United States and/r ther cuntries. Linux is the registered trademark f Linus Trvalds in the U.S. and ther cuntries. Red Hat is a registered trademark f Red Hat, Inc. in the United States and ther cuntries. Intel is a trademark f Intel Crpratin in the U.S. and ther cuntries.

3 Cntents Intrductin... 5 Persistent memry and NVDIMMs... 5 Operatin stages fr NVDIMM-Ns... 5 Persistent memry and NVDIMM terminlgy... 5 System perfrmance (maximum bandwidth)... 6 Maximum bandwidth when NVDIMM-N Memry Interleaving is disabled... 6 Maximum bandwidth when NVDIMM-N Memry Interleaving is enabled... 6 System perfrmance (maximum bandwidth)... 7 HPE Persistent Memry Manager... 7 Cmpnent identificatin... 8 NVDIMM LEDs... 8 NVDIMM identificatin... 8 Installatin Server requirements fr NVDIMM supprt General DIMM and NVDIMM-N slt ppulatin guidelines DIMM ppulatin rder DIMM handling guidelines Installing an NVDIMM Cnfiguring the system Cnfiguring NVDIMM Memry Optins NVDIMM-N Memry Functinality NVDIMM-N Memry Interleaving NVDIMM-N Backup Pwer Plicy NVDIMM-N Sanitize/Erase n Next Rebt Plicy NVDIMM-N Data Integrity Checking Cnfiguring additinal settings fr NVDIMMs Advanced Memry Prtectin QPI Snp Cnfiguratin Intel Perfrmance Mnitring Supprt Nde Interleaving Memry Fast Training Extended Memry Test Pwer Prfile Channel Interleaving Maximum Memry Bus Frequency Saving system default settings as user default settings Maintenance and management Viewing NVDIMM-Ns in management sftware tls Remving an NVDIMM NVDIMM sanitizatin NVDIMM sanitize plicies NVDIMM sanitizatin guidelines NVDIMM relcatin guidelines Balanced and unbalanced NVDIMM cnfiguratins Recvering restred data frm an NVDIMM-N DRAM Trubleshting NVDIMM errr messages Trubleshting resurces Supprt and ther resurces Accessing Hewlett Packard Enterprise Supprt Cntents 3

4 Befre yu cntact Hewlett Packard Enterprise Accessing updates Websites Remte supprt Dcumentatin feedback Acrnyms and abbreviatins Index Cntents 4

5 Intrductin Persistent memry and NVDIMMs Persistent memry cmbines the perfrmance f memry with the persistence f traditinal strage. NVDIMMs are DIMMs that prvide persistent memry and install in standard DIMM slts. NVDIMM-Ns are NVDIMMs that cmbine DRAM with NAND flash memry, backing up the DRAM cntents t flash memry n pwer lss and restring frm NAND flash memry t DRAM n pwer n. NVDIMM-Ns prvide applicatins with the full perfrmance capability f DRAM. NVDIMM-Ns are supprted in select HPE servers, drawing pwer frm the HPE Smart Strage Battery t perfrm the backup. The HPE 8GB NVDIMM is an NVDIMM-N. Operatin stages fr NVDIMM-Ns While the server is pwered n: Each NVDIMM-N perates at the speed f a regular DDR4 DIMM and data is stred in the DRAM. Each NVDIMM-N accesses data in the DRAM based n the prcessr lad/stre instructins and PCIe memry read and write transactins. Each NVDIMM-N is accessed using special device drivers. Each NVDIMM-N is nt presented as regular system memry. When pwer t the server is lst: Each NVDIMM-N cpies r backs up data frm its DRAM t its NAND flash memry. Each NVDIMM-N draws pwer frm the HPE Smart Strage Battery n the server. While the server is pwered ff, data is saved in the NAND flash memry f each NVDIMM-N. When the server is pwered n, each NVDIMM-N restres data frm its NAND flash memry t its DRAM during the server POST prcess. Fr mre infrmatin n persistent memry, see the Hewlett Packard Enterprise website ( Fr mre infrmatin abut HPE NVDIMMs, see the prduct QuickSpecs n the Hewlett Packard Enterprise website ( Persistent memry and NVDIMM terminlgy The terminlgy used in persistent memry tends t verlap and multiple terms may apply fr a single cmpnent. The HPE 8GB NVDIMM might be referenced using any f the fllwing terms: Persistent memry Memry delivering the perfrmance f memry with the persistence f strage SCM Strage class memry; encmpasses emerging technlgies NVM Nn-vlatile memry; includes slwer technlgies, such as flash memry DIMM Dual Inline Memry Mdule RDIMM Registered DIMM NVDIMM Nn-vlatile DIMM; prvides persistent memry Intrductin 5

6 NVDIMM-N NVDIMM with byte-addressable prgramming interface t DRAM, backed up t flash memry when needed (energy backed) NVRDIMM NVDIMM that is als an RDIMM NVRDIMM-N NVRDIMM that is als an NVDIMM-N The HPE 8GB NVDIMM Single Rank x4 DDR Mdule is nt any f the fllwing: UDIMM Unbuffered DIMM LRDIMM Lad reduced DIMM System perfrmance (maximum bandwidth) The system perfrmance (maximum bandwidth) is impacted by the number f NVDIMM-Ns installed in the system and the NVDIMM-N Memry Interleaving setting. Maximum bandwidth when NVDIMM-N Memry Interleaving is disabled Maximum bandwidth Maximum bandwidth fr ne thread n the lcal prcessr Maximum aggregate bandwidth fr multiple threads n the lcal prcessr Maximum bandwidth fr ne thread n the remte prcessr Maximum aggregate bandwidth fr multiple threads n the remte prcessr Maximum aggregate bandwidth when bth prcessrs are equally ppulated with NVDIMM-Ns and running multiple threads, each accessing lcal NVDIMM-Ns 1 NVDIMM-N per prcessr (GB/s) 2 NVDIMM-Ns per prcessr (GB/s) 3 NVDIMM-Ns per prcessr (GB/s) NVDIMM-Ns per prcessr (GB/s) Maximum bandwidth when NVDIMM-N Memry Interleaving is enabled Maximum bandwidth Maximum bandwidth fr ne thread n the lcal prcessr Maximum aggregate bandwidth fr multiple threads n the lcal prcessr 1 NVDIMM-N per prcessr (GB/s) 2 NVDIMM-Ns per prcessr (GB/s) 3 NVDIMM-Ns per prcessr (GB/s) NVDIMM-Ns per prcessr (GB/s) Intrductin 6

7 Maximum bandwidth Maximum bandwidth fr ne thread n the remte prcessr Maximum aggregate bandwidth fr multiple threads n the remte prcessr Maximum aggregate bandwidth when bth prcessrs are equally ppulated with NVDIMM-Ns and running multiple threads, each accessing lcal NVDIMM-Ns 1 NVDIMM-N per prcessr (GB/s) 2 NVDIMM-Ns per prcessr (GB/s) 3 NVDIMM-Ns per prcessr (GB/s) NVDIMM-Ns per prcessr (GB/s) System perfrmance (maximum bandwidth) The fllwing assumptins shuld be cnsidered when reviewing the System perfrmance (maximum bandwidth) infrmatin: All NVDIMM-Ns are HPE 8GB NVDIMM Single Rank x4 DDR Mdules. The memry subsystem is running at 2133 MT/s, which requires the fllwing system cnfiguratin: The system prcessr supprts at least 2133 MT/s. The system des nt have three DIMMs installed in any memry channel. All DIMMs in the system supprt at least 2133 MT/s. The Maximum Memry Bus Frequency is set t Aut r at least 2133 MHz (2133 MT/s). Fr mre infrmatin n the System Utilities setting, see "Maximum Memry Bus Frequency (n page 20)." The Maximum Bus Frequency menu item is visible nly when the UEFI System Utilities setting fr Pwer Prfile is set t Custm. Fr mre infrmatin abut changing these settings, see the HPE UEFI System Utilities User Guide fr HPE PrLiant Gen9 Servers n the Hewlett Packard Enterprise website ( The inter-cpu link (such as Intel QPI) is running at 19.2 GB/s (that is 9.6 GT/s with tw links). This infrmatin ignres DDR4 verhead. This infrmatin ignres bandwidth used by regular DIMM accesses. HPE Persistent Memry Manager The HPE Persistent Memry Manager is a desktp applicatin that helps yu mnitr yur NVDIMM-Ns and related cmpnents. HPE Persistent Memry Manager als helps yu evaluate yur memry cnfiguratin layut. IMPORTANT: The HPE Persistent Memry Manager is intended fr use nly n HPE servers with supprted NVDIMMs installed. Fr mre infrmatin, see the HPE Persistent Memry Manager User Guide n the Hewlett Packard Enterprise website ( Intrductin 7

8 Cmpnent identificatin NVDIMM LEDs When the server bts up, all LEDs flash three times. Any LED activity nt described in this sectin indicates a pssible errr. Item LED definitins 1 Fast-flashing blue = A backup is in prgress. D nt remve the NVDIMM. Slw-flashing blue (1 flash/15 secnds) = Nrmal peratin. 2 Reserved 3 Slid r flashing green = Pwer is available t the NVDIMM. D nt remve the NVDIMM. Off = Pwer is nt available t the NVDIMM. NVDIMM identificatin T determine NVDIMM characteristics, see the full prduct descriptin as shwn in the fllwing example: Item Descriptin Definitin 1 Capacity 8GB 2 Rank 1R (Single rank) Cmpnent identificatin 8

9 Item Descriptin Definitin 3 Data width x4 (4 bit) 4 Memry type NVDIMM-N 5 Maximum memry speed 2133 MT/s 6 Speed grade P (CAS ) 7 DIMM type RDIMM (registered) 8 Reserved Fr mre infrmatin abut prduct features, specificatins, ptins, cnfiguratins, and cmpatibility, see the prduct QuickSpecs n the Hewlett Packard Enterprise website ( Cmpnent identificatin 9

10 Installatin Server requirements fr NVDIMM supprt Befre installing an HPE 8GB NVDIMM-N in a server, make sure that the fllwing cmpnents and sftware are available: A supprted HPE server using lntel Xen E v4 prcessrs Fr mre infrmatin, see the NVDIMM QuickSpecs n the Hewlett Packard Enterprise website ( An HPE Smart Strage Battery A minimum f ne regular DIMM The system cannt have nly NVDIMM-Ns installed. A supprted fllwing perating systems with persistent memry/nvdimm drivers. Fr the latest sftware infrmatin, see the Hewlett Packard Enterprise website ( Windws Server 2016 Windws Server 2012 R2 with prductin driver frm Hewlett Packard Enterprise. RedHat RHEL 7.3 Suse SLES12 SP2 The latest firmware versins as fllws: Single pint system ROM firmware release T lcate the latest system ROM firmware versins, see the Hewlett Packard Enterprise website ( HPE ilo 4 firmware v2.50 r later T lcate the latest ilo 4 firmware versins, see the Hewlett Packard Enterprise website ( T determine NVDIMM supprt fr yur server, see the server QuickSpecs n the Hewlett Packard Enterprise website ( General DIMM and NVDIMM-N slt ppulatin guidelines Befre reviewing the ppulatin guidelines, review the "Persistent memry and NVDIMM terminlgy (n page 5)." Ppulatin requirements D nt mix RDIMMs, UDIMMs, and LRDIMMs. When NVDIMM-Ns are installed n a server, install at least ne regular DIMM in a DIMM slt assciated with the first prcessr installed. Install DIMMs nly if the crrespnding prcessr is installed. When mixing regular DIMMs and NVDIMM-Ns in a channel, install the regular DIMMs first and then install the NVDIMM-Ns in the channel. When installing NVDIMM-Ns in a server with mre than 16 DIMM slts and using the HPE 96W Smart Strage Battery, install a maximum f 16 NVDIMM-Ns in the server. Installatin 10

11 When single-rank, dual-rank, and quad-rank DIMMs are ppulated fr tw DIMMs per channel r three DIMMs per channel, install the higher numbered rank DIMM first in the channel (starting frm the farthest DIMM slt). Fr example, install the quad-rank DIMM first, the dual-rank DIMM next, and the single-rank DIMM last. Ppulatin recmmendatins T utilize all memry channels and prvide best perfrmance when ne prcessr is installed, install regular DIMMs in sequential alphabetic rder: A, B, C, D, E, F, and s frth. When tw prcessrs are installed, install the regular DIMMs in sequential alphabetic rder balanced between the tw prcessrs: P1-A, P2-A, P1-B, P2-B, P1-C, P2-C, and s frth. If installing NVDIMM-Ns in an unbalanced cnfiguratin, see "Balanced and unbalanced NVDIMM cnfiguratins (n page 25)." T achieve the best perfrmance, install nly tw DIMMs per channel in servers with three DIMM slts per channel. When three DIMMs per channel are ppulated, the speed reduces frm 2400 MT/s r 2133 MT/s t 1600 MT/s. The perating frequency is reduced t 1867 MT/s if the fllwing are true: If any channel in the system is ppulated with tw DIMMs per channel and at least ne f them is NVDIMM. If n channel in the system is cnfigured with three DIMMs per channel. If a channel in the system cnfigured with tw DIMMs per channel is ppulated with all regular DIMMs, an NVDIMM-N installed in a ne DIMM per channel cnfiguratin runs at 2133 MT/s. Fr mre infrmatin abut server memry, see the Hewlett Packard Enterprise website ( DIMM ppulatin rder Fr each prcessr, ppulate DIMMs sequentially in alphabetical rder beginning with A. Item Descriptin 1 Number f DIMMs t install per prcessr 2 1 st DIMM slt f the memry channel (white DIMM slts) 3 2 nd DIMM slt f the memry channel (black DIMM slts) 4 3 rd DIMM slt f the memry channel (blue DIMM slts) DIMM handling guidelines CAUTION: Failure t prperly handle DIMMs can cause damage t DIMM cmpnents and the system bard cnnectr. When handling a DIMM, bserve the fllwing guidelines: Avid electrstatic discharge. Installatin 11

12 Always hld DIMMs by the side edges nly. Avid tuching the cnnectrs n the bttm f the DIMM. Never wrap yur fingers arund a DIMM. Avid tuching the cmpnents n the sides f the DIMM. Never bend r flex the DIMM. When installing a DIMM, bserve the fllwing guidelines: Befre seating the DIMM, pen the DIMM slt and align the DIMM with the slt. T align and seat the DIMM, use tw fingers t hld the DIMM alng the side edges. T seat the DIMM, use tw fingers t apply gentle pressure alng the tp f the DIMM. Fr mre infrmatin, see the Hewlett Packard Enterprise website ( Installing an NVDIMM CAUTION: T avid damage t the hard drives, memry, and ther system cmpnents, the air baffle, drive blanks, and access panel must be installed when the server is pwered up. CAUTION: T avid damage t the hard drives, memry, and ther system cmpnents, be sure t install the crrect DIMM baffles fr yur server mdel. CAUTION: DIMMs are keyed fr prper alignment. Align ntches in the DIMM with the crrespnding ntches in the DIMM slt befre inserting the DIMM. D nt frce the DIMM int the slt. When installed prperly, nt all DIMMs will face in the same directin. CAUTION: Electrstatic discharge can damage electrnic cmpnents. Be sure yu are prperly grunded befre beginning this prcedure. CAUTION: Failure t prperly handle DIMMs can cause damage t DIMM cmpnents and the system bard cnnectr. CAUTION: Unlike traditinal strage devices, NVDIMMs are fully integrated in with the PrLiant server. Data lss can ccur when system cmpnents, such as the prcessr r HPE Smart Strage Battery fails. HPE Smart Strage battery is a critical cmpnent required t perfrm the backup functinality f NVDIMM. It is imprtant t take actin when HPE Smart Strage Battery related failures ccur. Always fllw best practices fr ensuring data prtectin. Befre handling r installing the DIMMs, see the "DIMM handling guidelines (n page 11)." Fr server-specific prcedures, see the server user guide n the Hewlett Packard Enterprise website ( 1. Pwer dwn the server. 2. Extend the server frm the rack. 3. Remve the access panel. 4. Remve all cmpnents necessary t access the server DIMM slts and the HPE Smart Strage Battery. Fr mre infrmatin, see the server user guide n the Hewlett Packard Enterprise website ( 5. Lcate any NVDIMM already installed in the server. Installatin 12

13 6. Verify that all LEDs n any installed NVDIMMs are ff. Fr mre infrmatin n NVDIMM LEDs, see "NVDIMM LEDs (n page 8)." 7. Install the NVDIMM. 8. Install the HPE Smart Strage Battery. 9. Cnnect the HPE Smart Strage Battery cable t the system bard. Fr mre infrmatin, see the server user guide n the Hewlett Packard Enterprise website ( 10. Install any cmpnents remved t access the DIMM slts and the HPE Smart Strage Battery. 11. Install the access panel. 12. Slide the server int the rack. 13. Pwer up the server. 14. Sanitize the NVDIMM-Ns, if required. Fr mre infrmatin, see "Setting the NVDIMM-N Sanitize/Erase n Next Rebt Plicy (n page 16)." Installatin 13

14 Cnfiguring the system Cnfiguring NVDIMM Memry Optins Launch the System Utilities screen thrugh the Remte Cnsle, such as ilo remte cnsle, by pressing the F9 key during POST t cnfigure the server fr the fllwing NVDIMM settings: NVDIMM-N Memry Functinality (n page 14) NVDIMM-N Memry Interleaving (n page 14) NVDIMM-N Backup Pwer Plicy (n page 15) NVDIMM-N Sanitize/Erase n Next Rebt Plicy (n page 15) NVDIMM-N Data Integrity Checking (n page 16) Fr mre infrmatin n cnfiguring settings fr NVDIMMs, see the HPE UEFI System Utilities User Guide fr HPE PrLiant Gen9 Servers n the Hewlett Packard Enterprise website ( NVDIMM-N Memry Functinality This ptin enables NVDIMM-N functinality (including backing up the cntents f the memry t flash n pwer dwn r reset) t be enabled r disabled. If Disabled is selected fr this ptin, the NVDIMM-Ns in the system are nt presented t the perating system as either persistent strage r system memry. Enabling/disabling NVDIMM-N Memry Functinality 1. Frm the System Utilities screen, select System Cnfiguratin BIOS/Platfrm Cnfiguratin (RBSU) System Optins Memry Operatins NVDIMM Memry Optins NVDIMM-N Memry Functinality, and then press the Enter key. 2. Select Enabled (default) r Disabled, and then press the Enter key. 3. Press the F10 key t save the selectin. NVDIMM-N Memry Interleaving Prerequisite This ptin enables NVDIMM-Ns installed n a particular prcessr t be interleaved with ther NVDIMM-Ns in the memry map. This ptin des nt impact the interleaving f regular DIMMs. Interleaving is never enabled acrss NVDIMM-Ns and regular DIMMs. NVDIMM-Ns installed n different prcessrs are never interleaved tgether. If this setting is changed (t Enabled r Disabled), then all installed NVDIMM-Ns must be sanitized. If all installed NVDIMM-Ns are nt sanitized, then an errr cnditin is reprted n the next bt and the NVDIMM-Ns are nt available fr use. The Channel Interleaving (n page 19) setting is enabled. Enabling/disabling NVDIMM-N Memry Interleaving 1. Frm the UEFI System Utilities screen, select System Cnfiguratin BIOS/Platfrm Cnfiguratin (RBSU) System Optins Memry Operatins NVDIMM Memry Optins NVDIMM-N Memry Interleaving, and then press the Enter key. Cnfiguring the system 14

15 2. Select Enabled r Disabled (default), and then press the Enter key. 3. Press the F10 key t save the selectin. 4. Sanitize the NVDIMMs. Fr mre infrmatin, see "Setting the NVDIMM-N Sanitize/Erase n Next Rebt Plicy (n page 16)." NVDIMM-N Backup Pwer Plicy This ptin enables the system t wait during system bt fr the HPE Smart Strage Battery t charge if sufficient battery backup pwer fr the installed NVDIMM-Ns is nt available. If this ptin is cnfigured fr Cntinue Bt withut Backup Pwer, the server bts even if sufficient battery backup pwer is nt available. In this case, the system might nt present the installed NVDIMM-Ns t the perating system as persistent strage r system memry. Setting the NVDIMM-N Backup Pwer Plicy 1. Frm the UEFI System Utilities screen, select System Cnfiguratin BIOS/Platfrm Cnfiguratin (RBSU) System Optins Memry Operatins NVDIMM Memry Optins NVDIMM-N Backup Pwer Plicy, and then press the Enter key. 2. Chse ne f the fllwing ptins, and then press the Enter key. Wait fr Backup Pwer n Bt (default) Cntinue Bt withut Backup Pwer 3. Press the F10 key t save the selectin. NVDIMM-N Sanitize/Erase n Next Rebt Plicy This setting is part f the prcess t sanitize r erase all user data and errr status data saved in the selected NVDIMM-Ns. After enabling the NVDIMM-N Sanitize/Erase n Next Rebt Plicy, the screen displays varius ptins fr sanitizing NVDIMMs. The fllwing selectins are available depending n the NVDIMM-Ns installed n the server: Sanitize/Erase all NVDIMM-N in the System Sanitizes all NVDIMM-Ns installed in the server n rebt. Sanitize/Erase all NVDIMM-N n Prcessr 1 Sanitizes all NVDIMM-Ns installed in the DIMM slts fr prcessr 1 n rebt. Sanitize/Erase Prcessr 1 DIMM X Sanitizes the NVDIMM-N installed in DIMM slt X fr prcessr 1 n rebt. A selectin is available fr each Prcessr 1 DIMM slt that cntains an NVDIMM-N. Sanitize/Erase all NVDIMM-N n Prcessr 2 Sanitizes all NVDIMM-Ns installed in the DIMM slts fr prcessr 1 n rebt. Sanitize/Erase Prcessr 2 DIMM X Sanitizes the NVDIMM-N installed in DIMM slt X fr prcessr 2 n rebt. A selectin is available fr each Prcessr 2 DIMM slt that cntains an NVDIMM-N. Selected NVDIMM-Ns are sanitized n the next rebt f the system. The largest grup f NVDIMM-Ns selected are sanitized. Fr example, if Sanitize/Erase all NVDIMM-N n Prcessr 1 is enabled and Sanitize/Erase Prcessr 1 DIMM 8 is disabled, all NVDIMM-Ns n prcessr 1 are sanitized including prcessr 1 DIMM 8. The fllwing plicies cntrl the actin f the system after NVDIMM-Ns are sanitized/erased: Pwer ff the system after sanitizing/erasing NVDIMMs Bt t the perating system after sanitizing NVDIMMs Bt t the System Utilities after sanitizing NVDIMMs Cnfiguring the system 15

16 Fr mre infrmatin, see "NVDIMM sanitize plicies (n page 23)." Setting the NVDIMM-N Sanitize/Erase n Next Rebt Plicy 1. Frm the System Utilities screen, select System Cnfiguratin BIOS/Platfrm Cnfiguratin (RBSU) System Optins Memry Operatins NVDIMM Memry Optins. 2. Select NVDIMM-N Sanitize/Erase n Next Rebt Plicy. The fllwing alert is displayed. IMPORTANT: Sanitizing/Erasing an NVDIMM-N will result in the lss f ALL user data saved in the NVDIMM-N. It is strngly recmmended that manual backup f all user data in the NVDIMM-N(s) be perfrmed befre sanitizing/erasing the NVDIMM-N(s). 3. Press any key t prceed. 4. Select ne f the fllwing menu items: Sanitize/Erase and Bt t Operating System Sanitize/Erase and Pwer System Off Sanitize/Erase and Bt t System Utilities Fr mre infrmatin abut the menu items abve, see "NVDIMM sanitize plicies (n page 23)." 5. Select ne f the fllwing menu items based n the NVDIMM-Ns t be sanitized/erased: Sanitize/Erase all NVDIMM-N in the System Use this ptin fr majr system recnfiguratins. Sanitize/Erase all NVDIMM-N n Prcessr 1 Use this ptin when all the NVDIMM-Ns n a prcessr must be sanitized tgether, such as when enabling NVDIMM-N Memry Interleaving. Sanitize/Erase Prcessr 1 DIMM X This ptin is available nly when NVDIMM-N Memry Interleaving is disabled. Use this ptin fr adding individual NVDIMM-Ns, r fr using an NVDIMM-N again after errrs ccur. Sanitize/Erase all NVDIMM-N n Prcessr 2 Use this ptin when all the NVDIMM-Ns n a prcessr must be sanitized tgether, such as when enabling NVDIMM-N Memry Interleaving. Sanitize/Erase Prcessr 2 DIMM X This ptin is available nly when NVDIMM-N Memry Interleaving is disabled. Use this ptin fr adding individual NVDIMM-Ns, r fr using an NVDIMM-N again after errrs ccur. When enabled, all user data in the selected NVDIMM-N is erased n the next rebt. The Sanitize NVDIMM-N scpe selectins are available nly after a sanitize plicy is selected. 6. Press the F10 key t save the changes. 7. Rebt the server. The server will rebt multiple times as part f the sanitize prcess. POST messages will als display t indicate the NVDIMM-Ns that are being sanitized. NVDIMM-N Data Integrity Checking When this ptin is enabled, the system checks each NVDIMM-N during system bt t determine the integrity f the data stred n the NVDIMM-N. If any data cannt be read prperly, the system maps ut the NVDIMM-N (nt usable by the perating system). If this ptin is disabled, an NVDIMM-N that has issues with the ability t read data r has bad data might result in the system getting uncrrectable errrs. Enable this ptin t ensure any NVDIMM-Ns that are made visible t the perating system perate apprpriately. Enabling this ptin will increase system bt time fr each installed NVDIMM-N. Cnfiguring the system 16

17 Enabling/Disabling NVDIMM-N Data Integrity Checking 1. Frm the System Utilities screen, select System Cnfiguratin BIOS/Platfrm Cnfiguratin (RBSU) System Optins Memry Operatins NVDIMM Memry Optins NVDIMM-N Data Integrity Checking, and then press the Enter key. 2. Select Enabled (default) r Disabled, and then press the Enter key. 3. Press the F10 key t save the selectin. Cnfiguring additinal settings fr NVDIMMs When NVDIMMs are installed, yu might need t change System Utilities settings that are nt specific t NVDIMMs. When necessary, use the fllwing additinal System Utilities settings t cnfigure the server: Advanced Memry Prtectin (n page 17) QPI Snp Cnfiguratin (n page 17) Intel Perfrmance Mnitring Supprt (n page 18) Nde Interleaving (n page 18) Memry Fast Training (n page 18) Extended Memry Test (n page 19) Maximum Memry Bus Frequency (n page 20) Channel Interleaving (n page 19) Pwer prfile (n page 19) Fr mre infrmatin n cnfiguring system settings, see the HPE UEFI System Utilities User Guide fr HPE PrLiant Gen9 Servers n the Hewlett Packard Enterprise website ( Advanced Memry Prtectin If NVDIMM-Ns are installed n a server, always select Advanced ECC Supprt in the Advanced Memry Prtectin menu. Other ptins, such as Online Spare Memry, Mirrred Memry, and Lckstep mde with DDDC are nt supprted when NVDIMMs are installed. Selecting ne f the unsupprted ptins generates messages displayed in the IML and the NVDIMMs are disabled until the cnfiguratin is set t Advanced ECC. When Advanced Memry Prtectin is set t Advanced ECC Supprt, Advanced Memry Prtectin is hidden in the menu. Cnfiguring Advanced Memry Prtectin 1. Frm the System Utilities screen, select System Cnfiguratin BIOS/Platfrm Cnfiguratin (RBSU) System Optins Memry Operatins Advanced Memry Prtectin, and then press the Enter key. 2. Select Advanced ECC Supprt (default), and then press the Enter key. 3. Press the F10 key t save the selectin. QPI Snp Cnfiguratin In prcessrs cntaining multiple memry cntrllers, the QPI Snp Cnfiguratin ptin f Cluster n Die divides the prcessr cres int ndes based n their prximity t the memry cntrllers. Interleaving (including NVDIMM-N Memry Interleaving) is cmpleted within each nde, nt within the entire scket. Fr NVDIMMs, this results in a larger number f smaller blck devices (fr example, fur 8 GiB NVDIMMs are presented as tw 16 GiB blck devices rather than ne 32 GiB blck device). Cnfiguring the system 17

18 The Hme Snp and Early Snp ptins interleave acrss the entire prcessr. Setting the QPI Snp Cnfiguratin 1. Frm the System Utilities screen, select System Cnfiguratin BIOS/Platfrm Cnfiguratin (RBSU) Perfrmance Optins Advanced Perfrmance Tuning Optins QPI Snp Cnfiguratin, and then press the Enter key. 2. Select ne f the fllwing settings, and then press the Enter key: Hme Snp (default) Early Snp Cluster n Die 3. Press the F10 key t save the selectin. Intel Perfrmance Mnitring Supprt Intel prcessrs include perfrmance cunters that can be used by sftware t measure DRAM perfrmance (including NVDIMM-N perfrmance). This ptin is a mnitring tl and des nt impact perfrmance. Fr example, the Intel Perfrmance Cunter Mnitr (PCM) tls are capable f reprting per-channel bandwidth. Fr mre infrmatin, see the Intel website ( Enabling r disabling Intel Perfrmance Mnitring Supprt 1. Frm the System Utilities screen, select System Cnfiguratin BIOS/Platfrm Cnfiguratin (RBSU) Perfrmance Optins Advanced Perfrmance Tuning Optins Intel Perfrmance Mnitring Supprt, and then press the Enter key. 2. Select ne f the fllwing settings, and then press the Enter key: Enabled Disabled (default) 3. Press the F10 key t save the selectin. Nde Interleaving Nde interleaving interleaves memry acrss prcessrs and is nt supprted with NVDIMM-Ns. When NVDIMM-Ns are installed n a server, always disable Nde Interleaving. The system generates messages displayed in the IML and the NVDIMMs are disabled until Nde Interleaving is disabled. Disabling Nde Interleaving 1. Frm the System Utilities screen, select System Cnfiguratin BIOS/Platfrm Cnfiguratin (RBSU) Perfrmance Optins Advanced Perfrmance Tuning Optins Nde Interleaving, and then press the Enter key. 2. Select Disabled, and then press the Enter key. 3. Press the F10 key t save the selectin. Memry Fast Training If Memry Fast Training is Enabled (default), then the NVDIMM-N Memry cntents are left undisturbed during warm resets. If Memry Fast Training is Disabled, then each warm reset is upgraded t a cld reset and results in an NVDIMM-N backup and restre. Hewlett Packard Enterprise recmmends that the Memry Fast Training setting is enabled. Cnfiguring the system 18

19 Enabling r disabling Memry Fast Training 1. Frm the System Utilities screen, select System Cnfiguratin BIOS/Platfrm Cnfiguratin (RBSU) System Optins Bt Time Optimizatin Memry Fast Training, and then press the Enter key. 2. Select ne f the fllwing settings, and then press the Enter key: Enabled (default) Hewlett Packard Enterprise recmmends this setting. Disabled 3. Press the F10 key t save the selectin. Extended Memry Test Use this ptin t cnfigure whether the system validates memry during the memry initializatin prcess. When Enabled, the Extended Memry Test always skips NVDIMM-N DRAM. Use NVDIMM-N Data Integrity Checking t check fr uncrrectable errrs after the restre. Fr mre infrmatin, see "Enabling/Disabling NVDIMM-N Data Integrity Checking (n page 17)." Enabling r disabling Extended Memry Test 1. Frm the System Utilities screen, select System Cnfiguratin BIOS/Platfrm Cnfiguratin (RBSU) System Optins Bt Time Optimizatin Extended Memry Test, and then press the Enter key. 2. Select ne f the fllwing settings, and then press the Enter key: Enabled (default) Disabled 3. Press the F10 key t save the selectin. Pwer Prfile This ptin allws yu t select a pwer prfile based n pwer and perfrmance characteristics and affects NVDIMM-N pwer and perfrmance. Setting a Pwer Prfile 1. Frm the System Utilities screen, select System Cnfiguratin BIOS/Platfrm Cnfiguratin (RBSU) Pwer Management Pwer Prfile, and then press the Enter key. 2. Select ne f the fllwing settings, and then press the Enter key: Balanced Pwer and Perfrmance (default) Minimum Pwer Usage (nt supprted) Maximum Perfrmance Custm 3. Press the F10 key t save the selectin. Channel Interleaving Channel interleaving interleaves memry acrss channels within a prcessr scket. If enabling the NVDIMM-N Memry Interleaving setting, then yu must enable Channel interleaving. Cnfiguring the system 19

20 Prerequisite The Pwer Prfile (n page 19) is set t Custm. Enabling r disabling Channel Interleaving 1. Frm the System Utilities screen, select System Cnfiguratin BIOS/Platfrm Cnfiguratin (RBSU) Pwer Management Advanced Pwer Optins Channel Interleaving, and then press the Enter key. 2. Select ne f the fllwing settings, and then press the Enter key: Enabled (default) Disabled 3. Press the F10 key t save the selectin. Maximum Memry Bus Frequency Prerequisite When Pwer Prfile (n page 19) is set t Custm, use this ptin t cnfigure the system t run memry at a lwer maximum speed than that supprted by the installed prcessr and DIMM cnfiguratin. Aut, the default setting, enables memry t run at the maximum speed supprted by the system cnfiguratin. Fr best NVDIMM-N perfrmance, use the Aut setting. Other settings might be useful fr lwer pwer r lwer perfrmance uses. The Pwer Prfile (n page 19) is set t Custm. Setting the Maximum Memry Bus Frequency 1. Frm the System Utilities screen, select System Cnfiguratin BIOS/Platfrm Cnfiguratin (RBSU) Pwer Management Advanced Pwer Optins Maximum Memry Bus Frequency, and then press the Enter key. 2. Select ne f the fllwing settings accrding t yur hardware, and then press the Enter key. Fr servers with lntel Xen E v3 prcessrs installed, chse ne f the fllwing: Aut (default) 1333MHz (nt supprted) 1600MHz 1867MHz 2133MHz Fr servers with lntel Xen E v4 prcessrs installed, chse ne f the fllwing: Aut (default) 1333MHz (nt supprted) 1600MHz 1867MHz 2133MHz 2400MHz 3. Press the F10 key t save the selectin. Cnfiguring the system 20

21 Saving system default settings as user default settings After cnfiguring the NVDIMM settings fr the server, Hewlett Packard Enterprise recmmends saving the settings as the user default settings. T save the settings, d the fllwing: 1. Frm the System Utilities screen, select System Cnfiguratin BIOS/Platfrm Cnfiguratin (RBSU) System Default Optins User Default Optins, and press the Enter key. 2. Select Save User Defaults, and press the Enter key. 3. Select Yes, Save t save the current settings as the system default settings, and then press the Enter key. 4. Press the F10 key t save the changes. Fr mre infrmatin abut changing the settings, see the HPE UEFI System Utilities User Guide fr HPE PrLiant Gen9 Servers n the Hewlett Packard Enterprise website ( Cnfiguring the system 21

22 Maintenance and management Viewing NVDIMM-Ns in management sftware tls When viewing memry infrmatin using certain management tls, such as SMH, NVDIMM-N infrmatin might nt be distinguished frm RDIMM infrmatin. HPE ilo displays the NVDIMM and RDIMM infrmatin separately. Remving an NVDIMM CAUTION: D nt remve an NVDIMM when any LEDs n any NVDIMM in the system are illuminated. Remving an NVDIMM when an LED is illuminated might cause a lss f data. CAUTION: Electrstatic discharge can damage electrnic cmpnents. Be sure yu are prperly grunded befre beginning this prcedure. CAUTION: Failure t prperly handle DIMMs can cause damage t DIMM cmpnents and the system bard cnnectr. Befre handling r installing the DIMMs, see the "DIMM handling guidelines (n page 11)." Fr server-specific prcedures, see the server user guide n the Hewlett Packard Enterprise website ( 1. Sanitize/erase any NVDIMMs being remved r relcated as necessary. Fr mre infrmatin, see "NVDIMM relcatin guidelines (n page 25)." 2. Pwer dwn the server. 3. Extend the server frm the rack. 4. Remve the access panel. 5. Remve all cmpnents necessary t access the server DIMM slts and the HPE Smart Strage Battery. Fr mre infrmatin, see the server user guide n the Hewlett Packard Enterprise website ( 6. Observe the NVDIMM LEDs. D nt remve an NVDIMM when any NVDIMM LED in the system is illuminated. Fr mre infrmatin, see "NVDIMM LEDs (n page 8)." Maintenance and management 22

23 7. Remve the NVDIMM-N. 8. Install any cmpnents remved t access the DIMM slts and the HPE Smart Strage Battery. 9. Install the access panel. 10. Slide the server int the rack. 11. Pwer up the server. NVDIMM sanitizatin Media sanitizatin is defined by NIST SP Guidelines fr Media Sanitizatin (Rev 1, Dec 2014) as "a general term referring t the actins taken t render data written n media unrecverable by bth rdinary and extrardinary means." The specificatin defines the fllwing levels: Clear Overwrite user-addressable strage space using standard write cmmands; might nt sanitize data in areas nt currently user-addressable (such as bad blcks and verprvisined areas) Purge Overwrite r erase all strage space that might have been used t stre data using dedicated device sanitize cmmands, such that data retrieval is "infeasible using state f the art labratry techniques" Destry Ensure that data retrieval is "infeasible using state f the art labratry techniques" and render the media unable t stre data (such as disintegrate, pulverize, melt, incinerate, r shred) The NVDIMM-N Sanitize ptins are intended t meet the Purge level. Fr mre infrmatin abut cnfiguring the Sanitize/Erase settings, see "Setting the NVDIMM-N Sanitize/Erase n Next Rebt Plicy (n page 16)." NIST SP Guidelines fr Media Sanitizatin (Rev 1, Dec 2014) is available fr dwnlad frm the NIST website ( NVDIMM sanitize plicies The System Utilities menu item fr NVDIMM-N Sanitize/Erase n Next Rebt plicy prvides the fllwing ptins: Sanitize/Erase and Bt t Operating System Use this plicy fr the fllwing scenaris: After adding a new NVDIMM-N t a system Maintenance and management 23

24 If an NVDIMM-N was mapped ut due t errrs and yu want t use the NVDIMM again (fr example, yu remved an NVDIMM-N while the LEDs were still illuminated, causing backup errrs) After mving NVDIMM-Ns previusly used in anther system t a new system (unless everything is an exact match) Sanitize/Erase and Pwer System Off Use this plicy fr the fllwing scenaris: Decmmissining an NVDIMM-N Recmmissining an NVDIMM-N (mve t anther server with n requirement t preserve the data) Befre returning the NVDIMM-N t Hewlett Packard Enterprise (service replacement) Sanitize/Erase and Bt t System Utilities Use this plicy t change any BIOS/Platfrm Cnfiguratin (RBSU) setting that results in the data n the NVDIMM-N n lnger being interpreted the same way. Examples include NVDIMM-N Memry Interleaving and QPI Snp Cnfiguratin f cluster-n-die. After selecting a sanitize plicy and ne r mre NVDIMM-Ns t sanitize, the system upgrades all warm reset requests int cld resets. The first cld reset: 1. Flushes any write data still pending in prcessr write buffers t DRAM. 2. Maps ut the NVDIMM-Ns. 3. Sends the sanitize cmmand t the NVDIMM-Ns. Fr Sanitize/Erase and Pwer System Off, the system pwers ff after cmpleting the Sanitize cmmands. Fr Sanitize/Erase and Bt t Operating System r Sanitize/Erase and Bt t System Utilities, the system perfrms anther cld reset t map in the NVDIMM-Ns again. Fr mre infrmatin abut cnfiguring the Sanitize/Erase settings, see "Setting the NVDIMM-N Sanitize/Erase n Next Rebt Plicy (n page 16)." NVDIMM sanitizatin guidelines NVDIMM sanitizatin is required in the fllwing scenaris: When a new NVDIMM-N is added t the system, yu must sanitize all NVDIMM-Ns in the system befre the NVDIMM-Ns can be used. When an NVDIMM-N is remved frm the system and NVDIMM-N Memry Interleaving is set t Enabled, yu must sanitize all the NVDIMM-Ns cnnected t a prcessr frm which the NVDIMM-N was remved befre the NVDIMM-Ns can be used. When a previusly used NVDIMM-N is added t the system, yu must sanitize all the NVDIMM-Ns in the system befre the NVDIMM-Ns can be used. When any f the fllwing settings are changed, yu must sanitize all the NVDIMM-Ns in the system befre the NVDIMM-Ns can be used: Channel Interleaving (n page 19) NVDIMM-N Memry Interleaving (n page 14) QPI Snp Cnfiguratin (n page 17) When NVDIMM-Ns used in ne mdel f HPE PrLiant server are mved t anther mdel f HPE PrLiant server, yu must sanitize the NVDIMM-Ns befre the NVDIMM-Ns can be used. NVDIMM sanitizatin might nt be required if the fllwing are true: The NVDIMM-N was already in use in anther server that matches the new server in bth hardware and System Utilities settings. The NVDIMM-N is installed in the new server in the same DIMM slt as in the riginal server. Maintenance and management 24

25 NVDIMM relcatin guidelines When relcating NVDIMM-Ns t anther DIMM slt n the server r t anther server, bserve the fllwing guidelines: If data n the NVDIMM-N r set f NVDIMM-Ns must be preserved, then bserve the fllwing requirements: The destinatin server hardware must match the riginal server hardware. All System Utilities settings must match the riginal System Utilities settings. All NVDIMM-Ns are installed in the same lcatins as in the riginal server. This guideline wuld apply when replacing a system bard due t system failure. If data n the NVDIMM-N r set f NVDIMM-Ns des nt have t be preserved, then mve the NVDIMM-Ns t the new lcatin and sanitize all NVDIMM-Ns after installing them t the new lcatin. Fr mre infrmatin, see "NVDIMM sanitizatin (n page 23)." Observe all ppulatin guidelines. Fr mre infrmatin, see "General DIMM and NVDIMM-N slt ppulatin guidelines (n page 10)." Observe the prcess fr remving an NVDIMM. Fr mre infrmatin, see "Remving an NVDIMM (n page 22)." Observe the prcess fr installing an NVDIMM. Fr mre infrmatin, see "Installing an NVDIMM." Review and cnfigure the system settings fr NVDIMMs. Fr mre infrmatin, see "Cnfiguring NVDIMM Memry Optins (n page 14)." Balanced and unbalanced NVDIMM cnfiguratins With regular DIMMs, it is cmmn t use a balanced cnfiguratin when installing regular DIMMs in a server in which DIMMs are allcated acrss all prcessrs and all memry channels (such as 1-A, 2-A, 1-B, 2-B, and s frth). An unbalanced cnfiguratin is preferred in sme cases when NVDIMM-Ns are installed. Balancing NVDIMM-Ns by psitining them equally acrss all prcessrs results in them being presented by the OS device drivers as multiple smaller blck devices. With NVDIMM-N Memry Interleaving enabled, ne blck device exists per prcessr, r ne blck device exists per nde if the QPI Snp Cnfiguratin is Cluster-n-Die. Fr example, eight 8 GiB NVDIMMs n tw prcessrs result in tw 32 GiB blck devices. This wrks best if strage threads need t run n all prcessrs and can partitin their data s threads access lcal NVDIMM-Ns. Unbalancing NVDIMM-Ns by psitining them all n ne prcessr (r ne nde if the QPI Snp Cnfiguratin is Cluster-n-Die) results in them being presented as ne big blck device. Fr example, eight 8 GiB NVDIMMs n ne prcessr results in ne 64 GiB blck device. This wrks best if strage threads can be limited t that prcessr. Example: Fr an unbalanced memry cnfiguratin when using tw regular DIMMs and six NVDIMM-Ns, install the DIMMs as fllws: Install a regular DIMM in slt A fr each prcessr Install three NVDIMM-Ns in the remaining white slts n prcessr 1 (slts B, C, and D) Install three mre NVDIMM-Ns in three f the fur black slts n prcessr 1 (slts E, F, G, and H) This cnfiguratin will result in ne 48 GiB persistent memry device. Fr best perfrmance, Hewlett Packard Enterprise recmmends running strage threads nly n prcessr 1. Maintenance and management 25

26 Recvering restred data frm an NVDIMM-N DRAM CAUTION: D nt remve an NVDIMM when any LEDs n any NVDIMM in the system are illuminated. Remving an NVDIMM when an LED is illuminated might cause a lss f data. CAUTION: Electrstatic discharge can damage electrnic cmpnents. Be sure yu are prperly grunded befre beginning this prcedure. CAUTION: Failure t prperly handle DIMMs can cause damage t DIMM cmpnents and the system bard cnnectr. Befre handling r installing the DIMMs, see the "DIMM handling guidelines (n page 11)." Fr server-specific prcedures, see the server user guide n the Hewlett Packard Enterprise website ( When the NVDIMM-N DRAM cntains the nly cpy f restred data, perfrm the fllwing prcedure t recver the infrmatin: 1. Cpy the data frm the NVDIMM t sme ther strage device (such as SSD, HDD, r anther NVDIMM) as sn as pssible (befre cld reset r pwer lss). 2. Pwer dwn the server. 3. Extend the server frm the rack. 4. Remve the access panel. 5. Remve all cmpnents necessary t access the server DIMM slts and the HPE Smart Strage Battery. Fr mre infrmatin, see the server maintenance and service guide n the Hewlett Packard Enterprise website ( 6. Observe the NVDIMM LEDs. D nt remve an NVDIMM when any NVDIMM LED in the system is illuminated. Fr mre infrmatin, see "NVDIMM LEDs (n page 8)." 7. Remve the NVDIMM-N. Fr mre infrmatin, see "Remving an NVDIMM (n page 22)." 8. Install a replacement NVDIMM. Fr mre infrmatin, see "Installing an NVDIMM." 9. Install any cmpnents remved t access the DIMM slts and the HPE Smart Strage Battery. 10. Install the access panel. 11. Slide the server int the rack. 12. Pwer up the server. 13. Sanitize the replacement NVDIMM. Fr mre infrmatin, see "Setting the NVDIMM-N Sanitize/Erase n Next Rebt Plicy (n page 16)." 14. Cpy the data frm the strage device t the NVDIMM-N. Maintenance and management 26

27 Trubleshting NVDIMM errr messages The system displays NVDIMM errr messages during POST and in the IML. These messages can prvide a status r indicate an errr. Messages that indicate an errr als prvide an actin with the errr text. Fr a full list f the errr messages, see the HPE PrLiant Gen9 Trubleshting Guide, Vlume II: Errr Messages. Fr mre infrmatin, see "Trubleshting resurces (n page 27)." Trubleshting resurces Trubleshting resurces are available fr HPE PrLiant Gen9 servers in the fllwing dcuments: The HPE PrLiant Gen9 Trubleshting Guide, Vlume I: Trubleshting prvides prcedures fr reslving cmmn prblems and cmprehensive curses f actin fr fault islatin and identificatin, issue reslutin, and sftware maintenance n PrLiant servers and server blades. The HPE PrLiant Gen9 Trubleshting Guide, Vlume II: Errr Messages prvides a list f errr messages and infrmatin t assist with interpreting and reslving errr messages n PrLiant servers and server blades. T access the trubleshting resurces, see the Hewlett Packard Enterprise website ( Trubleshting 27

28 Supprt and ther resurces Accessing Hewlett Packard Enterprise Supprt Fr live assistance, g t the Cntact Hewlett Packard Enterprise Wrldwide website ( T access dcumentatin and supprt services, g t the Hewlett Packard Enterprise Supprt Center website ( Befre yu cntact Hewlett Packard Enterprise Be sure t have the fllwing infrmatin available befre yu call Hewlett Packard Enterprise: Active Health System lg (HPE PrLiant Gen8 r later prducts) Dwnlad and have available an Active Health System lg fr 7 days befre the failure was detected. Fr mre infrmatin, see the HPE ilo 4 User Guide r HPE Intelligent Prvisining User Guide n the Hewlett Packard Enterprise website ( Onbard Administratr SHOW ALL reprt (fr HPE BladeSystem prducts nly) Fr mre infrmatin n btaining the Onbard Administratr SHOW ALL reprt, see the Hewlett Packard Enterprise website ( Technical supprt registratin number (if applicable) Prduct serial number Prduct mdel name and number Prduct identificatin number Applicable errr messages Add-n bards r hardware Third-party hardware r sftware Operating system type and revisin level Accessing updates Sme sftware prducts prvide a mechanism fr accessing sftware updates thrugh the prduct interface. Review yur prduct dcumentatin t identify the recmmended sftware update methd. T dwnlad prduct updates, g t either f the fllwing: Hewlett Packard Enterprise Supprt Center Get cnnected with updates page ( Sftware Dept website ( T view and update yur entitlements, and t link yur cntracts and warranties with yur prfile, g t the Hewlett Packard Enterprise Supprt Center Mre Infrmatin n Access t Supprt Materials page ( Supprt and ther resurces 28

29 IMPORTANT: Access t sme updates might require prduct entitlement when accessed thrugh the Hewlett Packard Enterprise Supprt Center. Yu must have an HP Passprt set up with relevant entitlements. Websites Hewlett Packard Enterprise Infrmatin Library ( Hewlett Packard Enterprise Supprt Center ( Cntact Hewlett Packard Enterprise Wrldwide ( Subscriptin Service/Supprt Alerts ( Sftware Dept ( Custmer Self Repair ( Insight Remte Supprt ( Remte supprt Remte supprt is available with supprted devices as part f yur warranty r cntractual supprt agreement. It prvides intelligent event diagnsis, and autmatic, secure submissin f hardware event ntificatins t Hewlett Packard Enterprise, which will initiate a fast and accurate reslutin based n yur prduct's service level. Hewlett Packard Enterprise strngly recmmends that yu register yur device fr remte supprt. If yur prduct includes additinal remte supprt details, use search t lcate that infrmatin. Remte supprt and Practive Care infrmatin HPE Get Cnnected ( HPE Practive Care services ( HPE Practive Care service: Supprted prducts list ( HPE Practive Care advanced service: Supprted prducts list ( Practive Care custmer infrmatin Practive Care central ( Practive Care service activatin ( Supprt and ther resurces 29

30 Dcumentatin feedback Hewlett Packard Enterprise is cmmitted t prviding dcumentatin that meets yur needs. T help us imprve the dcumentatin, send any errrs, suggestins, r cmments t Dcumentatin Feedback (mailt:dcsfeedback@hpe.cm). When submitting yur feedback, include the dcument title, part number, editin, and publicatin date lcated n the frnt cver f the dcument. Fr nline help cntent, include the prduct name, prduct versin, help editin, and publicatin date lcated n the legal ntices page. Dcumentatin feedback 30