HP MSA 2040 Array 750 Mailbox Resiliency Exchange 2013 Storage Solution

Transcription

1 Technical white paper HP MSA 2040 Array 750 Mailbox Resiliency Exchange 201 Storage Solution Table of contents Overview... 2 Disclaimer... 2 Features of the tested solution... 2 HP MSA 2040 Array overview... 2 Key features and benefits... HP ProLiant DL80p Gen HP StoreFabric SN1000E 16Gb Host Bus Adapter... 5 Features... 5 Solution description... 5 Storage configuration... 6 Mailbox configuration primary site operational... 7 Mailbox configuration primary site unavailable (planned or unplanned)... 8 Mailbox configuration primary site offline and single server failure at Disaster Recovery site (planned or unplanned)... 9 Tested deployment... 9 Best practices Test results summary Reliability Storage performance results backup / recovery performance... 1 Conclusion... 1 Appendix A stress testing... 1 Appendix B performance testing Appendix C streaming backup testing Appendix D soft recovery testing For more information... 21

2 Overview This document provides information on an HP MSA 2040 LFF Disk Array and HP ProLiant DL80p Gen8 server with HP SN1000E 16Gb 2-port PCIe Fibre Channel Host Bus Adapters storage solution for Microsoft Exchange Server 201 (Exchange), based on the Microsoft Exchange Solution Reviewed Program (ESRP) Storage program*. For any questions or comments regarding the contents of this document, see the For more information section. *The ESRP Storage program was developed by Microsoft Corporation to provide a common storage testing framework for vendors to provide information on its storage solutions for Microsoft Exchange Server software. For more details on the Microsoft ESRP Storage program, see: Tested with: ESRP Storage Version 4.0 Test Date: May 201 Disclaimer HP produced this document independently of Microsoft Corporation. Microsoft Corporation expressly disclaims responsibility for, and makes no warranty, express or implied, with respect to the accuracy of the contents of this document. Features of the tested solution This solution implements the Availability Group (DAG) mailbox resiliency feature found in Microsoft Exchange Server 201 (Exchange). This feature is the base component of the high availability and site resilience framework built into Exchange. A DAG is a group of up to 16 mailbox servers that hosts a set of databases and provides database-level recovery from failures that affect individual servers or databases. This solution brief describes a tested configuration for deploying Exchange in a 750-user mailbox resilient environment. The performance results and best practices outlined in this document provide tested guidelines for configuring Exchange with the HP MSA 2040 LFF Disk Array and HP ProLiant DL80p Gen8 servers in a SAN storage solution. This solution used a single DAG to support 750 mailboxes, each with a 5 GB mailbox capacity and a work profile of 200 messages sent and received for each user, each day. To provide mailbox resiliency, there are four copies of each database; two copies located at the primary site and two copies located at the disaster recovery site. The primary site hosts all 750 users during normal operations. The performance results outlined in this paper are from the testing of a single building block at the disaster recovery site. See the section Test results summary for more information. Note HP has developed the HP Sizer for Microsoft Exchange Server 201 to assist customers with proper server and storage sizing for their Exchange Server 201 deployments. The algorithms developed and implemented in this tool originate from extensive testing of Exchange Server 201 server roles and technologies, HP s deep experience with Microsoft Exchange, and intricate knowledge of server CPU, memory, and subsystems. Designed to simplify configuration across a broad range of deployments, this tool is free to download and use. For more information, visit: hp.com/solutions/microsoft/exchange201/sizer HP MSA 2040 Array overview The HP MSA 2040 Array shown in Figure 1 provides an excellent value for customers needing increasing performance to support initiatives such as consolidation and virtualization. The MSA 2040 delivers this performance by leveraging new controller architecture with a new processor, four 8Gb or 16Gb Fibre Channel (FC) ports with 4GB cache per controller and using drive technologies such as SSDs. The new MSA Storage ships standard with 64 Snapshots and Volume Copy enabling increased data protection and supporting replication with optional Remote Snap software. The HP MSA 2040 Array is ideal for companies with small budgets or limited IT expertise, and benefits larger companies with departmental or remote requirements. The array is easy to deploy and secure, with low management costs, enabling a rapid return on investment through efficient storage consolidation. 2

3 Figure 1: Front view of the HP MSA 2040 Storage (LFF) Key features and benefits Easily managed, highly affordable, highly efficient, and flexible storage consolidation Delivers low cost, consolidate storage array solutions to meet departmental and small-to-midsize business requirements with one or two 4-port 16Gb/8Gb Fibre Channel controllers with 4GB cache per controller. Offers single controller models for low initial investment, or dual controllers for higher data protection. The FC controller allows sharing of resources between different departments with the most cost-effective protocol. A wide choice of drive types means a high return on investment (ROI). Offers a choice of drives: high-performance and high-speed SSD drives, enterprise-class SAS, and SAS Midline drives. The array head comes with either 12 (LFF) or 24 (SFF) drive bays, able to accommodate all three-drive types. Ships standard with 64 snapshot and Volume Copy cloning capability enabled, optionally increase snapshots to 512 snaps. All HP MSA 2040 Array controller models support the Remote Snap (replication) software option. Start small and grow in number of supported servers and total capacity adaptable to changing needs Grow storage as demands increase up to a raw capacity of 288TB with TB LFF drives. The HP MSA 2040 Array can support 8 LFF enclosures and 96 drives, or 8 SFF enclosures and 192 drives. Single or dual controllers accommodate any budget. Powerful new controllers and 4GB of read/write cache each provide support for up to 64 hosts. The latest 16Gb Fibre Channel means that users will have fast, reliable, and affordable access to their data. With 512 LUNs and max volume size of 64TB, the HP MSA 2040 Array has more than sufficient LUN flexibility for a wide variety of configuration choices. Large Form Factor configurations can scale up to 6TB, expandable to 288 TB with the addition of a maximum of seven MSA inch Disk Enclosures. Small Form Factor configurations can scale from 24TB. With the addition of seven D2700 JBODs, the MSA 2040 storage can support 199TB. Users may configure a 24-drive MSA 2040 array head with 12-drive LFF MSA inch disk enclosures. Excellent method for a configuration that supports high-speed SFF SSDs or fast SFF enterprise-class SAS drives in the array head, combine with economical LFF drives staged for archival purposes, all in the same array. Comprehensive data protection in an easily administered SAN environment Reduces risk of IT failure with built in dual active/active controllers, dual-ported drives, and redundant hardware components. Increases data protection with HP MSA 2040 Array standard 64 Snapshot (optional 512) and Volume Copy software, allows space-efficient, copy-on-write snapshots and clones. Optional Remote Snap (replication) is available with the Fibre Channel model. Reduces deployment time with easy and secure configuration, which reduces operator errors, resulting in less downtime and data loss, while increasing customer satisfaction. Supports data-in-place upgrades, protecting the user s investment in JBODs and drives, enhancing performance and functionality. Intelligently creates and manages application specific snapshots that can be used to quickly restore application instances or databases using HP Recovery Manager Software. Recovery Manager is integrated with Microsoft Volume Shadow Copy Service (VSS) to make non-disruptive point-in-time copies of Microsoft Exchange for constant data protection.

4 For more details on the features and offerings of the HP MSA 2040 Array, visit the following site or contact your HP sales representative: hp.com/go/msa HP ProLiant DL80p Gen8 With innovations in performance, feature flexibility, and management capabilities, the HP DL80p Gen8 rack server shown in Figure 2 is an unmatched data center investment, which can handle today s demanding computing requirements. Redefining the customer experience with HP Proactive Insight architecture Prevent data loss, reduce downtime, and improve serviceability with included HP SmartDrives, HP Smart Socket guides, "Snap and Go" rail kit options, and tool-less access to components. Provides intuitive system management with simplified provisioning, proactive health monitoring and alerting, and automated firmware and system software maintenance using Integrated Lifecycle Automation. Dynamic Workload Acceleration converges storage, compute, and to turbo-charge performance and resiliency while eliminating bottlenecks. Reclaims space, power, and cooling resources needed for workloads and extends your data center capacity with Automated Energy Optimization. Enables industry leading performance, uptime, and productivity integrated into a personalized, simplified support experience with HP support services. Unlock your infrastructure s potential with HP s easy-to-use integrated management and support Complete set of embedded features, standard on all ProLiant Gen8 servers, including HP ilo, HP Agentless Management, HP Active Health System, HP Intelligent Provisioning, and HP Embedded Remote Support using HP ilo Management Engine. Provides 24X7 remote monitoring and anywhere, anytime personalized access to your IT and support status with HP Insight Online and HP Insight Remote Support. Reduces deployment time and update complexity by systematically updating server infrastructure in the data center. It includes HP Smart Update Manager (HP SUM), Service Pack for ProLiant (SPP), and other products using HP SmartUpdate. Provides advanced management capabilities across the lifecycle of your HP ProLiant server infrastructure with HP Insight Control. HP ilo Advanced, a key component, provides enhanced remote server functions that reduce IT travel costs and decrease resolution time. Improved capacity and performance on compute and storage Prevents data loss and downtime with enhanced error handling, while improving workload performance and power efficiency with HP SmartMemory. Improves serviceability and prevents data loss with features such as icon-based status display and Do Not Remove LED with HP SmartDrive technology. Offers maximum performance, memory, connectivity, and bandwidth for demanding workloads with the Intel Xeon processor E product family. Energy efficiency by design Includes a D array of temperature sensors that help precisely control server fans to direct cooling and reduce unnecessary fan power, saving on cooling costs. High efficiency 80+ certified HP Common Slot Power Supplies provide up to 94% efficiency (Platinum) and support HP s Power Discovery Services. ENERGY STAR qualified server configurations illustrate HP s continued commitment to helping customers conserve energy and save money. Figure 2: HP ProLiant DL80p Gen8 rack server 4

5 HP StoreFabric SN1000E 16Gb Host Bus Adapter The HP ProLiant DL80p Gen8 servers are configured with the HP SN1000E 16Gb 2-port PCIe Fibre Channel Host Bus Adapter as shown in Figure. The SN1000E is backwards compatible with 8 and 4Gb storage networks and protect future investments. With the ability to deliver twice the performance of 8Gb FC HBAs the SN Gb HBAs take storage networking performance and efficiency to the next level. Features Delivers twice the performance of the 8Gb Fibre Channel HBAs. Provides the infrastructure required for the more powerful servers and data intensive applications of the future by moving to 16Gb technology. Enables faster storage and retrieval of data with improved performance when using storage intensive applications like backup/restore and database transactions. Provides an HP-branded HBA solution that has undergone extensive HP interoperability testing for connecting HP ProLiant servers into storage and networking environments. Enables more applications to run on a single server and Fibre Channel port, resulting in reduced cabling and a higher return on IT investment. Figure : HP SN1000E 16Gb 2-port PCIe Fibre Channel Host Bus Adapter Solution description This solution brief provides best practices to help administrators implement an Exchange deployment with the following requirements: 750 mailbox users 0.16 IOPS workload per user (200 messages sent and received per user, per day, with an additional 20% headroom) 5 GB mailbox A single Availability Group (DAG) deployment with two mailbox servers in the primary site and two mailbox servers in the disaster recovery site, for a total of four mailbox servers across the entire solution Four copies of each mailbox database (one active / three passive) Four databases per server (two active and two passive) at the primary site and eight passive database copies at the disaster recovery site) Background Maintenance (BDM) enabled Designed for server and site resiliency 16 2TB 6G SAS 7.2K LFF (.5-inch) Dual Port MDL Hard drives per array for the Exchange databases and transaction logs Storage deployed as RAID-1 Vdisks. See the Storage configuration section for more information 5

6 15K SAS 00 GB 15K SAS 00 GB 15K SAS 00 GB 15K SAS 00 GB 15K 15K SAS 00 SASGB 00 GB 15K 15K SAS 00 SASGB 00 GB PROCS 1 DIMMS FANS PS1 PS2 POWER CAP NIC OVER TEMP AMP STATUS PROCS 1 DIMMS FANS PS1 PS2 2 PROCS 1 DIMMS FANS PS1 PS2 POWER CAP NIC OVER TEMP AMP STATUS POWER CAP NIC OVER TEMP AMP STATUS UID ProLiant DL80p Gen8 HP HP StorageWorks MSA2000 P UID 9 12 UID ProLiant DL80p Gen8 UID ProLiant DL80p Gen8 HP MSA UID 9 12 HP MSA UID P822 P SAS 1 SAS 1 SAS 2 SAS 2 PORT 1 PORT 2 PORT PORT 4 PORT 1 PORT 2 PORT PORT SERVICE 4 CLI SERVICE-2 PORT 1 PORT 2 PORT PORT 4 SERVICE CLI SERVICE-2 SERVICE-2 PORT 1 PORT 2 PORT PORT ilo CLI CLI SAS SAS CLI CLI /100 BASE - T 10/100 BASE - T SERVICE-2 SAS 4 SAS 4 ilo ilo CLI CLI SERVICE SERVICE CLI CLI 6Gb/s 6Gb/s IN SERVICE-1 IN SERVICE-1 CACHE IVITY CACHE IVITY SERVICE-1 SERVICE-1 6Gb/s 6Gb/s OUT OUT CACHE CACHE CACHE CACHE UID PS1 PS2 6Gb/s 6Gb/s 6Gb/s 6Gb/s UID UID PS1 PS2 PS1 PS2 Technical white paper HP MSA 2040 Array 750 Mailbox Resiliency Exchange 201 Storage Solution Storage configuration The recommended best practice for site and server resiliency is two ProLiant DL80p servers and one HP MSA 2040 LFF Disk Array connected to a dual- module MSA 2040 drive enclosure at each site. The array and enclosure each contain eight 2TB 6G SAS 7.2K LFF (.5-inch) Dual Port MDL hard drives for a total of 16 drives. For storage performance and redundancy, connect the HP ProLiant DL80p servers using two HP SN1000E HBA cards in each server to both controllers of the HP MSA 2040 Array in SAN mode. The HP MSA 2040 Array uses 16 disks for Exchange database and transaction logs. The Exchange restore volumes are located on the servers. This highly available, load-balanced configuration has four databases per server on the primary site, two active and two passive during normal operations. Figure 4 illustrates the hardware used in this solution at the primary site. Figure 4: Rack mounted view of the HP MSA 2040 Array and the HP ProLiant DL80p servers, cabled in a dual-path, SAN configuration at the primary site. QR559A QR559A PORT 0 QR559A QR559A PORT 0 Smart Array Smart Array TOP 1 4 QR559A QR559A QR559A QR559A PORT 0 PORT 0 TOP HP MSA 2040 Array with eight (8) 2TB 6G SAS 7.2K LFF (.5-inch) Dual Port MDL Hard drives 2. Dual- module HP MSA 2040 Drive Enclosure with eight (8) 2TB 6G SAS 7.2K LFF (.5-inch) Dual Port MDL Hard drives. Two (2) HP ProLiant DL80p Gen8 servers with HP SN1000E 16Gb 2-port PCIe Fibre Channel Host Bust Adapters 4. Primary and secondary paths from the HP MSA 2040 Array to the ProLiant servers 5. Mini-SAS cables from the HP MSA 2040 Controller to the drive enclosure The tested building block, a single HP ProLiant DL80p server connected to the HP MSA 2040 LFF Array demonstrates a worst case scenario; the failure of the primary site and one of the two servers in the disaster recovery site. Despite this catastrophic failure scenario, the single server can host four active databases; and continues to pass all tests. See Figure 5. Figure 5: Rack mounted view of the tested configuration. An HP MSA 2040 Array and an HP ProLiant DL80p server, cabled in a dual-path configuration. 2 QR559A QR559A PORT 0 PORT 0 TOP 6GB DP 15k 6GB DP 15k Serial SCSI Serial SCSI 2TB 2TB 6GB DP 15k 6GB DP 15k Serial SCSI Serial SCSI 2TB 2TB 1 Serial 6GB DP 15k Serial SCSI 6GB DP 15k SCSI 2TB 2TB 6GB DP 15k 6GB DP 15k Serial SCSI Serial SCSI 2TB 2TB 6

7 1. HP MSA 2040 LFF Disk Array with eight (8) 2TB 6G SAS 7.2K LFF (.5-inch) Dual Port MDL Hard drives 2. One HP ProLiant DL80p Gen8 server with HP SN1000E 16Gb 2-port PCIe Fibre Channel Host Bust Adapters. Primary and secondary paths from the HP MSA 2040 Array to the ProLiant server Mailbox configuration primary site operational Figure 6 shows the mailbox layout for active and passive database copies when the primary site is operational. This solution brief provides best practices to help administrators implement the Exchange deployment, with the following requirements: 750 mailbox users 0.16 IOPS workload per user (200 messages sent and received per user, per day, with an additional 20% headroom) 5 GB mailbox size Each mailbox server in the primary site hosts four database copies (two active and two passive). Each mailbox server in the disaster recovery site hosts four database copies (four passive) Background database maintenance (BDM) enabled Figure 6: Normal operation with all mailboxes hosted at the Primary Site. Active Passive Primary Site Disaster Recovery Site MBX1 MBX2 MBX MBX4 DAG DB1 DB1 DB1 DB1 DB DB DB DB DB4 DB4 DB4 DB4 7

8 Mailbox configuration primary site unavailable (planned or unplanned) Figure 7 shows the mailbox layout for active and passive database copies when the primary site is unavailable due to a planned or unplanned event. This solution brief provides best practices to help administrators implement the Exchange deployment, with the following requirements: 750 mailbox users 0.16 IOPS workload per user (200 messages sent and received per user, per day, with an additional 20% headroom) 5 GB mailbox size Primary site s database copies are unavailable due to a planned or unplanned event Each mailbox server in the disaster recovery site hosts four database copies (two active and two passive) Background database maintenance (BDM) enabled Figure 7: Primary site unavailable with all mailboxes hosted on Disaster Recovery Site. Active Passive Primary Site Disaster Recovery Site DAG XMBX1 XMBX2 MBX MBX4 DB1 DB1 DB1 DB1 DB DB DB DB DB4 DB4 DB4 DB4 8

9 Mailbox configuration primary site offline and single server failure at Disaster Recovery site (planned or unplanned) Figure 8 shows the tested mailbox layout for active database copies when the primary site and one of the servers in the disaster recovery site are unavailable due to a planned or unplanned event. This solution demonstrates the worst-case scenario with one host in the disaster recovery site hosting four active databases, with the following requirements: 750 mailbox users 0.16 IOPS workload per user (200 messages sent and received per user, per day, with an additional 20% headroom) 5 GB mailbox size Primary site s database copies and one of the two servers at the recovery site are unavailable due to a planned or unplanned event The mailbox server in the disaster recovery site hosting four database copies (four active) Background database maintenance (BDM) enabled Figure 8: Primary site unavailable and single server failure at Disaster Recovery Site. Active Passive Primary Site Disaster Recovery Site DAG XMBX1 XMBX2 XMBX MBX4 DB1 DB1 DB1 DB1 DB DB DB DB DB4 DB4 DB4 DB4 Tested deployment The following tables summarize the tested environment. 9

10 Simulated Exchange configuration Number of Exchange mailboxes simulated 750 Number of Availability Groups (DAGs) 1 Number of mailbox servers per DAG 4 Number of active mailboxes per server 75 (normal operations) 750 (site failover and a single server offline) Number of databases per server 4 Number of copies per database 4 (1 active / passive) Number of active mailboxes per database 188 Simulated profile: operations per second per mailbox (IOPS, include 20% headroom) and Log LUN size Total database size for performance testing Background database maintenance (BDM) TB 4 TB Tested with 24/7 BDM enabled % formatted storage capacity used by Exchange database 55% Total DB size/total Formatted capacity 4TB/7.24TB Storage hardware Storage Connectivity Storage model and firmware version Storage cache Fibre Channel HP MSA 2040 Array Firmware Version: GL100R002 4 GB per controller Number of storage controllers per server 2 Number of storage ports Maximum bandwidth of storage connectivity to host HBA model and Firmware Version Number of HBAs Host server type Four x 16/8Gb FC ports per controller 8 x 16Gb/s HP SN1000E 16Gb 2P FC HBA Firmware Version: Driver Version: per host HP ProLiant DL80p Gen8 Total number of disks tested in solution 8* Maximum number of spindles that can be hosted in the tested configuration 12 * RAID1 for the Mailbox database and logs 10

11 Storage software HBA Driver Storport Miniport Driver FC HBA QueueTarget Setting 0 HBA QueueDepth Setting 2 Host OS Microsoft Windows Server 2008 R2 Enterprise with SP1 ESE.dll file version Storage disk configuration (mailbox and log disks) Disk type, speed, and firmware version Raw capacity for each disk (TB) 2TB 6G SAS 7.2K LFF (.5-inch) Dual Port MDL SAS drives Firmware Version: A001 2 TB Number of physical disks in test 8 Total raw storage capacity (TB) RAID level Total formatted capacity (TB) 16 TB* RAID 1 (2 disks per Vdisk) 7.24 TB Storage capacity utilization 45% raw storage capacity utilization 25% 7.24TB/16TB Formatted capacity / Total Raw capacity 4TB/16TB DB size / Total Raw capacity * Capacity of drives, and therefore the raw data capacity of the disk array, based on 1KB = 1000 bytes, not 1024 bytes. This means that 1 GB = 1,000,000,000 bytes, not (1,07,741,824 bytes) Best practices Exchange Server is a disk-intensive application. For Exchange 201 best practices on storage design from Microsoft, see For Exchange Server solution guidance, visit HP at hp.com/solutions/microsoft/exchange. Based on the testing run using the ESRP framework, we recommend the following to improve the storage performance. Drivers and Firmware Ensure that firmware and drivers for all hardware in the solution are up to date. For more information, see: hp.com/go/support. Multipathing Install Microsoft s Multipath (MPIO). Multipathing allows for redundant physical paths to the storage and load balancing of the. For more information, see: Jetstress 201 Before installing Exchange Server 201, test your storage solution with Jetstress to ensure it is configured properly and meets your requirements. For more information on Jetstress, see: microsoft.com/en-us/download/details.aspx?id=6849. Mailbox Copies In addition to the features of RAID1 protection, additional fault tolerance was achieved with four copies of the mailbox databases. There are two database copies at the primary site and two database copies at the disaster recovery site, ensuring business continuity through superior disaster recovery and Exchange availability options. 11

12 RAID Level The Vdisks used in this solution were configured as RAID 1 sets with a RAID stripe size of 256 KB (256 KB or larger is recommended). Provisioning of other RAID types is supported but not recommended for this Exchange Server solution. Windows Volumes Ensure that the Windows volumes are formatted with the 64KB allocation unit size for best performance. For more information on Exchange 201 Storage Configuration Options and Best Practices recommendation, see: Test results summary This section provides a high-level summary of the test data from ESRP and a reference to the detailed HTML reports, generated by the ESRP testing framework. For solutions that use a uniform building block style, in which each building block is independent and isolated, ESRP requires testing only one building block. For this solution, a building block consisted of one HP ProLiant DL80p Gen8 server and one HP MSA 2040 LFF Disk Array, with eight (8) 2TB 6G SAS 7.2K LFF (.5-inch) Dual Port MDL drives hosting all 750 mailboxes. However, for actual deployments of this solution, additional hardware is required at both the primary and disaster recovery sites. For a complete solution, contact your HP Reseller or HP Sales Representative. Reliability Reliability testing exercises the storage with the maximum sustainable Exchange load for 24 hours. The goal is to verify that the storage can handle the maximum load for an extended amount of time. Both log and database files are analyzed for integrity after the stress test to confirm that no database or log corruption occurred. After running the 24-hour test, we found no relevant errors reported in the event log for the storage reliability testing, and no errors reported for the checksum process. Storage performance results Storage performance testing exercises the storage with the maximum sustainable Exchange load for two hours. The test measures storage response times under the maximum sustainable Exchange load. The following data is the sum of all logical disk s and an average of all logical disk latency in the two-hour test duration. This solution is designed around an Exchange deployment with a single DAG. The DAG has two mailbox servers in the primary site and two mailbox servers in the disaster recovery site. Ideally, the two servers in the disaster recovery site should host all active mailboxes when the primary site is offline (planned or unplanned.) The performance results tables below shows the worst-case scenario when one server is running all four databases. See Figure 8. Needed Disk Transfers/sec* 120 Disk Transfers/sec 67 Disk /sec 46 Disk /sec 210 Disk Read (ms) 17.2 Disk Write (ms) 0.99 Transaction Log Log Disk /sec 148 Log Disk Write (ms) <1 ms * This row represents the total IOPS necessary to satisfy the IOPS for all mailboxes in the solution. 12

13 backup / recovery performance This section contains two test reports. The first report measures the sequential read rate of the database files; the second report measures the recovery/replay performance (playing transaction logs into the database.) The tests measure the read rates and log replay rates with all mailboxes under concurrent or simultaneous load. Read-Only Performance This test measures the maximum backup rate for Volume Shadow Copy Service (VSS) aware backup applications. The following table shows the average and sum of the database reads. MB read/sec per database MB read/sec total Transaction Log Recovery / Replay Performance This test measures the maximum rate that log files can play against the databases. The following table shows the average rate for log files played. Each log file is 1 MB in size. number of log files played 504 time to play one log file (sec) 2.12 Conclusion The information discussed in this solution brief highlights the tested performance results and configuration best practices for an Exchange solution supporting 750 5GB mailboxes and a 0.16 IOPS workload for each user (200 messages sent and received per user, per day with an additional 20% headroom.) The tested solution included an HP MSA 2040 LFF Disk Array with eight (8) 2TB 6G SAS 7.2K LFF (.5-inch) Dual Port MDL drives for the mailbox database storage and transaction logs. Testing demonstrated that the storage subsystem supports the IOPS needed for 750 Exchange users and provides additional performance headroom. The test results and data presented in this document are from the ESRP test framework. Test results are only a guide; customers should test their specific solution to make sure it meets their requirements. The ESRP program is not a benchmarking program. The tests do not measure the maximum throughput for a given solution. Rather, program focus is on producing recommendations from vendors for Exchange Server storage solutions, not direct comparisons among solutions. Appendix A stress testing Stress Test Result Report Test Summary Overall Test Result Machine Name Test Description Test Start Time Test End Time Pass WIN-7K2MCQ5RFC6 5/24/201 12:24:07 PM 5/27/201 10:4:5 PM Collection Start Time 5/24/201 12:26:05 PM Collection End Time 5/25/201 12:25:57 PM Jetstress Version ESE Version Operating System Windows Server 2008 R2 Enterprise Service Pack 1 ( ) Performance Log C:\Program Files\Exchange Jetstress\24HR_TEST\Stress_201_5_24_12_24_16.blg Sizing and Throughput Achieved Transactional per Second Target Transactional per Second 120 Initial Size (bytes) Final Size (bytes) Files (Count) 4 1

14 Jetstress System Parameters Thread Count 18 Minimum Cache Maximum Cache Insert Operations 40% Delete Operations 20% Replace Operations 5% Read Operations 5% Lazy Commits 70% Run Background Maintenance True Number of Copies per MB MB Configuration Instance424.1 Log path: C:\dblg1 : C:\dblg1\Jetstress edb Instance424.2 Log path: C:\dblg2 : C:\dblg2\Jetstress edb Instance424. Log path: C:\dblg : C:\dblg\Jetstress00001.edb Instance424.4 Log path: C:\dblg4 : C:\dblg4\Jetstress edb Transactional Performance MSExchange ==> Instances /sec /sec Log Log Log Log Log /sec /sec Log Instance Instance Instance Instance Background Maintenance Performance MSExchange ==> Instances Maintenance IO /sec Maintenance IO Instance Instance Instance Instance Log Replication Performance MSExchange ==> Instances Log /sec Log Instance Instance Instance Instance Total Performance MSExchange ==> Instances /sec /sec Log Log Log Log Log /sec /sec Log Instance Instance Instance Instance

15 Host System Performance Counter Minimum Maximum % Processor Time Available M Free System Page Table Entries Transition Pages RePurposed/sec Pool Nonpaged Pool Paged Page Fault Stalls/sec Test Log 5/24/201 12:24:07 PM -- Preparing for testing... 5/24/201 12:24:11 PM -- Attaching databases... 5/24/201 12:24:11 PM -- Preparations for testing are complete. 5/24/201 12:24:11 PM -- Starting transaction dispatch.. 5/24/201 12:24:11 PM -- cache settings: (minimum: MB, maximum: 1.0 GB) 5/24/201 12:24:11 PM -- flush thresholds: (start: 10.2 MB, stop: 20.5 MB) 5/24/201 12:24:16 PM -- read latency thresholds: (average: 20 msec/read, maximum: 200 msec/read). 5/24/201 12:24:16 PM -- Log write latency thresholds: (average: 10 msec/write, maximum: 200 msec/write). 5/24/201 12:24:2 PM -- Operation mix: Sessions 18, Inserts 40%, Deletes 20%, Replaces 5%, 5%, Lazy Commits 70%. 5/24/201 12:24:2 PM -- Performance logging started (interval: ms). 5/24/201 12:24:2 PM -- Attaining prerequisites: 5/24/201 12:26:05 PM -- \MSExchange (JetstressWin)\ Cache Size, Last: (lower bound: , upper bound: none) 5/25/201 12:26:06 PM -- Performance logging has ended. 5/27/201 10:4:52 PM -- JetInterop batch transaction stats: , , and /27/201 10:4:52 PM -- Dispatching transactions ends. 5/27/201 10:4:52 PM -- Shutting down databases... 5/27/201 10:4:5 PM -- Instance424.1 (complete), Instance424.2 (complete), Instance424. (complete) and Instance424.4 (complete) 5/27/201 10:4:5 PM -- C:\Program Files\Exchange Jetstress\24HR_TEST\Stress_201_5_24_12_24_16.blg has 5756 samples. 5/27/201 10:4:5 PM -- Creating test report... 5/27/201 10:5:19 PM -- Instance424.1 has 16.8 for. 5/27/201 10:5:19 PM -- Instance424.1 has 0.2 for Log. 5/27/201 10:5:19 PM -- Instance424.1 has 0.2 for Log. 5/27/201 10:5:19 PM -- Instance424.2 has 18. for. 5/27/201 10:5:19 PM -- Instance424.2 has 0.2 for Log. 5/27/201 10:5:19 PM -- Instance424.2 has 0.2 for Log. 5/27/201 10:5:19 PM -- Instance424. has 16.6 for. 5/27/201 10:5:19 PM -- Instance424. has 0.2 for Log. 5/27/201 10:5:19 PM -- Instance424. has 0.2 for Log. 5/27/201 10:5:19 PM -- Instance424.4 has 16.4 for. 5/27/201 10:5:19 PM -- Instance424.4 has 0.2 for Log. 5/27/201 10:5:19 PM -- Instance424.4 has 0.2 for Log. 5/27/201 10:5:19 PM -- Test has 0 Maximum Page Fault Stalls/sec. 5/27/201 10:5:19 PM -- The test has 0 Page Fault Stalls/sec samples higher than 0. 5/27/201 10:5:19 PM -- C:\Program Files\Exchange Jetstress\24HR_TEST\Stress_201_5_24_12_24_16.xml has 5749 samples queried. Appendix B performance testing Performance Test Result Report Test Summary Overall Test Result Machine Name Test Description Test Start Time Test End Time Pass WIN-7K2MCQ5RFC6 5/20/201 10:4:20 AM 5/20/201 1:48:7 PM Collection Start Time 5/20/201 10:45:21 AM Collection End Time 5/20/201 12:45:14 PM Jetstress Version ESE Version Operating System Windows Server 2008 R2 Enterprise Service Pack 1 ( ) Performance Log Sizing and Throughput C:\Program Files\Exchange Jetstress\2HR_TEST\Performance_201_5_20_10_4_9.blg 15

16 Achieved Transactional per Second Target Transactional per Second 120 Initial Size (bytes) Final Size (bytes) Files (Count) 4 Jetstress System Parameters Thread Count 18 Minimum Cache Maximum Cache Insert Operations 40% Delete Operations 20% Replace Operations 5% Read Operations 5% Lazy Commits 70% Run Background Maintenance True Number of Copies per MB MB Configuration Instance Log path: C:\dblg1 : C:\dblg1\Jetstress edb Instance Log path: C:\dblg2 : C:\dblg2\Jetstress edb Instance4852. Log path: C:\dblg : C:\dblg\Jetstress00001.edb Instance Log path: C:\dblg4 : C:\dblg4\Jetstress edb Transactional Performance MSExchange ==> Instances /sec /sec Log Log Log Log Log /sec /sec Log Instance Instance Instance Instance Background Maintenance Performance MSExchange ==> Maintenance IO Instances /sec Instance Instance Instance Instance Maintenance IO Log Replication Performance MSExchange ==> Instances Log /sec Log Instance Instance Instance Instance Total Performance MSExchange ==> Instances /sec /sec Log Log Log Log Log /sec /sec Log Instance Instance Instance Instance

17 Host System Performance Counter Minimum Maximum % Processor Time Available M Free System Page Table Entries Transition Pages RePurposed/sec Pool Nonpaged Pool Paged Page Fault Stalls/sec Test Log 5/20/201 10:4:20 AM -- Preparing for testing... 5/20/201 10:4:4 AM -- Attaching databases... 5/20/201 10:4:4 AM -- Preparations for testing are complete. 5/20/201 10:4:4 AM -- Starting transaction dispatch.. 5/20/201 10:4:5 AM -- cache settings: (minimum: MB, maximum: 1.0 GB) 5/20/201 10:4:5 AM -- flush thresholds: (start: 10.2 MB, stop: 20.5 MB) 5/20/201 10:4:9 AM -- read latency thresholds: (average: 20 msec/read, maximum: 100 msec/read). 5/20/201 10:4:9 AM -- Log write latency thresholds: (average: 10 msec/write, maximum: 100 msec/write). 5/20/201 10:4:46 AM -- Operation mix: Sessions 18, Inserts 40%, Deletes 20%, Replaces 5%, 5%, Lazy Commits 70%. 5/20/201 10:4:46 AM -- Performance logging started (interval: ms). 5/20/201 10:4:46 AM -- Attaining prerequisites: 5/20/201 10:45:21 AM -- \MSExchange (JetstressWin)\ Cache Size, Last: (lower bound: , upper bound: none) 5/20/201 12:45:22 PM -- Performance logging has ended. 5/20/201 1:48:6 PM -- JetInterop batch transaction stats: 4409, 4409, 4409 and /20/201 1:48:6 PM -- Dispatching transactions ends. 5/20/201 1:48:7 PM -- Shutting down databases... 5/20/201 1:48:7 PM -- Instance (complete), Instance (complete), Instance4852. (complete) and Instance (complete) 5/20/201 1:48:7 PM -- C:\Program Files\Exchange Jetstress\2HR_TEST\Performance_201_5_20_10_4_9.blg has 485 samples. 5/20/201 1:48:7 PM -- Creating test report... 5/20/201 1:48:40 PM -- Instance has 17.1 for. 5/20/201 1:48:40 PM -- Instance has 0.2 for Log. 5/20/201 1:48:40 PM -- Instance has 0.2 for Log. 5/20/201 1:48:40 PM -- Instance has 18. for. 5/20/201 1:48:40 PM -- Instance has 0.2 for Log. 5/20/201 1:48:40 PM -- Instance has 0.2 for Log. 5/20/201 1:48:40 PM -- Instance4852. has 17.0 for. 5/20/201 1:48:40 PM -- Instance4852. has 0.2 for Log. 5/20/201 1:48:40 PM -- Instance4852. has 0.2 for Log. 5/20/201 1:48:40 PM -- Instance has 16.4 for. 5/20/201 1:48:40 PM -- Instance has 0.2 for Log. 5/20/201 1:48:40 PM -- Instance has 0.2 for Log. 5/20/201 1:48:40 PM -- Test has 0 Maximum Page Fault Stalls/sec. 5/20/201 1:48:40 PM -- The test has 0 Page Fault Stalls/sec samples higher than 0. 5/20/201 1:48:40 PM -- C:\Program Files\Exchange Jetstress\2HR_TEST\Performance_201_5_20_10_4_9.xml has 478 samples queried. Appendix C streaming backup testing backup Test Result Report Backup Statistics - All Instance Size (M) Elapsed Backup Time M Transferred/sec Instance :8: Instance :41: Instance :8: Instance :41: Avg Sum Jetstress System Parameters Thread Count 18 Minimum Cache MB 17

18 Maximum Cache MB Insert Operations 40% Delete Operations 20% Replace Operations 5% Read Operations 5% Lazy Commits 70% Configuration Instance Log path: C:\dblg1 : C:\dblg1\Jetstress edb Instance Log path: C:\dblg2 : C:\dblg2\Jetstress edb Instance1520. Log path: C:\dblg : C:\dblg\Jetstress00001.edb Instance Log path: C:\dblg4 : C:\dblg4\Jetstress edb Transactional Performance MSExchange ==> Instances /sec /sec Log Log Log Log Log /sec /sec Instance Instance Instance Instance Host System Performance Counter Minimum Maximum % Processor Time Available M Free System Page Table Entries Transition Pages RePurposed/sec Pool Nonpaged Pool Paged Page Fault Stalls/sec Log Test Log 5/17/201 1:58:57 PM -- Preparing for testing... 5/17/201 1:59:01 PM -- Attaching databases... 5/17/201 1:59:01 PM -- Preparations for testing are complete. 5/17/201 1:59:10 PM -- Performance logging started (interval: 0000 ms). 5/17/201 1:59:10 PM -- Backing up databases... 5/17/201 :40:54 PM -- Performance logging has ended. 5/17/201 :40:54 PM -- Instance (100% processed), Instance (100% processed), Instance1520. (100% processed) and Instance (100% processed) 5/17/201 :40:54 PM -- C:\Program Files\Exchange Jetstress\DB_BACKUP\Backup_201_5_17_1_59_1.blg has 20 samples. 5/17/201 :40:54 PM -- Creating test report... Appendix D soft recovery testing SoftRecovery Test Result Report Soft-Recovery Statistics - All Instance Log files replayed Elapsed seconds Instance Instance Instance Instance Avg Sum

19 Configuration Instance Log path: C:\dblg1 : C:\dblg1\Jetstress edb Instance Log path: C:\dblg2 : C:\dblg2\Jetstress edb Instance4544. Log path: C:\dblg : C:\dblg\Jetstress00001.edb Instance Log path: C:\dblg4 : C:\dblg4\Jetstress edb Transactional Performance MSExchange ==> Instances /sec /sec Log Log Log Log Log /sec /sec Instance Instance Instance Instance Background Maintenance Performance MSExchange ==> Maintenance IO Instances /sec Instance Instance Instance Instance Total Performance MSExchange ==> Instances /sec /sec Maintenance IO Log Log Log Log Log /sec /sec Instance Instance Instance Instance Host System Performance Counter Minimum Maximum % Processor Time Available M Free System Page Table Entries Transition Pages RePurposed/sec Pool Nonpaged Pool Paged Page Fault Stalls/sec Log Log Test Log 5/21/201 9:26: AM -- Preparing for testing... 5/21/201 9:26:7 AM -- Attaching databases... 5/21/201 9:26:7 AM -- Preparations for testing are complete. 5/21/201 9:26:7 AM -- Starting transaction dispatch.. 5/21/201 9:26:7 AM -- cache settings: (minimum: MB, maximum: 1.0 GB) 5/21/201 9:26:7 AM -- flush thresholds: (start: 10.2 MB, stop: 20.5 MB) 5/21/201 9:26:41 AM -- read latency thresholds: (average: 20 msec/read, maximum: 100 msec/read). 5/21/201 9:26:41 AM -- Log write latency thresholds: (average: 10 msec/write, maximum: 100 msec/write). 5/21/201 9:26:46 AM -- Operation mix: Sessions 18, Inserts 40%, Deletes 20%, Replaces 5%, 5%, Lazy Commits 70%. 5/21/201 9:26:46 AM -- Performance logging started (interval: ms). 5/21/201 9:26:46 AM -- Generating log files... 5/21/201 10:48:46 AM -- C:\dblg1 (100.2% generated), C:\dblg2 (100.6% generated), C:\dblg (101.8% generated) and C:\dblg4 (101.4% generated) 19

20 5/21/201 10:48:46 AM -- Performance logging has ended. 5/21/201 10:48:46 AM -- JetInterop batch transaction stats: 2142, 2142, 2141 and /21/201 10:48:46 AM -- Dispatching transactions ends. 5/21/201 10:48:47 AM -- Shutting down databases... 5/21/201 10:48:47 AM -- Instance (complete), Instance (complete), Instance4544. (complete) and Instance (complete) 5/21/201 10:48:47 AM -- C:\Program Files\Exchange Jetstress\SOFT_RECOVERY\Performance_201_5_21_9_26_41.blg has 27 samples. 5/21/201 10:48:47 AM -- Creating test report... 5/21/201 10:48:49 AM -- Instance has 16.9 for. 5/21/201 10:48:49 AM -- Instance has 0. for Log. 5/21/201 10:48:49 AM -- Instance has 0. for Log. 5/21/201 10:48:49 AM -- Instance has 18. for. 5/21/201 10:48:49 AM -- Instance has 0. for Log. 5/21/201 10:48:49 AM -- Instance has 0. for Log. 5/21/201 10:48:49 AM -- Instance4544. has 16.7 for. 5/21/201 10:48:49 AM -- Instance4544. has 0. for Log. 5/21/201 10:48:49 AM -- Instance4544. has 0. for Log. 5/21/201 10:48:49 AM -- Instance has 16.7 for. 5/21/201 10:48:49 AM -- Instance has 0. for Log. 5/21/201 10:48:49 AM -- Instance has 0. for Log. 5/21/201 10:48:49 AM -- Test has 0 Maximum Page Fault Stalls/sec. 5/21/201 10:48:49 AM -- The test has 0 Page Fault Stalls/sec samples higher than 0. 5/21/201 10:48:49 AM -- C:\Program Files\Exchange Jetstress\SOFT_RECOVERY\Performance_201_5_21_9_26_41.xml has 26 samples queried. 5/21/201 10:48:49 AM -- C:\Program Files\Exchange Jetstress\SOFT_RECOVERY\Performance_201_5_21_9_26_41.html was saved. 5/21/201 :57:29 PM -- Performance logging started (interval: 2000 ms). 5/21/201 :57:29 PM -- Recovering databases... 5/21/201 4:16:01 PM -- Performance logging has ended. 5/21/201 4:16:01 PM -- Instance ( ), Instance ( ), Instance4544. ( ) and Instance ( ) 5/21/201 4:16:02 PM -- C:\Program Files\Exchange Jetstress\SOFT_RECOVERY\SoftRecovery_201_5_21_15_57_24.blg has 550 samples. 5/21/201 4:16:02 PM -- Creating test report... 20

21 For more information HP MSA 2040 Storage Array: hp.com/go/msa2040 QuickSpecs for HP DL80p Gen8 Servers: QuickSpecs for HP SN1000E 16Gb 2-port PCIe Fibre Channel Host Bust Adapters: To read more about HP solutions for Exchange, including best practices and additional testing of HP Server and Storage products with Exchange, see: hp.com/solutions/exchange For general information on Exchange sizing and best practices, there are several white papers and planning tools that are free to download from: hp.com/solutions/activeanswers/exchange For more information on Jetstress and the process requirements for validating an Exchange Storage Solution, see: To help us improve our documents, please provide feedback at hp.com/solutions/feedback. Sign up for updates hp.com/go/getupdated Copyright 201 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. The only warranties for HP products and services are set forth in the express warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty. HP shall not be liable for technical or editorial errors or omissions contained herein. Microsoft and Windows are U.S. registered trademarks of Microsoft Corporation. Intel and Xeon are trademarks of Intel Corporation in the U.S. and other countries. ENERGY STAR is a registered mark owned by the U.S. government. 4AA4-7540ENW, September 201, Rev. 1