IBM Storwize V ,000 mailbox resiliency Microsoft Exchange 2013 storage solution. IBM Systems and Technology Group ISV Enablement March 2014

Similar documents
Dell PowerVault MD1220 is a SAS based storage enclosure. The major features of the storage system include:

ESRP Storage Program

Dell EMC SCv3020 7,000 Mailbox Exchange 2016 Resiliency Storage Solution using 7.2K drives

HP StorageWorks 600 Modular Disk System 4,000 user 3GB Mailbox resiliency Exchange 2010 storage solution

Sun ZFS Storage 7120 Appliance 5,000 Mailbox Resiliency Exchange 2010 Storage Solution

HP 3PAR StoreServ ,000 Mailbox Resiliency Exchange 2010 Storage Solution

Dell PowerVault MD Mailbox Single Copy Cluster Microsoft Exchange 2007 Storage Solution

Hitachi Unified Storage VM Dynamically Provisioned 21,600 Mailbox Exchange 2013 Mailbox Resiliency Storage Solution

Dell PowerVault MD3000i 5000 Mailbox Single Copy Cluster Microsoft Exchange 2007 Storage Solution

Sun ZFS Storage 7320 Appliance 10,000 Mailbox Resiliency Exchange 2010 Storage Solution

Dell Compellent Storage Center 6.5 SC4020 4,500 Mailbox Exchange 2013 Resiliency Storage Solution

NetApp E-Series E ,000-Mailbox Microsoft Exchange Server 2013 Mailbox Resiliency Storage Solution

Dell EMC SC Series SC5020 9,000 Mailbox Exchange 2016 Resiliency Storage Solution using 7.2K Drives

IBM System Storage DS3300 Storage System 1000 Mailbox Clustered Continuous Replication Microsoft Exchange 2007 Storage Solution

Dell PowerEdge R730xd 2,500 Mailbox Resiliency Microsoft Exchange 2013 Storage Solution. Tested with ESRP Storage Version 4.0 Tested Date: June 2015

Dell PowerEdge R720xd 6,000 Mailbox Resiliency Microsoft Exchange 2013 Storage Solution. Tested with ESRP Storage Version 4.0 Tested Date: Feb 2014

HPE StoreVirtual 3200 Storage 1000 Mailbox Resiliency Exchange 2016 Storage Solution

Dell Storage Center 6.6 SCv2000 SAS Front-end Arrays and 2,500 Mailbox Exchange 2013 Resiliency Storage Solution

HP MSA 2040 Array 750 Mailbox Resiliency Exchange 2013 Storage Solution

Microsoft Exchange Server 2010 workload optimization on the new IBM PureFlex System

Fujitsu PRIMEFLEX for VMware vsan 20,000 User Mailbox Exchange 2016 Mailbox Resiliency Storage Solution

Dell PowerEdge R720xd 12,000 Mailbox Resiliency Microsoft Exchange 2013 Storage Solution

EMC CLARiiON AX4-5i (2,000 User) Storage Solution for Microsoft Exchange Server 2007 SP1

This document contains information about the EMC DMX SRDF/A Storage Solution for Microsoft Exchange Server.

Dell PowerVault MD3820f 1,000 user Mailbox Exchange 2013 Resiliency Storage Solution Direct Attach FC using dual QLogic QLE Gb FC adapters

Dell PowerVault MD3820f 5,000 user Mailbox Exchange 2013 Resiliency Storage Solution Direct Attach FC using dual QLogic QLE Gb FC adapters

ESRP Storage Program EMC CLARiiON CX3-20c (500 User) Storage Solution for Microsoft Exchange Server

ESRP Storage Program EMC CLARiiON CX3-20c(1000 user) Storage Solution for Microsoft Exchange Server

Dell PowerVault MD3860f 20,000 user Mailbox Exchange 2013 Resiliency Storage Solution Direct Attach FC using dual QLogic QLE Gb FC adapters

Dell PowerEdge R720xd with PERC H710P: A Balanced Configuration for Microsoft Exchange 2010 Solutions

PS SERIES STORAGE ARRAYS 90,000-USER STORAGE SOLUTION FOR MICROSOFT EXCHANGE SERVER 2007

ESRP Storage Program EMC Celerra NS-120 (1,500 User) Storage Solution for Microsoft Exchange Server 2007 SP1

Microsoft ESRP 4.0. Dell MD3 Series storage solutions September 2015

ESRP Storage Program EMC Celerra NS40 (3,000 User) Storage Solution for Microsoft Exchange Server 2007 SP1

EMC VSPEX FOR VIRTUALIZED MICROSOFT EXCHANGE 2013 WITH MICROSOFT HYPER-V

ESRP Storage Program EMC Celerra NS20 (1,500 User) Storage Solution for Microsoft Exchange Server 2007

ESRP Storage Program EMC Celerra NS20 (700 User) Storage Solution for Microsoft Exchange Server 2007

Reference Architecture Microsoft Exchange 2013 on Dell PowerEdge R730xd 2500 Mailboxes

IBM System Storage DCS3700

half the remaining storage, 20 percent of total available storage, for log files.

Assessing performance in HP LeftHand SANs

ESRP Storage Program EMC Celerra NS20 (1,000 User) Storage Solution for Microsoft Exchange Server 2007

HP SAS benchmark performance tests

EMC Backup and Recovery for Microsoft Exchange 2007

Dell Exchange 2013 Reference Architecture for 500 to 20,000 Microsoft Users. 1 Overview. Reliable and affordable storage for your business

EMC VSPEX FOR VIRTUALIZED MICROSOFT EXCHANGE 2013 WITH HYPER-V

ESRP Storage Program EMC CLARiiON CX3-20c (1,400 User) iscsi with LCR Storage Solution for Microsoft Exchange Server 2007

ESRP Storage Program EMC CX-3-20 (900 User) iscsi Storage Solution for Microsoft Exchange Server 2007

ESRP Storage Program EMC CX-3-20 (700 User) iscsi Storage Solution for Microsoft Exchange Server 2007

JANUARY 2009 ESRP performance comparison: Solid-state drives vs. hard disk drives

IBM Storwize V7000 Unified

Veritas NetBackup on Cisco UCS S3260 Storage Server

ESRP Storage Program EMC CLARiiON CX3-20c (1,400 User) iscsi Storage Solution for Microsoft Exchange Server 2007

Lenovo Database Configuration

DELL EMC READY BUNDLE FOR MICROSOFT EXCHANGE

Dell EqualLogic PS 6210E Series 5,000-User Mailbox Resiliency Storage Solution for Microsoft Exchange Server 2013

IBM System Storage DS5020 Express

ESRP Storage Program EMC CX-3-20 (1000 User) iscsi Storage Solution for Microsoft Exchange Server 2007

Dell EMC Microsoft Exchange 2016 Solution

ESRP Storage Program EMC CX-3-20 (1300 User) iscsi Storage Solution for Microsoft Exchange Server 2007

ESRP Storage Program EMC CLARiiON CX3-20c (1,000 User) iscsi Storage Solution for Microsoft Exchange Server 2007

Dell Fluid Data solutions. Powerful self-optimized enterprise storage. Dell Compellent Storage Center: Designed for business results

ESRP Storage Program EMC CLARiiON CX3-20c (1,200 User) iscsi with LCR Storage Solution for Microsoft Exchange Server 2007

ESRP Storage Program EMC CLARiiON CX3-20c (1,300 User) iscsi Storage Solution for Microsoft Exchange Server 2007

Microsoft SQL Server in a VMware Environment on Dell PowerEdge R810 Servers and Dell EqualLogic Storage

ESRP Storage Program EMC CLARiiON CX3-20c (600 User) iscsi Storage Solution for Microsoft Exchange Server 2007

VSTOR Vault Mass Storage at its Best Reliable Mass Storage Solutions Easy to Use, Modular, Scalable, and Affordable

Microsoft SQL Server 2012 Fast Track Reference Configuration Using PowerEdge R720 and EqualLogic PS6110XV Arrays

IBM System Storage DS6800

Microsoft SQL Server 2012 Fast Track Reference Architecture Using PowerEdge R720 and Compellent SC8000

Estimate Mailbox Storage Capacity Requirements Estimate Mailbox I/O Requirements Determine Storage Type Choose Storage Solution Determine Number of

Demystifying Storage Area Networks. Michael Wells Microsoft Application Solutions Specialist EMC Corporation

Evaluation Report: Improving SQL Server Database Performance with Dot Hill AssuredSAN 4824 Flash Upgrades

Nové možnosti storage virtualizace s řešením IBM Storwize V7000

Deploy a High-Performance Database Solution: Cisco UCS B420 M4 Blade Server with Fusion iomemory PX600 Using Oracle Database 12c

A Comparative Study of Microsoft Exchange 2010 on Dell PowerEdge R720xd with Exchange 2007 on Dell PowerEdge R510

Storage Consolidation with the Dell PowerVault MD3000i iscsi Storage

EMC Virtual Infrastructure for Microsoft Exchange 2010 Enabled by EMC Symmetrix VMAX, VMware vsphere 4, and Replication Manager

Accelerating Microsoft SQL Server 2016 Performance With Dell EMC PowerEdge R740

Slide 0 Welcome to this Web Based Training session introducing the ETERNUS DX80 S2, DX90 S2, DX410 S2 and DX440 S2 storage systems from Fujitsu.

TECHNICAL SPECIFICATIONS

Dell Reference Configuration for Large Oracle Database Deployments on Dell EqualLogic Storage

Virtualized SQL Server Performance and Scaling on Dell EMC XC Series Web-Scale Hyper-converged Appliances Powered by Nutanix Software

Upgrade to Microsoft SQL Server 2016 with Dell EMC Infrastructure

Exchange 2010 Tested Solutions: 500 Mailboxes in a Single Site Running Hyper-V on Dell Servers

EMC CLARiiON CX3 Series FCP

Storage Update and Storage Best Practices for Microsoft Server Applications. Dennis Martin President, Demartek January 2009 Copyright 2009 Demartek

Vblock Architecture. Andrew Smallridge DC Technology Solutions Architect

Exchange Server 2007 Performance Comparison of the Dell PowerEdge 2950 and HP Proliant DL385 G2 Servers

White Paper. EonStor GS Family Best Practices Guide. Version: 1.1 Updated: Apr., 2018

IBM System Storage DS4800

Design a Remote-Office or Branch-Office Data Center with Cisco UCS Mini

ESRP Storage Program EMC CLARiiON CX3-20c (600 User) iscsi with LCR Storage Solution for Microsoft Exchange Server 2007

Dell PowerVault MD Family. Modular storage. The Dell PowerVault MD storage family

Performance Evaluation Using Network File System (NFS) v3 Protocol. Hitachi Data Systems

Virtualizing SQL Server 2008 Using EMC VNX Series and VMware vsphere 4.1. Reference Architecture

W H I T E P A P E R. Comparison of Storage Protocol Performance in VMware vsphere 4

HCI: Hyper-Converged Infrastructure

Key results at a glance:

Microsoft Office SharePoint Server 2007

Transcription:

IBM Storwize V5000 16,000 mailbox resiliency Microsoft Exchange 2013 storage solution IBM Systems and Technology Group ISV Enablement March 2014 Copyright IBM Corporation, 2014

Table of contents Abstract... 1 Disclaimer... 1 Features... 1 Solution description... 3 IBM Storwize V5000... 3 IBM Flex System... 4 IBM Flex System x240 Compute Node... 5 Solution overview and layout... 6 Targeted customer profile... 7 Test environment... 8 Simulated Exchange configuration... 8 Storage hardware... 8 Storage software... 9 Storage disk configuration (mailbox store and log disks)... 10 Best practices... 10 Storage mailbox resiliency... 10 Backup strategy... 11 Additional information... 11 Test result summary... 11 Reliability... 11 Storage performance results... 12 Database backup and recovery performance... 14 Database read-only performance... 14 Transaction log recovery / replay performance... 14 Conclusion... 14 Appendix - Test results... 15 Stress testing... 15 Performance testing... 21 Streaming backup testing... 29 Soft-recovery testing... 32 Resources... 39 Trademarks and special notices... 40

Abstract This paper describes a Microsoft Exchange Server 2013 high availability (HA) solution for 16,000 user mailboxes using the IBM Storwize V5000 as part of the Microsoft Exchange Solution Reviewed Program (ESRP). The ESRP was developed by Microsoft Corporation to provide a common testing framework for vendors to demonstrate their storage products performance characteristics when used with Microsoft Exchange Server. For more details about the storage-centric Microsoft ESRP, refer to the following website location: technet.microsoft.com/en-us/exchange/ff182054.aspx This Microsoft Exchange Server solution primarily focuses on database and log storage performance for the stated mailbox count and profile. It does not take into account all of the unique variables and space requirements present in many production messaging environments. For supplemental Microsoft Exchange solution and sizing guidance, refer to the TechNet content at the following website location: blogs.technet.com/b/exchange/archive/2013/05/06/ask-the-perf-guy-sizing-exchange-2013- deployments.aspx For additional storage-related questions or comments regarding this solution, visit the following website location: ibm.com/systems/storage/disk Disclaimer This paper has been produced independently of Microsoft Corporation. Microsoft Corporation expressly disclaims responsibility for, and makes no warranty, express or implied, with respect to, the accuracy of the contents of this paper. Refer to IBM disclaimer at the end of the paper. Features The solution achieves Microsoft Exchange 2013 mailbox resiliency by employing a single database availability group (DAG) spread across two sites. Each site maintains different IBM Storwize V5000 controllers and spindles that contain HA database copies hosted by separate servers for redundancy and failover. Notably, the solution includes two IBM Storwize V5000 systems with a total of eight servers. The Microsoft Exchange Jetstress 2013 testing actually simulates the additional workload of the secondary site and thereby requires only half of the total hardware located at the primary site. This is achieved mostly by doubling the server workloads or active databases during the Microsoft Exchange Jetstress testing. Thus, the test bed consists of a single Storwize V5000 system and four servers or compute nodes. Figure 1 illustrates the general design of the Microsoft Exchange DAG architecture. There are three HA database copies with the active and passive databases being evenly distributed across all of the servers in the DAG, with eight active databases and sixteen passive databases per server. The database copies benefit from network-based replication using the native Exchange 2010 DAG log shipping engine. Each server has 2000 active mailboxes, allowing for database or entire server failovers. 1

Figure 1: Microsoft Exchange Server 2013 DAG layout 2

Solution description The primary objective of this paper is to reveal the storage performance behavior for 16,000 Exchange 2013 mailboxes on the IBM Storwize V5000 system. This particular solution uses two Storwize V5000 systems, each with three expansion enclosures for a total of 96 disks. Two separate controllers and corresponding disks are required to provide DAG redundancy and failover capability. Each Storwize V5000 system can scale out considerably by attaching up to six expansion enclosures per storage controller or by using additional external virtualized storage. IBM Storwize V5000 As illustrated in Figure 2, IBM Storwize V5000 is an entry-level, mid-range storage system with an innovative design and advanced features offered at a truly competitive price. Within the IBM storage portfolio, the Storwize V5000 system is positioned between the proven IBM Storwize V7000 and Storwize V3700 systems, offering customers a powerful yet affordable alternative that is very reliable, conveniently scalable, and provides dependable performance. Small- to mid-size businesses can take advantage of this cost-effective, efficient, and simple storage system with built-in virtualization, consolidation, and solid-state drive (SSD) tiering capabilities all through a user-friendly management interface for both new and existing storage arrays. Based on the well-established virtualization technology of the predecessor IBM System Storage SAN Volume Controller (SVC), numerous IBM and third-party external storage systems can be readily virtualized by the Storwize V5000 system, extending the flexibility and longevity of existing data center assets. Remarkably, Storwize V5000 makes integration with a diverse spectrum of storage arrays painless, providing a single, native, Web Based Enterprise Management (WBEM) interface for internal and external storage. Upon examining the system as a whole, individual storage enclosures house up to twelve 3.5-inch drives or twenty-four 2.5-inch drives. Control enclosures contain drives, redundant dual-active intelligent Redundant Array of Independent Disks (RAID) controllers and dual-power supplies, batteries, and cooling components. Expansion enclosures contain drives, power supplies, and cooling components. The modular design allows attachment of up to six expansion enclosures for each control enclosure, enabling the system to scale up to 168 drives. Other components and characteristics of the system include: Disk drives Serial-attached SCSI (SAS) disk drives, nearline SAS disk drives, and solidstate drives (SSDs). Intermix of these drive types within RAID controller and storage expansion enclosures add flexibility. Efficient 2U rack-mountable modular design. Support for standard RAID levels 0, 1, 5, 6, and 10. One-way data migration to simplify implementation. Designed for easy customer setup and support, with flexible warranty and extended support options IBM Subsystem Device Driver Device Specific Module (SDDDSM) path failover driver Storage Management Initiative Specification (SMI-S) provider for industry-standard storage management and monitoring solutions Cache memory 16 GB cache memory (8 GB per internal RAID controller) as a base feature designed to improve performance and availability. 3

Host connectivity 8 Gbps Fibre Channel (FC), 6 Gbps SAS, or 1 Gbps iscsi. Advanced features including: thin provisioning, IBM System Storage Easy Tier automated tiering, nondisruptive data migration, replication, and IBM FlashCopy. Virtualize existing external storage arrays, and manage all of it from a single interface. Take advantage of the advanced features of Storwize V5000 with existing storage systems. Figure 2: Front and rear view of the tested IBM Storwize 5000 storage system For further information about the IBM Storwize V5000 system, visit the following website location: ibm.com/systems/storage/disk/storwize_v5000 IBM Flex System As illustrated in Figure 3, IBM Flex System is the latest (at the time of publishing this paper) IBM blade chassis evolution to offer a new high performance, double-dense design that can support the equivalent of up to 28 nodes per enterprise chassis that substantially reduces its data center footprint by lowering power, cooling, and operational costs. Information technology (IT) administrators have the flexibility to choose preferred chassis integrated technology elements (ITEs) from a wide assortment of priceoptimized yet powerful compute, storage, management, and network hardware resources. Consequently, organizations can easily custom-build very scalable, physical, or virtual infrastructures for demanding business-critical applications such as Microsoft Exchange Server 2013 and the infrastructures can be comfortably managed using the optional IBM Flex System Manager ITE. IBM Flex System Manager is designed to optimize the physical and virtual resources of the IBM Flex System infrastructure while simplifying and automating repetitive tasks. It provides easy system setup procedures with wizards and built-in expertise, and consolidated monitoring for compute, storage, networking, virtualization, and energy resources. In essence, IBM Flex System Manager provides core management functionality along with automation that allows organizations to minimize administrative expenses and focus efforts on business innovation. 4

IBM Flex System Manager provides a single-user graphical user interface (GUI) that controls the following features: Simplified setup Complete management integration Improved resource utilization Intelligent automation Resource pooling Figure 3: Front and rear view of the IBM Flex System Enterprise Chassis For further information about the IBM Flex System, visit the following website location: ibm.com/systems/pureflex/flex-converged-infrastructure.html IBM Flex System x240 Compute Node As one of the optional elements of the Flex System chassis, the IBM Flex System x240 Compute Node provides outstanding performance for popular business-critical applications. Its highly scalable and energy-efficient design supports up to 16 processor cores and 768 GB of memory capacity in a package that is easy to service and manage. Moreover, with outstanding computing power per watt and the latest Intel Xeon processors, data centers can reduce costs without sacrificing infrastructure speed and availability. Basically, to meet today s complex and ever-changing business demands, the x240 compute node as illustrated in Figure 4, provides the following highlights and comes equipped with numerous notable features that decidedly power a wide variety of workloads, including Microsoft Exchange Server. Optimized for virtualization, performance, and highly scalable networking Embedded IBM Virtual Fabric allows I/O flexibility Designed for simplified deployment and management Intel Xeon processor E5-2600 v2 product family 24 DDR3 / DDR3L LP, 768 GB maximum with 32 GB LRDIMM Automated power management with onboard sensors 5

Two 2.5-inch hot-swap disk slots Integrated system management Integrated RAID-0, -1 or optional ServeRAID M5115 (RAID-0, -1, -5, -6, -10, -50) Optional hypervisor Two Mezzanine Cards (x16 + x8 PCI Express 3.0) Dual integrated 10 GbE Figure 4: Front view of the IBM Flex System x240 Compute Node For further information about the IBM Flex System x240 Compute Node, visit the following website location: ibm.com/systems/flex/compute-node/x86/bto/x240/ Solution overview and layout While consisting of the latest IBM Flex System technologies, this solution focuses on the performance of the IBM Storwize V5000 internal disks. The system is based on the well-established virtualization technology of IBM SVC and the innovative Storwize V7000 architecture, running the same software and graphical management interface. The system uses RAID arrays called managed disks (MDisks) created from either the Storwize V5000 internal drives or external attached storage systems. The MDisk arrays are then placed in storage pools. The pools are where the virtualization takes place by creating extents to help define the volumes. Furthermore, data and workload isolation can be attained by placing MDisks in separate storage pools so that the individual pool volumes reside on different physical spindles. This allows Microsoft Exchange administrators the flexibility to use separate database and log pools based on workload I/O profiles while still providing different RAID-level protection. In this solution, because it takes advantage of Exchange 2013 DAGs, the database and log files can be placed on the same physical spindles, within the same storage pool. 6

The following table outlines the MDisk, storage pool, and volume layout used in this solution. Jetstress test virtualization layout Total internal MDisks 8 Total storage pools Virtual extent size 4 (one for each server) 1 GB (default) Physical disks per pool 16 MDisks per storage pool 2 (eight-disk RAID 5 arrays) Volumes 16 (4 per storage pool) Table 1: Test virtualization layout The Microsoft ESRP focuses on storage solution testing to address performance and reliability issues with storage design. However, storage is not the only factor to take into consideration when designing an Exchange vertical scaling solution. Other factors that affect the server scalability are: server processor utilization, server physical and virtual memory limitations, resource requirements for other applications, directory and network service latencies, network infrastructure limitations, replication and recovery requirements, and client usage profiles. All these factors are beyond the scope of the Microsoft ESRP. Therefore, the number of mailboxes hosted per server as part of the tested configuration might not necessarily be viable for some customer deployments. For more information on identifying and addressing performance issues in an Exchange system, refer to Troubleshooting Microsoft Exchange Server Performance, available at the following Microsoft website: go.microsoft.com/fwlink/?linkid=23454 Targeted customer profile The IBM Storwize V5000 system targets small- to mid-range customers, with the ability to scale out as their business grows. The targeted profile for this solution includes: Eight Microsoft Exchange Server 2013 compute nodes Two identical IBM Storwize V5000 systems 16,000 mailboxes 0.07 input/output operations per second (IOPS) per user mailbox (0.09 tested for growth) 1000 MB mailbox size Background database maintenance, enabled during all Jetstress tests DAG mailbox resiliency providing high availability and primary data protection 7

Test environment Table 2 summarizes the Jetstress testing environment: Simulated Exchange configuration Number of Exchange mailboxes simulated 16,000 Number of DAGs 1 Number of servers/dag 8 Number of active mailboxes/server 2000 Number of databases/host 16 Number of copies/database 3 Number of mailboxes/database 250 Simulated profile: I/O per second per mailbox (IOPS, include 20% headroom) Database logical unit number (LUN) size Log LUN size 0.07 (0.09 tested) 1.27 TB (4 DB per LUN) Logs on DB volumes Total database size for performance testing 15.27 TB (244.1 GB x 64) Percentage of storage capacity used by the 75.7% Exchange database Table 2: Simulated Exchange configuration Storage hardware Storage connectivity (Fiber Channel, SAS, Serial Advanced Technology Attachment (SATA), iscsi) Storage model and OS / firmware revision Storage cache Fibre Channel IBM Storwize V5000 Version 7.2.0.1 Microsoft Windows Server Catalog link: http://www.windowsservercatalog.com/item.aspx?iditem=ddf62561-8ab6-683c-04cd-eb224c972189&bcatid=1282 16 GB (8 GB per controller canister) Number of storage controllers 2 Number of storage ports Maximum bandwidth of storage connectivity to host Switch type/model/firmware revision Eight 8 Gb FC ports, four 6 Gb SAS, four iscsi 16 Gb (two 8 Gb FC) IBM Flex System FC5022 24-port 16Gb ESB SAN Scalable Switch, FW 7.0.0_pha4 Host bus adapter (HBA) model and IBM Flex System FC5022 2-Port 16Gb FC Adapter, FW 3.2.1.1 8

firmware Number of HBAs/host Host server type Total number of disks tested in solution Maximum number of spindles that can be hosted in the storage 1 dual-port mezzanine card IBM Flex System x240, dual Intel Xeon E5-2690 2.90 Ghz processors, 128 GB RAM 96 168 (seven 24 disk enclosures) Table 3: Storage hardware Storage software HBA driver Brocade 3.2.1.1 x64 FC driver for Windows Server 2012 HBA QueueTarget setting N/A HBA QueueDepth setting 100 Multipathing IBM SDDDSM v. 2.4.3.4-4 Load balanced, fault tolerant, multipath I/O (MPIO) Host OS Microsoft Windows Server 2012 standard ESE.dll file version 15.0.516.26 Replication solution name/version N/A Table 4: Storage software 9

Storage disk configuration (mailbox store and log disks) Disk type, speed, and firmware revision Raw capacity per disk (GB) Number of physical disks in test 96 Total raw storage capacity (GB) Disk slice size (GB) Number of disks per LUN Raid level Total formatted capacity SAS, 10 k, firmware level J2E9 558 GB (600 GB) 52.35 TB (before RAID) N/A Four virtual average (eight disks per MDisk) RAID 5, storage level 20.32 TB Storage capacity utilization 38.82% Database capacity utilization 29.2% Table 5: Storage disk configuration Best practices Microsoft Exchange Server is a disk-intensive application. Based on the tests run using the ESRP framework, the test team recommends the following reference to improve the storage performance. For Exchange 2013 best practices on storage design, visit: technet.microsoft.com/en-us/library/ee832792%28v=exchg.150%29.aspx Storage mailbox resiliency Use the following guidelines to optimize the Exchange 2013 environment for IBM Storwize V5000. 1. Format the volumes at 64 KB allocation unit size, as recommended by Microsoft. 2. Even though Microsoft storage guidance for Exchange 2013 suggests a maximum of seven disks per array group, the IBM Storwize is performance optimized for eight disk array groups, as used in this solution. 3. Isolate the Exchange Server database and the log files from other disk-intensive application workloads to avoid performance conflicts. During testing, the storage subsystems were dedicated to Exchange Server. Sharing the storage with other applications might negatively impact Exchange I/O performance. 4. It is now optional with DAGs to isolate the Exchange database and log disk I/O on separate, physical disk arrays. Isolation allows separate log and database array tuning, such as RAID or disk types. With Storwize V5000, LUNs can be separated physically by using separate storage pools. This solution kept the database and logs on the same physical spindles in the same storage pool. 5. The Storwize V5000 system can use external virtualized storage, which are external storage systems connected to Storwize V5000, similar to SAN Volume Controller. This is an optional premium feature. In this configuration, do not assign different external storage controllers to the same storage pool. Each external controller must have its own storage pools. 10

6. For most Exchange 2013 environments, it is now recommended to use hardware level RAID 5 for databases and RAID 5 or 10 for the logs. RAID 5 for databases also provides better space utilization when using larger mailboxes (1 GB plus), provided there is an adequate number of spindles to meet the I/O requirements. 7. Enable caching on Storwize V5000 when creating the volumes. Note that the cache option is either read/write combined or none, and is enabled by default. 8. The recommended disk stripe size for Exchange 2013 is 256 KB (or larger). The default stripe size on Storwize V5000 is 256 KB, which was used for this testing. 9. Use single-initiator zoning when configuring the FC switch zones. Each server HBA port is zoned to two Storwize V5000 ports one port per controller. 10. Troubleshooting performance on Storwize V5000 can be performed using its native monitoring features, storage area networking (SAN) switch or HBA monitoring features, and popular tools such as Microsoft Windows Performance Monitor. These tools can help determine the location where the heaviest disk I/O reads and writes are occurring, and the data transfer rates. Assuming all storage components are functioning and configured correctly, most Exchange Server 2013 storage latency issues are caused by an insufficient number of disks for the I/O load. 11. The number of IOPS hitting a given drive can be measured using the Performance Monitor Logical Disk object and Disk Transfers/sec counter. Add the data from all database volumes to find the total IOPS being generated. 12. The average disk latency should be less than 20 milliseconds (ms), with the maximum value no higher than 100 ms. Disk latency can be measured using the Performance Monitor Logical Disk object, Avg Disk sec/read. Backup strategy The solution does not include a backup strategy. Additional information It is recommended to visit the following URL for additional information and support resources: ibm.com/systems/storage/disk Test result summary This section provides a high-level summary of the test data from ESRP and links to the detailed HTML reports that are generated by the ESRP testing framework. The cross reference links can be clicked in the following section to view the HTML report for each test category. Reliability To get a better picture of reliability and to tax the storage system, a number of tests in the framework are required to run for 24 hours. This verifies the storage can handle high I/O load for a longer period of time. Both log and database files are analyzed for integrity after the shorter performance or longer stress tests to ensure no database or log corruption. 11

The following list provides an overview. (Click the underlined words to view the HTML report after the reliability tests run). There were no errors reported in the saved event log file. There were no errors reported during the database and log checksum process. Storage performance results The primary storage performance testing is designed to exercise the storage with maximum sustainable Exchange type of I/O for 2 hours. The test is to show how long it takes for the storage to respond to an I/O under load. The following data is the sum of all of the logical disk I/O and average of all the logical disks I/O latency in the two-hour test. Each server is listed separately and the aggregate numbers across all servers are listed. Individual server metrics: This section includes the sum of I/O and the average latency across all the databases on a per server basis. Server 1 (cn02) Database I/O Database disks transfers/sec 606 Database disks reads/sec 433 Database disks writes/sec 173 Average database disk read latency (ms) 6.54 Average database disk write latency (ms) 1.26 Transaction log I/O Log disks writes/sec 123.6 Average log disk write latency (ms) 0.42 Server 2 (cn03) Database I/O Database disks transfers/sec 606 Database disks reads/sec 433 Database disks writes/sec 173 Average database disk read latency (ms) 6.53 Average database disk write latency (ms) 1.26 Transaction log I/O Log disks writes/sec 124.0 Average log disk write latency (ms) 0.43 12

Server 3 (cn04) Database I/O Database disks transfers/sec 606 Database disks reads/sec 433 Database disks writes/sec 173 Average database disk read latency (ms) 6.54 Average database disk write latency (ms) 1.23 Transaction log I/O Log disks writes/sec 123.6 Average log disk write latency (ms) 0.42 Server 4 (cn05) Database I/O Database disks transfers/sec 604 Database disks reads/sec 432 Database disks writes/sec 172 Average database disk read latency (ms) 6.55 Average database disk write latency (ms) 1.23 Transaction log I/O Log disks writes/sec 122.52 Average log disk write latency (ms) 0.42 Aggregate performance across all servers: This section includes the sum of I/O and the average latency across all servers in the solution. Database I/O Database disks transfers/sec 2422 Database disks reads/sec 1731 Database disks writes/sec 691 Average database disk read latency (ms) 6.54 Average database disk write latency (ms) 1.25 Transaction log I/O Log disks writes/sec 493.72 Average log disk write latency (ms) 0.42 13

Database backup and recovery performance There are two test reports in this section. The first one is to measure the sequential read rate of the database files and the second is to measure the recovery or replay performance (playing transaction logs into the database). Database read-only performance This test is to measure the maximum rate at which databases can be backed up using Volume Shadow Copy Service (VSS). The following table shows the average rate for a single database file. MB read/sec per database 69.38 MB read/sec total per server 1110.01 Transaction log recovery / replay performance This test is to measure the maximum rate at which the log files can be played against the databases. The following table shows the average rate for 507 log files played in a single database. Each log file is 1 MB in size. Average time to play one log file (sec) 2.65 Conclusion The IBM Storwize V5000 storage system easily meets business-critical email requirements for 16,000 Microsoft Exchange Server 2013 mailbox users. The Microsoft Exchange Jetstress 2013 performance and stress test results plainly exceed the target IOPS and keep well within the Microsoft Exchange latency requirements. With further IBM Storwize V5000 storage scalability and flexibility, there is ample headroom for more demanding and rapidly growing Microsoft Exchange organizations. Also part of the IBM SVC code family, many advanced storage features are available and easily managed all within one of the industry s most user-friendly web-based interfaces. This paper is developed by storage solution providers, and reviewed by the Microsoft Exchange Product team. The test results and data presented in this paper are based on the tests introduced in the ESRP test framework version 4.0. Customers cannot quote the data directly for their predeployment verification. It is still necessary to go through the exercises to validate the storage design for any specific customer environment. The ESRP program is not designed to be a benchmarking program; tests are not designed for getting the maximum throughput from a given solution. Rather, it is focused on producing recommendations from vendors for the Exchange application. So the data presented in this paper must not be used for direct comparisons among the solutions. 14

Appendix - Test results This section includes Microsoft Exchange Jetstress 2013 summary reports for stress, performance, streaming backup and soft recovery tests. All of the server test results were reviewed by Microsoft, and experienced similar performance. Since the test results for all hosts were similar, only one is provided below. Stress testing Microsoft Exchange Jetstress 2013 Stress test result report Test summary Overall Test Result Pass Machine Name CN02 Test Description 4000 user mbx, 1000 MB mbx size,.09 IOPS mbx, 6 threads Test Start Time 2/17/2014 1:21:01 PM Test End Time 2/18/2014 1:43:28 PM Collection Start Time 2/17/2014 1:34:00 PM Collection End Time 2/18/2014 1:34:00 PM Jetstress Version 15.00.0775.000 ESE Version 15.00.0516.026 Operating System Windows Server 2012 Standard Evaluation (6.2.9200.0) Performance Log C:\Program Files\Exchange Jetstress\Stress_2014_2_17_13_22_14.blg Database sizing and throughput Achieved Transactional I/O per Second 459.322 Target Transactional I/O per Second 360 Initial Database Size (bytes) 4223631622144 Final Database Size (bytes) 4240392060928 Database Files (Count) 16 Jetstress system parameters Thread Count 6 Minimum Database Cache 512.0 MB Maximum Database Cache 4096.0 MB Insert Operations 40% Delete Operations 20% Replace Operations 5% Read Operations 35% Lazy Commits 70% Run Background Database Maintenance True Number of Copies per Database 3 15

Database configuration 1292.1 Log path: W:\1 Database: W:\1\Jetstress001001.edb 1292.2 Log path: W:\2 Database: W:\2\Jetstress002001.edb 1292.3 Log path: W:\3 Database: W:\3\Jetstress003001.edb 1292.4 Log path: W:\4 Database: W:\4\Jetstress004001.edb 1292.5 Log path: X:\5 Database: X:\5\Jetstress005001.edb 1292.6 Log path: X:\6 Database: X:\6\Jetstress006001.edb 1292.7 Log path: X:\7 Database: X:\7\Jetstress007001.edb 1292.8 Log path: X:\8 Database: X:\8\Jetstress008001.edb 1292.9 Log path: Y:\9 Database: Y:\9\Jetstress009001.edb 1292.10 Log path: Y:\10 Database: Y:\10\Jetstress010001.edb 1292.11 Log path: Y:\11 Database: Y:\11\Jetstress011001.edb 1292.12 Log path: Y:\12 Database: Y:\12\Jetstress012001.edb 1292.13 Log path: Z:\13 Database: Z:\13\Jetstress013001.edb 1292.14 Log path: Z:\14 Database: Z:\14\Jetstress014001.edb 1292.15 Log path: Z:\15 Database: Z:\15\Jetstress015001.edb 1292.16 Log path: Z:\16 Database: Z:\16\Jetstress016001.edb 16

MSExchange Database ==> s I/O Database Reads Average Latency (msec) I/O Database Writes Average Latency (msec) I/O Database Reads/sec I/O Database Writes/sec I/O Database Reads Average Bytes I/O Database Writes Average Bytes I/O Log Reads Average Latency (msec) I/O Log Writes Average Latency (msec) I/O Log Reads/sec I/O Log Writes/sec I/O Log Reads Average Bytes I/O Log Writes Average Bytes Transactional I/O performance 1292.1 1292.2 1292.3 1292.4 1292.5 1292.6 1292.7 1292.8 1292.9 1292.10 1292.11 1292.12 1292.13 1292.14 1292.15 1292.16 7.084 0.703 17.903 10.812 33944.533 36291.363 0.000 0.423 0.000 7.720 0.000 8056.210 6.828 0.705 17.923 10.853 33956.438 36269.805 0.000 0.426 0.000 7.709 0.000 8073.660 6.639 0.715 17.926 10.848 33954.925 36293.278 0.000 0.423 0.000 7.710 0.000 8054.687 6.504 0.708 17.864 10.798 34009.679 36339.976 0.000 0.423 0.000 7.717 0.000 8085.817 6.354 1.131 17.884 10.842 33959.695 36309.049 0.000 0.417 0.000 7.758 0.000 8093.500 6.283 1.114 17.908 10.819 33957.981 36269.691 0.000 0.419 0.000 7.727 0.000 8057.775 6.240 1.112 17.874 10.827 33978.746 36299.222 0.000 0.418 0.000 7.772 0.000 8051.509 6.232 1.093 17.875 10.790 33981.781 36288.781 0.000 0.418 0.000 7.719 0.000 8061.575 6.254 1.469 17.933 10.888 33962.983 36333.509 0.000 0.436 0.000 7.767 0.000 8023.701 6.252 1.445 17.848 10.780 33934.684 36323.555 0.000 0.433 0.000 7.716 0.000 8070.797 6.275 1.436 17.879 10.805 33959.933 36321.391 0.000 0.437 0.000 7.706 0.000 8081.858 6.331 1.422 17.878 10.818 33987.983 36329.725 0.000 0.434 0.000 7.717 0.000 8094.294 6.609 1.803 17.923 10.862 33974.256 36282.960 0.000 0.406 0.000 7.743 0.000 8076.874 6.715 1.798 17.866 10.819 33967.142 36329.470 0.000 0.408 0.000 7.752 0.000 8055.356 6.866 1.783 17.845 10.741 33937.932 36328.731 0.000 0.407 0.000 7.699 0.000 8048.482 7.134 1.795 17.903 10.788 33954.291 36305.705 0.000 0.412 0.000 7.682 0.000 8067.383 17

Background database maintenance I/O performance MSExchange Database ==> s Database Maintenance IO Reads/sec Database Maintenance IO Reads Average Bytes 1292.1 9.169 260517.796 1292.2 9.168 260541.191 1292.3 9.167 260595.886 1292.4 9.168 260548.109 1292.5 9.168 260564.641 1292.6 9.169 260532.445 1292.7 9.168 260562.523 1292.8 9.167 260554.993 1292.9 9.167 260576.692 1292.10 9.166 260622.850 1292.11 9.168 260568.261 1292.12 9.167 260595.941 1292.13 9.168 260554.910 1292.14 9.166 260626.432 1292.15 9.167 260581.793 1292.16 9.167 260589.240 Log replication I/O performance MSExchange Database ==> s I/O Log Reads/sec I/O Log Reads Average Bytes 1292.1 0.354 69052.965 1292.2 0.355 69145.084 1292.3 0.354 69103.676 1292.4 0.356 69557.406 1292.5 0.358 69949.588 1292.6 0.355 69256.406 1292.7 0.356 69513.385 1292.8 0.355 69265.083 1292.9 0.354 69023.244 1292.10 0.356 69462.437 1292.11 0.355 69275.146 1292.12 0.357 69658.903 1292.13 0.356 69529.742 1292.14 0.357 69549.289 1292.15 0.354 69027.432 1292.16 0.353 68898.380 18

MSExchange Database ==> s I/O Database Reads Average Latency (msec) I/O Database Writes Average Latency (msec) I/O Database Reads/sec I/O Database Writes/sec I/O Database Reads Average Bytes I/O Database Writes Average Bytes I/O Log Reads Average Latency (msec) I/O Log Writes Average Latency (msec) I/O Log Reads/sec I/O Log Writes/sec I/O Log Reads Average Bytes I/O Log Writes Average Bytes Total I/O performance 1292.1 1292.2 1292.3 1292.4 1292.5 1292.6 1292.7 1292.8 1292.9 1292.10 1292.11 1292.12 1292.13 1292.14 1292.15 1292.16 7.084 0.703 27.072 10.812 110683.683 36291.363 0.380 0.423 0.354 7.720 69052.965 8056.210 6.828 0.705 27.091 10.853 110636.818 36269.805 0.369 0.426 0.355 7.709 69145.084 8073.660 6.639 0.715 27.093 10.848 110638.642 36293.278 0.376 0.423 0.354 7.710 69103.676 8054.687 6.504 0.708 27.033 10.798 110840.686 36339.976 0.368 0.423 0.356 7.717 69557.406 8085.817 6.354 1.131 27.052 10.842 110753.692 36309.049 0.457 0.417 0.358 7.758 69949.588 8093.500 6.283 1.114 27.077 10.819 110678.546 36269.691 0.450 0.419 0.355 7.727 69256.406 8057.775 6.240 1.112 27.042 10.827 110794.334 36299.222 0.463 0.418 0.356 7.772 69513.385 8051.509 6.232 1.093 27.042 10.790 110790.007 36288.781 0.454 0.418 0.355 7.719 69265.083 8061.575 6.254 1.469 27.100 10.888 110621.366 36333.509 0.462 0.436 0.354 7.767 69023.244 8023.701 6.252 1.445 27.014 10.780 110850.762 36323.555 0.451 0.433 0.356 7.716 69462.437 8070.797 6.275 1.436 27.046 10.805 110772.424 36321.391 0.445 0.437 0.355 7.706 69275.146 8081.858 6.331 1.422 27.045 10.818 110796.185 36329.725 0.456 0.434 0.357 7.717 69658.903 8094.294 6.609 1.803 27.091 10.862 110651.373 36282.960 0.425 0.406 0.356 7.743 69529.742 8076.874 6.715 1.798 27.031 10.819 110821.232 36329.470 0.428 0.408 0.357 7.752 69549.289 8055.356 6.866 1.783 27.012 10.741 110854.145 36328.731 0.431 0.407 0.354 7.699 69027.432 8048.482 7.134 1.795 27.070 10.788 110699.371 36305.705 0.430 0.412 0.353 7.682 68898.380 8067.383 19

Host system performance Counter Average Minimum Maximum % Processor Time 0.344 0.000 1.866 Available MBytes 120722.507 120677.000 121186.000 Free System Page Table Entries 33555779.427 33555765.000 33555865.000 Transition Pages RePurposed/sec 0.000 0.000 0.000 Pool Nonpaged Bytes 123101718.789 121458688.000 123744256.000 Pool Paged Bytes 89155176.831 86466560.000 94322688.000 Database Page Fault Stalls/sec 0.000 0.000 0.000 Test Log 2/17/2014 1:21:01 PM -- Preparing for testing... 2/17/2014 1:21:56 PM -- Attaching databases... 2/17/2014 1:21:56 PM -- Preparations for testing are complete. 2/17/2014 1:21:56 PM -- Starting transaction dispatch.. 2/17/2014 1:21:56 PM -- Database cache settings: (minimum: 512.0 MB, maximum: 4.0 GB) 2/17/2014 1:21:56 PM -- Database flush thresholds: (start: 40.9 MB, stop: 81.9 MB) 2/17/2014 1:22:14 PM -- Database read latency thresholds: (average: 20 msec/read, maximum: 200 msec/read). 2/17/2014 1:22:14 PM -- Log write latency thresholds: (average: 10 msec/write, maximum: 200 msec/write). 2/17/2014 1:22:16 PM -- Operation mix: Sessions 6, Inserts 40%, Deletes 20%, Replaces 5%, Reads 35%, Lazy Commits 70%. 2/17/2014 1:22:16 PM -- Performance logging started (interval: 15000 ms). 2/17/2014 1:22:16 PM -- Attaining prerequisites: 2/17/2014 1:34:00 PM -- \MSExchange Database(JetstressWin)\Database Cache Size, Last: 3868475000.0 (lower bound: 3865470000.0, upper bound: none) 2/18/2014 1:34:00 PM -- Performance logging has ended. 2/18/2014 1:43:00 PM -- JetInterop batch transaction stats: 74557, 74557, 74557, 74557, 74557, 74557, 74557, 74557, 74557, 74557, 74557, 74557, 74556, 74556, 74556 and 74556. 2/18/2014 1:43:00 PM -- Dispatching transactions ends. 2/18/2014 1:43:00 PM -- Shutting down databases... 2/18/2014 1:43:28 PM -- 1292.1 (complete), 1292.2 (complete), 1292.3 (complete), 1292.4 (complete), 1292.5 (complete), 1292.6 (complete), 1292.7 (complete), 1292.8 (complete), 1292.9 (complete), 1292.10 (complete), 1292.11 (complete), 1292.12 (complete), 1292.13 (complete), 1292.14 (complete), 1292.15 (complete) and 1292.16 (complete) 2/18/2014 1:43:28 PM -- C:\Program Files\Exchange Jetstress\Stress_2014_2_17_13_22_14.blg has 5775 samples. 2/18/2014 1:43:29 PM -- Creating test report... 2/18/2014 1:44:51 PM -- 1292.1 has 7.1 for I/O Database Reads Average Latency. 2/18/2014 1:44:51 PM -- 1292.1 has 0.4 for I/O Log Writes Average Latency. 2/18/2014 1:44:51 PM -- 1292.1 has 0.4 for I/O Log Reads Average Latency. 2/18/2014 1:44:51 PM -- 1292.2 has 6.8 for I/O Database Reads Average Latency. 2/18/2014 1:44:51 PM -- 1292.2 has 0.4 for I/O Log Writes Average Latency. 2/18/2014 1:44:51 PM -- 1292.2 has 0.4 for I/O Log Reads Average Latency. 2/18/2014 1:44:51 PM -- 1292.3 has 6.6 for I/O Database Reads Average Latency. 2/18/2014 1:44:51 PM -- 1292.3 has 0.4 for I/O Log Writes Average Latency. 2/18/2014 1:44:51 PM -- 1292.3 has 0.4 for I/O Log Reads Average Latency. 2/18/2014 1:44:51 PM -- 1292.4 has 6.5 for I/O Database Reads Average Latency. 2/18/2014 1:44:51 PM -- 1292.4 has 0.4 for I/O Log Writes Average Latency. 2/18/2014 1:44:51 PM -- 1292.4 has 0.4 for I/O Log Reads Average Latency. 2/18/2014 1:44:51 PM -- 1292.5 has 6.4 for I/O Database Reads Average Latency. 2/18/2014 1:44:51 PM -- 1292.5 has 0.4 for I/O Log Writes Average Latency. 2/18/2014 1:44:51 PM -- 1292.5 has 0.4 for I/O Log Reads Average Latency. 2/18/2014 1:44:51 PM -- 1292.6 has 6.3 for I/O Database Reads Average Latency. 2/18/2014 1:44:51 PM -- 1292.6 has 0.4 for I/O Log Writes Average Latency. 2/18/2014 1:44:51 PM -- 1292.6 has 0.4 for I/O Log Reads Average Latency. 20

2/18/2014 1:44:51 PM -- 1292.7 has 6.2 for I/O Database Reads Average Latency. 2/18/2014 1:44:51 PM -- 1292.7 has 0.4 for I/O Log Writes Average Latency. 2/18/2014 1:44:51 PM -- 1292.7 has 0.4 for I/O Log Reads Average Latency. 2/18/2014 1:44:52 PM -- 1292.8 has 6.2 for I/O Database Reads Average Latency. 2/18/2014 1:44:52 PM -- 1292.8 has 0.4 for I/O Log Writes Average Latency. 2/18/2014 1:44:52 PM -- 1292.8 has 0.4 for I/O Log Reads Average Latency. 2/18/2014 1:44:52 PM -- 1292.9 has 6.3 for I/O Database Reads Average Latency. 2/18/2014 1:44:52 PM -- 1292.9 has 0.4 for I/O Log Writes Average Latency. 2/18/2014 1:44:52 PM -- 1292.9 has 0.4 for I/O Log Reads Average Latency. 2/18/2014 1:44:52 PM -- 1292.10 has 6.3 for I/O Database Reads Average Latency. 2/18/2014 1:44:52 PM -- 1292.10 has 0.4 for I/O Log Writes Average Latency. 2/18/2014 1:44:52 PM -- 1292.10 has 0.4 for I/O Log Reads Average Latency. 2/18/2014 1:44:52 PM -- 1292.11 has 6.3 for I/O Database Reads Average Latency. 2/18/2014 1:44:52 PM -- 1292.11 has 0.4 for I/O Log Writes Average Latency. 2/18/2014 1:44:52 PM -- 1292.11 has 0.4 for I/O Log Reads Average Latency. 2/18/2014 1:44:52 PM -- 1292.12 has 6.3 for I/O Database Reads Average Latency. 2/18/2014 1:44:52 PM -- 1292.12 has 0.4 for I/O Log Writes Average Latency. 2/18/2014 1:44:52 PM -- 1292.12 has 0.4 for I/O Log Reads Average Latency. 2/18/2014 1:44:52 PM -- 1292.13 has 6.6 for I/O Database Reads Average Latency. 2/18/2014 1:44:52 PM -- 1292.13 has 0.4 for I/O Log Writes Average Latency. 2/18/2014 1:44:52 PM -- 1292.13 has 0.4 for I/O Log Reads Average Latency. 2/18/2014 1:44:52 PM -- 1292.14 has 6.7 for I/O Database Reads Average Latency. 2/18/2014 1:44:52 PM -- 1292.14 has 0.4 for I/O Log Writes Average Latency. 2/18/2014 1:44:52 PM -- 1292.14 has 0.4 for I/O Log Reads Average Latency. 2/18/2014 1:44:52 PM -- 1292.15 has 6.9 for I/O Database Reads Average Latency. 2/18/2014 1:44:52 PM -- 1292.15 has 0.4 for I/O Log Writes Average Latency. 2/18/2014 1:44:52 PM -- 1292.15 has 0.4 for I/O Log Reads Average Latency. 2/18/2014 1:44:52 PM -- 1292.16 has 7.1 for I/O Database Reads Average Latency. 2/18/2014 1:44:52 PM -- 1292.16 has 0.4 for I/O Log Writes Average Latency. 2/18/2014 1:44:52 PM -- 1292.16 has 0.4 for I/O Log Reads Average Latency. 2/18/2014 1:44:52 PM -- Test has 0 Maximum Database Page Fault Stalls/sec. 2/18/2014 1:44:52 PM -- The test has 0 Database Page Fault Stalls/sec samples higher than 0. 2/18/2014 1:44:52 PM -- C:\Program Files\Exchange Jetstress\Stress_2014_2_17_13_22_14.xml has 5728 samples queried. Performance testing Microsoft Exchange Jetstress 2013 Performance test result report Test summary Overall Test Result Pass Machine Name CN02 Test Description 4000 user mbx, 1000 MB mbx size,.09 IOPS mbx, 6 threads Test Start Time 2/18/2014 3:16:32 PM Test End Time 2/18/2014 6:14:50 PM Collection Start Time 2/18/2014 3:28:47 PM Collection End Time 2/18/2014 5:28:37 PM Jetstress Version 15.00.0775.000 ESE Version 15.00.0516.026 Operating System Windows Server 2012 Standard Evaluation (6.2.9200.0) Performance Log C:\Program Files\Exchange Jetstress\Performance_2014_2_18_15_17_6.blg 21

Database sizing and throughput Achieved Transactional I/O per Second 459.068 Target Transactional I/O per Second 360 Initial Database Size (bytes) 4240392060928 Final Database Size (bytes) 4242405326848 Database Files (Count) 16 Jetstress system parameters Thread Count 6 Minimum Database Cache 512.0 MB Maximum Database Cache 4096.0 MB Insert Operations 40% Delete Operations 20% Replace Operations 5% Read Operations 35% Lazy Commits 70% Run Background Database Maintenance True Number of Copies per Database 3 22

Database configuration 3288.1 Log path: W:\1 Database: W:\1\Jetstress001001.edb 3288.2 Log path: W:\2 Database: W:\2\Jetstress002001.edb 3288.3 Log path: W:\3 Database: W:\3\Jetstress003001.edb 3288.4 Log path: W:\4 Database: W:\4\Jetstress004001.edb 3288.5 Log path: X:\5 Database: X:\5\Jetstress005001.edb 3288.6 Log path: X:\6 Database: X:\6\Jetstress006001.edb 3288.7 Log path: X:\7 Database: X:\7\Jetstress007001.edb 3288.8 Log path: X:\8 Database: X:\8\Jetstress008001.edb 3288.9 Log path: Y:\9 Database: Y:\9\Jetstress009001.edb 3288.10 Log path: Y:\10 Database: Y:\10\Jetstress010001.edb 3288.11 Log path: Y:\11 Database: Y:\11\Jetstress011001.edb 3288.12 Log path: Y:\12 Database: Y:\12\Jetstress012001.edb 3288.13 Log path: Z:\13 Database: Z:\13\Jetstress013001.edb 3288.14 Log path: Z:\14 Database: Z:\14\Jetstress014001.edb 3288.15 Log path: Z:\15 Database: Z:\15\Jetstress015001.edb 3288.16 Log path: Z:\16 Database: Z:\16\Jetstress016001.edb 23

MSExchange Database ==> s I/O Database Reads Average Latency (msec) I/O Database Writes Average Latency (msec) I/O Database Reads/sec I/O Database Writes/sec I/O Database Reads Average Bytes I/O Database Writes Average Bytes I/O Log Reads Average Latency (msec) I/O Log Writes Average Latency (msec) I/O Log Reads/sec I/O Log Writes/sec I/O Log Reads Average Bytes I/O Log Writes Average Bytes Transactional I/O performance 3288.1 3288.2 3288.3 3288.4 3288.5 3288.6 3288.7 3288.8 3288.9 3288.10 3288.11 3288.12 3288.13 3288.14 3288.15 3288.16 7.031 0.687 17.842 10.669 33943.795 36154.608 0.000 0.426 0.000 7.675 0.000 8031.209 6.790 0.699 17.840 10.675 34019.479 36090.964 0.000 0.432 0.000 7.602 0.000 8163.077 6.611 0.705 17.832 10.787 34040.479 36080.319 0.000 0.422 0.000 7.778 0.000 7975.474 6.515 0.695 17.933 10.904 33876.547 36201.139 0.000 0.429 0.000 7.794 0.000 8047.333 6.344 1.109 17.876 10.813 33983.173 36072.808 0.000 0.422 0.000 7.726 0.000 8018.012 6.288 1.108 17.865 10.836 33923.789 36067.142 0.000 0.421 0.000 7.735 0.000 8057.731 6.230 1.100 17.888 10.942 33952.483 36038.684 0.000 0.413 0.000 7.766 0.000 8085.695 6.265 1.073 17.901 10.756 34014.922 36078.351 0.000 0.424 0.000 7.702 0.000 7950.881 6.266 1.421 17.940 10.976 33974.681 36085.277 0.000 0.448 0.000 7.883 0.000 7993.555 6.241 1.422 18.121 10.919 33957.717 36024.516 0.000 0.447 0.000 7.628 0.000 8034.345 6.260 1.391 17.922 10.866 33993.909 35988.197 0.000 0.436 0.000 7.675 0.000 8073.980 6.347 1.377 17.994 10.913 33961.856 36205.586 0.000 0.451 0.000 7.724 0.000 8096.017 6.566 1.710 17.675 10.524 34025.573 36216.375 0.000 0.416 0.000 7.613 0.000 8123.559 6.726 1.725 17.726 10.744 33991.096 36153.566 0.000 0.416 0.000 7.729 0.000 8179.431 6.854 1.740 17.882 10.799 34038.983 36029.592 0.000 0.418 0.000 7.728 0.000 8168.529 7.170 1.733 17.977 10.733 33948.635 36085.497 0.000 0.427 0.000 7.606 0.000 7978.226 24

Background database maintenance I/O performance MSExchange Database ==> s Database Maintenance IO Reads/sec Database Maintenance IO Reads Average Bytes 3288.1 9.162 260736.015 3288.2 9.163 260690.764 3288.3 9.158 260829.330 3288.4 9.162 260697.622 3288.5 9.161 260758.480 3288.6 9.163 260694.921 3288.7 9.159 260782.460 3288.8 9.164 260653.353 3288.9 9.162 260737.175 3288.10 9.163 260672.494 3288.11 9.162 260688.689 3288.12 9.160 260800.647 3288.13 9.164 260677.078 3288.14 9.158 260855.788 3288.15 9.165 260626.099 3288.16 9.163 260690.198 Log replication I/O performance MSExchange Database ==> I/O Log Reads Average I/O Log Reads/sec s Bytes 3288.1 0.354 68889.098 3288.2 0.354 68889.098 3288.3 0.354 69282.827 3288.4 0.356 69836.712 3288.5 0.351 68400.523 3288.6 0.356 69377.673 3288.7 0.359 69866.248 3288.8 0.348 68217.725 3288.9 0.359 69866.248 3288.10 0.348 67911.948 3288.11 0.354 68889.098 3288.12 0.356 69377.673 3288.13 0.356 69771.402 3288.14 0.364 70880.237 3288.15 0.359 69866.248 3288.16 0.348 67911.948 25

MSExchange Database ==> s I/O Database Reads Average Latency (msec) I/O Database Writes Average Latency (msec) I/O Database Reads/sec I/O Database Writes/sec I/O Database Reads Average Bytes I/O Database Writes Average Bytes I/O Log Reads Average Latency (msec) I/O Log Writes Average Latency (msec) I/O Log Reads/sec I/O Log Writes/sec I/O Log Reads Average Bytes I/O Log Writes Average Bytes Total I/O performance 3288.1 3288.2 3288.3 3288.4 3288.5 3288.6 3288.7 3288.8 3288.9 3288.10 3288.11 3288.12 3288.13 3288.14 3288.15 3288.16 7.031 0.687 27.004 10.669 110890.975 36154.608 0.391 0.426 0.354 7.675 68889.098 8031.209 6.790 0.699 27.004 10.675 110937.531 36090.964 0.381 0.432 0.354 7.602 68889.098 8163.077 6.611 0.705 26.990 10.787 110994.790 36080.319 0.368 0.422 0.354 7.778 69282.827 7975.474 6.515 0.695 27.096 10.904 110576.016 36201.139 0.442 0.429 0.356 7.794 69836.712 8047.333 6.344 1.109 27.037 10.813 110824.433 36072.808 0.431 0.422 0.351 7.726 68400.523 8018.012 6.288 1.108 27.028 10.836 110805.869 36067.142 0.463 0.421 0.356 7.735 69377.673 8057.731 6.230 1.100 27.047 10.942 110767.926 36038.684 0.407 0.413 0.359 7.766 69866.248 8085.695 6.265 1.073 27.065 10.756 110754.888 36078.351 0.464 0.424 0.348 7.702 68217.725 7950.881 6.266 1.421 27.102 10.976 110633.264 36085.277 0.491 0.448 0.359 7.883 69866.248 7993.555 6.241 1.422 27.284 10.919 110096.103 36024.516 0.433 0.447 0.348 7.628 67911.948 8034.345 6.260 1.391 27.085 10.866 110681.828 35988.197 0.419 0.436 0.354 7.675 68889.098 8073.980 6.347 1.377 27.153 10.913 110481.221 36205.586 0.447 0.451 0.356 7.724 69377.673 8096.017 6.566 1.710 26.839 10.524 111412.612 36216.375 0.418 0.416 0.356 7.613 69771.402 8123.559 6.726 1.725 26.884 10.744 111273.602 36153.566 0.446 0.416 0.364 7.729 70880.237 8179.431 6.854 1.740 27.047 10.799 110820.922 36029.592 0.408 0.418 0.359 7.728 69866.248 8168.529 7.170 1.733 27.140 10.733 110502.332 36085.497 0.410 0.427 0.348 7.606 67911.948 7978.226 26

Host system performance Counter Average Minimum Maximum % Processor Time 0.366 0.000 1.973 Available MBytes 120732.482 120710.000 121044.000 Free System Page Table Entries 33555849.000 33555849.000 33555849.000 Transition Pages RePurposed/sec 0.000 0.000 0.000 Pool Nonpaged Bytes 126965463.748 126533632.000 127176704.000 Pool Paged Bytes 98201016.084 98070528.000 98291712.000 Database Page Fault Stalls/sec 0.000 0.000 0.000 Test Log 2/18/2014 3:16:32 PM -- Preparing for testing... 2/18/2014 3:16:49 PM -- Attaching databases... 2/18/2014 3:16:49 PM -- Preparations for testing are complete. 2/18/2014 3:16:49 PM -- Starting transaction dispatch.. 2/18/2014 3:16:49 PM -- Database cache settings: (minimum: 512.0 MB, maximum: 4.0 GB) 2/18/2014 3:16:49 PM -- Database flush thresholds: (start: 40.9 MB, stop: 81.9 MB) 2/18/2014 3:17:06 PM -- Database read latency thresholds: (average: 20 msec/read, maximum: 100 msec/read). 2/18/2014 3:17:06 PM -- Log write latency thresholds: (average: 10 msec/write, maximum: 100 msec/write). 2/18/2014 3:17:08 PM -- Operation mix: Sessions 6, Inserts 40%, Deletes 20%, Replaces 5%, Reads 35%, Lazy Commits 70%. 2/18/2014 3:17:08 PM -- Performance logging started (interval: 15000 ms). 2/18/2014 3:17:08 PM -- Attaining prerequisites: 2/18/2014 3:28:47 PM -- \MSExchange Database(JetstressWin)\Database Cache Size, Last: 3881820000.0 (lower bound: 3865470000.0, upper bound: none) 2/18/2014 5:28:48 PM -- Performance logging has ended. 2/18/2014 6:14:21 PM -- JetInterop batch transaction stats: 8961, 8960, 8960, 8960, 8960, 8960, 8960, 8960, 8960, 8960, 8960, 8960, 8960, 8960, 8960 and 8960. 2/18/2014 6:14:21 PM -- Dispatching transactions ends. 2/18/2014 6:14:21 PM -- Shutting down databases... 2/18/2014 6:14:50 PM -- 3288.1 (complete), 3288.2 (complete), 3288.3 (complete), 3288.4 (complete), 3288.5 (complete), 3288.6 (complete), 3288.7 (complete), 3288.8 (complete), 3288.9 (complete), 3288.10 (complete), 3288.11 (complete), 3288.12 (complete), 3288.13 (complete), 3288.14 (complete), 3288.15 (complete) and 3288.16 (complete) 2/18/2014 6:14:50 PM -- C:\Program Files\Exchange Jetstress\Performance_2014_2_18_15_17_6.blg has 523 samples. 2/18/2014 6:14:50 PM -- Creating test report... 2/18/2014 6:14:59 PM -- 3288.1 has 7.0 for I/O Database Reads Average Latency. 2/18/2014 6:14:59 PM -- 3288.1 has 0.4 for I/O Log Writes Average Latency. 2/18/2014 6:14:59 PM -- 3288.1 has 0.4 for I/O Log Reads Average Latency. 2/18/2014 6:14:59 PM -- 3288.2 has 6.8 for I/O Database Reads Average Latency. 2/18/2014 6:14:59 PM -- 3288.2 has 0.4 for I/O Log Writes Average Latency. 2/18/2014 6:14:59 PM -- 3288.2 has 0.4 for I/O Log Reads Average Latency. 2/18/2014 6:14:59 PM -- 3288.3 has 6.6 for I/O Database Reads Average Latency. 2/18/2014 6:14:59 PM -- 3288.3 has 0.4 for I/O Log Writes Average Latency. 2/18/2014 6:14:59 PM -- 3288.3 has 0.4 for I/O Log Reads Average Latency. 2/18/2014 6:14:59 PM -- 3288.4 has 6.5 for I/O Database Reads Average Latency. 2/18/2014 6:14:59 PM -- 3288.4 has 0.4 for I/O Log Writes Average Latency. 2/18/2014 6:14:59 PM -- 3288.4 has 0.4 for I/O Log Reads Average Latency. 2/18/2014 6:14:59 PM -- 3288.5 has 6.3 for I/O Database Reads Average Latency. 2/18/2014 6:14:59 PM -- 3288.5 has 0.4 for I/O Log Writes Average Latency. 2/18/2014 6:14:59 PM -- 3288.5 has 0.4 for I/O Log Reads Average Latency. 2/18/2014 6:14:59 PM -- 3288.6 has 6.3 for I/O Database Reads Average Latency. 2/18/2014 6:14:59 PM -- 3288.6 has 0.4 for I/O Log Writes Average Latency. 27