ESRP Storage Program EMC Celerra NS-120 (1,500 User) Storage Solution for Microsoft Exchange Server 2007 SP1

Transcription

1 ESRP Storage Program EMC Celerra NS-120 (1,500 User) Storage Solution for Microsoft Exchange Server 2007 SP1 Tested with: ESRP Storage Version 2.1 Tested Date: 04/28/2009 EMC Corporation Corporate Headquarters Hopkinton, MA

2 EMC believes the information in this publication is accurate as of its publication date. The information is subject to change without notice. THE INFORMATION IN THIS PUBLICATION IS PROVIDED AS IS. EMC CORPORATION MAKES NO REPRESENTATIONS OR WARRANTIES OF ANY KIND WITH RESPECT TO THE INFORMATION IN THIS PUBLICATION, AND SPECIFICALLY DISCLAIMS IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Use, copying, and distribution of any EMC software described in this publication requires an applicable software license. EMC 2, EMC, EMC ControlCenter, AlphaStor, ApplicationXtender, Avamar, Captiva, Catalog Solution, Celerra, Centera, CentraStar, CLARalert, CLARiiON, ClientPak, CodeLink, Connectrix, Co-StandbyServer, Dantz, Direct Matrix Architecture, DiskXtender, DiskXtender 2000, Documentum, Xaminer, Xtender, Xtract, eroom, FLARE, HighRoad, InputAccel, Invista, Max Retriever, Navisphere, NetWorker, nlayers, OpenScale, Powerlink, PowerPath, Rainfinity, RepliStor, ResourcePak, Retrospect, Smarts, SnapShotServer, SnapView/IP, SRDF, Symmetrix, TimeFinder, VisualSAN, VSAM-Assist, WebXtender, where information lives, Xtender, and Xtender Solutions are registered trademarks and EMC Developers Program, EMC OnCourse, EMC Proven, EMC Snap, EMC Storage Administrator, Acartus, Access Logix, ArchiveXtender, Authentic Problems, Automated Resource Manager, AutoStart, AutoSwap, AVALONidm, C-Clip, Celerra Replicator, CLARevent, Codebook Correlation Technology, Common Information Model, CopyCross, CopyPoint, Xtender, Direct Matrix, EDM, E-Lab, Enginuity, FarPoint, Global File Virtualization, Graphic Visualization, InfoMover, Infoscape, MediaStor, MirrorView, NetWin, OnAlert, PowerSnap, RepliCare, SafeLine, SAN Advisor, SAN Copy, SAN Manager, SDMS, SnapImage, SnapSure, SnapView, StorageScope, SupportMate, SymmAPI, SymmEnabler, Symmetrix DMX, UltraPoint, UltraScale, Viewlets, and VisualSRM are trademarks of EMC Corporation. All other trademarks used herein are the property of their respective owners. Copyright EMC Corporation. All rights reserved. July, 2009 h6429 EMC Celerra NS-120 (1,500 User) Storage Solutions for Microsoft Exchange 2007 SP1 2

3 Content Overview...4 Disclaimer...4 Features...4 Solution Description...5 Targeted Customer Profile...8 Tested Deployment...8 Simulated Exchange Configuration...8 Primary Storage Hardware...9 Primary Storage Software...9 Primary Storage Disk Configuration (Mailbox Store Disks)...10 Primary Storage Disk Configuration (Transactional Log Disks)...10 Best Practices...10 Core Storage...11 Backup Strategy...11 Test Result Summary...12 Reliability...12 Primary Storage Performance Results...12 Streaming Backup/Recovery Performance...13 Read-only Performance...13 Log Read-only Performance...13 Conclusion...14 Contact Information...14 Appendix A: Stress Test Report (24 hrs Performance Test)...15 Appendix B: Performance Test Results...22 Appendix C: Soft Recovery Test Results...28 Appendix D: Streaming Backup Test Results...34 Appendix E: Maximum Solution IOPS Testing...36 EMC Celerra NS-120 (1,500 User) Storage Solutions for Microsoft Exchange 2007 SP1 3

4 Overview This document provides information on an EMC Celerra NS-120 storage solution for Microsoft Exchange Server, based on the Microsoft Exchange Solution Reviewed Program (ESRP) Storage program*. For any questions or comments regarding the contents of this document, see Contact Information. *The ESRP Storage program was developed by Microsoft Corporation to provide a common storage testing framework for vendors to provide information on its storage solutions for Microsoft Exchange Server software. For more details on the Microsoft ESRP Storage program, visit the website Disclaimer This document has been produced independently of Microsoft Corporation. Microsoft Corporation expressly disclaims responsibility for, and makes no warranty, express or implied, with respect to, the accuracy of the contents of this document. The information contained in this document represents the current view of EMC on the issues discussed as of the date of publication. Due to changing market conditions, it should not be interpreted to be a commitment on the part of EMC, and EMC cannot guarantee the accuracy of any information presented after the date of publication. Features This document describes an approach that can be used to configure Microsoft Exchange 2007 with EMC s Celerra NS-120 storage system. The EMC Celerra NS-120 meets the storage needs of a wide range of applications that include: Mail/Messaging s File/Print and Web services Distributed applications Remote replication In addition, the NS-120 supports a wide range of server operating environments such as Microsoft Windows, Linux, Solaris, AIX, and HP-UX. Celerra NS-120 is a high-performance, full function IP storage platform. It delivers NAS and iscsi capabilities to consolidate application storage and file servers. Easy to deploy and simple to manage, the NS-120 is all-in-one IP storage for customers looking for enterprise-class capabilities packaged for specific applications, departments, or locations. EMC Celerra NS-120 (1,500 User) Storage Solutions for Microsoft Exchange 2007 SP1 4

5 Celerra NS-120 also supports optical Fibre Channel connections. Regardless of the configuration, Celerra platforms offer a full suite of advanced functionality: Robust snap and replication capabilities offer protection of data Celerra File Mover API allows automated policy-based movement of files between tiers of storage File-level retention provides disk-based WORM functionality, which is useful for archiving Exchange s Automated Volume Management and Virtual Provisioning TM improve storage utilization The performance results and best practices discussed in this document provide proven guidelines for configuring Celerra NS-120 for highperformance Exchange environments. For this solution, an integrated Celerra NS-120 storage system was used and configured for 1,500 Exchange 2007 users. Each of the 1,500 users had a profile of 0.42 IOPS and a 500 MB mailbox. Solution Description Sizing and configuring storage for use with Microsoft Exchange Server is a complicated process, driven by many variables and factors, which vary from organization to organization. One method often used to simplify the sizing and configuration of EMC Celerra NS-120 storage systems for use with Microsoft Exchange Server 2007 is to define a unit of measure. This unit of measure is known as a building block. The Microsoft Exchange Server 2007 building block is defined as six disk spindles, four spindles for Exchange database and two spindles for Exchange log. The testing in this document proves that two building blocks meets and exceeds the Microsoft Exchange Server recommended metrics for reliability, scalability, and performance. This unit of measure or building block needs to be scalable. In that way, an organization can simply take this building block and multiply it by some factor until the desired number of Microsoft Exchange Server users has been met while satisfying the Microsoft Exchange Server recommended performance metrics. If each unit is properly configured, it will match the Microsoft Exchange Server recommendations for a healthy-performing system from both a disk and an end-user perspective. EMC Celerra NS-120 (1,500 User) Storage Solutions for Microsoft Exchange 2007 SP1 5

6 In this particular testing, one server was used to simulate the Exchange environment. Table 1 describes the characteristics of the storage configuration. Table 1: Server characteristics Number of users 1,500 Number of Exchange Servers 1 IOPS per user 0.42 Mailbox size 500 MB Number of disks required for logs 12 (8 for database and 4 for log) and database Disk type 300 GB 15k FC drives RAID type 1 Using the performance characteristics of a Celerra NS-120 architecture, disk drives (300 GB, 15k rpm) and 12 spindles with I/O capability are required to provide the necessary performance to match the I/O requirements of 1,500; 0.42 IOPS users with a 1:1 read/write ratio. See Figure 1 on page 7 for a view of the single building block disk layout on a Celerra NS-120. EMC Celerra NS-120 (1,500 User) Storage Solutions for Microsoft Exchange 2007 SP1 6

7 Figure 1: Disk Configuration The 1,500 users are distributed among eight Exchange storage groups. The Exchange databases for SG1, SG2, SG3, and SG4 are striped over four disk spindles from two 1+1 RAID 1 groups. The Exchange databases for SG5, SG6, SG7, and SG8 are striped over another four disk spindles from an additional two 1+1 RAID 1 groups. The logs for SG1, SG2, SG3, and SG4 are stored on a single 1+1 RAID 1 group. The logs for SG5 and SG6, SG7 and SG8 are stored on another single 1+1 RAID 1 group. The ESRP-Storage program focuses on storage solution testing to address performance and reliability issues with storage design. However, storage is not the only factor to take into consideration when designing a scaleable Exchange solution. Other factors that affect the server scalability are: Server processor utilization Physical and virtual memory limitations Resource requirements for other applications Directory and network service latencies Network infrastructure limitations Replication and recovery requirements Client usage profiles EMC Celerra NS-120 (1,500 User) Storage Solutions for Microsoft Exchange 2007 SP1 7

8 All these factors are beyond the scope for ESRP-Storage. Therefore, the number of mailboxes hosted per server as part of the tested configuration may not necessarily be viable for some customer deployments. For more information on identifying and addressing performance bottlenecks in an Exchange system, refer to Microsoft's Troubleshooting Microsoft Exchange Server Performance, available at Targeted Customer Profile The solution is intended for medium-to-large Enterprise Exchange customers to consolidate their Exchange users on a high-performance, highly-available storage platform. This configuration is designed to support 1,500 Exchange users, with the following assumptions: One Exchange Jetstress Server User I/O profile for testing (0.5 IOPS tested) User mailbox size for testing MB Eight Exchange storage groups per server One mailbox database per storage group Tested Deployment The tables in this section summarize the testing environment. Simulated Exchange Configuration Table 2 lists the simulated Exchange configuration. Table 2: Simulated Exchange Configuration Number of Exchange mailboxes 1,500 simulated Number of hosts 1 Number of mailboxes/host 1,500 Number of storage groups/host 8 Number of mailbox stores/storage 1 group Number of mailboxes/mailbox store 1,500 Number of mailbox store 1 LUNs/storage group Simulated profile: I/Os per second 0.42 per mailbox (IOPS, include 20% headroom) LUN size 119 GB Log LUN size 20 GB Backup LUN size/storage group N/A EMC Celerra NS-120 (1,500 User) Storage Solutions for Microsoft Exchange 2007 SP1 8

9 Total database size for performance testing % storage capacity used by Exchange database** GB 80.27% **Storage performance characteristics change based on the percentage utilization of the individual disks. Tests that use a small percentage of the storage (~25 percent) may exhibit reduced throughput if the storage capacity utilization is significantly increased beyond what is tested in this paper. Primary Storage Hardware Table 3 lists the hardware used in the environment. Table 3: Hardware Storage connectivity (Fibre Channel, iscsi SAS, SATA, iscsi) Storage model and OS/firmware EMC Celerra version revision Storage cache 2 GB split for Write/Read Number of storage controllers 4 (2 Frontend, 2 Backend) Number of storage ports 4 (of the total 8 ports, 4 are passive/redundant) Maximum bandwidth of storage 2x1Gb iscsi Total Bandwidth 2 Gb/s connectivity to host Switch type/model/firmware revision Cisco/6509-E/IOS Version 12.2 HBA model and firmware Intel PRO/1000 PT Dual Port Server Number of HBAs/host 2 dual port HBAs Host server type Server 1850 Total number of disks tested in 12 (8 for s and 4 for Logs) solution Maximum number of spindles can be 120 hosted in the storage Primary Storage Software Table 4 lists the software configuration used in the environment. Table 4: Primary Storage Software HBA driver Microsoft iscsi Initiator build 3497, Driver version: HBA QueueTarget setting N/A HBA QueueDepth setting N/A Multipathing Multiple connections per session Host OS Microsoft Windows Server 2003 Enterprise X64 Edition R2 SP2 ESE.dll file version EMC Celerra NS-120 (1,500 User) Storage Solutions for Microsoft Exchange 2007 SP1 9

10 Replication solution name/version N/A Primary Storage Disk Configuration (Mailbox Store Disks) Table 5 lists the disk configuration (mailbox store disks) for the environment. Table 5: Storage Disk Configuration Disk type, speed and firmware 4 GB/s FC 15k rpm, firmware ES01 revision Raw capacity per disk (GB) 300 GB Number of physical disks in test 8 Total raw storage capacity (GB) 2.34 TB Disk slice size (GB) N/A Number of slices per LUN or number 2 disks per LUN of disks per LUN RAID level RAID 1 Total formatted capacity 952 GB Storage capacity utilization 39.6% capacity utilization 31.8% Primary Storage Disk Configuration (Transactional Log Disks) Table 6 shows the disk configuration (transactional log disks) for the environment. Table 6: Storage Disk Configuration (Transactional Log Disks) Disk type, speed and firmware 4 GB/s FC 15k rpm, firmware ES01 revision Raw capacity per disk (GB) 300 GB FC Number of spindles in test 4 Total raw storage capacity (GB) 1200 GB Disk slice size (GB) N/A Number of slices per LUN or 2 disks per LUN number of disks per LUN RAID level RAID 1 Total formatted capacity 160 GB Best Practices Exchange server is a disk-intensive application. Based on the testing run using the ESRP framework, EMC recommends the Exchange 2007 SP1 best practices to improve the storage performance. For Exchange 2007 best practices on storage design, access the website EMC Celerra NS-120 (1,500 User) Storage Solutions for Microsoft Exchange 2007 SP1 10

11 Core Storage Based on the testing run using an ESRP framework, EMC recommends the following best practices to improve the storage performance with Exchange solutions: 1. Use DISKPART (in Microsoft Windows Server 2003 Enterprise X64 Edition R2 SP2) to align all Microsoft Exchange-related disks. Use a value of 64 for iscsi LUNs to align the NTFS partitions at a 64 KB boundary. 2. Isolate the Microsoft Exchange Server database workload from other I/O-intensive applications or workloads. This ensures the highest levels of performance for Microsoft Exchange and simplifies troubleshooting in the event of a disk-related Microsoft Exchange performance problem. 3. Microsoft Exchange Server logs and databases must be separated onto different physical disks and in different RAID groups. 4. Size and configure the environment based on disk spindle performance as a primary consideration, with spindle or storage capacity as secondary issue. In other words, size for performance first and make the capacity requirements work. Backup Strategy A well-designed and implemented disaster recovery strategy should be a top priority for every Microsoft Exchange Server deployment. Proper planning must be done prior to configuration to meet the required service-level agreements (SLAs) for server downtime. Various backup and restore strategies can be implemented, depending on the requirements of the environment. EMC offers multiple solutions to protect an Exchange environment. EMC Replication Manager can manage snapshot and replication in an Exchange environment. EMC NetWorker allows an Exchange environment to be backed up to tape or to disk. Both these products work in conjunction with Volume Shadow Copy services (VSS) as proven techniques, having undergone vigorous testing. In this solution, the tested method for backup was a one stage disk-to-disk backup. With this configuration, several best practice considerations must be understood to achieve optimal performance: EMC Celerra NS-120 (1,500 User) Storage Solutions for Microsoft Exchange 2007 SP1 11

12 Disk-to-disk backup LUNs should be configured in separate disk groups. Workload isolation optimizes the performance of streaming backups and minimizes the impact on the production workload. Higher capacity SATA drives must be utilized if the environment requires additional backup copies of the data on the primary disks. Test Result Summary This section provides a high-level summary of the test data from ESRP, and provides links to the detailed html reports, which are generated by ESRP testing framework. Reliability The tests in the framework are designed to test the reliability over a 24-hour period. The goal is to verify if storage can handle high I/O load for a long period of time. Both log and database files are analyzed for integrity after the stress test to ensure that there is no database/log corruption. The reliability test executed on Celerra NS-120 provided the following results: No errors are reported in the event log file for the storage reliability testing No errors are reported for the database and log checksum No errors are reported in the event log file for the backup-to-disk test The Jetstress performance results (24-hour performance test) can be found in Appendix A: Stress Test Report (24 hrs Performance Test). Primary Storage Performance Results The Primary Storage Performance testing is designed to exercise the storage with a maximum sustainable Exchange type of I/O for two hours. The test is to show how long it takes for the storage to respond to an I/O under load. Table 7 shows the sum of all of the logical disk I/Os and the average of all the logical disk latency in the 2-hour test duration. Table 7: Performance Results I/O Disks Transfers/sec 810 Disks Reads/sec Disks Writes/sec Average Disk Read Latency (ms) 13.5 EMC Celerra NS-120 (1,500 User) Storage Solutions for Microsoft Exchange 2007 SP1 12

13 Average Disk Write 3 Latency (ms) Transaction Log I/O Log Disks Writes/sec Average Log Disk Write Latency (ms) 2 Appendix B: Performance Test Results provides the results of JetStress performance results (2-hour performance test) Appendix E: Maximum Solution IOPS Testing provides results that characterize the maximum performance of the disk layout. Streaming Backup/Recovery Performance There are two tests in this section. The first test is to measure the read I/O performance metrics by running checksum on all the databases and log files. The second test is to measure the end to end performance when the databases are backed up to disks. Read-only Performance The test is to measure the maximum rate at which databases could be streaming backed up. The following table shows the average rate for a single database file. Table 8: Read-only Performance MB read/sec per storage group MB read/sec total Also, refer to Appendix D: Streaming Backup Test Results to find results that characterize the database read-only performance. Log Read-only Performance The test is to measure the maximum rate at which the log files can be played against the databases. Table 9 shows the average rate for 500 log files played in a single storage group. Each log file is 1 MB in size. Table 9: Log Read-only Performance Average time to play one log file (sec) EMC Celerra NS-120 (1,500 User) Storage Solutions for Microsoft Exchange 2007 SP1 13

14 Appendix C: Soft Recovery Test Results shows the results that characterize the log read-only performance. Conclusion As this document illustrates, EMC Celerra NS-120 is more than capable of supporting deployments of up to 1,500 users at 0.42 IOPS per user. A careful analysis of each environment must be performed to understand the specific requirements of the architecture and to adopt a solution that best fits those needs. The information included in this document verifies that NS-120 can support a high-performance Exchange configuration. This solution does not include local or remote replication features. The addition of these features may affect the performance of Celerra NS-120. Contact Information EMC recommends that you consult with EMC Professional Services to assist with the design and deployment of a similar solution. For information regarding this or any other EMC Solution, please use the following numbers: United States: (800) (SVC-4EMC) Canada: (800) (543-4SVC) Worldwide: (508) For additional information on EMC Products and services available to customers and partners, refer to or EMC Celerra NS-120 (1,500 User) Storage Solutions for Microsoft Exchange 2007 SP1 14

15 Appendix A: Stress Test Report (24 hrs Performance Test) Microsoft Exchange Server Jetstress Stress Test Result Report Test Summary Overall Test Pass Result Machine Name RTPSOL311 Test Description Test Start Time 5/26/2009 6:15:11 AM Test End Time 5/27/ :11:20 AM Jetstress Version Ese Version Operating System Performance Log Microsoft Windows Server 2003 R2 Service Pack 2 ( ) C:\Program Files\Exchange Jetstress\Stress_2009_5_26_9_51_5.blg C:\Program Files\Exchange Jetstress\DBChecksum_2009_5_27_10_11_20.blg Sizing and Throughput Achieved I/O per Second Capacity Percentage 100% Throughput Percentage 100% Initial database size Final database size files (count) 8 Jetstress System Parameters Thread count 3 (per-storage group) Log buffers 9000 Minimum database cache MB Maximum database cache MB Insert operations 40% Delete operations 30% Replace operations 5% Read operations 25% Lazy commits 55% Disk Subsystem Performance LogicalDisk Avg. Disk Avg. Disk Disk Disk Avg. Disk EMC Celerra NS-120 (1,500 User) Storage Solutions for Microsoft Exchange 2007 SP1 15

16 (G:) (H:) (I:) (J:) (K:) (L:) (M:) (N:) sec/read sec/write Reads/sec Writes/sec Bytes/Write (n/a) (n/a) (n/a) (n/a) (n/a) (n/a) (n/a) (n/a) Log (O:) Log (P:) Log (Q:) Log (R:) Log (S:) Log (T:) Log (U:) Log (V:) Host System Performance Counter Average Minimum Maximum % Processor Time Available MBytes Free System Page Table Entries Transition Pages RePurposed/sec Pool Nonpaged Bytes Pool Paged Bytes Page Fault Stalls/sec Test Log 5/26/2009 6:15:00 AM -- Prepare testing begins... 5/26/2009 6:15:00 AM -- Creating G:\Jetstress1.edb. 5/26/2009 6:15:00 AM -- cache settings: (minimum: 32.0 MB, maximum: MB) 5/26/2009 6:15:00 AM -- flush thresholds: (start: 2.6 MB, stop: 5.1 MB) 5/26/2009 6:15:01 AM % of 95.5 GB complete (3900 records inserted). 5/26/2009 6:15:01 AM -- Prepare testing ends. EMC Celerra NS-120 (1,500 User) Storage Solutions for Microsoft Exchange 2007 SP1 16

17 5/26/2009 6:15:11 AM -- Jetstress testing begins... 5/26/2009 6:15:11 AM -- Prepare testing begins... 5/26/2009 6:15:11 AM -- Creating G:\Jetstress1.edb. 5/26/2009 6:15:11 AM -- cache settings: (minimum: 32.0 MB, maximum: MB) 5/26/2009 6:15:11 AM -- flush thresholds: (start: 2.6 MB, stop: 5.1 MB) 5/26/2009 6:37:10 AM % of 95.5 GB complete ( records inserted). 5/26/2009 7:11:54 AM % of 95.5 GB complete ( records inserted). 5/26/2009 7:11:56 AM -- Duplicating 7 databases: 5/26/2009 9:50:47 AM % of GB complete (668.7 GB duplicated). 5/26/2009 9:50:55 AM -- Attaching databases... 5/26/2009 9:50:55 AM -- Prepare testing ends. 5/26/2009 9:50:55 AM -- Dispatching transactions begins... 5/26/2009 9:50:55 AM -- cache settings: (minimum: MB, maximum: 2.0 GB) 5/26/2009 9:50:55 AM -- flush thresholds: (start: 20.5 MB, stop: 41.0 MB) 5/26/2009 9:51:04 AM -- read latency thresholds: (average: 0.02 seconds/read, maximum: 0.1 seconds/read). 5/26/2009 9:51:04 AM -- Log write latency thresholds: (average: 0.01 seconds/write, maximum: 0.1 seconds/write). 5/26/2009 9:51:06 AM -- Operation mix: Sessions 3, Inserts 40%, Deletes 30%, Replaces 5%, Reads 25%, Lazy Commits 55%. 5/26/2009 9:51:06 AM -- Performance logging begins (interval: ms). 5/26/2009 9:51:06 AM -- Attaining prerequisites: 5/26/ :11:15 AM -- \MSExchange (JetstressWin)\ Cache Size, Last: (lower bound: , upper bound: none) 5/27/ :11:17 AM -- Performance logging ends. 5/27/ :11:17 AM -- JetInterop batch transaction stats: , , , , , , , and /27/ :11:18 AM -- Dispatching transactions ends. 5/27/ :11:18 AM -- Shutting down databases... 5/27/ :11:20 AM -- Instance (complete), Instance (complete), Instance (complete), Instance (complete), Instance (complete), Instance (complete), Instance (complete), and Instance (complete) 5/27/ :11:21 AM -- Performance logging begins (interval: ms). 5/27/ :11:21 AM -- Verifying database checksums... 5/27/ :38:42 AM -- G: (100% processed), H: (100% processed), I: (100% processed), J: (100% processed), K: (100% processed), L: (100% processed), M: (100% processed), and N: (100% processed) 5/27/ :38:43 AM -- Performance logging ends. 5/27/ :38:43 AM -- C:\Program Files\Exchange EMC Celerra NS-120 (1,500 User) Storage Solutions for Microsoft Exchange 2007 SP1 17

18 Jetstress\DBChecksum_2009_5_27_10_11_20.blg has 174 samples. 5/27/ :38:50 AM -- C:\Program Files\Exchange Jetstress\DBChecksum_2009_5_27_10_11_20.html is saved. 5/27/ :38:50 AM -- Verifying log checksums... 5/27/ :38:51 AM -- O:\ (2 logs passed), P:\ (2 logs passed), Q:\ (2 logs passed), R:\ (2 logs passed), S:\ (2 logs passed), T:\ (2 logs passed), U:\ (2 logs passed), and V:\ (2 logs passed) 5/27/ :38:51 AM -- C:\Program Files\Exchange Jetstress\Stress_2009_5_26_9_51_5.blg has 5838 samples. 5/27/ :38:51 AM -- Creating test report... 5/27/ :40:07 AM -- Volume G: has for Avg. Disk sec/read. 5/27/ :40:07 AM -- Volume H: has for Avg. Disk sec/read. 5/27/ :40:07 AM -- Volume I: has for Avg. Disk sec/read. 5/27/ :40:07 AM -- Volume J: has for Avg. Disk sec/read. 5/27/ :40:07 AM -- Volume K: has for Avg. Disk sec/read. 5/27/ :40:07 AM -- Volume L: has for Avg. Disk sec/read. 5/27/ :40:07 AM -- Volume M: has for Avg. Disk sec/read. 5/27/ :40:07 AM -- Volume N: has for Avg. Disk sec/read. 5/27/ :40:07 AM -- Volume O: has for Avg. Disk sec/write. 5/27/ :40:07 AM -- Volume O: has for Avg. Disk sec/read. 5/27/ :40:07 AM -- Volume P: has for Avg. Disk sec/write. 5/27/ :40:07 AM -- Volume P: has for Avg. Disk sec/read. 5/27/ :40:07 AM -- Volume Q: has for Avg. Disk sec/write. 5/27/ :40:07 AM -- Volume Q: has for Avg. Disk sec/read. 5/27/ :40:07 AM -- Volume R: has for Avg. Disk sec/write. 5/27/ :40:07 AM -- Volume R: has for Avg. Disk sec/read. 5/27/ :40:07 AM -- Volume S: has for Avg. Disk sec/write. 5/27/ :40:07 AM -- Volume S: has for Avg. Disk sec/read. 5/27/ :40:07 AM -- Volume T: has for Avg. Disk sec/write. 5/27/ :40:07 AM -- Volume T: has for Avg. Disk sec/read. 5/27/ :40:07 AM -- Volume U: has for Avg. Disk sec/write. 5/27/ :40:07 AM -- Volume U: has for Avg. Disk sec/read. 5/27/ :40:07 AM -- Volume V: has for Avg. Disk sec/write. 5/27/ :40:07 AM -- Volume V: has for Avg. Disk sec/read. 5/27/ :40:07 AM -- Test has 0 Maximum Page Fault Stalls/sec. 5/27/ :40:07 AM -- Test has 0 Page Fault Stalls/sec samples higher than 0. 5/27/ :40:07 AM -- C:\Program Files\Exchange Jetstress\Stress_2009_5_26_9_51_5.xml has 5757 samples queried. EMC Celerra NS-120 (1,500 User) Storage Solutions for Microsoft Exchange 2007 SP1 18

19 Stress Test Report Checksum Statistics Microsoft Exchange Server Jetstress Test Result Report Checksum Statistics - All Seen pages Bad pages Correctable pages Wrong page no pages File length / seconds taken G:\Jetstress1.edb MBytes / 5239 seconds H:\Jetstress1.edb MBytes / 5234 seconds I:\Jetstress1.edb MBytes / 5231 seconds J:\Jetstress1.edb MBytes / 5226 seconds K:\Jetstress1.edb MBytes / 5228 seconds L:\Jetstress1.edb MBytes / 5225 seconds M:\Jetstress1.edb MBytes / 5232 seconds N:\Jetstress1.edb MBytes / 5228 seconds (Sum) MBytes / 5240 seconds Disk Subsystem Performance (of checksum) LogicalDisk Avg. Disk sec/read Avg. Disk sec/write Disk Reads/sec Disk Writes/sec G: H: I: J: K: L: M: N: Memory System Performance (of checksum) Counter Average Minimum Maximum % Processor Time Available MBytes Free System Page Table Entries Transition Pages RePurposed/sec Pool Nonpaged Bytes Pool Paged Bytes EMC Celerra NS-120 (1,500 User) Storage Solutions for Microsoft Exchange 2007 SP1 19

20 Test Log 5/26/2009 6:15:00 AM -- Prepare testing begins... 5/26/2009 6:15:00 AM -- Creating G:\Jetstress1.edb. 5/26/2009 6:15:00 AM -- cache settings: (minimum: 32.0 MB, maximum: MB) 5/26/2009 6:15:00 AM -- flush thresholds: (start: 2.6 MB, stop: 5.1 MB) 5/26/2009 6:15:01 AM % of 95.5 GB complete (3900 records inserted). 5/26/2009 6:15:01 AM -- Prepare testing ends. 5/26/2009 6:15:11 AM -- Jetstress testing begins... 5/26/2009 6:15:11 AM -- Prepare testing begins... 5/26/2009 6:15:11 AM -- Creating G:\Jetstress1.edb. 5/26/2009 6:15:11 AM -- cache settings: (minimum: 32.0 MB, maximum: MB) 5/26/2009 6:15:11 AM -- flush thresholds: (start: 2.6 MB, stop: 5.1 MB) 5/26/2009 6:37:10 AM % of 95.5 GB complete ( records inserted). 5/26/2009 7:11:54 AM % of 95.5 GB complete ( records inserted). 5/26/2009 7:11:56 AM -- Duplicating 7 databases: 5/26/2009 9:50:47 AM % of GB complete (668.7 GB duplicated). 5/26/2009 9:50:55 AM -- Attaching databases... 5/26/2009 9:50:55 AM -- Prepare testing ends. 5/26/2009 9:50:55 AM -- Dispatching transactions begins... 5/26/2009 9:50:55 AM -- cache settings: (minimum: MB, maximum: 2.0 GB) 5/26/2009 9:50:55 AM -- flush thresholds: (start: 20.5 MB, stop: 41.0 MB) 5/26/2009 9:51:04 AM -- read latency thresholds: (average: 0.02 seconds/read, maximum: 0.1 seconds/read). 5/26/2009 9:51:04 AM -- Log write latency thresholds: (average: 0.01 seconds/write, maximum: 0.1 seconds/write). 5/26/2009 9:51:06 AM -- Operation mix: Sessions 3, Inserts 40%, Deletes 30%, Replaces 5%, Reads 25%, Lazy Commits 55%. 5/26/2009 9:51:06 AM -- Performance logging begins (interval: ms). 5/26/2009 9:51:06 AM -- Attaining prerequisites: 5/26/ :11:15 AM -- \MSExchange (JetstressWin)\ Cache Size, Last: (lower bound: , upper bound: none) 5/27/ :11:17 AM -- Performance logging ends. 5/27/ :11:17 AM -- JetInterop batch transaction stats: , , , , , , , and /27/ :11:18 AM -- Dispatching transactions ends. 5/27/ :11:18 AM -- Shutting down databases... 5/27/ :11:20 AM -- Instance (complete), Instance EMC Celerra NS-120 (1,500 User) Storage Solutions for Microsoft Exchange 2007 SP1 20

21 (complete), Instance (complete), Instance (complete), Instance (complete), Instance (complete), Instance (complete), and Instance (complete) 5/27/ :11:21 AM -- Performance logging begins (interval: ms). 5/27/ :11:21 AM -- Verifying database checksums... 5/27/ :38:42 AM -- G: (100% processed), H: (100% processed), I: (100% processed), J: (100% processed), K: (100% processed), L: (100% processed), M: (100% processed), and N: (100% processed) 5/27/ :38:43 AM -- Performance logging ends. 5/27/ :38:43 AM -- C:\Program Files\Exchange Jetstress\DBChecksum_2009_5_27_10_11_20.blg has 174 samples. EMC Celerra NS-120 (1,500 User) Storage Solutions for Microsoft Exchange 2007 SP1 21

22 Appendix B: Performance Test Results Microsoft Exchange Server Jetstress Performance Test Result Report Test Summary Overall Test Pass Result Machine Name RTPSOL311 Test Description Test Start Time 5/22/2009 1:14:28 AM Test End Time 5/22/2009 3:34:43 AM Jetstress Version Ese Version Operating System Performance Log Microsoft Windows Server 2003 R2 Service Pack 2 ( ) C:\Program Files\Exchange Jetstress\Performance_2009_5_22_1_14_46.blg C:\Program Files\Exchange Jetstress\DBChecksum_2009_5_22_3_34_43.blg Sizing and Throughput Achieved I/O per Second Capacity Percentage 100% Throughput Percentage 100% Initial database size Final database size files (count) 8 Jetstress System Parameters Thread count 3 (per-storage group) Log buffers 9000 Minimum database cache MB Maximum database cache MB Insert operations 40% Delete operations 30% Replace operations 5% Read operations 25% Lazy commits 55% Disk Subsystem Performance LogicalDisk Avg. Disk Avg. Disk sec/read sec/write (G:) Disk Reads/sec Disk Writes/sec (n/a) Avg. Disk Bytes/Write EMC Celerra NS-120 (1,500 User) Storage Solutions for Microsoft Exchange 2007 SP1 22

23 (H:) (n/a) (n/a) (I:) (n/a) (J:) (n/a) (K:) (n/a) (L:) (n/a) (M:) (n/a) (N:) Log (O:) Log (P:) Log (Q:) Log (R:) Log (S:) Log (T:) Log (U:) Log (V:) Host System Performance Counter Average Minimum Maximum % Processor Time Available MBytes Free System Page Table Entries Transition Pages RePurposed/sec Pool Nonpaged Bytes Pool Paged Bytes Page Fault Stalls/sec Test Log 5/22/2009 1:14:28 AM -- Jetstress testing begins... 5/22/2009 1:14:28 AM -- Prepare testing begins... 5/22/2009 1:14:37 AM -- Attaching databases... 5/22/2009 1:14:37 AM -- Prepare testing ends. 5/22/2009 1:14:37 AM -- Dispatching transactions begins... 5/22/2009 1:14:37 AM -- cache settings: (minimum: MB, maximum: 2.0 GB) 5/22/2009 1:14:37 AM -- flush thresholds: (start: 20.5 MB, stop: 41.0 MB) 5/22/2009 1:14:46 AM -- read latency thresholds: (average: 0.02 seconds/read, maximum: 0.05 seconds/read). 5/22/2009 1:14:46 AM -- Log write latency thresholds: (average: 0.01 EMC Celerra NS-120 (1,500 User) Storage Solutions for Microsoft Exchange 2007 SP1 23

24 seconds/write, maximum: 0.05 seconds/write). 5/22/2009 1:14:48 AM -- Operation mix: Sessions 3, Inserts 40%, Deletes 30%, Replaces 5%, Reads 25%, Lazy Commits 55%. 5/22/2009 1:14:48 AM -- Performance logging begins (interval: ms). 5/22/2009 1:14:48 AM -- Attaining prerequisites: 5/22/2009 1:34:39 AM -- \MSExchange (JetstressWin)\ Cache Size, Last: (lower bound: , upper bound: none) 5/22/2009 3:34:41 AM -- Performance logging ends. 5/22/2009 3:34:41 AM -- JetInterop batch transaction stats: 15752, 16086, 16083, 15990, 15946, 15930, 15867, and /22/2009 3:34:41 AM -- Dispatching transactions ends. 5/22/2009 3:34:41 AM -- Shutting down databases... 5/22/2009 3:34:43 AM -- Instance (complete), Instance (complete), Instance (complete), Instance (complete), Instance (complete), Instance (complete), Instance (complete), and Instance (complete) 5/22/2009 3:34:44 AM -- Performance logging begins (interval: ms). 5/22/2009 3:34:44 AM -- Verifying database checksums... 5/22/2009 5:01:51 AM -- G: (100% processed), H: (100% processed), I: (100% processed), J: (100% processed), K: (100% processed), L: (100% processed), M: (100% processed), and N: (100% processed) 5/22/2009 5:01:52 AM -- Performance logging ends. 5/22/2009 5:01:52 AM -- C:\Program Files\Exchange Jetstress\DBChecksum_2009_5_22_3_34_43.blg has 168 samples. 5/22/2009 5:01:58 AM -- C:\Program Files\Exchange Jetstress\DBChecksum_2009_5_22_3_34_43.html is saved. 5/22/2009 5:01:58 AM -- Verifying log checksums... 5/22/2009 5:02:00 AM -- O:\ (2 logs passed), P:\ (2 logs passed), Q:\ (2 logs passed), R:\ (2 logs passed), S:\ (2 logs passed), T:\ (2 logs passed), U:\ (2 logs passed), and V:\ (2 logs passed) 5/22/2009 5:02:00 AM -- C:\Program Files\Exchange Jetstress\Performance_2009_5_22_1_14_46.blg has 559 samples. 5/22/2009 5:02:00 AM -- Creating test report... 5/22/2009 5:02:07 AM -- Volume G: has for Avg. Disk sec/read. 5/22/2009 5:02:07 AM -- Volume H: has for Avg. Disk sec/read. 5/22/2009 5:02:07 AM -- Volume I: has for Avg. Disk sec/read. 5/22/2009 5:02:07 AM -- Volume J: has for Avg. Disk sec/read. 5/22/2009 5:02:07 AM -- Volume K: has for Avg. Disk sec/read. 5/22/2009 5:02:07 AM -- Volume L: has for Avg. Disk sec/read. 5/22/2009 5:02:07 AM -- Volume M: has for Avg. Disk sec/read. 5/22/2009 5:02:07 AM -- Volume N: has for Avg. Disk sec/read. 5/22/2009 5:02:07 AM -- Volume O: has for Avg. Disk sec/write. 5/22/2009 5:02:07 AM -- Volume O: has for Avg. Disk sec/read. 5/22/2009 5:02:07 AM -- Volume P: has for Avg. Disk sec/write. 5/22/2009 5:02:07 AM -- Volume P: has for Avg. Disk sec/read. 5/22/2009 5:02:07 AM -- Volume Q: has for Avg. Disk sec/write. 5/22/2009 5:02:07 AM -- Volume Q: has for Avg. Disk sec/read. EMC Celerra NS-120 (1,500 User) Storage Solutions for Microsoft Exchange 2007 SP1 24

25 5/22/2009 5:02:07 AM -- Volume R: has for Avg. Disk sec/write. 5/22/2009 5:02:07 AM -- Volume R: has for Avg. Disk sec/read. 5/22/2009 5:02:07 AM -- Volume S: has for Avg. Disk sec/write. 5/22/2009 5:02:07 AM -- Volume S: has for Avg. Disk sec/read. 5/22/2009 5:02:07 AM -- Volume T: has for Avg. Disk sec/write. 5/22/2009 5:02:07 AM -- Volume T: has for Avg. Disk sec/read. 5/22/2009 5:02:07 AM -- Volume U: has for Avg. Disk sec/write. 5/22/2009 5:02:07 AM -- Volume U: has for Avg. Disk sec/read. 5/22/2009 5:02:07 AM -- Volume V: has for Avg. Disk sec/write. 5/22/2009 5:02:07 AM -- Volume V: has for Avg. Disk sec/read. 5/22/2009 5:02:07 AM -- Test has 0 Maximum Page Fault Stalls/sec. 5/22/2009 5:02:07 AM -- Test has 0 Page Fault Stalls/sec samples higher than 0. 5/22/2009 5:02:07 AM -- C:\Program Files\Exchange Jetstress\Performance_2009_5_22_1_14_46.xml has 479 samples queried. Microsoft Exchange Server Jetstress Test Result Report Checksum Statistics - All Seen pages Bad pages Correctable pages Wrong page no pages File length / seconds taken G:\Jetstress1.edb MBytes / 5056 seconds H:\Jetstress1.edb MBytes / 5049 seconds I:\Jetstress1.edb MBytes / 5045 seconds J:\Jetstress1.edb MBytes / 5042 seconds K:\Jetstress1.edb MBytes / 5048 seconds L:\Jetstress1.edb MBytes / 5043 seconds M:\Jetstress1.edb MBytes / 5049 seconds N:\Jetstress1.edb MBytes / 5047 seconds (Sum) MBytes / 5226 seconds Disk Subsystem Performance (of checksum) LogicalDisk Avg. Disk sec/read Avg. Disk sec/write Disk Reads/sec Disk Writes/sec G: H: I: J: EMC Celerra NS-120 (1,500 User) Storage Solutions for Microsoft Exchange 2007 SP1 25

26 K: L: M: N: Memory System Performance (of checksum) Counter Average Minimum Maximum % Processor Time Available MBytes Free System Page Table Entries Transition Pages RePurposed/sec Pool Nonpaged Bytes Pool Paged Bytes Test Log 5/22/2009 1:14:28 AM -- Jetstress testing begins... 5/22/2009 1:14:28 AM -- Prepare testing begins... 5/22/2009 1:14:37 AM -- Attaching databases... 5/22/2009 1:14:37 AM -- Prepare testing ends. 5/22/2009 1:14:37 AM -- Dispatching transactions begins... 5/22/2009 1:14:37 AM -- cache settings: (minimum: MB, maximum: 2.0 GB) 5/22/2009 1:14:37 AM -- flush thresholds: (start: 20.5 MB, stop: 41.0 MB) 5/22/2009 1:14:46 AM -- read latency thresholds: (average: 0.02 seconds/read, maximum: 0.05 seconds/read). 5/22/2009 1:14:46 AM -- Log write latency thresholds: (average: 0.01 seconds/write, maximum: 0.05 seconds/write). 5/22/2009 1:14:48 AM -- Operation mix: Sessions 3, Inserts 40%, Deletes 30%, Replaces 5%, Reads 25%, Lazy Commits 55%. 5/22/2009 1:14:48 AM -- Performance logging begins (interval: ms). 5/22/2009 1:14:48 AM -- Attaining prerequisites: 5/22/2009 1:34:39 AM -- \MSExchange (JetstressWin)\ Cache Size, Last: (lower bound: , upper bound: none) 5/22/2009 3:34:41 AM -- Performance logging ends. 5/22/2009 3:34:41 AM -- JetInterop batch transaction stats: 15752, 16086, 16083, 15990, 15946, 15930, 15867, and /22/2009 3:34:41 AM -- Dispatching transactions ends. 5/22/2009 3:34:41 AM -- Shutting down databases... 5/22/2009 3:34:43 AM -- Instance (complete), Instance (complete), Instance (complete), Instance (complete), Instance (complete), Instance (complete), Instance (complete), and Instance (complete) 5/22/2009 3:34:44 AM -- Performance logging begins (interval: ms). 5/22/2009 3:34:44 AM -- Verifying database checksums... 5/22/2009 5:01:51 AM -- G: (100% processed), H: (100% processed), I: EMC Celerra NS-120 (1,500 User) Storage Solutions for Microsoft Exchange 2007 SP1 26

27 (100% processed), J: (100% processed), K: (100% processed), L: (100% processed), M: (100% processed), and N: (100% processed) 5/22/2009 5:01:52 AM -- Performance logging ends. 5/22/2009 5:01:52 AM -- C:\Program Files\Exchange Jetstress\DBChecksum_2009_5_22_3_34_43.blg has 168 samples. EMC Celerra NS-120 (1,500 User) Storage Solutions for Microsoft Exchange 2007 SP1 27

28 Appendix C: Soft Recovery Test Results Microsoft Exchange Server Jetstress SoftRecovery Test Result Report Soft-Recovery Statistics - All Instance Log files replayed Elapsed seconds Instance Instance Instance Instance Instance Instance Instance Instance Disk Subsystem Performance LogicalDisk Avg. Disk Avg. Disk sec/read sec/write (G:) (H:) (I:) (J:) (K:) (L:) (M:) (N:) Disk Reads/sec Disk Writes/sec (n/a) (n/a) (n/a) (n/a) (n/a) (n/a) (n/a) (n/a) Avg. Disk Bytes/Write Log (O:) Log (P:) Log (Q:) Log (R:) Log (S:) Log (T:) Log (U:) Log (V:) EMC Celerra NS-120 (1,500 User) Storage Solutions for Microsoft Exchange 2007 SP1 28

29 Host System Performance Counter Average Minimum Maximum % Processor Time Available MBytes Free System Page Table Entries Transition Pages RePurposed/sec Pool Nonpaged Bytes Pool Paged Bytes Page Fault Stalls/sec Test Log 5/23/2009 5:54:27 AM -- Jetstress testing begins... 5/23/2009 5:54:27 AM -- Prepare testing begins... 5/23/2009 5:54:37 AM -- Attaching databases... 5/23/2009 5:54:37 AM -- Prepare testing ends. 5/23/2009 5:54:37 AM -- Dispatching transactions begins... 5/23/2009 5:54:37 AM -- cache settings: (minimum: MB, maximum: 2.0 GB) 5/23/2009 5:54:37 AM -- flush thresholds: (start: 20.5 MB, stop: 41.0 MB) 5/23/2009 5:54:47 AM -- read latency thresholds: (average: 0.02 seconds/read, maximum: 0.05 seconds/read). 5/23/2009 5:54:47 AM -- Log write latency thresholds: (average: 0.01 seconds/write, maximum: 0.05 seconds/write). 5/23/2009 5:54:49 AM -- Operation mix: Sessions 3, Inserts 40%, Deletes 30%, Replaces 5%, Reads 25%, Lazy Commits 55%. 5/23/2009 5:54:49 AM -- Performance logging begins (interval: ms). 5/23/2009 5:54:49 AM -- Generating log files... 5/23/2009 8:05:14 AM -- O:\ (100.8% generated), P:\ (100.8% generated), Q:\ (100.8% generated), R:\ (104.4% generated), S:\ (102.2% generated), T:\ (103.6% generated), U:\ (100.8% generated), and V:\ (100.2% generated) 5/23/2009 8:05:15 AM -- Performance logging ends. 5/23/2009 8:05:15 AM -- JetInterop batch transaction stats: 14496, 14495, 14530, 14814, 14563, 14728, 14398, and /23/2009 8:05:16 AM -- Dispatching transactions ends. 5/23/2009 8:05:16 AM -- Shutting down databases... 5/23/2009 8:05:17 AM -- Instance (complete), Instance (complete), Instance (complete), Instance (complete), Instance (complete), Instance (complete), Instance (complete), and Instance (complete) 5/23/2009 8:05:17 AM -- C:\Program Files\Exchange Jetstress\Performance_2009_5_23_5_54_47.blg has 519 samples. 5/23/2009 8:05:17 AM -- Creating test report... 5/23/2009 8:05:23 AM -- Volume G: has for Avg. Disk sec/read. 5/23/2009 8:05:23 AM -- Volume H: has for Avg. Disk sec/read. EMC Celerra NS-120 (1,500 User) Storage Solutions for Microsoft Exchange 2007 SP1 29

30 5/23/2009 8:05:23 AM -- Volume I: has for Avg. Disk sec/read. 5/23/2009 8:05:23 AM -- Volume J: has for Avg. Disk sec/read. 5/23/2009 8:05:23 AM -- Volume K: has for Avg. Disk sec/read. 5/23/2009 8:05:23 AM -- Volume L: has for Avg. Disk sec/read. 5/23/2009 8:05:23 AM -- Volume M: has for Avg. Disk sec/read. 5/23/2009 8:05:23 AM -- Volume N: has for Avg. Disk sec/read. 5/23/2009 8:05:23 AM -- Volume O: has for Avg. Disk sec/write. 5/23/2009 8:05:23 AM -- Volume O: has for Avg. Disk sec/read. 5/23/2009 8:05:23 AM -- Volume P: has for Avg. Disk sec/write. 5/23/2009 8:05:23 AM -- Volume P: has for Avg. Disk sec/read. 5/23/2009 8:05:23 AM -- Volume Q: has for Avg. Disk sec/write. 5/23/2009 8:05:23 AM -- Volume Q: has for Avg. Disk sec/read. 5/23/2009 8:05:23 AM -- Volume R: has for Avg. Disk sec/write. 5/23/2009 8:05:23 AM -- Volume R: has for Avg. Disk sec/read. 5/23/2009 8:05:23 AM -- Volume S: has for Avg. Disk sec/write. 5/23/2009 8:05:23 AM -- Volume S: has for Avg. Disk sec/read. 5/23/2009 8:05:23 AM -- Volume T: has for Avg. Disk sec/write. 5/23/2009 8:05:23 AM -- Volume T: has for Avg. Disk sec/read. 5/23/2009 8:05:23 AM -- Volume U: has for Avg. Disk sec/write. 5/23/2009 8:05:23 AM -- Volume U: has for Avg. Disk sec/read. 5/23/2009 8:05:23 AM -- Volume V: has for Avg. Disk sec/write. 5/23/2009 8:05:23 AM -- Volume V: has for Avg. Disk sec/read. 5/23/2009 8:05:23 AM -- Test has 0 Maximum Page Fault Stalls/sec. 5/23/2009 8:05:23 AM -- Test has 0 Page Fault Stalls/sec samples higher than 0. 5/23/2009 8:05:23 AM -- C:\Program Files\Exchange Jetstress\Performance_2009_5_23_5_54_47.xml has 518 samples queried. 5/23/2009 8:05:24 AM -- C:\Program Files\Exchange Jetstress\Performance_2009_5_23_5_54_47.html is saved. 5/23/2009 8:05:25 AM -- Performance logging begins (interval: 4000 ms). 5/23/2009 8:05:25 AM -- Recovering databases... 5/23/2009 8:33:51 AM -- Performance logging ends. 5/23/2009 8:33:51 AM -- Instance ( ), Instance ( ), Instance ( ), Instance ( ), Instance ( ), Instance ( ), Instance ( ), and Instance ( ) 5/23/2009 8:33:51 AM -- C:\Program Files\Exchange Jetstress\SoftRecovery_2009_5_23_8_5_24.blg has 425 samples. 5/23/2009 8:33:51 AM -- Creating test report... EMC Celerra NS-120 (1,500 User) Storage Solutions for Microsoft Exchange 2007 SP1 30