EMC Solutions for Microsoft Exchange 2007 Virtual Exchange 2007 in a VMware ESX Datastore with a VMDK File Replicated Virtual Exchange 2007 within a VMware ESX datastore VMDK file replicated EMC Commercial Solutions Group Corporate Headquarters Hopkinton, MA 01748-9103 1-508-435-1000 www.emc.com www.emc.com
Copyright 2008 EMC Corporation. All rights reserved. Published February, 2008 EMC believes the information in this publication is accurate as of its publication date. The information is subject to change without notice. THE INFORMATION IN THIS PUBLICATION IS PROVIDED AS IS. EMC CORPORATION MAKES NO REPRESENTATIONS OR WARRANTIES OF ANY KIND WITH RESPECT TO THE INFORMATION IN THIS PUBLICATION, AND SPECIFICALLY DISCLAIMS IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Use, copying, and distribution of any EMC software described in this publication requires an applicable software license. For the most up-to-date listing of EMC product names, see EMC Corporation Trademarks on EMC.com. All other trademarks used herein are the property of their respective owners. EMC Solutions for Microsoft Exchange 2007 Virtual Exchange 2007 in a VMware ESX Datastore with a VMDK File Replicated P/N H4171 2 EMC Solutions for Microsoft Exchange 2007 Virtual Exchange 2007 in a VMware ESX Datastore with a VMDK File Replicated
Contents About this Document... 5 Chapter 1 Solution Overview... 7 Technology solution... 8 Chapter 2 Solution Architecture... 9 Physical architecture... 10 Network architecture... 11 Microsoft Exchange Server architecture... 13 Storage architecture... 13 Building blocks... 14 Consolidate...14 Backup/Advanced and Protect... 14 VMware... 15 Chapter 3 Hardware and Software Resources... 17 Hardware resources... 18 Software resources... 18 Virtual Infrasturcture server...18 Appendix A Hotfixes... 21 Hotfixes... 22 EMC Solutions for Microsoft Exchange 2007 Virtual Exchange 2007 in a VMware ESX Datastore with a VMDK File Replicated 3
Contents 4 EMC Solutions for Microsoft Exchange 2007 Virtual Exchange 2007 in a VMware ESX Datastore with a VMDK File Replicated
About this Document This document provides an overview of the architecture of the EMC Solution for Microsoft Exchange 2007 Virtual Exchange 2007 in a VMware ESX Datastore with a VMDK file replicated. This solution was developed by the EMC Commercial Solutions Group. Purpose The consolidate solution was designed as a set of performance measurements to determine the bounding point of the solution stack in terms of performance. A reasonable amount of tuning was performed in order to ensure that the performance measurements achieved were consistent with real-world, best-of-breed performance. Audience This document is intended for internal EMC personnel, partners, and customers. Scope This document describes the architecture of an EMC Solution built and tested at the EMC Commercial Solutions Validation labs in Research Triangle Park, N.C. Implementation instructions and sizing guidelines are beyond the scope of this document. For detailed information about the tests performed to validate this solution, refer to the next section. Related documents The following document, located on Powerlink, provides additional, relevant information. Access to this document is based on your login credentials. If you do not have access to the following content, contact your EMC representative: EMC Solutions for Microsoft Exchange 2007 CLARiiON CX3 Series iscsi - Best Practices Planning EMC Solutions for Microsoft Exchange 2007 Virtual Exchange 2007 in a VMware ESX Datastore with a VMDK File Replicated 5
About this Document 6 EMC Solutions for Microsoft Exchange 2007 Virtual Exchange 2007 in a VMware ESX Datastore with a VMDK File Replicated
Chapter 1 Solution Overview This chapter presents this topic: Technology solution... 8 EMC Solutions for Microsoft Exchange 2007 Virtual Exchange 2007 in a VMware ESX Datastore with a VMDK File Replicated 7
Solution Overview Technology solution A consolidated Microsoft Exchange infrastructure is the first step toward meeting the challenges of managing e-mail. The Virtual Exchange 2007 within a VMware ESX datastore having the VMDK file replicated for an Advanced Backup and Recovery solution for the Exchange Server and Windows Server operating system is an integrated, low-cost, lifecycle solution that delivers availability and performance for today, scaling for tomorrow. It does this while maximizing the financial and operational benefits of Exchange and enabling rapid database recovery and restoration. The solution eliminates the need for.pst (Personal Storage) files and automates the movement of older e-mail by archiving them to lower-cost devices and by storing years of e-mail in a single storage array. The solution offers guaranteed and verifiable authenticity of e-mail with optimized search, retrieval, and management of e-mail archives. 8 EMC Solutions for Microsoft Exchange 2007 Virtual Exchange 2007 in a VMware ESX Datastore with a VMDK File Replicated
Chapter 2 Solution Architecture This chapter presents these topics: Physical architecture... 10 Network architecture... 11 Microsoft Exchange Server architecture... 13 Storage architecture... 13 Building blocks... 14 Backup/Advanced and Protect... 14 VMware... 15 EMC Solutions for Microsoft Exchange 2007 Virtual Exchange 2007 in a VMware ESX Datastore with a VMDK File Replicated 9
Solution Architecture Physical architecture Figure 1 shows the overall physical architecture of Virtual Exchange 2007 within a VMware ESX datastore having the VMDK file replicated. The four-part solution described is an addition to the advanced backup portion that has the ability to replicate the VMware guest and start up the Exchange Server on completely different hardware running the ESX Server 3.5. This solution was designed to decrease the difficulty of bringing new e-mail servers online while allowing customers to quickly restore e-mail services in the event of loss of drives where the VMware ESX datastore is located. VMware ESX Server already has the capabilities of VMotion, DRS, and VMHA. This solution adds to the functionality by having a replica of the VMDK files for a quick restore, or a quick startup, on different VMware ESX Servers. Backup and restore of the file system on an Exchange 2007 server can be extremely difficult and time consuming, resulting in a high recover to operations time or production time. At times, it is faster to mount the databases on a different Exchange Server than to rebuild the existing physical server. With this solution, recovery is required only in restoring the replica or mounting the replica from another ESX Server. In the event of virus attacks, failed hotfixes or services packs, this solution allows for a quick recovery of operations. A VMware ESX Server 3.5 was used for consolidation of hardware for a low-cost solution. Although it still has the ability to home a midsize enterprise level of mailboxes, this solution will also work in a physical environment requiring individual server hardware through the VMware guest identified as follows: Note: Figure 1 shows the CX3-20 diagram. 10 EMC Solutions for Microsoft Exchange 2007 Virtual Exchange 2007 in a VMware ESX Datastore with a VMDK File Replicated
Solution Architecture Figure 1 Physical architecture of Virtual Exchange 2007 on VMDK file replicated Network architecture The network architecture discussed in this reference architecture focuses on two areas: Virtualization using VMware ESX 3.5, and iscsi technology. iscsi technology is a blossoming technology allowing customers to connect to storage arrays utilizing existing Ethernet networks as an ideal fit. iscsi works best with low bandwidth, high I/O. Exchange of small I/O (a size of 8k for Exchange 2007) means iscsi can scale to tens of thousands of users simply by using GbE NICs and the Microsoft Software Initiator. EMC Solutions for Microsoft Exchange 2007 Virtual Exchange 2007 in a VMware ESX Datastore with a VMDK File Replicated 11
Solution Architecture Virtualization is an upcoming technology that can be used for consolidated usage of hardware along with high availability using VMware technologies within the ESX Server such as VMotion, DRS, and VMHA. A CLARiiON CX3-20 using Microsoft iscsi Initiator on the hosts, along with EMC s PowerPath software in an interconnect SP design, allows for multiple paths and fault tolerance in the event of a SP failure. Note: Figure 2 shows the iscsi connection ports for the CX3-20. Figure 2 iscsi connection ports for CX3-20 Note: Figure 3 shows the Microsoft iscsi Initiator configuration. 12 EMC Solutions for Microsoft Exchange 2007 Virtual Exchange 2007 in a VMware ESX Datastore with a VMDK File Replicated
Solution Architecture Figure 3 iscsi Initiator Properties Microsoft Exchange Server architecture Storage architecture The Microsoft Exchange Server architecture (refer to Figure 1) represents a stand-alone configuration using Microsoft Windows 64-bit Microsoft Windows 2003 Enterprise Edition SP2, Exchange 2007 Enterprise Edition installed for messaging with PowerPath 5.0 64-bit, Microsoft iscsi 2.0.5 64-bit, and Navisphere Agent/CLI.26 64-bit installed for storage array access using iscsi. After the installation of Exchange, it is highly recommended to run the Microsoft Best Practices Analyzer. In the current setup, Microsoft Best Practices Analyzer is installed with Exchange 2007, following all recommendations for performance tuning and hotfix installation found in the Exchange Management Console (EMC). The Exchange Server is connected to the external storage through iscsi connections created using Microsoft iscsi Initiator 2.0.5. Note: For instructions on the configuration and setup of the iscsi targets please refer to EMC Solutions for Microsoft Exchange 2007 CLARiiON CX3 Series iscsi - Best Practices Planning An EMC CLARiiON CX3-20 provides external storage to the Exchange Server. The Exchange message stores and logs are accessed through the assigned ports logged through the Microsoft iscsi Initiator. Service processor failover of LUNs is available through PowerPath 5.0. The storage architecture is based on a new design utilizing building blocks. This design builds upon itself as customers grow and require additional space and fault tolerance The building blocks guarantee performance and minimize design and operations complexity in increments of four-disk RAID 10 building blocks, with a 0.42 user I/O profile and a maximum mailbox size of 270 MB. EMC Solutions for Microsoft Exchange 2007 Virtual Exchange 2007 in a VMware ESX Datastore with a VMDK File Replicated 13
Solution Architecture RAID 10 supports high fault tolerance and performance levels with the least amount of disks and the maximum number of users. Thorough testing proves that the design approach using building blocks provides exceptional performance. Building blocks Consolidate The building blocks 1 design is set up using four Exchange storage groups, one database per storage group. For the databases, four-drive (300 GB/15,000 rpm FC) RAID 1_0 RAID groups will be created, and four LUNs of 120 GB will be created within each of the newly-created RAID groups. The RAID group is created for the log file LUNs in a four-drive (300 GB/15,000 rpm FC) RAID1_0 RAID group and four LUNs of 12 GB will be created within the newly-created RAID group. The databases will be placed onto the corresponding LUNs (drive or mount point) created on the 120 GB LUNs. Log files will be placed onto the corresponding 12 GB LUN (drive or mount point) along with a LUN created to home the VMware datastores that hold the boot file (VMDK) for the Exchange 2007 operating system. Note: Figure 4 shows the drive layout. Figure 4 Drive layout Backup/Advanced and Protect To backup the replica of the VMware VMDK file, a VMware ESX 3.5 was used in addition to the advanced backup process. A three-disk RAID 5 configuration was used for the location of the Exchange Server operating system to boot the VMDK file, and an additional three-disk RAID 5 was used for the replica of the VMDK file. 14 EMC Solutions for Microsoft Exchange 2007 Virtual Exchange 2007 in a VMware ESX Datastore with a VMDK File Replicated
Solution Architecture VMware VMware guests were configured on the CLARiiON in a RAID 5 configuration for fast reads during boot and to maximize space for the VMDK (boot) files for the reference architecture guests described in this solution. EMC Solutions for Microsoft Exchange 2007 Virtual Exchange 2007 in a VMware ESX Datastore with a VMDK File Replicated 15
Solution Architecture 16 EMC Solutions for Microsoft Exchange 2007 Virtual Exchange 2007 in a VMware ESX Datastore with a VMDK File Replicated
Chapter 3 Hardware and Software Resources This chapter presents these topics: Hardware resources... 18 Software resources... 18 EMC Solutions for Microsoft Exchange 2007 Virtual Exchange 2007 in a VMware ESX Datastore with a VMDK File Replicated 17
Hardware and Software Resources Hardware resources Table 1 shows the hardware resources used in this solution: Table 1 Hardware resources Quantity Hardware Configuration 1 CLARiiON CX3-10 FLARE.26 1 DAE3P 15 300 GB 15k rpm FC drives 1 Dell 1950 4 dual-core EM64T Family 6 Model 15 Stepping 7 GenuineIntel ~2328 MHz 16 GB RAM 3 Dell 6850 4 dual-core EM64T Family 6 Model 15 Stepping 7 GenuineIntel ~2328 MHz 64 GB RAM 4 Intel PRO/1000 MT Network connection 2 Broadcom BCM5708C NetXtreme II GigE (NDIS VBD client) 2 Dell 5324 Gigabit Ethernet switch 2 VLANs 1 Production 2 iscsi Software resources Table 2 shows the software resources used in this solution: Table 2 Software resources Software Version Count VMware ESX 3.5 build 59330 3 Microsoft Windows 2003 Enterprise Edition x64 SP2 3 Microsoft iscsi Initiator 2.0.5 1 EMC PowerPath 5.0 1 Navisphere Agent/CLI.26 1 Virtual Infrastructure server Table 3 shows the details of the Virtual Infrastructure server used in this solution: Table 3 Virtual Infrastructure server Software Version Purpose Microsoft Windows 2003 Enterprise 32-bit 5.2.3790 Service Pack 2 Operating system (OS) build 3790 Microsoft.Net 2.0 SP1 Needed for the Virtual Infrastructure server Microsoft SQL Desktop Engine Part of the Virtual Infrastructure server to store information about 18 EMC Solutions for Microsoft Exchange 2007 Virtual Exchange 2007 in a VMware ESX Datastore with a VMDK File Replicated
Hardware and Software Resources Software Version Purpose the virtual infrastructure VMware Virtual Infrastructure server 2.5 To manage the ESX Server centrally VMware Virtual Infrastructure client 2.5 To access Virtual Infrastructure server features EMC Solutions for Microsoft Exchange 2007 Virtual Exchange 2007 in a VMware ESX Datastore with a VMDK File Replicated 19
Hardware and Software Resources 20 EMC Solutions for Microsoft Exchange 2007 Virtual Exchange 2007 in a VMware ESX Datastore with a VMDK File Replicated
Appendix A Hotfixes This appendix presents this topic: Hotfixes... 22 EMC Solutions for Microsoft Exchange 2007 Virtual Exchange 2007 in a VMware ESX Datastore with a VMDK File Replicated 21
Hotfixes Hotfixes [20]: Q147222 [21]: SP1 - SP [22]: KB925398_WMP64 [23]: KB914961 - Service Pack [24]: KB926139 - Update [25]: KB921503 - Update [26]: KB924667-v2 - Update [27]: KB925902 - Update [28]: KB926122 - Update [29]: KB927891 - Update [30]: KB929123 - Update [31]: KB930178 - Update [32]: KB932596 - Update [33]: KB933729 - Update [34]: KB935839 - Update [35]: KB935840 - Update [36]: KB936021 - Update [37]: KB936357 - Update [38]: KB936782 - Update [39]: KB938127 - Update [40]: KB939653 - Update [41]: KB943460 - Update 22 EMC Solutions for Microsoft Exchange 2007 Virtual Exchange 2007 in a VMware ESX Datastore with a VMDK File Replicated