EMC CLARiiON CX3 Series FCP

Transcription

1 EMC Solutions for Microsoft SQL Server 2005 on Windows 2008 EMC CLARiiON CX3 Series FCP EMC Global Solutions 42 South Street Hopkinton, MA

2 Copyright 2008 EMC Corporation. All rights reserved. Published September, 2008 EMC believes the information in this publication is accurate as of its publication date. The information is subject to change without notice. THE INFORMATION IN THIS PUBLICATION IS PROVIDED AS IS. EMC CORPORATION MAKES NO REPRESENTATIONS OR WARRANTIES OF ANY KIND WITH RESPECT TO THE INFORMATION IN THIS PUBLICATION, AND SPECIFICALLY DISCLAIMS IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Use, copying, and distribution of any EMC software described in this publication requires an applicable software license. For the most up-to-date listing of EMC product names, see EMC Corporation Trademarks on EMC.com. All other trademarks used herein are the property of their respective owners. EMC Solutions for Microsoft SQL Server 2005 on Windows 2008 EMC CLARiiON CX3 Series FCP P/N H EMC Solutions for Microsoft SQL Server 2005 on Windows 2008 EMC CLARiiON CX3 Series FCP

3 Contents About this Document... 5 Chapter 1 Solution Overview... 7 Business challenge... 8 Technology solution... 8 Solution advantages... 8 Chapter 2 Solution Architecture... 9 Overall architecture General characteristics Network architecture Switches Storage architecture Disk configuration Application server architecture Microsoft SQL Server 2005 cluster architecture Application architecture Chapter 3 Hardware and Software Resources Hardware resources Software resources Appendix A Detailed Server Hardware Listing Detailed server hardware listing EMC Solutions for Microsoft SQL Server 2005 on Windows 2008 EMC CLARiiON CX3 Series FCP 3

4 Contents 4 EMC Solutions for Microsoft SQL Server 2005 on Windows 2008 EMC CLARiiON CX3 Series FCP

5 About this Document This document provides an overview of the architecture of an EMC Database Solution using Microsoft SQL Server 2005, developed by the EMC Global Solutions group. Purpose Information in this document can be used as the basis for a solution build, white paper, best practices document, or training. Information in this document can also be used by other EMC organizations (for example, the technical services or sales organization) as the basis for producing documentation for a technical services or sales kit. Audience This document is intended for internal EMC personnel, EMC partners, and EMC customers. Scope This document describes the architecture of an EMC industry solution built and tested at the EMC Global Solutions lab at Research Triangle Park, North Carolina. Implementation instructions and sizing guidelines are beyond the scope of this document. For detailed information about the tests performed to validate this solution, refer to the EMC Solutions for Microsoft SQL Server 2005 CLARiiON CX3 FCP - Validation Test Report Related documents The following documents, located on Powerlink, provide additional, relevant information. Access to these documents is based on your login credentials. If you do not have access to the following content, contact your EMC representative: EMC Solutions for Microsoft SQL Server 2005 CLARiiON CX3 Series FCP - Applied Best Practices EMC Solutions for Microsoft SQL Server 2005 CLARiiON CX3 Series FCP - Validation Test Report EMC Solutions for Microsoft SQL Server 2005 on Windows 2008 EMC CLARiiON CX3 Series FCP 5

6 About this Document 6 EMC Solutions for Microsoft SQL Server 2005 on Windows 2008 EMC CLARiiON CX3 Series FCP

7 Chapter 1 Solution Overview This chapter presents these topics: Business challenge... 8 Technology solution... 8 Solution advantages... 8 EMC Solutions for Microsoft SQL Server 2005 on Windows 2008 EMC CLARiiON CX3 Series FCP 7

8 Solution Overview Business challenge Technology solution With increasing demands and limited resources, today s midsize enterprises face challenges similar to their larger counterparts. Apart from managing the burgeoning IT costs and reducing the risk of business disruption, some of the challenges that midsize enterprises face include: Consolidating multiple database applications scattered throughout the enterprise Ensuring information access, availability, and continuity Maximizing server and storage utilization to deliver optimal system performance Managing upgrades and migrations Reducing the demands on limited IT resources and budgets Decreasing the complexity of technology choices The Microsoft SQL Server 2005 EMC CLARiiON CX3 Series FCP solution leverages SAN connectivity to consolidate Microsoft database information. Centralization of information and consolidation of resources create immense economic advantages for any business. Solution advantages The solution offers the following advantages: Table 1 Solution advantages Benefit Maintain service levels Reduce costs Reduce risk Accelerate implementations Details Keep critical and revenue-generating Microsoft applications available and running at peak performance. Minimize the cost of database and information management. Proven reference architecture with tested and validated configurations to ensure performance and scalability, among others. EMC Professional Services and ASN-certified EMC Partners provide rapid assessment and efficient implementation. 8 EMC Solutions for Microsoft SQL Server 2005 on Windows 2008 EMC CLARiiON CX3 Series FCP

9 Chapter 2 Solution Architecture This chapter presents these topics: Overall architecture General characteristics Network architecture Storage architecture Disk configuration Application server architecture EMC Solutions for Microsoft SQL Server 2005 on Windows 2008 EMC CLARiiON CX3 Series FCP 9

10 Solution Architecture Overall architecture Figure 1 shows the overall architecture of the Microsoft SQL Server 2005 CX3 FCP solution. The solution is currently made up of modules that are comprised of the following components: Client (or public) LAN and FC SAN networks Microsoft SQL Server 2005 cluster connected to the client LAN and FC SAN networks Clients connected to the Microsoft SQL Server 2005 cluster through the client LAN Option to use Microsoft SQL Server 2005 Database Mirroring Figure 1 Overall architecture of the Microsoft SQL Server 2005 CLARiiON CX3 FC solution General characteristics The solution architecture has the following general characteristics: The Microsoft SQL Server 2005 resides on a two-node active/passive cluster to provide local high availability. 10 EMC Solutions for Microsoft SQL Server 2005 on Windows 2008 EMC CLARiiON CX3 Series FCP

11 Solution Architecture The Microsoft SQL Server 2005 Enterprise Edition SP2 (64-bit) runs on Windows 2008 Enterprise Edition 64-bit. EMC PowerPath (multipath software) runs on each server in the Microsoft SQL Server 2005 cluster to provide path load-balancing and failover capabilities. The database datafiles, logfiles, TempDB files, and system database files reside on separate RAID groups (physical RAID arrays). The LUNs for database files and database logfiles are designed specifically to sustain TPC-C (simulated OLTP) type I/O loads. The EMC CLARiiON CX3-40 storage system can support other applications in addition to the Microsoft SQL Server IP (Gigabit Ethernet and VLAN) connections are designed to balance and distribute network traffic. All database files are stored on the CLARiiON CX3-40 storage system, thereby decreasing server replacement complexity. Network architecture Switches The management and client networks shown in Figure 1 include IP switches. These switches support Gigabit Ethernet (GbE) connections. Storage architecture The solution uses Fibre Channel technology and a standard switched-fabric topology. The switches use VLANs to segment specific port groups that the storage and hosts are connected to. Figure 2 illustrates the ports on the EMC CLARiiON CX3-40 storage processor. Figure 2 EMC CLARiiON CX3-40 storage processor ports The CX3-40 storage processor supports two front-end (optical) 4 Gb/s Fibre Channel ports, four front-end iscsi (copper) 1 Gb/s ports, and one back-end (copper) 4 Gb/s Fibre Channel port. EMC Solutions for Microsoft SQL Server 2005 on Windows 2008 EMC CLARiiON CX3 Series FCP 11

12 Solution Architecture The storage processor supports host port operation in 1 Gb, 2 Gb, and 4 Gb modes for compatibility with an existing Fibre Channel infrastructure. The mode is independently determined for every port and can be changed using the CLARiiON Navisphere Management Console. Additional ports on the storage processor are as follows: RS232 serial up to 115k baud service port with modem support capabilities (micro DB9) RS232 serial SPS port (micro DB9) 10/100 LAN management port (RJ45) 10/100 LAN service port (RJ45) Light-emitting diodes (LEDs) indicate the status of the power and port links. Disk configuration The CLARiiON storage system consists of a series of disk-array enclosures (DAEs). Each DAE can hold up to 15 disks. The CX3-40 can scale up to eight DAEs with a total of 120 disks. The disks can be logically combined across DAEs to form RAID groups. The RAID groups can be segmented into logical unit numbers, or LUNs. The LUNs can be exposed to the Microsoft Windows operating system. When additional storage is required, disks can be added to DAEs that are not yet full, or new DAEs can be installed and combined into additional RAID groups. The LUNs can be expanded to form metaluns. A metalun retains the logical unit number of the original LUN. The metaluns can also be exposed to the Microsoft Windows operating system. Note: EMC CLARiiON FLARE two-disk RAID 1/0 is similar to RAID 1 (FLARE is the CLARiiON operating environment). Both employ one-to-one disk mirroring. The significant difference between the two is that RAID 1/0 supports RAID group expansion (assigning additional disks to a RAID group) whereas RAID 1 does not. The following disk configuration was used as a part of this solution: Table 2 Disk configuration Configuration Number of spindles System TempDB Data Log Backup A single disk configuration was tested that had 12 spindles for the TPC-C database data and four database log spindles. 12 EMC Solutions for Microsoft SQL Server 2005 on Windows 2008 EMC CLARiiON CX3 Series FCP

13 Solution Architecture Figure 3 illustrates the distribution of application files across the spindles. Figure 3 Disk Configuration 1 In the configuration, the TPC-C database datafiles were stored in two datafiles, each in its own LUN, and both LUNs were taken from the RAID 1/0 group of 12 spindles. Each LUN of 200 GB (total of 400 GB) contained a single database datafile of 175 GB (350 GB total). Therefore, the total size of the database datafiles was 350 GB, of which 240 GB was used at the beginning of the test iteration set. The TPC-C database logfile was contained on a single LUN, which was presented from the RAID 1/0 group of four spindles. The single database log LUN was 100 GB, and contained a 50 GB database logfile. The two spindles allocated to the system area contained a LUN that had all of the system database files and logfiles, such as msdb, master, model, and so on. If the change rate of any of the system databases is high, or if the more recent data is critical, then it is recommended that the system database logfiles be stored on a LUN that is on a different RAID group, thereby physically isolating the logs from the database to maximize recoverability. In the solution that was tested, as the system databases sustained few or no changes at regular intervals, this was not an issue. The quorum LUN for a cluster can also be located on the same spindles as the system databases. This should not be an issue in most scenarios. However, if the RAID group were to become busy, there is a possibility that the cluster might see the quorum LUN as unavailable and cause a needless cluster failover. Therefore, it is important that the quorum LUN be located on a RAID group that will not become excessively busy. For the current solution, as the system databases are never put under much stress, it is acceptable to have the quorum LUN in the same RAID group as the system databases. Tempdb was isolated to its own two-spindle RAID 1/0 group as this is a recommended best practice from Microsoft. EMC Solutions for Microsoft SQL Server 2005 on Windows 2008 EMC CLARiiON CX3 Series FCP 13

14 Solution Architecture However, these spindles were seldom used as the TPC-C workload puts effectively zero workload on the tempdb database. The 15k rpm physical Fibre Channel disks are 146 GB in size with 133 GB of usable space. In a RAID 1/0 configuration, the disks are both mirrored and striped, which results in approximately half of the RAID group s capacity being lost to disk mirrors. Therefore, the capacity of a four-spindle RAID 1/0 group is approximately 266 GB, or (4 * 133 GB) / 2. Nine spindles were set up in a RAID 3 array to be used for backup and restore purposes. RAID 3 was used because it provides an excellent throughput for serial I/O per second (IOPS) and backups are exclusively serial. Table 3 lists each file/activity type and indicates where it resides or is recorded: Table 3 Application file or activity types and locations Application server architecture File or activity type Location RAID level Total number of physical disks Database binary files Host local disk RAID 1 N/A TPC-C database log CX3-40 RAID 1/0 4 files TempDB files CX3-40 RAID 1/0 2 TPC-C database CX3-40 RAID 1/0 12 datafiles Cluster quorum disk CX3-40 RAID 1/0 2 MSDTC 1 (optional) CX3-40 RAID 1/0 2 System database files CX3-40 RAID 1/0 2 This section describes the application server architecture. Microsoft SQL Server 2005 cluster architecture Each of the two servers in the Microsoft SQL Server 2005 cluster has two FC and six network interfaces. While the FC interfaces connect to the SAN, the network interfaces connect to the other server in the cluster (to enable the heartbeat through a crossover). One interface connects to the client (public) network, and four interfaces are available for future needs. Table 4 lists each interface and describes its use. 1 Microsoft Distributed Transaction Coordinator. This software enables a single transaction to include data from multiple source locations. The software then coordinates the process of committing the transaction across the various locations. 14 EMC Solutions for Microsoft SQL Server 2005 on Windows 2008 EMC CLARiiON CX3 Series FCP

15 Solution Architecture Table 4 Application server network interface configuration Interface port ID FC0 FC1 Eth0 Eth1 Eth2 Eth3 Description SAN connection SAN connection Public network Future use Future use Future use High availability and failover The validated solution provides protection at the storage and host layers. Storage layer The CLARiiON CX3-40 has two storage processors to provide high availability and load balancing. In the validated solution, the two storage processors provide seamless failover capabilities for the storage. This minimizes disruption during maintenance or possible component failure. The RAID configuration on the CLARiiON back end provides protection against hard disk failures. Host layer The application hosts have redundant power supplies, FC connections, and network connections to reduce the impact of host hardware failure. Microsoft Cluster Services The Microsoft Cluster Services (MSCS) is enabled on each of the two clustered application servers. These servers operate in active/passive mode to provide local protection against potential hardware failure of the active server. The MSCS shared storage, which includes the quorum disk files, database files, and all system database files, resides on the CLARiiON storage. Application architecture No special configuration settings were used for Microsoft SQL Server 2005 during the solution testing. All default settings were used for memory, processors, network, threads, and so on. The only exception was that it was verified that the account under which the SQL Server service ran had the Lock Pages In Memory, and the Perform Volume Maintenance Tasks user rights, to allow the SQL Server to prevent pages from being swapped and to enable fast file initialization. EMC Solutions for Microsoft SQL Server 2005 on Windows 2008 EMC CLARiiON CX3 Series FCP 15

16 Solution Architecture 16 EMC Solutions for Microsoft SQL Server 2005 on Windows 2008 EMC CLARiiON CX3 Series FCP

17 Chapter 3 Hardware and Software Resources This chapter presents these topics: Hardware resources Software resources EMC Solutions for Microsoft SQL Server 2005 on Windows 2008 EMC CLARiiON CX3 Series FCP 17

18 Hardware and Software Resources Hardware resources The Microsoft SQL Server 2005 CX3 Series FCP solution uses the hardware resources listed in Table 5. Note: The hardware and software quantities listed include the disaster recovery (DR) site resources. For a more detailed list of the hardware used in the 1U and 4U servers, refer to the section Detailed Server Hardware Listing. Table 5 Hardware resources Hardware Quantity Configuration Notes Store 4U server Two Four 2.8-GHz AMD Opteron dual-core processors 32 GB of memory One active/passive cluster Dell 6248 switch Two 48 (copper) 1 Gb/s ports QLogic 5600 FC Two Sixteen 4 Gb/s FC ports switch EMC CLARiiON CX3-40 One Two storage processors (SPs) Two 4 Gb/s FC connections per SP Three FC shelves (DAE) Fifteen 146 GB (15k) FC disks per DAE FLARE 3.26 Software resources The software resources used are listed in Table 6. Table 6 Software resources Software Store Microsoft Windows 2008 Server Enterprise Edition, 64-bit Microsoft SQL Server 2005 Enterprise, 64-bit SP2 Number of licenses Two One Configuration SQL Application Server One license per node in the cluster Using EMC PowerPath * One license per cluster 18 EMC Solutions for Microsoft SQL Server 2005 on Windows 2008 EMC CLARiiON CX3 Series FCP

19 Appendix A Detailed Server Hardware Listing This appendix presents this topic: Detailed server hardware listing EMC Solutions for Microsoft SQL Server 2005 on Windows 2008 EMC CLARiiON CX3 Series FCP 19

20 Detailed Server Hardware Listing Detailed server hardware listing Table 7 Detailed server hardware listing Features Processors 1U servers Two Xeon 5345 quad-core processors Chipset Front-side bus I/O channels (5) Intel 5000X Greencreek 1333 MHz PCI Express riser with two x8 lane slots Intel PRO/1000 PT Quad Port network card Memory RAID support Video Networking Features Processors 32 GB 667 MHz FBD, ECC PERC 5/i serial-attached SCSI RAID controller with 256 MB cache Embedded ATI RN50 with 16 MB memory Dual-embedded Broadcom Gigabit NICs (5708) with TOE disabled 4U servers Four AMD 8218 dual-core processors Chipset Front-side bus I/O channels (4) Memory RAID support Video Networking Broadcom HT-2100 and HT-1000 Server I/O controllers 1 GHz HyperTransport PCI Express expansion slots 2x8, 5x4 Intel PRO/1000 PT Quad Port network card (8-lane connector) QLogic QLE2462, 4 Gb/s FC card (8-lane connector) 32 GB 667 MHz ECC PERC 5/i serial-attached SCSI RAID controller with 256 MB cache Integrated ATI ES1000 with 16 MB memory Dual-embedded Broadcom Gigabit NICs (5708) with TOE disabled 20 EMC Solutions for Microsoft SQL Server 2005 on Windows 2008 EMC CLARiiON CX3 Series FCP