Vertical Scaling of Oracle 10g Performance on Red Hat Enterprise Linux 5 on Intel Xeon-Based Servers Oracle 10g Red Hat Enterprise Linux 5 Intel Xeon-based servers 3 1. Introduction and executive summary 4 2. Performance testing methodology 5 3. Oracle oltp performance and scaling on red hat enterprise linux 5 / harpertown (Intel e5540) 6 4. Oracle OLTP Performance and Scaling on Red Hat Enterprise Linux 5 / Tigerton (Intel X7350) 7 5. Oracle OLTP Performance and Scaling on Red Hat Enterprise Linux 5 / Dunnington (Intel X7600) 8 6. Conclusions 8 7. References www.redhat.com
Version 1.0 1801 Varsity Drive Raleigh, NC 27606-2072 USA Phone: +1 919 754 3700 Phone: +1 888 733 4281 Fax: +1 919 754 3701 PO Box 13588 Research Triangle Park, NC 27709 USA Linux is a registered trademark of Linus Torvalds. Red Hat, Red Hat Enterprise Linux and the Red Hat Shadowman logo are registered trademarks of Red Hat, Inc. in the United States and other countries. All other trademarks referenced herein are the property of their respective owners. 2009 by Red Hat, Inc. This material may be distributed only subject to the terms and conditions set forth in the Open Publication License, V1.0 or later (the latest version is presently available at http://www.opencontent.org/openpub/). The information contained herein is subject to change without notice. Red Hat, Inc. shall not be liable for technical or editorial errors or omissions contained herein. Distribution of modified versions of this document is prohibited without the explicit permission of Red Hat Inc. Distribution of this work or derivative of this work in any standard (paper) book for commercial purposes is prohibited unless prior permission is obtained from Red Hat Inc. The GPG fingerprint of the security@redhat.com key is: CA 20 86 86 2B D6 9D FC 65 F6 EC C4 21 91 80 CD DB 42 A6 0E 2 www.redhat.com
1. Introduction and Executive Summary Customers seriously considering migrating mission-critical applications from UNIX to Red Hat Enterprise Linux are demanding up-to-date vertical scaling data for Oracle performance. This is an update of an earlier study which demonstrated scaling up to eight cores. The goal of this study is to characterize the performance and vertical scaling of Oracle OLTP performance on Red Hat Enterprise Linux 5 running on Intel Xeon-based servers (up to 24 cores). The OLTP workload was used because it represents a very common type of database workload that exercises both the memory and I/O sub-systems. The performance metric is transactions per minute (TPM). Since this TPM performance metric is for a synthetic benchmark workload, the actual TPM for a real application will depend on the characteristics of the application. Figure 1 illustrates the excellent scaling achieved up to 24 cores. Figure 1 350 300 Oracle OLTP performance scaling on Red Hat Enterprise Linux 5 / Intel Xeon Thousands of TPM 250 200 150 100 50 0 0 5 10 15 20 25 30 Number of cores Harpertown Tigerton Dunnington www.redhat.com 3
2. Performance Testing Methodology Database performance and scalability often depend on many factors. However, it is impractical to try and collect data for all values of all factors that can influence Oracle performance on Red Hat Enterprise Linux. In order to get some useful information out to our sales, support, and consultants in the field in a timely manner, some judgment must be exercised in selecting the subset of the data that can be collected with the time and resources available. Specifically selected were: 1. Workload types: Online Transaction Processing (OLTP) Decision Support System (DSS) The OLTP workload was used because it represents a very common type of database workload which exercises both memory and I/O sub-systems. DSS workloads are less common and require large storage sub-systems. Since access to such storage subsystems was limited, we limited this version of the study to OLTP workloads. 2. File systems: EXT3 GFS NFS RAW device pseudo-files The EXT3 file system was selected as the basis for most of the experiments. EXT3 is a journalled file system and is the default system on Red Hat Enterprise Linux. Using a file system and/or LVM volumes for the Oracle databases maps to a large percent of users of Oracle on Red Hat Enterprise Linux. 3. I/O modes: Synchronous I/O Asynchronous I/O (AIO) Direct I/O (DIO) AIO with DIO (AIO + DIO) Raw I/O In previous experiments, it was observed that AIO+DIO consistently performed better than synch I/O, asynch I/O (AIO) and direct I/O (DIO) for OLTP workloads. So, studying AIO+DIO would yield the upper bound OLTP performance and scaling. AIO+DIO is what we recommend to our customers for OLTP workloads. 4. X86_64 servers: Intel Xeon AMD Opteron Processors from Intel s Harpertown, Tigerton, and Dunnington families were used. The enterprise customers simulated in these experiments, used the above OLTP workload with an average database size between 50 100 GB. 4 www.redhat.com
3. Oracle OLTP Performance and Scaling on Red Hat Enterprise Linux 5 / Harpertown (Intel E5440) 3.1 Configuration Processor Dual socket, quad-core (total of eight cores) Intel Xeon E5440 (Harpertown) 2.83 GHz, 8 GB RAM Storage EqualLogic PS3800XV iscsi array 4.8 TB (16 x 300 GB, 15 K RPM SAS drives) Operating system Red Hat Enterprise Linux 5.1 File system EXT3 Database Oracle 10g R2 3.2 Results (Figure 2) Oracle scaling on Red Hat Enterprise Linux 5 / Harpertown 90 80 Thousands of TPM 70 60 50 40 30 20 10 0 0 2 4 6 8 10 Number of cores www.redhat.com 5
4. Oracle OLTP Performance and Scaling on Red Hat Enterprise Linux 5 / Tigerton (Intel X7350) 4.1 Configuration Processor Quad socket, quad-core (total of 16 cores) Intel Xeon X7350 (Tigerton) 2.93 GHz, 32 GB RAM Storage HP StorageWorks 4400 Enterprise Virtual Array (EVA) 5.6 TB (20 x 280 GB drives) Operating system Red Hat Enterprise Linux 5.3 File system EXT3 Database Oracle 10g R2 4.2 Results (Figure 3) Oracle scaling on Red Hat Enterprise Linux 5 / Tigerton Thousands of TPM 200 180 160 140 120 100 80 60 40 20 0 0 5 10 15 20 Number of cores 6 www.redhat.com
5. Oracle OLTP Performance and Scaling on Red Hat Enterprise Linux 5 / Dunnington (Intel X7600) 5.1 Configuration Processor Storage Quad socket, hex-core (total of 24 cores) Intel Xeon E7350 (Tigerton) 2.93 GHz, 32 GB RAM HP StorageWorks 2000 Modular Smart Array (MSA) 1.716 TB (12 x 146 GB drives) for data + 2 x 80 GB Fusion IO SSD for logs Operating system Red Hat Enterprise Linux 5.3 File system Database EXT3 Oracle 10g R2 5.2 Results (Figure 4) Oracle scaling on Red Hat Enterprise Linux 5 / Dunnington 350 300 Thousands of TPM 250 200 150 100 50 0 0 5 10 15 20 25 30 Number of cores www.redhat.com 7
6. Conclusions Database OLTP workloads represent a large portion of enterprise database customers real environments today. Chip vendors are driving scalability and innovation through larger processor counts and cores/ chips. As this trend continues to increase from dual-to-quad, quad-to-hex core on x86_64 servers open source Red Hat Enterprise Linux will continue to optimize the operating system (OS) for database scalability. Enterprise applications like Oracle can benefit from incremental improvement in real customer environments as CPU-cores increase. While the hardware design ultimately determines the position of the scale curve, the operating system and its capabilities affect the slope of the curve. This study demonstrates that given adequate I/O bandwidth, Oracle database OLTP performance scales very well up to 24 cores with Red Hat Enterprise Linux 5 on Intel Xeon servers. In the future, we expect to demonstrate vertical scaling of database OLTP performance to servers with: even larger numbers of cores or hyper-threads newer chip technology, such as Intel Nehalem 7. References 1. Red Hat Reference Architecture: Tuning & Optimizing Red Hat Enterprise Linux for Oracle 9i and 10g Databases. Version 1.1, November 2007. redhat.com/rhel/resource_center/reference_architecture.html 2. Red Hat Reference Architecture: Performance & Scalability of Virtualized Oracle 10g Servers on Red Hat Enterprise Linux, Version 1.0, June 2008. redhat.com/rhel/resource_center/reference_architecture.html Red Hat Reference Architecture: Oracle 10 3. g Server on Red Hat Enterprise Linux 5 Deployment Recommendations, Version 1.2, November 2008. redhat.com/rhel/resource_center/reference_architecture.html Red Hat Sales and Inquiries NORTH AMERICA 1 888 REDHAT1 www.redhat.com EUROPE, MIDDLE EAST AND AFRICA 00800 7334 2835 www.europe.redhat.com europe@redhat.com ASIA PACIFIC +65 6490 4200 www.apac.redhat.com apac@redhat.com LATIN AMERICA +54 11 4341 6200 www.latam.redhat.com info-latam@redhat.com Copyright 2010 Red Hat, Inc. Red Hat, Red Hat Enterprise Linux, the Shadowman logo, JBoss, MetaMatrix, and RHCE are trademarks of Red Hat, Inc., registered in the U.S. and other countries. Linux is the registered trademark of Linus Torvalds in the U.S. and other countries. All other trademarks referenced herein are the property of their respective owners. www.redhat.com #2698477_0610