OLTP Server Evaluation 3Q02: Expanded Comparisons

Transcription

1 Decision Framework, A. Butler, G. Weiss Research Note 17 October 2002 OLTP Server Evaluation 3Q02: Expanded Comparisons The August 2002 online transaction processing server evaluation model features a simplified look and adds Hewlett-Packard's NonStop. 's zseries wins yet again, but the Unix competitors are catching up. Core Topic Hardware Platforms: Server Platforms Key Issue How will centralized and distributed servers evolve during the next five years? The latest update of Gartner's spreadsheet-based server evaluation model introduces a simpler format and a new platform. This model has existed since 1999 and is now available in its sixth major iteration. The server evaluation model was originally created for Gartner's own internal use; however, it is also designed to be flexible, enabling users to modify existing scores, change the weighting factors used and even assign their own measurement criteria. Use the Gartner server evaluation model as a numerically specific methodology to complement Gartner's Magic Quadrant. The server evaluation model findings are also synchronized to reflect other Gartner research positions, such as the recent high-availability study. The model also provides a good basis for creating requests for proposal. Recognizing the growing acceptance of "best of breed" technologies, the server evaluation model helps users deploy servers in specific application-dependent situations such as online transaction processing (OLTP) or enterprise resource planning (ERP) and data warehousing. A server may be wellqualified for one kind of deployment, but not for others. Here, we examine the latest version of the OLTP model. "'s Regatta Still Lags NCR Teradata in Data Warehousing" covers the data warehousing model, which has also been updated. New Format Previous versions of the OLTP/ERP model have featured two separate models one called "Volume Leaders" for the zseries and major midrange Unix and proprietary platforms, and a second model for Intel-based servers. We have now integrated the two models into one version, which should make it much easier to assess the relative strengths and weaknesses of mainframe machines vs. reduced instruction set computer (RISC) Unix servers vs. Intel-based servers. Gartner Entire contents 2002 Gartner, Inc. All rights reserved. Reproduction of this publication in any form without prior written permission is forbidden. The information contained herein has been obtained from sources believed to be reliable. Gartner disclaims all warranties as to the accuracy, completeness or adequacy of such information. Gartner shall have no liability for errors, omissions or inadequacies in the information contained herein or for interpretations thereof. The reader assumes sole responsibility for the selection of these materials to achieve its intended results. The opinions expressed herein are subject to change without notice.

2 The server evaluation model tends to evaluate the "flagship" model of each server range, and we have often specified the platform to help avoid confusion. Where necessary, specific operating system releases are also named. For example, we have evaluated Solaris 8 for Sun Microsystems and Fujitsu Siemens Computers (FSC), even though Solaris 9 is now available, because we believe that few users will have Solaris 9 installed. In addition, the software portfolio for Solaris 9 is still immature. However, Solaris 9 does introduce many technological improvements over the previous version (for example, greatly improved workload management and a new virtual partitioning feature called "Containers"). Users should consider the mostappropriate Solaris version in their dealings with both vendors. Merger Between Hewlett-Packard () and Compaq Computer Because 's merger with Compaq closed in May, we have revised the branding of the affected platforms. So Proliant becomes the Proliant, and the Superdome rating continues as before. Although Tru64 Unix is still available, and is technically an excellent choice for running applications such as SAP R/3, we see little probability that will promote Tru64 Unix in new business situations. For that reason, we have excluded Tru64 Unix from the server evaluation model. We continue to recommend that users limit Tru64 Unix investments to tactical short-term deployments typically installed-base upgrades or replacements. Those planning long-term investment decisions (beyond three years) around Tru64 Unix should defer those decisions unless the application absolutely relies on Tru64. NonStop Server For the first time, we have added the NonStop server. Previously named the Compaq Himalaya, this server runs the NonStop Kernel (NSK) operating system and is most widely deployed as a fault-tolerant, parallel server. However, we see interesting potential for NonStop servers to function as the pivotal core of a heterogeneous IT infrastructure, where their great reliability makes them a solid choice as a database engine. Server Naming Convention Since Gartner's server evaluation model was first released in late 1999, has embarked on a complete re-branding of its disparate server lines, under the common umbrella name "eservers." In the interests of accuracy, we use only the new 17 October

3 definitions, but Table 1 maps the new names onto the older and better-known names, which are still more familiar to many users. Table 1 Server Names Old Name New Name System/390 zseries AS/400 iseries Netfinity xseries RS/6000 pseries Source: Gartner Research Servers Running Microsoft Previous versions of the server evaluation model have made two assessments: one was a generic, Intel, eight-way standard high-volume (SHV) comparison (running Advanced Server); the other was the Unisys ES7000, running Datacenter Server. Because we have now integrated the Intel server evaluation model, the new version features all three main SHV server offerings, from Dell Computer, and, plus the Unisys ES7000. We have not yet added a Linux platform choice, because demand for Linux as an OLTP application-serving solution is still immature. However, increasingly, key OLTP independent software vendors (ISVs), such as SAP, are favoring Linux as an application development choice, and this will likely stimulate demand. Scoring and Weighting Our findings compare the platforms as servers running an OLTP/database application such as ERP, using 21 raw and weighted selection criteria that cover three categories: technology, market momentum and business practice. A further, unfilled category (local) is reserved for clients that wish to tailor the model. Each criterion is scored from one to 10 and (as with Gartner Magic Quadrants) each score is relative to the other servers tested. The server evaluation model focuses on what each platform supports now, rather than on the marketing promises that most vendors will make. To reflect the fact that some criteria are more relevant to a particular application than others, a weighting factor has been applied to each one. This weighting factor can vary from one application type to another and is scored from one to five. Weighting factors also vary between the OLTP and data-warehousing models. The server evaluation model does not rate outright performance, or price against performance. Price tends to be negotiated by transaction, and is greatly affected by discounting strategies and local politics. Similarly, performance data is not consistent 17 October

4 Operating system Processor zseries NonStop between all the platforms featured in the server evaluation model. Industry standard benchmarks, such as the Transaction Processing Performance Council's TPC-C, are not available for all platforms, and runs only Large System Performance Reference (LSPR) for zseries. We are evaluating the methodology for assessing price against performance in a future revision of the server evaluation model. Table 2 shows the summary for weighted data for the August 2002 revision. Table 3 shows the raw data in greater detail, with all scoring changes made since the last server evaluation model update in February 2002 shown in bold. Table 2 OLTP/Database Serving Summary Weighted Data Sun Sun Fire 15K Dell Poweredge zos NSK Solaris 8 -UX 11i CMOS MIPS Ultra- PA-RISC G7 R14000 SPARC-III 8700 pseries p690 iseries Proliant Super- Dome FSC xseries Prime- Power AIX5L OS/400 Solaris 8 AS AS AS Power 4 Power 4 SPARC64 Intel Xeon Intel Xeon Intel Xeon Unisys ES7000 DCS Intel Xeon Technology Market Momentum Business Practice Total Source: Gartner Research 17 October

5 Table 3 OLTP/Database Serving Comparisons Raw Data zseries NonStop Sun Sun Fire 15K Superdome pseries 690 iseries 890 FSC Prime- Power xseries Proliant Dell Poweredge Unisys ES7000 Operating system zos NSK Solaris 8 -UX 11i AIX5L AIX5L Solaris 8 AS AS AS DCS Processor CMOS G7 MIPS R14000 Ultra- SPARC- III PA- RISC 8700 Power 4 Power 4 SPARC64 Intel Xeon Intel Xeon Intel Xeon Intel Xeon Technology Processor Technology System Performance Clustering (for Performance) Planned Downtime Unplanned Downtime (Single) Unplanned Downtime (Clustered) Disaster Tolerance/ Recovery Workload Management OS Partitioning Manageability Market Momentum Architectural Viability ISV Enthusiasm Application Portfolio Demand Creation and Fulfillment Gartner Client "Radar" Delivers On Promises Business Practice Ease of Doing Business Support Capacity On Demand Bus. Model/Fin Strength Negotiation Opportunity Professional Services Availability of Skills Total Rank Source: Gartner Research 17 October

6 Technology The technology category measures the performance, reliability and functionality of each platform. 's zseries has always been the outright winner of each server evaluation model update, but its lead is being steadily eroded by increasingly competent Unix servers. zseries has always won by opening a commanding technological lead that has outweighed its relatively low market momentum and business practice scores. However, the zseries technological lead over the top-tier Unix platforms has now diminished to just one or two points in many criteria. Of the Unix platforms, -UX maintained a comfortable lead over pseries in both raw and weighted data. 's October 2002 announcement of AIX 5.2, with dynamic partitioning, was not included because Gartner's server evaluation model requires some reference to customer usage before new capabilities are included in the comparison. Sun and FSC were slightly behind in raw data scores, but all four top Unix vendors were well-placed. offered advantages in disaster tolerance/recovery and workload management, while the planned downtime and operating system (OS) partitioning scores for Sun and FSC were higher than those of the other vendors. 's Unix gains came from generally high scores throughout, rather than from excellence in any one area. Unisys scored substantially better than other Intel platforms in this category, underscoring its determination to have users compare the ES7000 against Unix opposition, rather than traditional Intel competition. As expected, the newly added NonStop server scored very well in this category, finishing only marginally behind the zseries. Weighting factors favor performance and reliability criteria, with less emphasis on CPU performance and parallel clustering. Market Momentum This category measures the state of market acceptance and demand for each platform. Since the inception of the server evaluation model, this category has been dominated by Solaris and. However, there are distinct signs that Solaris' grip is waning. Although the software portfolio for Solaris remains strong, and is beaten only by that of, key ISVs are giving equal priority to their AIX and -UX versions and are also factoring Linux into their OS support planning. 's recent Unix market improvement gave it slightly better scores than or Sun. Also, the enthusiasm and portfolio scores vary between Advanced Server and Datacenter Server. The impact of the smaller software portfolio, 17 October

7 stunted ISV enthusiasm and the general sluggishness of the Datacenter Server market is the primary reason why the Unisys ES7000, the only Datacenter Server machine evaluated in the server evaluation model, falls behind Intel SHV competition in the final rankings. A good track record is usually a major selling factor, so the weighting factors for this category are generally high. Business Practice Business practice assesses the go-to-market and engagement strategy of each vendor. To excel in this category, vendors must make significant investments and be committed to building professional services, skills, application choices and flexible negotiation opportunities, tailored to the needs of OLTP or ERP users. Only support gets a maximum weighting factor; other ratings are considered to be of average importance. Scores in this category vary much less between the vendors, and no single vendor excels. Strong scores for support and professional services have favored strong data center vendors such as Unisys, and although all vendors are now investing heavily in this area. The disparity is decreasing with each new server evaluation model update. Although much mention has been made of the potential for capacity on demand, the strategies of vendors differ greatly and demand for capacity on demand remains patchy. For this reason, we give it a minimum weighting factor. Bottom Line: In the August 2002 server evaluation model update, scores for the zseries and iseries remain buoyant, proving that although these platforms will attract less new business, they remain strong solutions. Despite growing maturity for 's pseries 690 and Sun's Sun Fire 15K, is the best of the Unix vendors again helped by strong disaster tolerance, planned downtime and capacity-on-demand scores. Acronym Key ERP ISV LSPR NSK OLTP OS RISC SHV Enterprise resource planning Independent software vendor Large System Performance Reference NonStop Kernel Online transaction processing Operating system Reduced instruction set computer Standard high-volume 's xseries narrowly wins an even-closer battle between the Intel SHV platforms. We are disappointed that lack of promotion by Microsoft and its allies for the Datacenter Server product is depressing market demand for Intel serving, beyond eight-way. This remains the main inhibitor to the technically innovative Unisys ES7000. The June 2002 introduction of 's new x440 should still help stimulate this market, but not until.net Server starts shipping in early Consider choosing the NonStop it is a technically advanced database server, if the relatively small software portfolio and lack of available skills are not inhibitors. 17 October