CIO Update: Gartner's Predictions for Storage Hardware

Transcription

1 IGG J. Monroe, F. Yale, R. Passmore, N. Allen, S. Zaffos Article 26 November 2003 CIO Update: Gartner's Predictions for Storage Hardware The need for instant data access and increasingly cost-effective and flexible systems will shape the technological development and practical deployment of storage components, infrastructures and systems. The need for instant data access and increasingly cost-effective and flexible systems will shape the technological development and practical deployment of storage components, infrastructures and systems. Storage Will Become Increasingly Ubiquitous Although hardware performance may exceed software requirements in many IT environments, the forces that dictate explosive storage growth in 2004 and beyond will far outweigh those that inhibit data consumption. Consumers throughout the world have demonstrated an almost insatiable desire to view movies and listen to digital music at home and on the road. The digitization of the world s cultural artifacts is in its infancy, and digital photography is only beginning to make a large-scale impact. More of the world s commerce will be conducted as e-commerce (and thus require more data to be online and transactional), and new regulations regarding the preservation of corporate documents will also serve to increase storage requirements. Much like computing, storage will become increasingly ubiquitous; pervasive computing (coupled with pervasive storage) is already more than a cliche. The seamless integration of scalable technologies that can enhance a system s ability to handle innumerable transactions per second will become more crucial to the success of any storage strategy. Storage Components: Hard Disk Drives Prediction At least one major hard disk drive (HDD) vendor will announce an alliance, merger or partial abdication in Enormous consolidation has already occurred in the HDD industry, and further consolidation is inevitable. The increasing complexity and cost of HDD technology will help drive future consolidation and strategic alliances. Gartner Entire contents 2003 Gartner, Inc. All rights reserved. Reproduction of this publication in any form without prior written permission is forbidden. The information contained herein has been obtained from sources believed to be reliable. Gartner disclaims all warranties as to the accuracy, completeness or adequacy of such information. Gartner shall have no liability for errors, omissions or inadequacies in the information contained herein or for interpretations thereof. The reader assumes sole responsibility for the selection of these materials to achieve its intended results. The opinions expressed herein are subject to change without notice.

2 Although advances in HDD technology will become more expensive, the HDD makers will make astonishing progress, reduce production expenses and enhance key performance and reliability metrics. At the same time, costs per gigabyte will continue to decline, creating solid bargains for buyers, but complicating the competitive vendor landscape. Because of unmatched cost and performance efficiencies, HDDs will remain the primary components in all corporate and consumer storage systems. The markets for primary HDD storage will be huge, but only a few gigantic players will survive to address these markets. Strategic Planning Assumption: By 2006, five or fewer major HDD makers will exist (0.8 probability). Despite potential consolidations, major direct customers of the HDD vendors should expect relatively stable mobile and desktop HDD prices in However, chaotic disruptions in enterprise HDD pricing are possible, partially because of the threat posed by Advanced Technology Attachment (ATA)-interface incursions, and partially because of competitive market share ambitions and surplus production. Buyers should prepare to take advantage of better cost efficiencies throughout the enterprise storage chain. Storage Components: Tape Drives Prediction The proliferation of new tape formats will be held in check during the next five years. From 1995 through 2003, 19 new tape technologies representing new formats were introduced. In 1998 alone, six new formats entered the market: Three from companies already in the industry Linear TapeOpen by Hewlett-Packard, Seagate and IBM SDLT by Quantum The 9840 drive by StorageTek Three from startup companies (Benchmark, Ecrix and OnStream). Ecrix merged with Exabyte, Benchmark was acquired by Quantum, and OnStream filed for bankruptcy, obtained new funding, started up again, then ended up filing for bankruptcy and closing down completely. The experiences of the startups have clearly shown the difficulties in establishing a new tape technology. Of the technologies that have become successful, none has been able to establish a position of clear-cut market domination.

3 In a market so fragmented, the best chance of success lies with enterprises that have a built-in customer base and large cash reserves. The market potential for any new tape technology is limited; there are already too many formats, and tape systems will have to withstand incursive threats from lower-cost ATA-disk systems. During the next five years, almost all of the advancements in tape will come from succeeding generations of established technologies. Gartner expects only one new format to be introduced from 2004 through Strategic Planning Assumption: Despite minimal shipment growth and actual declines in certain markets, tape technology will continue to prove its value in backup, recovery and archival applications (0.8 probability). Action recommendation for 2004: Buyers should weigh all of their options in the selection of new tape products, but the final decision should be centered around vendor viability and the credibility of a technology in the present and its road map for the future. Storage Infrastructure: Wheels for the Fabric-Attached Storage (FAS) Bandwagon Prediction In vigorous competition for share of storage area network (SAN) attachments to servers priced below $5,000, Internet Protocol (IP) SANs will surpass Fibre Channel (FC) for low-priced servers in Although the number of servers priced below $5,000 far exceeds the remainder of the market, until recently, virtually none of these servers had been attached to a SAN. The comparative cost of FC SAN infrastructure was excessive and proven Internet Small Computer System Interface (iscsi) products were not yet available. However, in 2003, blade servers began to use embedded host bus adapters (HBAs) and copper backplane connections to switch blades to dramatically reduce the cost structure for FC. Similar deployments for iscsi with embedded Ethernet chips are possible at an even lower-than-expected cost. Each of these solutions brings SAN attachment costs into an acceptable range for highperformance blades that are priced well below $5,000. Although the competition between FC and iscsi is on a relatively level playing field for blade servers, the same is not true for the remainder of this low-priced segment of the server market. Here, the possibility of using a low-cost network interface card (NIC), together with free Microsoft iscsi initiator software, cannot be surpassed. The volume of deployed Ethernet products also guarantees a lower port cost for the rest of the required SAN infrastructure. iscsi at 1 Gbps, lagging 2-Gbps FC performance, will be good enough for many applications. FC will continue to maintain presence for high performance in this space because coming 4-Gbps costs will be favorable compared with 10-Gbps Ethernet alternatives. However, the low cost of iscsi will quickly give the edge to iscsi in the numbers game. Strategic Planning Assumption: By 2005, more new server SAN attachments will use iscsi than FC for all server price bands (0.7 probability).

4 Enterprises should consider the opportunity for SAN attachment for low-priced servers. Opt for SAN attachment where separation of servers and storage provides desired expandability and availability. Choose IP SANs for low-cost connectivity or FC for higher performance as appropriate for the application. Vendors should plan for the coexistence of IP and FC SANs in this market. They should market IP and FC products as complementary, rather than competitive. Storage Systems: Disk Storage Architectures Prediction A new enterprise hard disk drive form factor will emerge. As real-time infrastructures become a reality, enterprises will clearly require FAS systems that support higher-performance scalability characteristics. Random input/output (I/O) performance is largely dependent on spindle count, and proposed new enterprise-class, 2.5-inch small form factor (SFF) HDDs can increase spindle count by 50 percent in the same footprint presently required by traditional 3.5-inch HDDs. Configured with rugged and reliable high-grade components that can withstand 100 percent duty cycles at 10,000-rpm and 15,000-rpm spindle speeds, SFF drives will satisfy the most-stringent performance and availability demands. SFF drives are also expected to draw less power, a critical attribute that further contributes to improved total cost of ownership (TCO). Initially designed to support Ultra320 SCSI and FC 2 gigabit interfaces, Serial Attached SCSI (SAS) support is expected to be available by late No drive maker has any concrete plans to deliver SFF drives with the Serial ATA (SATA) interface. Strategic Planning Assumption: By 2007, SFF HDDs will be the preferred choice for applications demanding the highest levels of I/O performance (0.8 probability). Action recommendation for 2004: Enterprises should consider using new SFF drives solely as a high-performance technology that will most likely carry an initial pricing premium over 3.5-inch drives. Storage Systems: Serial ATA in Multiuser Environments Prediction Budget constraints will accelerate the acceptance of low-cost storage systems. Good enough has almost always been the enemy of better, and good enough will prevail in a growing number of storage purchasing decisions. Many enterprises will discover that servers and storage systems configured with SATA HDDs can provide significant cost advantages with minimal, if any, sacrifice in performance, quality or reliability.

5 But enterprises must remember that SATA is a drive interface; it is not a system solution. For most online applications using midrange and high-end storage, SCSI, FC and, in the future, SAS HDDs will remain the more-appropriate choices. Complex corporate storage problems involving heterogeneous networks, servers and datasets may require expensive solutions, and good-enough options will not always suffice. Strategic Planning Assumption: By 2006, 30 percent of all HDDs configured in multiuser systems will have SATA interfaces (0.8 probability). Explore the possibility of using systems that incorporate SATA HDDs in diverse applications. Demand that vendors justify additional costs for systems that incorporate SCSI or FC HDDs. Accept the fact that low-cost storage systems may have performance limitations or compatibility issues with legacy installations. Carefully determine the cost/performance and data integrity benefits of the system (regardless of the HDD interfaces used). Storage Systems: Heterogeneous Support in SANS Prediction Interoperability issues among storage vendors products will continue to plague FC SANs. Virtually all storage vendors that integrate and sell SANs will support configurations of heterogeneous operating systems, applications and brands/architectures of servers. However, mixing storage arrays from different vendors is, in general, not supported unless the arrays and the associated HBAs are zoned to effectively create two SANs that happen to share switches. This state of affairs is not likely to change, because interoperability testing is expensive and the vendors all want to own or control their customer s environments. The one bright spot is that storage resource management (SRM) and SAN management software is evolving to enable a centralized, single point of management of multiple SAN islands, each containing a different vendor s storage. iscsi SANs also promise to improve interoperability, especially because Microsoft is producing a standard initiator for Windows, which drives all the storage vendors to test to the same data path. This competition may eventually cause FC vendors to change. Strategic Planning Assumption: Storage arrays from different vendors will continue to be incompatible in FC SANs, at least through 2006 (0.7 probability). Buyers should continue to choose a single vendor to integrate FC SANs and thereby avoid interoperability issues.

6 Where multiple islands have brought multiple storage vendors in play, enterprises should form strategies and begin to implement single software solutions that work across all the islands. Enterprises should form dedicated storage management teams to drive best practices as a service to the rest of the IS organization. Storage Systems: Disk Array Pricing Trends Prediction Storage prices will continue to decline, limited only by vendor lock-ins. Competition, improvements in technology, a narrowing of functional differences between midrange and high-end storage systems, and more knowledgeable enterprises willing to deploy good-enough storage will continue to drive storage hardware prices down at historically rapid rates. Software license and maintenance fees that were once immune to discounting are now frequently discounted and sometimes bundled with hardware to create a blended price, particularly in strategic accounts and prospect accounts that have not yet deployed value-added features and functions. Nonetheless, the spread between good and bad deals can still easily exceed 300 percent given the strength of vendor lock-ins. Strategic Planning Assumption: Aggressively negotiated bids made in competitive environments will reduce acquisition costs by at least 20 percent through 2006 (0.7 probability). Build a storage organization that can effectively manage installed storage assets and aggressively negotiate new equipment acquisitions with storage vendors. This organization should include members with operational, application, financial and marketing expertise. Within this organization, marketing would be responsible for selling the benefits of the IS organization s vision of its future storage infrastructure to users, project managers and senior management. Bottom Line The bad news is that seamless integration of heterogeneous systems and datasets will not become a widespread reality in The good news is that storage technology will continue to advance in multiple directions and dimensions, giving users faster access to critical data, greater reliability and lower costs than ever before. Storage components and systems will continue to deliver some of the best cost and performance metrics in the entire IT industry. Written by Edward Younker, Research Products

7 Analytical sources: John Monroe, Fara Yale, Robert Passmore, Nick Allen and Stanley Zaffos, Gartner Research For related Inside Gartner articles, see: Management Update: Storage Management TCO Considerations, (IGG ) CIO Update: Gartner s Storage Services Magic Quadrant, (IGG )