E-Guide STORAGE NETWORKING TECHNOLOGY STEPS UP TO PERFORMANCE CHALLENGES SearchStorage
S torage network technology is changing and speed is the name of the game. To handle the burgeoning data growth, organizations require technology that can circumvent performance bottlenecks. This eguide discusses new storage networking and interfacing technologies, such as fibre channel (FC), serial attached SCSI (SAS) and NVM express (NVMe), designed to increase connectivity and minimize latency. PAGE 2 OF 11
STORAGE NETWORKING TECHNOLOGY STEPS UP TO PERFORMANCE CHALLENGE Dennis Martin, Founder and President technology is changing, and speed is the name of the game. Fast flash storage and the growing use of virtualization and applications with larger amounts of data aren't the only technologies putting pressure on networks that carry storage traffic like never before. Databases such as IBM DB2, MySQL, Oracle and SQL Server, for instance, can always use faster connections with lower latency, while increasingly popular big data applications hold huge amounts of information that need to be moved. And while video origination at 4K resolution is already established, starting this year the requirements for video post-production in native 4K resolution have been set by companies such as Amazon, Netflix and others, furthering the demand for higher storage network bandwidth. These are just a few examples of the s facing managers of today's storage fabrics. To help keep storage traffic from becoming the bottleneck in your data center, be it large or small, we present a rundown of the key PAGE 3 OF 11
improvements to storage networking and interface technologies available in 2016. WIDENING THE ETHERNET LANE Nearly everybody uses Ethernet for connectivity between desktops, workstations, application servers and file servers. While many of us with wired connections to our desktops use 1 GbE, 10 GbE is the backbone for our data center connections, with 40 GbE technology leveraged in certain pockets of the enterprise. A fair amount of the traffic traversing these networks can be considered storage traffic, especially with respect to file servers. As flash storage begins to proliferate, we are finding that even 10 GbE can become a bottleneck. To alleviate this, the Ethernet industry is making a significant performance jump. Until now, the fastest speed per lane for Ethernet has been 10 Gbps. Faster Ethernet such as 40 GbE and 100 GbE bundle multiple lanes of 10 Gbps connections into one connection: 4 x 10 for 40 GbE and 10 x 10 for 100 GbE. Announced two years ago, Ethernet running at 25 Gbps per lane is now available. This means that a single lane of Ethernet connectivity runs 2.5 times faster than legacy 10 GbE. There are also options so that 50 GbE and 100 GbE PAGE 4 OF 11
can be achieved by bundling two and four lanes, respectively. While considerably faster than 10 GbE, the good news is that 25 GbE technology can generally use the same types of fiber-optic or copper cables as 10 GbE (with the exception of some cable lengths and transceiver differences). The 25 GbE technology uses the same underlying SFP28 technology as 32 Gbps Fibre Channel as well (see next section), but runs at a slightly different speed, which is one reason why both of these technologies are coming to market this year. Those planning new data center buildouts should be familiar with the Ethernet Alliance roadmap. This roadmap provides a good idea of the new speeds coming along, the approximate time frames for these, details on the physical connectors for copper and fiber optic cables, and a good discussion of the entire Ethernet ecosystem from residential to high-end data center (also see: Ethernet Speed Roadmap). FIBRE CHANNEL NEITHER DOWN, NOR OUT Popular in data centers for its reliability and stability, Fibre Channel (FC) dominates high-end storage networking technology. According to some industry estimates, 90% of high-end data centers have deployed FC technology. And PAGE 5 OF 11
although there has been some discussion about the decline this high-speed storage networking technology, recent analyst reports suggest that the FC market actually grew in late 2015 and early 2016. Fibre Channel performance has doubled in speed approximately every three to five years since 1997. Gen 6 Fibre Channel became available this year, and includes a single-lane speed of 32 Gbps and a quad-lane speed of 128 Gbps (4 x 32). This generation of FC also includes new management and diagnostic features. As with previous generations, Gen 6 FC is backward-compatible with the two previous generations (16 Gbps FC and 8 Gbps FC), making the transition to the new technology a relatively smooth process for enterprises. The Fibre Channel Industry Association (FCIA) offers a public roadmap that provides information on new speeds, guidance in cable and connector selection and more (also see Fibre Channel Roadmap). CATCH THE NVM EXPRESS NVM Express (NVMe) is an optimized, high-performance scalable host controller interface designed for enterprise and client solid-state storage that uses the local PCI Express bus. More recently, NVMe has been extended over PAGE 6 OF 11
distance with the new NVMe over Fabrics specification. NVMe over Fabrics can use a remote direct memory access (RDMA) fabric or a Fibre Channel fabric and works with future fabric technologies. NVMe is designed to streamline the I/O access to storage devices and storage systems built with non-volatile memory -- from today's NAND flash technology to future higher-performing and persistent memory technologies. NVMe's streamlined command set typically uses less than half the number of CPU instructions to process an I/O request than other storage protocols. Internally, NVMe is designed differently than other storage protocols. It supports 64K commands per queue and up to 64K queues. These queues are designed such that I/O commands and responses to those commands operate on the same processor core and can take advantage of the parallel processing capabilities of multicore processors. Each application or thread can have its own independent queue, so no I/O locking is required. The NVMe protocol can be used in devices ranging from mobile phones to enterprise storage systems. NVMe devices in enterprise environments, typically running at full power, provide performance up to the full bandwidth of the number of PCIe lanes that each device uses. In consumer devices operating at low-power levels, NVMe devices provide lower performance. PAGE 7 OF 11
At the device level, you can use NVMe for add-in-cards that plug into PCIe slots, the traditional drive form factor (2.5-inch is the most popular), and the M.2 small form factor card. Because of these and other features, we've found that -- by running tests in our lab -- NVMe delivers considerably higher performance and lower latency than other storage protocols. REVVING UP SERIAL ATTACHED SCSI SAS, or Serial Attached SCSI, is an enterprise storage networking technology interface and protocol that's used in some fashion in nearly every enterprise storage product today. SAS, and its predecessor SCSI, have a long history of versatility, reliability and scalability for a device-level interface, as a shelf-to-shelf disk interface, and as a host interface to external storage platforms. In addition to HDDs and SSDs, SAS products include host bus adapters, RAID controllers, expanders and other components used in storage. There are also SAS switches used in SAS fabric implementations. Currently shipping SAS products run at 12 Gbps, and some older 6 Gbps products are still available. The roadmap for SAS doubles the speed to 24 Gbps, with those products expected to come to market with server platforms, which should also support PCIe 4.0, scheduled for release in 2019. PAGE 8 OF 11
The 24 Gbps SAS is backward compatible with the two previous SAS generations (12 Gbps and 6 Gbps) and with 6 Gbps SATA. For more on the future of SAS, see the SCSI Trade Association's SAS roadmap (also see: Serial Attached SCSI (SAS) Roadmap.) SERIAL ATA IN LIMBO SATA, or Serial ATA, has been used for many years to connect a computer to a single storage device such as a HDD, SSD or optical device (CD-ROM, DVD and so on). The current SATA interface runs at 6 Gbps and there is no roadmap for a faster speed, though there is ongoing work to add enterprise features. There was some activity for "SATA Express" running at higher speeds, but this activity appears to have stopped. SATA is used in the traditional drive form factor, but is also available in a much smaller M.2 card form factor. SATA, SAS AND NVME DEVICE COMPATIBILITY In my flash storage article in the June 2016 edition of Storage magazine (see "Flashy Servers -- the lowdown on server-side, solid-state storage"), I provided a diagram of SATA, SAS and PCIe/NVMe device connectors, showing the areas PAGE 9 OF 11
of compatibility between these three interfaces. For compatibility among SATA, SAS and PCIe/NVMe device connectors, think of them as a three-level hierarchy. A lower device can be placed in a higher device backplane, but higher devices cannot be placed into a lower-level backplane. SATA devices, at the lowest level of this hierarchy, can be placed into SATA, SAS and PCIe/NVMe device backplanes. SAS devices, at the middle level of this hierarchy, can fit into SAS and PCIe/NVMe device backplanes, but not SATA device backplanes. And NVMe devices in the drive form factor can only be placed into PCIe/NVMe backplanes. As you move up the hierarchy of storage networking technology, additional features and performance become available. For more on how the protocols covered in this article match up to different types of storage and enterprise use cases, see: The real world. PAGE 10 OF 11
FREE RESOURCES FOR TECHNOLOGY PROFESSIONALS TechTarget publishes targeted technology media that address your need for information and resources for researching products, developing strategy and making cost-effective purchase decisions. Our network of technology-specific Web sites gives you access to industry experts, independent content and analysis and the Web s largest library of vendor-provided white papers, webcasts, podcasts, videos, virtual trade shows, research reports and more drawing on the rich R&D resources of technology providers to address market trends, s and solutions. Our live events and virtual seminars give you access to vendor neutral, expert commentary and advice on the issues and s you face daily. Our social community IT Knowledge Exchange allows you to share real world information in real time with peers and experts. WHAT MAKES TECHTARGET UNIQUE? TechTarget is squarely focused on the enterprise IT space. Our team of editors and network of industry experts provide the richest, most relevant content to IT professionals and management. We leverage the immediacy of the Web, the networking and face-to-face opportunities of events and virtual events, and the ability to interact with peers all to create compelling and actionable information for enterprise IT professionals across all industries and markets. PAGE 11 OF 11