Micron NVMe in the Open19 Platform: Low-Latency Storage at the Edge.

Transcription

1 Micron NVMe in the Open19 Platform: Low-Latency Storage at the Edge. Introduction The explosion of data in the Age of Intelligence has created an unprecedented shift in the way data is generated and consumed. As the demand for connected devices with low latency processing requirements continues to grow, so does the pressure on data center architectures to provide ultra-fast data storage and retrieval. To scale at the rate of demand, data centers need a flexible racklevel infrastructure that minimizes complexity and reduces cost. This has prompted a shift from functions previously performed by proprietary hardware to commodity hardware and open source software. Flex is leading advancements with the new data center standard as a founding member of the Open19 consortium. Open19 addresses these issues by creating an open hardware and software management ecosystem which is both interoperable and interchangeable in any 19 rack environment. The Open19 framework has some key benefits: 5x gain in speed of full rack integration Low latency, high speed G networking per server brick to take advantage of NVMe bandwidth Standard server form factors, power & connectors to seamlessly integrate all Open19 gear while allowing vendors to protect their unique internal server IP This white paper provides an overview of an Open19 implementation by Flex and demonstrates the benefits of Micron 9200 NVMe SSDs in Open19 based data centers. Open19 aims to make data center infrastructure simple, cost-effective and easier to integrate. Open19 + Micron NVMe: Low Latency Storage 1

2 Open19 Building Blocks In an Open19 deployment, the brick cage is installed first into a standard 19 rack via standard cage screws. Horizontal and vertical dividers can be added or removed to support various brick form factors. Then the 100G Broadcom Tomahawk-based network switch is installed next to the cage. After that, the power shelf is added, and finally the snap power and data cables are attached to the back of the cage. At this point, operators can slide server bricks into the cage and snap them in place. The brick is the compute element in Open19 racks. The smallest brick server is a 1U, half-width server. These servers can accommodate up to 50Gb of network connectivity and have a power budget of 400W. The brick servers are fully blind mated (power and data) to the brick cage. Brick Cage Network Switch Power Shelf Cages come in 8U & 12U form factors supporting between 16 & 24 bricks Snap-on power cables provide w per brick Snap-on data cables provide G per brick Broadcom icos certified 3.2Tbps switching capacity Supports 48 server bricks at 50Gbps per brick with 8x100Gbps uplink ports 12v distribution 48 bricks at an average of 220W per brick 6 OTS power modules Open 19 Server Brick Form Factors Half Wide Brick Double High Half Wide Brick Double Wide Brick Double High Double Wide Brick Open19 + Micron NVMe: Low Latency Storage 2

3 Micron NVMe PCIe 9200 SSDs Designed for these Applications Micron is one of the first manufacturers of enterprise-class SSDs and one of the last US-based companies focused on those efforts. Micron has a long history of enterprise SSD design, tier-1 OEM qualification and success, multiple industry and analyst awards and worldwide design, validation and integration teams. Micron is a promoting member of the NVM Express Working Group, an open collection of standards and information to fully expose the benefits of non-volatile memory. This NVMe SSD-level expertise enables us to fully integrate enterprise application requirements into purpose-built storage and leverage that intimate knowledge into leading SSDs, such as the 9200 series. The 9200 series provides workload-focused endurance and capacities for both read-centric and mixed-use applications and environments. The rapid data delivery of Micron s 9200 enables you to process your data more quickly and efficiently. The 9200 is offered in U.2 (used in this design) as well as half-height, half-length (HHHL) industry standard form factors in capacities up to 3.2TB. Available in either read-centric (9200 PRO) or mixed-use (9200 MAX) classes, the 9200 provides an exceptional balance of performance, endurance and price. BIG DATA DATABASE MANAGEMENT HIGH-PERFORMANCE COMPUTING The 9200 Family Features Low Total Cost of Ownership Do more with less. The 9200 NVMe SSD accelerates data with throughput up to 10X higher than SATA and SAS SSDs. Enhanced Performance Improve workload performance with up to 3 GB/s transfer speeds and 300,000k write IOPS. Reliability and Quality Protect mission-critical data with power-loss protection and data path protection features. Optimized Endurance Choose from endurance options matched to your readcentric or mixed-use workloads. XPERT Firmware Features Rest easy with extended Performance and Enhanced Reliability Technology (XPERT) features such as powerloss protection, RAIN, data path protection, reduced command access latency, adaptive read and thermal protection. VISUALISATION Open19 + Micron NVMe: Low Latency Storage 3

4 Micron s NVMe SSDs in Open19 Open19 allows users the option to combine the Open19 reference design with best-in-class NVMe flash devices to build scale-out block storage infrastructures. Server-local storage in Open19 brings your data where you need it closer to the server and closer to the CPU. Flex Server Brick Two of the four hot-pluggable 2.5 slots support NVMe (U.2) and the other two slots support SAS/SATA. By directly attaching ultra-high bandwidth, ultra-low latency NVMe SSDs to the server bricks, Open19 designs take full advantage of what NVMe brings to your data, with the added benefits of simplicity, efficiency and simplified integration and management. Micron s new 9200 series of NVMe flash devices drive performance in an Open19 environment. As the successor to 9100 series, the 9200 series not only covers an extensive range of capacities, but also adds a third level of write endurance. OPEN19 TM DESIGNS TAKE FULL ADVANTAGE OF WHAT NVME BRINGS TO YOUR DATA. Micron 9200 The 9200 series comes in three models: ECO, PRO and MAX, aimed at read-heavy workloads, mixed workloads and writeintensive workloads, respectively. KEY SPECIFICATIONS 9200 ECO (read-intensive) 9200 PRO (mixed-use) 9200 MAX (mixed-use) Capacity 2 8TB 11TB 1.92TB 3.84TB 7.68TB 1.6TB 3.2TB 6.4TB Sequential Reads (GB/s) Sequential Writes (GB/s) Random Reads (IOPS) 4 840K 840K 680K 840K 840K 680K 840K 840K Random Writes (IOPS) 4 140K 130K 185K 170K 170K 225K 285K 280K Endurance (TBW in PB) Form Factor U.2 (2.5-inch, 15 mm) Interface NAND MTTF Advanced Features 5 PCle x4 Gen3 NVMe Micron 3D TLC NAND 2 million device hours Flex Capacity, end-to-end enterprise data path protection, power-loss protection, secure signed firmware, Storage Executive SSD management, XPERT features, high performance, low latency, NVM Express, industry-standard, 5-year warranty. Open19 + Micron NVMe: Low Latency Storage 4

5 Benchmarking Micron 9200 NVMe drives in Open19 Flex has developed an automated server and rack validation suite which uses Ansible and a suite of industry standard benchmarks, databases and visualization engines to execute server and rack level benchmarks and diagnostics. The diagram below shows the workflow for benchmarking the NVMe drives. The Flexible IO (FIO) storage benchmark will test the block storage performance of the Micron 9200 Max NVMe SSDs. Before the actual measured benchmark run, the following steps are executed to fill the drive several times over per SNIA solid state storage testing guidance. 1. A FIO sequential write command fills up the drive 2x using the 128KB block size. 2. Sequential writes are executed. 3. A FIO sequential write performs 2x additional fills to put the drive at 100% capacity. 4. Benchmarking begins. 1. Ansible ssh s into the Open19 brick ANSIBLE 4. Ansible copies the results to the database DATABASE FIO STORAGE 2. Ansible downloads, compiles, and installs fio on the Open19 brick. VISUALIZATION 3. Ansible runs fio with parameters such as 128KB block size with a 1 ramp and 10 test time against the NVMe drives. 5. A database visualization website displays the results to compare them against each other and a target goal. Open19 + Micron NVMe: Low Latency Storage 5

6 Results After completing the benchmarking, the results were visualized for analysis against the Micron spec sheet. Even after multiple drive fills, the Micron drive performance exceeded the spec sheet in all cases. In the charts below, the green horizontal line indicates the expected performance values specified by the Micron 9200 Max spec sheet. Sequential Read & Write Bandwidth With 128kb block size Sustained 4KB Random Mixed 70r/30w Performance by # of Threads (using 100% Capacity) BANDWIDTH (GB/S) IOPS RUNS # THREADS Run 1 Run 2 Run 3 Run 4 At 4k block size, the 9200 Max consistently reached the high end of the spec sheet by repeatedly obtaining read bandwidths of 3.5GB/s. The drives showed great consistency in the 70/30 RW test, beating the spec sheet with 465k IOPS at 256 threads. BANDWIDTH (GB/S) Sustained Multi-Threaded Random Read Bandwidth by Block Size (using 100% Capacity) BLOCK SIZE IOPS THOUSANDS Sustained 4KB Random Write Performance by # of Threads (using 100% Capacity) # THREADS Run 1 Run 2 Run 3 Run 4 Run 1 Run 2 Run 3 Run 4 In the multi-threaded read bandwidth test at 4KB block size, the drive repeatedly performed well above the datasheet at 3.43GB/s. In random write tests at 4KB block size, the 9200 performed above the 285k IOPS spec as soon as fio utilized enough threads to drive enough IO to the drive. Open19 + Micron NVMe: Low Latency Storage 6

7 Conclusion The Flex implementation of Open19 with Micron s 9200 family of high-duty NVMe SSDs makes them suitable for the workload diversity embraced by Open19 deployments. Dramatic performance advantages Remarkably consistent read-write response Compelling results in random read response High random read bandwidth in demanding applications Open19 + Micron NVMe: Low Latency Storage 7

8 Questions To learn more about the Open19 system visit: About Flex Flex is the Sketch-to-Scale solutions provider that designs and builds Intelligent Products for a Connected World. Flex delivers innovative design, engineering, manufacturing, real-time supply chain insight and logistics services to companies of all sizes in various industries and end-markets. With unrivalled expertise across every major industry, Flex empowers leading companies to flawlessly develop and launch their next innovation at scale, from ideation, through design and development, to market and beyond. Corporate Headquarters: Flex 6201 America Center Drive San Jose, CA To find out more about NVMe SSDs and other data center solutions, contact WPG Americas at or visit: About WPG Americas WPG Americas Inc. is a member of WPG Holdings, the largest electronics distributor in Asia. Founded in November 2007, WPG Americas is a franchised partner to technology leaders in the Semiconductor, Passive, Electromechanical, Interconnect, Display and Lighting Solutions markets. As a member of WPG Holdings, WPG Americas is uniquely positioned to support our diverse customer base including contract manufacturers (CMs), original equipment manufacturers (OEMs) and value-added resellers (VARs). WPG Americas is focused on providing total solutions to our customers and suppliers via superior design engineering services, a focused line card and exceptional, quality service. Corporate Headquarters: WPG Americas San Jose 5285 Hellyer Avenue Suite 150 San Jose, CA For more information, please visit or follow us on Flex is the Sketch-to-Scale solutions provider that designs and builds Intelligent Products for a Connected World. With approximately 200,000 professionals across 30 countries, Flex provides innovative design, engineering, manufacturing, real-time supply chain insight and logistics services to companies of all sizes in various industries and end-markets. For more information, visit flex.com or follow us on Flex Live Smarter. Copyright 2018, Flex. All rights reserved. No part of this document may be reproduced in any form without the prior written permission of Flex. Open19 + Micron NVMe: Low Latency Storage 8 ENG-WPS V1