RIDESHARING YOUR CLOUD DATA CENTER Realize Better Resource Utilization with NVMe-oF

Transcription

1 RIDESHARING YOUR CLOUD DATA CENTER Realize Better Resource Utilization with NVMe-oF OCP U.S. SUMMIT March 21, 2018 Jeremy Werner, Vice President, SSD Marketing & Product Planning Toshiba Memory America, Inc. 1

2 Machine Learning Team 100% utilized 24/7 100% 50% Friday, idle Black 350+ days/year Cyber Monday, etc. Online Marketplace Team 2

3 What s wrong with my cloud data center? PROBLEM 1 DAS stranded flash & IOPS direct-attached flash PROBLEM 2 stranded compute 3

4 How much SSD capacity per node? 10 6 IOPS / TB NoSQL (ad serving) stranded compute stranded flash Applications 50k NoSQL (user profiles) 10 3 Machine Learning <1k Optimum SSD Capacity/Node (TB) Too much wastes flash. Too little wastes CPU. One size does not fit all. 4

5 Workload Variability CPU TB/NODE STATELESS Web Server high low STATEFUL NoSQL DB (ad serving) NoSQL DB (user profiles) high low mid high BATCH Machine Learning (shopping suggestions) Hadoop (big data) high mid Unique resource mixes: CPU intensity, flash capacity, IOPS, memory Tough to optimize node configurations 5

6 Application Silos with DAS Strands Resources Bin-packing Loss Web Server 2 1 stranded stranded flash compute Stateless Jobs Stateful Jobs Batch Jobs Scheduling Loss Scheduling Loss NoSQL Ad Serving NoSQL Cust. Profiles Machine Learning 1 Challenges: Variable resource needs Þ stranded flash 2 Reserve capacity for demand peaks Þ stranded compute 6

7 Disaggregation Optimizes Use of Flash Web Server NoSQL Ad Serving NoSQL Cust. Profiles Machine Learning Benefits: Storage can now be provisioned optimally for every application Eliminates stranded flash Significant improvement in bin-packing loss (stranded compute) Shared Flash 7

8 What s wrong with my cloud data center? PROBLEM 1 DAS PROBLEM 3 stranded flash & IOPS direct-attached flash PROBLEM 2 lost operational agility & revenue stranded compute 8

9 Disaggregate and Orchestrate for Agility NoSQL Ad Serving Web Server Machine Learning All applications can now be scaled out quickly even stateful ones Borrow compute resources from lower priority applications during demand peaks Possible only if any application can run on any node unrestricted by data locality Shared Flash 9

10 What Flash-enabled Agility Looks Like in Your Data Center 30-60% fewer compute nodes for the same workload Provides optimal platforms for more applications with fewer node types Eurosys 2015: Large-scale cluster management at Google with Borg Google $8M Flexible, fast response to changing business conditions fewer SSDs for the same workload Internal Toshiba Analysis 10

11 Shared Accelerated Storage Solves DAS Problems PROBLEM 1 DAS stranded flash & IOPS PROBLEM 3 direct-attached flash PROBLEM 2 lost operational agility & revenue stranded compute shared accelerated storage SOLUTION 11

12 Shared Accelerated Storage Solves DAS Problems PROBLEM 1 BUY FEWER SSDs DAS stranded flash & IOPS PROBLEM 3 BETTER AGILITY direct-attached flash PROBLEM 2 BUY FEWER SERVERS lost operational agility & revenue stranded compute shared accelerated storage SOLUTION 12

13 Technology Advancements Making Shared Accelerated Storage WHY NOW? for Cloud Now Possible High bandwidth, low latency networks Mature orchestration frameworks Shared Accelerated Storage Software Bigger, faster & more cost-effective NVMe SSDs NVMe-oF protocol maximum data center efficiency 13

14 Toshiba KumoScale Shared Accelerated Storage Software Kubernetes Lenovo XClarity OpenStack Intel RSD ~ RESTful API Management Engine Virtualization / Abstraction Fabric Module (front end) NVMe Module (back end) Network Driver NVMe Driver NVMe SSDs NVMe SSDs NVMe SSDs NVMe-oF Network NVMe SSDs Toshiba KumoScale Software 14

15 KumoScale Software Key Benefits Fast Flexible Future-Proof Optimized <20 µs latency adder 4,000+ namespaces Popular cloud frameworks 100% elastic 8,000,000+ 4K RR IOPS 384 TB SSD capacity Broad ecosystem support Zero stranded capacity based on internal Toshiba testing 15

16 Inventor of NAND flash memory World s largest flash factory #2 in flash Cutting-edge 64/96 layer 3D flash technology Broad solid state drive portfolio Decades of storage experience Booth #A21 NVMe, SAS and SATA Major supplier to 10 of top 10 server & storage vendors 16

17 Thank You! Visit Toshiba at Booth #A21 NVMe and NVMe-oF are trademarks of NVM Express, Inc. KumoScale is a trademark of Toshiba Memory Corporation. Kubernetes is a registered trademark of Linus Torvalds. The OpenStack Word Mark is either registered trademark/service mark or trademark/service mark of the OpenStack Foundation, in the United States and other countries. We are not affiliated with, endorsed or sponsored by the OpenStack Foundation, or the OpenStack community. Lenovo XClarity is a registered trademark of Lenovo. Intel is a registered trademark of Intel Corporation. All other company names, product names, and service names mentioned herein may be trademarks of their respective companies Toshiba Memory America Inc. All rights reserved. Information, including product pricing and specifications, content of services, and contact information is current and believed to be accurate on the date of the announcement, but is subject to change without prior notice. Technical and application information contained here is subject to the most recent applicable Toshiba product specifications 17