Accelerating Real-Time Big Data. Breaking the limitations of captive NVMe storage

Similar documents
Highly Scalable, Non-RDMA NVMe Fabric. Bob Hansen,, VP System Architecture

Architected for Performance. NVMe over Fabrics. September 20 th, Brandon Hoff, Broadcom.

NVMe over Universal RDMA Fabrics

NVM Express Awakening a New Storage and Networking Titan Shaun Walsh G2M Research

Intel SSD Data center evolution

N V M e o v e r F a b r i c s -

Innovations in Non-Volatile Memory 3D NAND and its Implications May 2016 Rob Peglar, VP Advanced Storage,

THE STORAGE PERFORMANCE DEVELOPMENT KIT AND NVME-OF

Birds of a Feather Presentation

Innovator, Disruptor or Laggard, Where will your storage applications live? Next generation storage

Annual Update on Flash Memory for Non-Technologists

The Impact of SSD Selection on SQL Server Performance. Solution Brief. Understanding the differences in NVMe and SATA SSD throughput

Micron NVMe in the Open19 Platform: Low-Latency Storage at the Edge.

Designing Next Generation FS for NVMe and NVMe-oF

Re- I m a g i n i n g D a t a C e n t e r S t o r a g e a n d M e m o r y

Open storage architecture for private Oracle database clouds

New Approach to Unstructured Data

Top 5 Reasons to Consider

RoCE vs. iwarp Competitive Analysis

Flash Storage Complementing a Data Lake for Real-Time Insight

Low-Overhead Flash Disaggregation via NVMe-over-Fabrics Vijay Balakrishnan Memory Solutions Lab. Samsung Semiconductor, Inc.

Building an Open Memory-Centric Computing Architecture using Intel Optane Frank Ober Efstathios Efstathiou Oracle Open World 2017 October 3, 2017

FC-NVMe. NVMe over Fabrics. Fibre Channel the most trusted fabric can transport NVMe natively. White Paper

Toward a Memory-centric Architecture

Future Routing Schemes in Petascale clusters

Realizing the Next Generation of Exabyte-scale Persistent Memory-Centric Architectures and Memory Fabrics

InfiniBand Networked Flash Storage

Low-Overhead Flash Disaggregation via NVMe-over-Fabrics

FlashGrid Software Enables Converged and Hyper-Converged Appliances for Oracle* RAC

QLogic/Lenovo 16Gb Gen 5 Fibre Channel for Database and Business Analytics

Persistent Memory. High Speed and Low Latency. White Paper M-WP006

Adrian Proctor Vice President, Marketing Viking Technology

SNIA Developers Conference - Growth of the iscsi RDMA (iser) Ecosystem

Enterprise Architectures The Pace Accelerates Camberley Bates Managing Partner & Analyst

SOFTWARE-DEFINED BLOCK STORAGE FOR HYPERSCALE APPLICATIONS

MELLANOX EDR UPDATE & GPUDIRECT MELLANOX SR. SE 정연구

Red Hat Ceph Storage and Samsung NVMe SSDs for intensive workloads

Accelerating Hadoop Applications with the MapR Distribution Using Flash Storage and High-Speed Ethernet

Disclaimer This presentation may contain product features that are currently under development. This overview of new technology represents no commitme

EXPERIENCES WITH NVME OVER FABRICS

QLogic 16Gb Gen 5 Fibre Channel for Database and Business Analytics

Next Generation Architecture for NVM Express SSD

Scaling to Petaflop. Ola Torudbakken Distinguished Engineer. Sun Microsystems, Inc

Oracle Exadata: Strategy and Roadmap

DataON and Intel Select Hyper-Converged Infrastructure (HCI) Maximizes IOPS Performance for Windows Server Software-Defined Storage

The Future of Data Infrastructure

DDN. DDN Updates. Data DirectNeworks Japan, Inc Shuichi Ihara. DDN Storage 2017 DDN Storage

OpenMPDK and unvme User Space Device Driver for Server and Data Center

The Transition to PCI Express* for Client SSDs

G2M Research Presentation Flash Memory Summit 2018

Supermicro All-Flash NVMe Solution for Ceph Storage Cluster

Improving Ceph Performance while Reducing Costs

VEXATA FOR ORACLE. Digital Business Demands Performance and Scale. Solution Brief

SAS Technical Update Connectivity Roadmap and MultiLink SAS Initiative Jay Neer Molex Corporation Marty Czekalski Seagate Technology LLC

The NE010 iwarp Adapter

NVM PCIe Networked Flash Storage

Single-Points of Performance

Solid Access Technologies, LLC

São Paulo. August,

How consumer product like Google's Pixelbook benefit from NVMe Storage? Zhiping Yang, Ph. D. Google Inc. Oct. 17, 2017

DDN About Us Solving Large Enterprise and Web Scale Challenges

How to Network Flash Storage Efficiently at Hyperscale. Flash Memory Summit 2017 Santa Clara, CA 1

Application Acceleration Beyond Flash Storage

12th ANNUAL WORKSHOP 2016 NVME OVER FABRICS. Presented by Phil Cayton Intel Corporation. April 6th, 2016

Scale your Data Center with SAS Marty Czekalski Market and Ecosystem Development for Emerging Technology, Western Digital Corporation

SPDK China Summit Ziye Yang. Senior Software Engineer. Network Platforms Group, Intel Corporation

We will also specifically discuss concept of a pooled system, storage node, pooling of PCIe as well as NVMe based storage.

Persistent Memory over Fabrics

An NVMe-based FPGA Storage Workload Accelerator

iser as accelerator for Software Defined Storage Rahul Fiske, Subhojit Roy IBM (India)

Flashmatrix Technology

Aerospike Scales with Google Cloud Platform

Enhancing NVMe-oF Capabilities Using Storage Abstraction

Bringing Intelligence to Enterprise Storage Drives

Leveraging Software-Defined Storage to Meet Today and Tomorrow s Infrastructure Demands

Hardware NVMe implementation on cache and storage systems

At the heart of a new generation of data center infrastructures and appliances. Sept 2017

Extending RDMA for Persistent Memory over Fabrics. Live Webcast October 25, 2018

Why NVMe/TCP is the better choice for your Data Center

Using FPGAs to accelerate NVMe-oF based Storage Networks

Gen-Z Memory-Driven Computing

NVMe Direct. Next-Generation Offload Technology. White Paper

FMS18 Invited Session 101-B1 Hardware Acceleration Techniques for NVMe-over-Fabric

An NVMe-based Offload Engine for Storage Acceleration Sean Gibb, Eideticom Stephen Bates, Raithlin

Dell PowerEdge R730xd Servers with Samsung SM1715 NVMe Drives Powers the Aerospike Fraud Prevention Benchmark

NVM Express over Fabrics Storage Solutions for Real-time Analytics

Messaging Overview. Introduction. Gen-Z Messaging

Performance Optimizations via Connect-IB and Dynamically Connected Transport Service for Maximum Performance on LS-DYNA

Extremely Fast Distributed Storage for Cloud Service Providers

Storage Protocol Offload for Virtualized Environments Session 301-F

Dell EMC All-Flash solutions are powered by Intel Xeon processors. Learn more at DellEMC.com/All-Flash

SUPERMICRO, VEXATA AND INTEL ENABLING NEW LEVELS PERFORMANCE AND EFFICIENCY FOR REAL-TIME DATA ANALYTICS FOR SQL DATA WAREHOUSE DEPLOYMENTS

Interconnect Your Future

2008 International ANSYS Conference

Application Advantages of NVMe over Fabrics RDMA and Fibre Channel

An Oracle White Paper December Accelerating Deployment of Virtualized Infrastructures with the Oracle VM Blade Cluster Reference Configuration

HPE ProLiant ML350 Gen P 16GB-R E208i-a 8SFF 1x800W RPS Solution Server (P04674-S01)

Virtuozzo Hyperconverged Platform Uses Intel Optane SSDs to Accelerate Performance for Containers and VMs

Dr. Jean-Laurent PHILIPPE, PhD EMEA HPC Technical Sales Specialist. With Dell Amsterdam, October 27, 2016

Intel Enterprise Processors Technology

Transcription:

Accelerating Real-Time Big Data Breaking the limitations of captive NVMe storage 18M IOPs in 2u

Agenda Everything related to storage is changing! The 3rd Platform NVM Express architected for solid state storage Captive storage limitations Apeiron architecture NVMe over Ethernet Noe / NVMe over Fabrics comparison The Apeiron Storage Solution Captive storage vs. external storage performance 18.4M IOPs in 2 rack units The universal NVMe storage platform Advanced features 2

Driving the move to high performance, scale-out applications 3

4

5

NVMe delivers Performance Managability Robust ecosystem Well defined d standard d SSD form factor Steep innovation and healthy competition Performance, durability, capacity and cost 6

Captive Storage is a huge problem 7

Captive Storage Limitations Captive (direct attached) Storage Limited total capacity and performance No dynamic scaling No SSD virtualization No data sharing / tiering across cluster A severe management challenge Inefficient power, cooling, rack space Storage scale out is tied to CPU scale out PCIe board solutions are worse! Get the Storage Out of the Server!! 8

Apeiron Addresses Apeiron was founded d to address three inflection points in the storage market: 1. Move to server-managed scale-out storage and storage aware apps 2. Demand for real-time queries on massive data sets 3. The rapid adoption of NVMe as the standard SSD interface Apeiron delivers the highest performance density of any SSD platform on the market Ethernet and FPGA based networking acceleration enables ultra-low latency switching to 1000 s of NVMe Drives 9 9

NVMe over Ethernet (NoE) Hardware accelerated Layer 2 Ethernet fabric - Layer 3 robustness without the overhead and latency Fully integrated NVMe fabric (no external switching) The industry s lowest latency transport protocol delivers predictable performance at scale 10

NVMeoF (RDMA) / NoE Comparison NVMe Host Software NVMe Host Transport Abstraction NVMe RDMA RDMA Verbs iwarp Infiniband RoCE Fabrics iwarp Infiniband RoCE ADF Et thernet NoE <3 S Apeiron Data Fabric Simple, Robust Optimized for Ethernet and NVMe light weight Layer 2 RDMA Verbs NVMe RDMA Controller Transport Abstraction NVMe Controller Software ADF L2 Ethernet t Headers + 4B NoE Header/encapsulated dpcie TLPs 42B ~ > 112B Overhead The standard is not tied to any particular physical layer RDMA approach adds between 26B and 96B of headers, in addition to NVMe Encapsulation Flexible but adds complexity, link consumption and latency! 11 15

NoE / NVMe over Fabrics comparison NVMe over Ethernet (NoE) Transports NVMe commands NVMe over Fabrics Transports Data (RDMA) Optimized for Ethernet (minimizes overhead) Transport independent (more complexity) 4 Byte per packet added overhead >> overhead (depends on implementation) Optimized for scale-out clusters Supports ANY standard NVMe SSD???? Architected for traditional storage arrays Next gen (3D XPoint) ready???? (demonstrated latency is a problem) Shipping today NVMeoF standard out for approval Apeiron is in production today shipping the highest performance scale out NVMe storage solution in the world All mentioned brand names are registered trademarks and property of their respective owners. 3D XPoint is a trademark of Intel Corporation in the U.S. and/or other countries 12

ADS1000 Scale-out NVMe Solution Unmatched Performance, Scalability and Efficiency ADS1000 Performance (2U) Capacity 38/76/154/192TB Latency (NAND LIMITATION) Protocol Overhead Bandwidth sustained Random 4K reads 100us <3us (roundtrip) 72 GB/s 18.4 M IOPS 13

A New Standard in Storage Networking Performance 4KB Random Read 8 Threads, QD=12 The ultra low latency Apeiron network technology is 100% transparent to the servers* Apeiron vlun s enable workload optimization across multiple l NVMe di drives * Please see the March 2016 ESG Whitepaper- Validation of Apeiron Performance at apeirondata.com 14

FIO Performance Benchmarks The balanced architecture of the ADS1000 improves server utilization up to 3x (limited by SSD type) Apeiron s driver technology moves the bottleneck from the network to the NAND architecture itself (18.4M IOPs single ADS1000) Performance scales linearly to 100 s of millions of IOPs as the system solution grows Vendor B 770k per SSD 18.4M IOPS 2U Industry Leading Performance Density 15

The World s Only Universal NVMe Platform Unlike captive storage, Apeiron enables independent scaling of servers and storage Offering multiple NVMe options accelerates customer benefits Compatible with ANY commercial NVMe drive-data resides on appropriate SSD type for its value (Including 3D XPoint technology ) Adoption of NVMe SSD s is rapidly increasing; Only Apeiron can provide compatibility with all suppliers and drive profiles The roadmap for density and performance of NVMe SSD s is accelerating; Apeiron passes this advantage to the customer All mentioned brand names are registered trademarks and property of their respective owners. 3D XPoint is a trademark of Intel Corporation in the U.S. and/or other countries 16

NVMe Solution Comparison System A ADS1000 Rack Units 5U 4U (2x 2U) Bandwidth 100GB/s 144GB/s IOPs 10M IOPs 37M IOPs SSD Proprietary Any SFF NVMe SSD Latency 100us (avg) 100us Interconnect PCIe 3.0 40Gb Ethernet Maximum Capacity 144 TB 4.6 PB, 9.2 PB Q3 16 (60 enclosures) Intel 3D XPoint TM No Yes 3D Xpoint = 7us latency* Entry Level List Price 3x Apeiron 1/3 System A *Note: Publically Disclosed By Intel 17

Performance, Scalability and Simplification All the simplicity it and promise of direct attached storage with the capabilities of network attached storage. -Ahmed Shihab, VP Engineering, Amazon Web Services 18