NVM Express over Fabrics Storage Solutions for Real-time Analytics

Transcription

1 NVM Express over Fabrics Storage Solutions for Real-time Analytics Presented by Paul Prince, CTO Santa Clara, CA 1

2 NVMe Over Fabrics NVMf Why do we need NVMf? What is it? How does it fit in the Market? Example Solutions What s in the Future? Santa Clara, CA 2

3 At the Intersection of High Velocity & Big Data Real-Time Analytics Source: ScaleDB Santa Clara, CA 3

4 I need to get more business value out of my datacenter [CIO] the questions are getting more complex and the answers have to be there immediately [Data Scientist] Santa Clara, CA 4

5 Looking for Needles Identify full-length transcripts using 2 nd and 3 rd generation sequencing in bone marrow cell populations Cancer Center project Source: Slideshare Santa Clara, CA 5

6 Agenda Why do we need NVMf? What is it? How does it fit in the Market? Example Solutions What s in the Future? Santa Clara, CA 6

7 FC iscsi Legacy SAN NVMf Standard for Fabric attached PCIe SSDs SATA SAS Legacy HDD & SSD NVME Standard for PCIe SSDs Santa Clara, CA 7

8 extends the benefits of NVM Express beyond rack-scale architectures to datacenter-wide Fabric architectures supporting thousands of solid state devices Santa Clara, CA 8

9 NVMe Local SSD model Applica8ons Applica8ons File System Applica8ons Block Storage Device Interface NVMe Driver LINUX or Windows OS Industry Standard Server ü Industry standard interface (Multiple sources) ü Great IO performance Fixed storage per server SW RAID required for large volumes NVME SSDs Santa Clara, CA 9

10 NVMf Remote SSD model No change to applications Applica8ons Applica8ons Applica8ons File System Block Storage Device Interface NVMf Target NVMf Driver LINUX or Windows OS Industry Standard Server NVME SSDs RDMA NIC NVMf Storage Array RDMA NIC Santa Clara, CA 10

11 NVMf Benefits ü Industry standard interface (Multiple sources) ü Unlimited storage per server ü Scale storage independent of servers ü Efficient shared storage ü HA is straightforward ü Greater IO performance Compute servers Storage Fabric NVMf Arrays Santa Clara, CA 11

12 Typical SSD Latency (Reads) 100 us Santa Clara, CA 12

13 Local SSD vs NVMf Array (Reads) Latency vs IOPs Industry leading SSD Latency vs IOPs (NVMf Array) Application Operating range Source: Mangstor labs. Array data using (4) MX6300 SSDs and (2) Dual-port Mellanox Connect-X4 40Gb RoCE NICs connected thru Mellanox MSX1012 switch Santa Clara, CA 13

14 NVMf is the new FAST 10,000 Typical 2U FC All-Flash-Array With (4) 16Gb FC ports Latency (us) 1, Lower Latency Higher Bandwidth Mangstor 2U NVMf Array With (4) Mellanox 40Gb ports 10 Santa Clara, CA Bandwidth (GB/s) 14

15 The result lightning fast query results with bigger databases get more work done with fewer compute resources Santa Clara, CA keep up with fast influx of data and analyze it at the same time 15

16 Agenda Why do we need NVMf? What is it? How does it fit in the Market? Example Solutions What s in the Future? Santa Clara, CA 16

17 Storage Tiers Tier 0 Tier 1 SSDs FC/iSCSI AFAs SSDs / HDDs SAN Arrays (Hybrid) NVMe SSDs NVMf Arrays SSDs (AFA) Tier 2 SAN Arrays (HDDs) (Hybrid) Tier 3 Bulk storage HDDs Tape Optical Higher Capacity Santa Clara, CA 17

18 NVMf is ideal for: HPC Applications: Aerospace Automotive EDA Financial Life Sciences Oil & Gas Database Applications Gov t Applications Online Shopping Online Shop Analysis Data Warehouse Data Mining Military & Defense Santa Clara, CA 18

19 Hype Cycle for Storage Technologies, 2016 NVMe SSDs NVMe has gone through the trough, and is now working its way out. 2-5 years before the plateau, probably closer to 5. Gartner, August 2016 Industry Call to Action" NVMf Source: Gartner July 2016 Santa Clara, CA 19

20 Agenda Why do we need NVMf? What is it? How does it fit in the Market? Example Solutions What s in the Future? Santa Clara, CA 20

21 Solutions Using all variants of NVMe devices Add-In-Card 2.5 (U.2) 110mm (M.2) Many chassis options Santa Clara, CA 21

22 Mangstor NVMf Product Portfolio Available today! 50GB/s ü Redundant Hotplug system ü Windows Storage Server Performance 40GB/s 30GB/s 20GB/s 10GB/s Santa Clara, CA ü Database ü Network Capture ü Realtime Analytics NX ü Burst Buffer ü Storage for GPGPU computing NX Capacity NX TB 40TB 80TB 160TB 320TB 640 TB 240 GB/s In One 42U rack 22

23 Application: Burst Buffer Use: Post-processing analysis of large simulation jobs In-transit visualization and analysis Burst Buffer Benefits: Accelerated application analysis Fast temporary space Staging area large input files Persistent fast storage Santa Clara, CA 23

24 Application: Data Capture & Analysis Data Source Dual 100 Gb Data Write Paths Switch Multiple 25 Gb Data Read Paths Multiple clients (read access) Filter Node 20 GB/s Write 40GB/s read Santa Clara, CA Capture Buffer 100 s of TB 24

25 Introducing Mangstor TITAN Applica8ons Applica8ons Applica8ons File System Block Storage Device Interface NVMf Target TITAN NVMf Driver LINUX or Windows OS Industry Standard Server NVME SSDs RDMA NIC NVMf Storage Array RDMA NIC Santa Clara, CA 25

26 Mangstor TITAN NVMf Target SW Santa Clara, CA 26

27 Connecting NVMf to SANs SANConnect TM New InfraStructure Existing Storage Fiber Channel / iscsi Network NVMf Network IB or RoCE SAN Storage 27 Santa Clara, 7/20/16 CA FX6340 Cache Bridges with SANConnect TM NVMf Arrays 27

28 Agenda Why do we need NVMf? What is it? How does it fit in the Market? Example Solutions What s in the Future? Santa Clara, CA 28

29 What about faster NVM? Network overhead matters more Faster NVM = Faster Arrays Santa Clara, CA 29

30 Where we are headed 100GB/s U 1,000TB, 100GB/s 2018 Performance 80GB/s 60GB/s 40GB/s 20GB/s U 32TB, 12GB/s 640 PetaBytes TB 4, GB/s In In One 42U rack Santa Clara, CA 40TB 80TB 160TB 320TB 640TB Capacity 1280TB 30

31 Thank You Paul Prince, CTO 601 Santa Clara, CA 31