N V M e o v e r F a b r i c s -

Transcription

1

2 N V M e o v e r F a b r i c s - H i g h p e r f o r m a n c e S S D s n e t w o r k e d f o r c o m p o s a b l e i n f r a s t r u c t u r e Rob Davis, VP Storage Technology, Mellanox

3 OCP Evolution Server Density Compute Storage Disaggregation Lately called Composable Infrastructure Physical Rack 3

4 Why NVMe over Fabrics? 4

5 NVMe Technology Background Optimized for flash Traditional SCSI designed for disk NVMe bypasses unneeded layers Dramatically reducing latency and increasing bandwidth 5

6 NVMe over Fabrics Enables Storage Networking of NVMe SSDs Sharing NVMe-based storage with multiple servers Better utilization: capacity, rack space, and power Better scalability Management Fault isolation While maintaining NVMe Performance Gb/s 6

7 NVMe over Fabrics Technology Extends NVMe efficiency over a fabric NVMe commands and data structures are transferred end to end Relies on RDMA for performance Bypassing TCP/IP 7

8 Faster Storage Needs a Faster Network 10GbE 8

9 Faster Network Wires Solves Some of the Problem Ethernet & InfiniBand End-to-End 25, 40, 50, 56, 100Gb Going to 200 and 400Gb 9

10 Faster Protocols Solves More 10

11 Faster Protocols Solves More 11

12 NVMe, NVMe-oF, and RoCE Protocols 12

13 Network Based Offload Engines Complete the Picture Protocol offloads NVMe over Fabrics RoCE Security offloads Encryption Platform isolation Storage offloads Data Integrity Compression 13

14 Logarithmic scale Importance of Latency Ethernet Storage Fabric - ESF Common Switch & NIC 600ns Network hops multiply latency 14

15 DDR4 DDR4 DDR4 DDR4 Storage Platform Latency ConnectX no Offload BlueField Offload Target 2 100Gb Initiators SOC Target 2 100Gb Initiators ConnectX-5 ConnectX-5 Initiator x86 Initiator x86 ConnectX-5 16 ARM cores ConnectX-5 PCIe Switch Initiator x86 PCIe Switch Initiator x86 NVME SSD NVME SSD Data Path Control Path NVME SSD NVME SSD 6M IOPs, 512B block size 2M IOPs, 4K block side 50% CPU utilization ~15usec latency (not including SSD) 8M IOPs, 512B block size 5M IOPs, 4K block side 0.01% CPU utilization ~5usec latency (not including SSD) 15

16 Composable Infrastructure Switch Compute Compute Compute Compute Compute Compute Compute Compute Compute Compute Compute NVMe over Fabrics enables Composable Infrastructure Low latency High bandwidth Nearly local disk performance High performance network components are required ESF 1 usec or less latency Protocol offloads Further offloads needed for storage features Security Compression Data integrity 16

17 Offloads in the Compute Node Adapter Right place for some applications Data in flight encryption Applications vs. storage node decision In-line processing is efficient Data must flow through network adapter regardless Minimize need for special software flow Lower latency data path Natural place for security boundary Isolated execution separate domain from host 17

18 Advanced NICs Accelerate Storage Apps Storage Video Big Data Efficient Data Transport Security Application Acceleration Delivers Infrastructure Efficiency X86 SW Processing Network QSFP/ SFP28 QSFP/ SFP28 X86 Security Challenges & Vulnerabilities No isolation = Vulnerable Infrastructure Application & security domain are identical Poor performance Poor scalability Vulnerable to DDOS attacks PCIe Gen3/4 18

19 SmartNICs Accelerate Storage Apps & Security & Storage Video Big Data Efficient Data Transport Security Application Acceleration Delivers Infrastructure Efficiency X86 Processing Network QSFP/ SFP28 QSFP/ SFP28 BlueField SOC Accelerators DRAM SOC Security Benefits Security & workload isolation & offload Logically separated security domains Secure boot & firmware update Workload control & visibility Fully programmable PCIe Switch PCIe Gen3/4 64-bit ARM Cores 19

20 Network Accelerates Workloads Video Acceleration Storage Security Big Data Offload ConnectX-5 100G Optical Transceivers Active Optical Cables Smart NIC ConnectX-4 50G Breakout Cables Spectrum 25, 50, 100G Switches Multimode & Single Mode BlueField SoC ConnectX-4 Lx 25G Copper Cables 20

21 NVMe over Fabrics Enables Composable Infrastructure and Much More NVMe over Fabrics Local storage performance across a network High performance network components - ESF RDMA Low latency High Bandwidth Hardware offload accelerators Protocols Security Storage features Composable Infrastructure, Security, Video, Big Data 21

22 Thank You 22

23