Сетевые технологии для систем хранения данных

Transcription

1 Сетевые технологии для систем хранения данных Nov, 2018 Boris Neiman Sr. System Engineer 1

2 Mellanox Overview Company Headquarters Yokneam, Israel Sunnyvale, California Worldwide Offices ~2,900 Employees worldwide Ticker: MLNX 2

3 Revenue & Execution Mellanox Named in 2018 Gartner MQ for DCN Great Partnership! Mellanox debuted in 2018 Gartner Magic Quadrant for Data Center Networking Gartner recognized Mellanox switches for: Storage / HCI (Ethernet Storage Fabric or ESF) Machine Learning NVMe / RoCE (ESF) High Frequency Trading VXLAN Routing Strong momentum to move up in 2019: 64x 100G switches replace chassis VMware certification is gained More clients deploy Mellanox in ESF and Cloud Innovation & Market Direction 3

4 Entering The Era of 25GbE, 50GbE And 100GbE GbE Ports, 64 25/50GbE Ports 10 / 25 / 40 / 50 / 56 / 100GbE Throughput of 6.4Tb/s 100GbE Adapter 200 million messages per second 10 / 25 / 40 / 50 / 56 / 100GbE Transceivers Active Optical and Copper Cables 10 / 25 / 40 / 50 / 56 / 100GbE VCSELs, Silicon Photonics and Copper 4

5 Mellanox Not Like Other Network Vendors Mellanox is Unique: Unique Switch Silicon Unique NIC Silicon Own Cables & Optics Open Ethernet First to Market with 25/40/50/100GbE Cisco, Arista, Juniper, etc.: Proprietary OS Generic switch ASICs Re-label & lock generic optics License Features 5

6 Open Ethernet 10/25/40/50/100 Switch Portfolio SN x40/100GbE (64x50GbE) Ideal 40/100GbE ToR / Aggregation SN2410 8x100GbE + 48x25GbE 25GbE 100GbE ToR SN x100GbE ports (64x25GbE) Ideal storage/database Switch Highest 25GbE Density per rack unit SN x10/25GbE + 4x40/100GbE Ideal HCI ToR Switch Predictable Performance Fair Traffic Distribution for Cloud Best-in-Class Throughput, Latency, Power Consumption Zero Packet Loss 6

7 Portfolio Coming Soon 64x100GbE (QSFP-28) Ports in 2U Form factor SN x100GbE Spine/Super-Spine 32x200GbE (QSFP-56) Ports in 1U SN x200GbE Spine/Super-Spine 32x100GbE (QSFP-28) Ports in 1U SN3700C 32x100GbE Spine/128x25GbE Leaf 48x50GbE (SFP-56) + 8x400GbE (QSFP-DD) Ports in 1U SN x50GbE+8x400GbE Leaf 7

8 Packet Loss Packet Loss Packet Loss Packet Loss Packet Loss Packet Loss Max Burst Size (MB) Spectrum 25/100G Switch Advantages Congestion Management B Microburst Absorption Capability B 1.5B 9KB Packet Size Spectrum Competition Avoidable Packet Loss Spectrum Packet Size (Bytes) Competition Packet Size (Bytes) Fairness & QoS Spectrum Competition Lowest Latency 8

9 Spectrum Has 10x Lower Latency Top of rack topology 25/50G servers talking to each other Spectrum: 300ns latency Consistent cut-through latency Spectrum is the only low latency switch >10G Top of Rack Topology 100GbE Uplinks 25GbE Server Links 25GbE to 25GbE Latency Test Results 9

10 NEO Makes Networking Simple and Agile Fabric Bring-up Made Easy Efficient Network Monitoring Save Time on Day-to-Day Operations Network API, Built for Integration Mellanox Onyx & Cumulus Linux End-to-End RoCE Automation Auto-Provisioning with Nutanix and OpenStack 10

11 Storage & HCI 11

12 Mellanox ESF NIC side: Best RoCE performance NVMeOF Target Offload Erasure-Coding Offload T10DIF 100/200G support Ethernet Storage Fabric Switch side: RoCE-aware Storage-Aware Low any packet size Zero Packet loss 100/200G support 12

13 Leadership in Storage Platforms SMB Direct Delivering the Highest Return on Investment 13

14 Storage Architecture In Transition Software-Defined Storage Flash Storage Hard Disk Drive Flash SSDs Storage Arrays Server-SAN 14

15 More Ethernet Storage Traffic Changes Flash, Faster servers Social/Mobile/Video Hyperconverged Cloud Big Data Distributed applications Effects Faster networking; 10/25/40/50/100GbE Huge data growth; more file and object content Distributed Server-SAN on Ethernet Virtualization, software-defined, price pressure File and distributed storage More east-west traffic Bottom Line: More Ethernet Storage Traffic Over Scale-out Infrastructure 15

16 ESF Re-defining the Modern Data Centers Predictable Performance, cost Deterministic & Secure Fabrics Servers Risk Fabrics Complexit y Storage Block, file, and object storage Faster, more predictable performance Higher processing capability High-density virtualization Simplified security and management High bandwidth, low latency, zero packet loss Move to All-flash Faster protocols NVMe-oF Data Center modernization requires a faster, lossless Ethernet Storage Fabric 16

17 Modern Datacenter Storage Where is the Line? Main Network chassis switches FC SAN Proprietary Big Box Complex to manage Expensive to scale Main Network chassis switches Ethernet Storage Fabric Performance Scalability Automation Cost Efficiency Servers Servers FC SAN Legacy DC FC SAN Modern Datacenters/Clouds 17

18 Spectrum the Best Storage Switch Ethernet Storage Fabric needs dedicated storage switches Performance High Availability Simple Automated Scalable Cost Efficient 2 Switches in 1RU Storage/HCI port count Zero Packet Loss Low Latency RoCE optimized switches (NVMe-oF) NEO for Network automation/visibility Native SDK on a container Cost optimized NOS alternatives 18

19 Mellanox ESF is Easy to Scale Half Rack Full Rack Multiple Racks SN2700 SN2700 2* GbE SN rack = 12 nodes 1 rack = 24 nodes 19

20 End-to-End RoCE Acceleration Zero packet loss, line-rate performance at all packet sizes and port combination 30% loss in competitive solution Predictable buffer allocation to any port & packet sizes Competitive variance spreading by ~600% Low latency, up to 90% latency in a typical TOR deployment scenario Highest performance and lowest latency Hardware RDMA offload Hardware offload of RoCE congestion control Hardware offload of data path and NVMe command offload RoCE Enabled Storage iser NVMe-oF Microsoft SMB 3.0 vsphere 6.5 Ceph Spark 20

21 Pause time (Microseconds) Pause time (Microseconds) RoCE Done Right Application Blocked by the Switch Application not Blocked by the Switch Other Switches Application runs Smoothly Time/Seconds Time/Seconds 21

22 Better RoCE with Fast Congestion Notification 10 Gigabit Ethernet Fast Congestion Notification Packets marked as they leave queue Up to 10ms faster alerts Servers react faster Reduces average queue depth - Lowers real world latency Improves application performance marks packets exiting queue marks packets entering queue 10 Gigabit Ethernet Legacy Congestion Notification: Packets marked as they enter queue Notification delayed until queue empties Delay inside switch is equivalent to placing server hundreds of miles away 22

23 NEO Simplifies RoCE Provisioning Automated setup of RoCE across entire fabric Mellanox switches Mellanox NICs Ideal for End-to-End Mellanox deployments No manual configuration needed 23

24 Spectrum as the M-Series in HPE StoreFabric Block Storage M-Series File Storage Compute Object Storage All Flash Arrays Storage Hyperconverged Backup/DR Source: HPE Storage Switches 24

25 Mellanox Networking With Nutanix HCI Agile Simple Automated Scale-out Nutanix Elevate Partner of the Year 2018 for Calm Blueprint 2017 for Nutanix Ready Source: Mellanox Networking with Nutanix We have seen worldwide deployment and great customer experience together with Mellanox. Our customers and channel partners are realizing the value of Mellanox as the perfect complement to Nutanix enterprise cloud solutions. Venugopal Pai VP, Customer Success, Nutanix 25

26 Auto Network Provisioning in Multi-Clouds App OS App OS AHV Server Flash App OS VXLAN Overlay App OS AHV Server Flash App OS Primary Site Secondary Site NEO+Prism Central Demo for Business Continuity What It Does: Mellanox DCI, with VXLAN/EVPN overlay, preserves the IP addresses of applications when they fail over across sites Fully automated VLAN/VXLAN provisioning by Mellanox NEO integration with Nutanix Prism Central Benefits: Undisrupted business continuity upon disaster recovery Zero-touch application mobility over multi clouds Completely transparent to the client AHV Prism Central 26

27 BlueField The Premier System on Chip Solution BlueField Field of Advantages 27

28 The Most Integrated Flash Controller 28

29 BlueField Product Line System on Chip BlueField Platform BF1100 & BF1200 SmartNIC Ethernet SmartNIC VPI BF1660 Dual Port 100Gb/s Controller BF1600 Dual Port 100Gb/s Controller BF1700 Different SKUs # Cores Speeds Perf points Different SKUs GPU and SSD 1U and 2U Up to 16 SSDs Different SKUs 16/8/4 cores Dual 25Gb/s VPI 2-ports 100G 100Gb/s / EDR 16 Cores Different SKUs PCIe x16 PCIe x32 Storage card Full Software Enablement SDK and Development Tools Networking, Security Features Full NVMe storage capability 29

30 End-to-End NVMeoF Acceleration Compute Nodes VM VM VM VM VM VM VM 3 1 Spectrum Switches Line-rate switching fabric up to 100G Ultra-low latency of ~350ns with no jitter Zero packet loss Hypervisor Faster congestion notification ConnectX NICs Highest performance and lowest latency RDMA offload (transport and data path) NVMe offload (control path and data path) NVMe-oF target offload (ConnectX-5) NEO Networking operations are translated into REST APIs End-to-end network management capabilities One-Click RoCE configuration Seamless integration with 3 rd -party management software NVMe Flash Storage Array Scale-out Storage 30

31 Excelero and Mellanox in the cloud Teuto wanted Easy scalable solution Fast performance and workload mobility Cost-effective Solution Excelero NVMesh + Mellanox provided 10 times lower IO latency than CEPH 20 times higher IO/s than CEPH Easy scalable all SW solution Unifying all NVMe resources available through the network into one resources pool NVMesh Cinder Driver NVMesh Cinder Driver 31

32 Burst buffer for HPC applications USE CASE Large-scale modeling, simulation, analysis and visualization CHALLENGE Complete checkpoints within 15 minutes to meet availability SLAs SOLUTION NVMesh enables a petabyte-scale unified pool of distributed high-performance NVMe flash as burst buffer for checkpointing RESULTS 80 pooled NVMe devices 148 GB/s of write burst (device-limited) 230GB/s read throughput (network-limited) Well over 20M random 4k IOPS BENEFITS Meets 15-minute checkpoint window Extremely cost effective Unprecedented burst buffer bandwidth 32

33 E8 High-Performance NVMe Storage 1st Sub-millisecond Overall Response Time (ORT) a World Record! SPEC SFS2014 Software build benchmark results 600 builds and 0.69ms ORT Previous record 520 builds and 1.04ms ORT E8 Storage configuration 16 IBM Spectrum Scale client nodes simulate software build workloads - Mellanox ConnectX-4 100GbE adapter - E8 can support up to 96 host servers providing compute services Mellanox SN port 100GbE switch E8-D24, high availability NVMe enclosure - 4 Mellanox ConnectX-4 100GbE adapters - 24 dual port NVMe SSDs from leading vendors End-to-end RoCE References: SPEC SFS 2014 benchmark smashed by storage newbie E8 solution brief 33

34 ESF Additional Information Nutanix Solution Note NEO automated network provisioning for Nutanix AHV VM operations Accelerate RedHat Ceph Storage Microsoft S2D Performance with 100GbE Mellanox solution Microsoft SQL Performance with 100GbE Mellanox solution VMware vmotion with 40GbE Mellanox RoCE Micron SolidScale NVMe platform E8 high-performance NVMe storage Excelero NVMesh software-defined NVMe flash platform Scale Computing config guide Selected Solution Briefs Technical References Get started with RoCE configuration Understanding RoCE v2 Congestion Management Bring up Ceph RDMA Developer s Guide How to configure NVMe-OF 34

35 Thank You 35