Networking at the Speed of Light
|
|
- Valentine Ross
- 6 years ago
- Views:
Transcription
1 Networking at the Speed of Light Dror Goldenberg VP Software Architecture MaRS Workshop April 2017
2 Cloud The Software Defined Data Center Resource virtualization Efficient services VM, Containers uservices scale out arch DevOps automation Tenant isolation & security Visibility and telemetry vmem vcpu vstor (SDS) vaccelerator vnetwork (SDN) 2017 Mellanox Technologies 2
3 Networking at the Heart of the Datacenter HPC Cloud Web 2.0 Database Storage Big Data Artificial Intelligence Intelligent Network Compute Storage GPU FPGA 2017 Mellanox Technologies 3
4 Feeds and Speeds One Generation Ahead Mellanox Roadmap of Data Speed 10G 20G 40G 56G 100G 200/400G Enabling the Use of Data 2017 Mellanox Technologies 4
5 200 Gigabit Ethernet 1518B Packet 64B Packet 16M packets per second 62ns/packet 298M packets per second 3.3ns/packet 2017 Mellanox Technologies 5
6 Network Design Tradeoffs Extreme Performance PPS Switch Accelerator Model NIC FPGA CoProcessor Model Smart NIC NPU Moderate Performance PPS Rigid Partially Programmable x86 Fully Programmable 2017 Mellanox Technologies 6
7 Network Design Tradeoffs Extreme Performance PPS Switch Accelerator Model NIC FPGA CoProcessor Model Smart NIC NPU Moderate Performance PPS Rigid Partially Programmable x86 Fully Programmable 2017 Mellanox Technologies 7
8 Bandwidth (%) Bandwidth (Gb/s) Switch Hardware Design Challenges Tomahawk Spectrum Achieving Line Rate Ability to process any packet size at line rate Impacts: long tail for application, data loss, etc Packet Size (Bytes) Packet Size (Bytes) Tomahawk Spectrum Fairness One shared buffer vs multiple buffers Impacts: unequal bandwidth per ingress port 2017 Mellanox Technologies 8
9 OPS / PACKET OPS / PACKET 200 Gigabit Ethernet CPU Perspective 1518B Packet 64B Packet 6 5 Single 1518B Packet Software Budget 5.4 Single 64B Packet Software Budget L3 cache access Spin lock/unlock Syscall Memory access 0 L3 cache access Spin lock/unlock Syscall Memory access 2017 Mellanox Technologies 9
10 OPS / PACKET 200Gigabit Storage Trends Storage at 200GE 6M I/O per second (4KB I/Os) 167ns per I/O 100,000,000 10,000,000 Storage Access Latency (ns) Storage I/O Software Budget ,000, ,000 10,000 1, HDD SAS SSD NMVe NVDIMM 0 L3 cache access Spin lock/unlock Syscall Memory access 2017 Mellanox Technologies 10
11 Building a Balanced Element for the Scale Out Storage System Network I/O should match Disk I/O 2017 Mellanox Technologies 11
12 Addressing The Speed Challenges HW Offloads New Protocols New APIs New Programming Models 2017 Mellanox Technologies 12
13 Hardware Offloads Scalability to multi CPU cores Reduce CPU cycles per operation Improve CPU efficiency (NUMA, affinity, etc) RDMA Examples T10/DIF Offload Stateless offloads Kernel bypass Erasure Code Offload SRIOV Collective Offloads Trusted VM NIC SW VNIC VM VM VM SW VNIC SW VNIC SW VNIC Hypervisor vswitch Single Root I/O Virtualization (SRIOV) Trusted VM NIC VM VM VM NIC Hypervisor NIC NIC Direct assignment of devices to VMs Improve VM I/O efficiency Avoid hypercalls Virtual switch offloads Enable advanced protocols ASAP 2 - Overlay Network Offloads PF PF VF VF VF Legacy NIC SRIOV I/O NIC eswitch 2017 Mellanox Technologies 13
14 Ethernet Performance Optimizations Driver Features Checksum, TSO, RSS, VXLAN, Cache line alignment LRO HW offload Stride RX queue CQE compression CQE based Interrupt Moderation DIM Description Standard NIC offloads Writing integral cache lines over the PCIe Partial cache lines write to the PCI wastes up to 40% of the throughput Aggregate received TCP segments to a larger packet Reduce CPU RX overhead Use a single descriptor for handling multiple packets on the same virtual contiguous buffer Optimize memory footprint, RX CPU utilization (replenishing WQEs and buffers) Merge several completion descriptors (CQEs) to a single CQE Optimize PCIe bandwidth and CPU utilization Completion event moderation, based on timer from last completion Obtain optimal latency and bandwidth Dynamically tuned Interrupt moderation algorithm (per core) Latency In Full Throughput optimized 2017 Mellanox Technologies 14
15 ASAP 2 Accelerated Steering and Packet Processing SDN data path acceleration Virtual switch hardware offload Improved performance Maintain same management model 2017 Mellanox Technologies 15
16 Million Packet Per Second Number of Dedicated Cores OVS over DPDK VS. ASAP 2 Performance Test 1 Flow VLAN 60K flows VXLAN ASAP2 Direct OVS DPDK Benefit 33M PPS 7.6M PPS 4.3X 16.4M PPS 1.9M PPS 8.6X Zero! CPU utilization on hypervisor compared to 4 cores with OVS over DPDK Same CPU load on VM MPPS 4 Cores OVS over DPDK Message Rate 0 Cores 33 MPPS OVS Offload Dedicated Hypervisor Cores Mellanox Technologies 16
17 Perimeter Security Clouded Datacenter Security Crypto DDoS prevention Stateful firewalls DPI and microsegmentation Anomaly detection Virtualized Servers VM VM VM VF VF VF Virtualized Servers VM VM VM VF VF VF Secure NIC Secure Mellanox NIC eswitch Secure Mellanox NIC eswitch Safe channel Safe channel Secure Network Core Network 2017 Mellanox Technologies 17
18 CPU% / 1GbE CPU% / 1GbE IPSEC Acceleration Inline crypto for IPSEC Transparent acceleration of IPSEC workloads Same management used (software compatible) Line rate 38Gb/s (Innova) vs 13Gb/s (SW) 3x speedup at ¼ CPU demand CPU Utilization per 1GbE on ip gateway Tx 40G Link CPU Utilization per 1GbE on ip gateway Rx 40G Link Security Applications (Iproute2, libreswan, strongswan etc.) DPDK Software Mellanox IPsec Kernel Module Kernel Mellanox FPGA Accelerator Mellanox NIC Driver Linux kernel IP- XFRN & Offload API Mellanox Poll Mode Driver Hardware Ethernet 0 1 strm 2 strm 3 strm 4 strm Number of IPsec NO IPsec HW IPSEC IPSEC in CPU 0 1 strm 2 strm 3 strm 4 strm Number of IPsec streams NO IPsec HW IPSEC IPSEC in CPU Mellanox software: ~4x CPU utilization decrease 2017 Mellanox Technologies 18
19 TLS/SSL Acceleration Inline Crypto for TLS Integrates with Kernel TLS Offload symmetric crypto (AES-GCM) Software stack unchanged (even simplified) 1.6xBW, 40% lower CPU with TLS acceleration! KTLS TCP TLS record plaintext byte stream TCP segments of plaintext TLS records NIC TCP segments of ciphertext TLS records Network 2017 Mellanox Technologies 19
20 New Protocols Reduce protocol stack overheads Add new functionality and operations Examples RDMA over Converged Ethernet (RoCE) NVMe over Fabrics Remote CUDA Overlay Networks NVMe Over Fabrics Block Storage Protocol App Virtual Filesystem Block Layer SCSI Mid Layer iscsi iser App Virtual Filesystem Block Layer NVMe over Fabrics Lightweight protocol stack Bypass storage stack layers Native mapping into storage devices Native multi queueing Low latency using RDMA (<10us additional latency vs native) More HW offloads RDMA Verbs RDMA Verbs 2017 Mellanox Technologies 20
21 Breaking the Latency Barrier 900 ConnectX Family Latency (ns) A B T roundtrip Poll post ConnectX-4 ConnectX-5 ConnectX-5EX InfiniBand Ethernet (RoCE) Latency = T roundtrip / 2 Latency measurement Ping-pong test Can we improve 2x??? 2017 Mellanox Technologies 21
22 Optimize Higher Level Operation 2x Latency Improvement Data reduction operation Commonly used in Scientific applications Deep learning Node All Reduce Latency (usec) Switch 0 0 B 8 B 16 B 32 B 64 B 128 B Host SHARP Improvement 0 Aggregated Data Aggregated Result 128 Node Pipelined All Reduce Latency (usec) Data Switch Switch Host Host Host Host Host Aggregated Result B 16 B 32 B 64 B 128 B Host SHARP Improvement 2017 Mellanox Technologies 22
23 SHArP is a Component of the Intelligent Interconnect CPU-Centric Data-Centric Limited to Main CPU Usage Results in Performance Limitation Must Wait for the Data Creates Performance Bottlenecks Creating Synergies Enables Higher Performance and Scale Work on The Data as it Moves Enables Performance and Scale 2017 Mellanox Technologies 23
24 New APIs Reduce protocol stack overheads Enable usermode protocol stacks Add new functionality and operations Enable offloading RDMA Examples DPDK UCX RDMA (RoCE and InfiniBand) GPU Direct App ULP/Middleware RDMA Aware App RDMA I/F & Infrastructure Kernel bypass Message semantics Zero copy Protocol offload Batching operations Polling and interrupts RDMA Verbs Provider 2017 Mellanox Technologies 24
25 Frame rate [mpps] DPDK Efficient User-Mode Access for Ethernet Control Path User Verbs I/F User Kernel Kernel Verbs DPDK mlx5 PMD User Verbs (libibverbs+libmlx5) New APIs, opensource, NFV optimized Usermode enables extreme packet rate Optimizations Minimal CPU cycles/packet, batching, RSS, cache line, data structures, descriptors, vectored operations, TSO, flow classification, VLAN, etc. HW memory protection mlx5 verbs provider (mlx5_ib) Data Path Direct PRM I/F ConnectX-5 Ex 100GbE Frame Rate[Mpps] HW mlx5_core PRM ConnectX NIC Cores Line Rate Frame Size [B] 2017 Mellanox Technologies 25
26 New Programming Models - NPU Extreme Single Thread Performance General CPU (x86) 3Ghz 16 cores 10s threads Huge caches Low Single Thread Performance Minimal Parallelism NPU Massive Parallelism 1 Ghz 256 cores 1000s threads Small caches 2017 Mellanox Technologies 26
27 NPU Programming 101 General Purpose CPU Targeting ANY application 10s threads General purpose code Limited number of large heavy apps Flow per core Standard memory subsystem Huge caches NPU Targeting L2-7 network applications Scalable to millions of flows 1000s threads massive parallelism Custom code network oriented ISA, accelerators and more 100M of light weight data driven applications (i.e. Flows) Flow per many cores HW RX packet spray to many cores + TX reorder Network optimized memory system Small caches, extreme threading and high memory bandwidth compensate on mem access Example NPU performance: 500Gb/s stateful firewall 400Gb/s deep packet inspection (15x vs x86) 2017 Mellanox Technologies 27
28 Summary I/O performance must keep up with compute and storage development CPUs require accelerators & co-processor to enable efficient network and storage processing Software defined enables flexibility which can be HW accelerated Adding intelligence to the network enable efficient application scaling 2017 Mellanox Technologies 28
29 Thank You! 2017 Mellanox Technologies 29
Fast packet processing in the cloud. Dániel Géhberger Ericsson Research
Fast packet processing in the cloud Dániel Géhberger Ericsson Research Outline Motivation Service chains Hardware related topics, acceleration Virtualization basics Software performance and acceleration
More informationN V M e o v e r F a b r i c s -
N V M e o v e r F a b r i c s - H i g h p e r f o r m a n c e S S D s n e t w o r k e d f o r c o m p o s a b l e i n f r a s t r u c t u r e Rob Davis, VP Storage Technology, Mellanox OCP Evolution Server
More information2017 Storage Developer Conference. Mellanox Technologies. All Rights Reserved.
Ethernet Storage Fabrics Using RDMA with Fast NVMe-oF Storage to Reduce Latency and Improve Efficiency Kevin Deierling & Idan Burstein Mellanox Technologies 1 Storage Media Technology Storage Media Access
More informationIsoStack Highly Efficient Network Processing on Dedicated Cores
IsoStack Highly Efficient Network Processing on Dedicated Cores Leah Shalev Eran Borovik, Julian Satran, Muli Ben-Yehuda Outline Motivation IsoStack architecture Prototype TCP/IP over 10GE on a single
More informationAdvanced Computer Networks. End Host Optimization
Oriana Riva, Department of Computer Science ETH Zürich 263 3501 00 End Host Optimization Patrick Stuedi Spring Semester 2017 1 Today End-host optimizations: NUMA-aware networking Kernel-bypass Remote Direct
More informationStorage Protocol Offload for Virtualized Environments Session 301-F
Storage Protocol Offload for Virtualized Environments Session 301-F Dennis Martin, President August 2016 1 Agenda About Demartek Offloads I/O Virtualization Concepts RDMA Concepts Overlay Networks and
More informationHardened Security in the Cloud Bob Doud, Sr. Director Marketing March, 2018
Hardened Security in the Cloud Bob Doud, Sr. Director Marketing March, 2018 1 Cloud Computing is Growing at an Astounding Rate Many compelling reasons for business to move to the cloud Cost, uptime, easy-expansion,
More informationInterconnect Your Future
Interconnect Your Future Smart Interconnect for Next Generation HPC Platforms Gilad Shainer, August 2016, 4th Annual MVAPICH User Group (MUG) Meeting Mellanox Connects the World s Fastest Supercomputer
More informationEthernet. High-Performance Ethernet Adapter Cards
High-Performance Ethernet Adapter Cards Supporting Virtualization, Overlay Networks, CPU Offloads and RDMA over Converged Ethernet (RoCE), and Enabling Data Center Efficiency and Scalability Ethernet Mellanox
More informationHow to Network Flash Storage Efficiently at Hyperscale. Flash Memory Summit 2017 Santa Clara, CA 1
How to Network Flash Storage Efficiently at Hyperscale Manoj Wadekar Michael Kagan Flash Memory Summit 2017 Santa Clara, CA 1 ebay Hyper scale Infrastructure Search Front-End & Product Hadoop Object Store
More informationSurvey of ETSI NFV standardization documents BY ABHISHEK GUPTA FRIDAY GROUP MEETING FEBRUARY 26, 2016
Survey of ETSI NFV standardization documents BY ABHISHEK GUPTA FRIDAY GROUP MEETING FEBRUARY 26, 2016 VNFaaS (Virtual Network Function as a Service) In our present work, we consider the VNFaaS use-case
More informationAgilio CX 2x40GbE with OVS-TC
PERFORMANCE REPORT Agilio CX 2x4GbE with OVS-TC OVS-TC WITH AN AGILIO CX SMARTNIC CAN IMPROVE A SIMPLE L2 FORWARDING USE CASE AT LEAST 2X. WHEN SCALED TO REAL LIFE USE CASES WITH COMPLEX RULES TUNNELING
More informationData Path acceleration techniques in a NFV world
Data Path acceleration techniques in a NFV world Mohanraj Venkatachalam, Purnendu Ghosh Abstract NFV is a revolutionary approach offering greater flexibility and scalability in the deployment of virtual
More informationApplication Acceleration Beyond Flash Storage
Application Acceleration Beyond Flash Storage Session 303C Mellanox Technologies Flash Memory Summit July 2014 Accelerating Applications, Step-by-Step First Steps Make compute fast Moore s Law Make storage
More informationSmartNICs: Giving Rise To Smarter Offload at The Edge and In The Data Center
SmartNICs: Giving Rise To Smarter Offload at The Edge and In The Data Center Jeff Defilippi Senior Product Manager Arm #Arm Tech Symposia The Cloud to Edge Infrastructure Foundation for a World of 1T Intelligent
More informationNetronome 25GbE SmartNICs with Open vswitch Hardware Offload Drive Unmatched Cloud and Data Center Infrastructure Performance
WHITE PAPER Netronome 25GbE SmartNICs with Open vswitch Hardware Offload Drive Unmatched Cloud and NETRONOME AGILIO CX 25GBE SMARTNICS SIGNIFICANTLY OUTPERFORM MELLANOX CONNECTX-5 25GBE NICS UNDER HIGH-STRESS
More informationvswitch Acceleration with Hardware Offloading CHEN ZHIHUI JUNE 2018
x vswitch Acceleration with Hardware Offloading CHEN ZHIHUI JUNE 2018 Current Network Solution for Virtualization Control Plane Control Plane virtio virtio user space PF VF2 user space TAP1 SW Datapath
More informationNew Approach to OVS Datapath Performance. Founder of CloudNetEngine Jun Xiao
New Approach to OVS Datapath Performance Founder of CloudNetEngine Jun Xiao Agenda VM virtual network datapath evolvement Technical deep dive on a new OVS datapath Performance comparisons Q & A 2 VM virtual
More informationPCI Express x8 Quad Port 10Gigabit Server Adapter (Intel XL710 Based)
NIC-PCIE-4SFP+-PLU PCI Express x8 Quad Port 10Gigabit Server Adapter (Intel XL710 Based) Key Features Quad-port 10 GbE adapters PCI Express* (PCIe) 3.0, x8 Exceptional Low Power Adapters Network Virtualization
More informationProgrammable NICs. Lecture 14, Computer Networks (198:552)
Programmable NICs Lecture 14, Computer Networks (198:552) Network Interface Cards (NICs) The physical interface between a machine and the wire Life of a transmitted packet Userspace application NIC Transport
More informationEXPERIENCES WITH NVME OVER FABRICS
13th ANNUAL WORKSHOP 2017 EXPERIENCES WITH NVME OVER FABRICS Parav Pandit, Oren Duer, Max Gurtovoy Mellanox Technologies [ 31 March, 2017 ] BACKGROUND: NVME TECHNOLOGY Optimized for flash and next-gen
More informationNFS/RDMA over 40Gbps iwarp Wael Noureddine Chelsio Communications
NFS/RDMA over 40Gbps iwarp Wael Noureddine Chelsio Communications Outline RDMA Motivating trends iwarp NFS over RDMA Overview Chelsio T5 support Performance results 2 Adoption Rate of 40GbE Source: Crehan
More informationHow to abstract hardware acceleration device in cloud environment. Maciej Grochowski Intel DCG Ireland
How to abstract hardware acceleration device in cloud environment Maciej Grochowski Intel DCG Ireland Outline Introduction to Hardware Accelerators Intel QuickAssist Technology (Intel QAT) as example of
More informationSUSE Linux Enterprise Server (SLES) 12 SP4 Inbox Driver Release Notes SLES 12 SP4
SUSE Linux Enterprise Server (SLES) 12 SP4 Inbox Release Notes SLES 12 SP4 www.mellanox.com Mellanox Technologies NOTE: THIS HARDWARE, SOFTWARE OR TEST SUITE PRODUCT ( PRODUCT(S) ) AND ITS RELATED DOCUMENTATION
More informationQuickSpecs. Overview. HPE Ethernet 10Gb 2-port 535 Adapter. HPE Ethernet 10Gb 2-port 535 Adapter. 1. Product description. 2.
Overview 1. Product description 2. Product features 1. Product description HPE Ethernet 10Gb 2-port 535FLR-T adapter 1 HPE Ethernet 10Gb 2-port 535T adapter The HPE Ethernet 10GBase-T 2-port 535 adapters
More informationDPDK Summit China 2017
Summit China 2017 Embedded Network Architecture Optimization Based on Lin Hao T1 Networks Agenda Our History What is an embedded network device Challenge to us Requirements for device today Our solution
More informationRoCE Update. Liran Liss, Mellanox Technologies March,
RoCE Update Liran Liss, Mellanox Technologies March, 2012 www.openfabrics.org 1 Agenda RoCE Ecosystem QoS Virtualization High availability Latest news 2 RoCE in the Data Center Lossless configuration recommended
More informationNetwork Function Virtualization Using Data Plane Developer s Kit
Network Function Virtualization Using Enabling 25GbE to 100GbE Virtual Network Functions with Cavium FastLinQ Intelligent Ethernet Adapters DPDK addresses key scalability issues of NFV workloads Cavium
More informationInfiniBand Networked Flash Storage
InfiniBand Networked Flash Storage Superior Performance, Efficiency and Scalability Motti Beck Director Enterprise Market Development, Mellanox Technologies Flash Memory Summit 2016 Santa Clara, CA 1 17PB
More informationIntroduction to Infiniband
Introduction to Infiniband FRNOG 22, April 4 th 2014 Yael Shenhav, Sr. Director of EMEA, APAC FAE, Application Engineering The InfiniBand Architecture Industry standard defined by the InfiniBand Trade
More informationSharing High-Performance Devices Across Multiple Virtual Machines
Sharing High-Performance Devices Across Multiple Virtual Machines Preamble What does sharing devices across multiple virtual machines in our title mean? How is it different from virtual networking / NSX,
More informationLearn Your Alphabet - SRIOV, NPIV, RoCE, iwarp to Pump Up Virtual Infrastructure Performance
Learn Your Alphabet - SRIOV, NPIV, RoCE, iwarp to Pump Up Virtual Infrastructure Performance TechTarget Dennis Martin 1 Agenda About Demartek I/O Virtualization Concepts RDMA Concepts Examples Demartek
More informationMeltdown and Spectre Interconnect Performance Evaluation Jan Mellanox Technologies
Meltdown and Spectre Interconnect Evaluation Jan 2018 1 Meltdown and Spectre - Background Most modern processors perform speculative execution This speculation can be measured, disclosing information about
More informationOpen vswitch DPDK Acceleration Using HW Classification
Open vswitch DPDK Acceleration Using HW Classification Rony Efraim DPDK summit Dublin Oct 2016 Accelerated Switch And Packet Processing (ASAP 2 ) ASAP 2 take advantage of ConnectX-4 capability to accelerate
More informationSR-IOV Support for Virtualization on InfiniBand Clusters: Early Experience
SR-IOV Support for Virtualization on InfiniBand Clusters: Early Experience Jithin Jose, Mingzhe Li, Xiaoyi Lu, Krishna Kandalla, Mark Arnold and Dhabaleswar K. (DK) Panda Network-Based Computing Laboratory
More informationAn Intelligent NIC Design Xin Song
2nd International Conference on Advances in Mechanical Engineering and Industrial Informatics (AMEII 2016) An Intelligent NIC Design Xin Song School of Electronic and Information Engineering Tianjin Vocational
More informationIn-Network Computing. Sebastian Kalcher, Senior System Engineer HPC. May 2017
In-Network Computing Sebastian Kalcher, Senior System Engineer HPC May 2017 Exponential Data Growth The Need for Intelligent and Faster Interconnect CPU-Centric (Onload) Data-Centric (Offload) Must Wait
More informationvnetwork Future Direction Howie Xu, VMware R&D November 4, 2008
vnetwork Future Direction Howie Xu, VMware R&D November 4, 2008 Virtual Datacenter OS from VMware Infrastructure vservices and Cloud vservices Existing New - roadmap Virtual Datacenter OS from VMware Agenda
More informationThe Future of High Performance Interconnects
The Future of High Performance Interconnects Ashrut Ambastha HPC Advisory Council Perth, Australia :: August 2017 When Algorithms Go Rogue 2017 Mellanox Technologies 2 When Algorithms Go Rogue 2017 Mellanox
More informationAccelerating Real-Time Big Data. Breaking the limitations of captive NVMe storage
Accelerating Real-Time Big Data Breaking the limitations of captive NVMe storage 18M IOPs in 2u Agenda Everything related to storage is changing! The 3rd Platform NVM Express architected for solid state
More informationQuickSpecs. HP Z 10GbE Dual Port Module. Models
Overview Models Part Number: 1Ql49AA Introduction The is a 10GBASE-T adapter utilizing the Intel X722 MAC and X557-AT2 PHY pairing to deliver full line-rate performance, utilizing CAT 6A UTP cabling (or
More informationSingle Root I/O Virtualization (SR-IOV) and iscsi Uncompromised Performance for Virtual Server Environments Leonid Grossman Exar Corporation
Single Root I/O Virtualization (SR-IOV) and iscsi Uncompromised Performance for Virtual Server Environments Leonid Grossman Exar Corporation Introduction to Exar iscsi project and related datacenter trends
More informationiscsi or iser? Asgeir Eiriksson CTO Chelsio Communications Inc
iscsi or iser? Asgeir Eiriksson CTO Chelsio Communications Inc Introduction iscsi is compatible with 15 years of deployment on all OSes and preserves software investment iser and iscsi are layered on top
More informationPerformance Accelerated Mellanox InfiniBand Adapters Provide Advanced Data Center Performance, Efficiency and Scalability
Performance Accelerated Mellanox InfiniBand Adapters Provide Advanced Data Center Performance, Efficiency and Scalability Mellanox InfiniBand Host Channel Adapters (HCA) enable the highest data center
More informationToward a Memory-centric Architecture
Toward a Memory-centric Architecture Martin Fink EVP & Chief Technology Officer Western Digital Corporation August 8, 2017 1 SAFE HARBOR DISCLAIMERS Forward-Looking Statements This presentation contains
More informationAchieve Low Latency NFV with Openstack*
Achieve Low Latency NFV with Openstack* Yunhong Jiang Yunhong.Jiang@intel.com *Other names and brands may be claimed as the property of others. Agenda NFV and network latency Why network latency on NFV
More informationDesigning Next Generation FS for NVMe and NVMe-oF
Designing Next Generation FS for NVMe and NVMe-oF Liran Zvibel CTO, Co-founder Weka.IO @liranzvibel Santa Clara, CA 1 Designing Next Generation FS for NVMe and NVMe-oF Liran Zvibel CTO, Co-founder Weka.IO
More informationFMS18 Invited Session 101-B1 Hardware Acceleration Techniques for NVMe-over-Fabric
Flash Memory Summit 2018 Santa Clara, CA FMS18 Invited Session 101-B1 Hardware Acceleration Techniques for NVMe-over-Fabric Paper Abstract: The move from direct-attach to Composable Infrastructure is being
More informationPLUSOPTIC NIC-PCIE-2SFP+-V2-PLU
PLUSOPTIC NIC-PCIE-2SFP+-V2-PLU PCI Express v3.0 x8 Dual Port SFP+ 10 Gigabit Server Adapter (Intel X710- BM2 Based) Overview: NIC-PCIE-2SFP+-V2-PLU is PLUSOPTIC a new generation of high-performance server
More informationMemory Management Strategies for Data Serving with RDMA
Memory Management Strategies for Data Serving with RDMA Dennis Dalessandro and Pete Wyckoff (presenting) Ohio Supercomputer Center {dennis,pw}@osc.edu HotI'07 23 August 2007 Motivation Increasing demands
More information08:End-host Optimizations. Advanced Computer Networks
08:End-host Optimizations 1 What today is about We've seen lots of datacenter networking Topologies Routing algorithms Transport What about end-systems? Transfers between CPU registers/cache/ram Focus
More informationVPI / InfiniBand. Performance Accelerated Mellanox InfiniBand Adapters Provide Advanced Data Center Performance, Efficiency and Scalability
VPI / InfiniBand Performance Accelerated Mellanox InfiniBand Adapters Provide Advanced Data Center Performance, Efficiency and Scalability Mellanox enables the highest data center performance with its
More informationPARAVIRTUAL RDMA DEVICE
12th ANNUAL WORKSHOP 2016 PARAVIRTUAL RDMA DEVICE Aditya Sarwade, Adit Ranadive, Jorgen Hansen, Bhavesh Davda, George Zhang, Shelley Gong VMware, Inc. [ April 5th, 2016 ] MOTIVATION User Kernel Socket
More informationThe NE010 iwarp Adapter
The NE010 iwarp Adapter Gary Montry Senior Scientist +1-512-493-3241 GMontry@NetEffect.com Today s Data Center Users Applications networking adapter LAN Ethernet NAS block storage clustering adapter adapter
More informationPaving the Road to Exascale
Paving the Road to Exascale Gilad Shainer August 2015, MVAPICH User Group (MUG) Meeting The Ever Growing Demand for Performance Performance Terascale Petascale Exascale 1 st Roadrunner 2000 2005 2010 2015
More informationASPERA HIGH-SPEED TRANSFER. Moving the world s data at maximum speed
ASPERA HIGH-SPEED TRANSFER Moving the world s data at maximum speed ASPERA HIGH-SPEED FILE TRANSFER 80 GBIT/S OVER IP USING DPDK Performance, Code, and Architecture Charles Shiflett Developer of next-generation
More informationSNIA Developers Conference - Growth of the iscsi RDMA (iser) Ecosystem
SNIA Developers Conference - Growth of the iscsi RDMA (iser) Ecosystem Rob Davis Mellanox Technologies robd@mellanox.com The FASTEST Storage Protocol: iser The FASTEST Storage: Flash What it is: iscsi
More informationGetting Real Performance from a Virtualized CCAP
Getting Real Performance from a Virtualized CCAP A Technical Paper prepared for SCTE/ISBE by Mark Szczesniak Software Architect Casa Systems, Inc. 100 Old River Road Andover, MA, 01810 978-688-6706 mark.szczesniak@casa-systems.com
More informationDisclaimer This presentation may contain product features that are currently under development. This overview of new technology represents no commitme
SER1740BU RDMA: The World Of Possibilities Sudhanshu (Suds) Jain # SER1740BU #VMworld2017 Disclaimer This presentation may contain product features that are currently under development. This overview of
More informationMELLANOX EDR UPDATE & GPUDIRECT MELLANOX SR. SE 정연구
MELLANOX EDR UPDATE & GPUDIRECT MELLANOX SR. SE 정연구 Leading Supplier of End-to-End Interconnect Solutions Analyze Enabling the Use of Data Store ICs Comprehensive End-to-End InfiniBand and Ethernet Portfolio
More information打造 Linux 下的高性能网络 北京酷锐达信息技术有限公司技术总监史应生.
打造 Linux 下的高性能网络 北京酷锐达信息技术有限公司技术总监史应生 shiys@solutionware.com.cn BY DEFAULT, LINUX NETWORKING NOT TUNED FOR MAX PERFORMANCE, MORE FOR RELIABILITY Trade-off :Low Latency, throughput, determinism Performance
More informationVIRTUALIZING SERVER CONNECTIVITY IN THE CLOUD
VIRTUALIZING SERVER CONNECTIVITY IN THE CLOUD Truls Myklebust Director, Product Management Brocade Communications 2011 Brocade Communciations - All Rights Reserved 13 October 2011 THE ENTERPRISE IS GOING
More informationQorIQ Intelligent Network Interface Card (inic) Solution SDK v1.0 Update
QorIQ Intelligent Network Interface Card (inic) Solution SDK v1.0 Update APF-NET-T0658 Gary Chu A U G. 2 0 1 4 TM External Use The New Virtualized Network Cloud Cloud gaining momentum as the service platform
More informationDDN. DDN Updates. Data DirectNeworks Japan, Inc Shuichi Ihara. DDN Storage 2017 DDN Storage
DDN DDN Updates Data DirectNeworks Japan, Inc Shuichi Ihara DDN A Broad Range of Technologies to Best Address Your Needs Protection Security Data Distribution and Lifecycle Management Open Monitoring Your
More informationIn-Network Computing. Paving the Road to Exascale. 5th Annual MVAPICH User Group (MUG) Meeting, August 2017
In-Network Computing Paving the Road to Exascale 5th Annual MVAPICH User Group (MUG) Meeting, August 2017 Exponential Data Growth The Need for Intelligent and Faster Interconnect CPU-Centric (Onload) Data-Centric
More informationLow-Overhead Flash Disaggregation via NVMe-over-Fabrics Vijay Balakrishnan Memory Solutions Lab. Samsung Semiconductor, Inc.
Low-Overhead Flash Disaggregation via NVMe-over-Fabrics Vijay Balakrishnan Memory Solutions Lab. Samsung Semiconductor, Inc. 1 DISCLAIMER This presentation and/or accompanying oral statements by Samsung
More informationSupport for Smart NICs. Ian Pratt
Support for Smart NICs Ian Pratt Outline Xen I/O Overview Why network I/O is harder than block Smart NIC taxonomy How Xen can exploit them Enhancing Network device channel NetChannel2 proposal I/O Architecture
More informationDisclaimer This presentation may contain product features that are currently under development. This overview of new technology represents no commitme
NET1343BU NSX Performance Samuel Kommu #VMworld #NET1343BU Disclaimer This presentation may contain product features that are currently under development. This overview of new technology represents no
More informationNVMe over Universal RDMA Fabrics
NVMe over Universal RDMA Fabrics Build a Flexible Scale-Out NVMe Fabric with Concurrent RoCE and iwarp Acceleration Broad spectrum Ethernet connectivity Universal RDMA NVMe Direct End-to-end solutions
More informationHigh Performance Packet Processing with FlexNIC
High Performance Packet Processing with FlexNIC Antoine Kaufmann, Naveen Kr. Sharma Thomas Anderson, Arvind Krishnamurthy University of Washington Simon Peter The University of Texas at Austin Ethernet
More informationCorporate Update. OpenVswitch hardware offload over DPDK. DPDK summit 2017
Corporate Update OpenVswitch hardware offload over DPDK DPDK summit 2017 Agenda ASAP2-Flex for vswitch/vrouter acceleration HW classification offload concept OVS-DPDK using HW classification offload RFC
More informationIn-Network Computing. Paving the Road to Exascale. June 2017
In-Network Computing Paving the Road to Exascale June 2017 Exponential Data Growth The Need for Intelligent and Faster Interconnect -Centric (Onload) Data-Centric (Offload) Must Wait for the Data Creates
More informationAccelerating Contrail vrouter
WHITE PAPER Accelerating Contrail vrouter WHEN DEPLOYED WITH THE JUNIPER NETWORKS CONTRAIL CLOUD NETWORKING PLATFORM, THE NETRONOME AGILIO VROUTER SOLUTION DELIVERS ACCELERATED PERFORMANCE THAT ENABLES
More informationRemote Persistent Memory With Nothing But Net Tom Talpey Microsoft
Remote Persistent Memory With Nothing But Net Tom Talpey Microsoft 1 Outline Aspiration RDMA NIC as a Persistent Memory storage adapter Steps to there: Flush Write-after-flush Integrity Privacy QoS Some
More informationBuilding the Most Efficient Machine Learning System
Building the Most Efficient Machine Learning System Mellanox The Artificial Intelligence Interconnect Company June 2017 Mellanox Overview Company Headquarters Yokneam, Israel Sunnyvale, California Worldwide
More informationLow-Overhead Flash Disaggregation via NVMe-over-Fabrics
Low-Overhead Flash Disaggregation via NVMe-over-Fabrics Vijay Balakrishnan Memory Solutions Lab. Samsung Semiconductor, Inc. August 2017 1 DISCLAIMER This presentation and/or accompanying oral statements
More informationVPI / InfiniBand. Performance Accelerated Mellanox InfiniBand Adapters Provide Advanced Data Center Performance, Efficiency and Scalability
VPI / InfiniBand Performance Accelerated Mellanox InfiniBand Adapters Provide Advanced Data Center Performance, Efficiency and Scalability Mellanox enables the highest data center performance with its
More informationRoCE vs. iwarp Competitive Analysis
WHITE PAPER February 217 RoCE vs. iwarp Competitive Analysis Executive Summary...1 RoCE s Advantages over iwarp...1 Performance and Benchmark Examples...3 Best Performance for Virtualization...5 Summary...6
More informationNext-Generation NVMe-Native Parallel Filesystem for Accelerating HPC Workloads
Next-Generation NVMe-Native Parallel Filesystem for Accelerating HPC Workloads Liran Zvibel CEO, Co-founder WekaIO @liranzvibel 1 WekaIO Matrix: Full-featured and Flexible Public or Private S3 Compatible
More information10GE network tests with UDP. Janusz Szuba European XFEL
10GE network tests with UDP Janusz Szuba European XFEL Outline 2 Overview of initial DAQ architecture Slice test hardware specification Initial networking test results DAQ software UDP tests Summary 10GE
More informationIX: A Protected Dataplane Operating System for High Throughput and Low Latency
IX: A Protected Dataplane Operating System for High Throughput and Low Latency Adam Belay et al. Proc. of the 11th USENIX Symp. on OSDI, pp. 49-65, 2014. Presented by Han Zhang & Zaina Hamid Challenges
More informationNext Gen Virtual Switch. CloudNetEngine Founder & CTO Jun Xiao
Next Gen Virtual Switch CloudNetEngine Founder & CTO Jun Xiao Agenda Thoughts on next generation virtual switch Technical deep dive on CloudNetEngine virtual switch Q & A 2 Major vswitches categorized
More informationWIND RIVER TITANIUM CLOUD FOR TELECOMMUNICATIONS
WIND RIVER TITANIUM CLOUD FOR TELECOMMUNICATIONS Carrier networks are undergoing their biggest transformation since the beginning of the Internet. The ability to get to market quickly and to respond to
More informationInterconnect Your Future
Interconnect Your Future Paving the Road to Exascale August 2017 Exponential Data Growth The Need for Intelligent and Faster Interconnect CPU-Centric (Onload) Data-Centric (Offload) Must Wait for the Data
More informationChoosing the Best Network Interface Card for Cloud Mellanox ConnectX -3 Pro EN vs. Intel XL710
COMPETITIVE BRIEF April 5 Choosing the Best Network Interface Card for Cloud Mellanox ConnectX -3 Pro EN vs. Intel XL7 Introduction: How to Choose a Network Interface Card... Comparison: Mellanox ConnectX
More informationMessaging Overview. Introduction. Gen-Z Messaging
Page 1 of 6 Messaging Overview Introduction Gen-Z is a new data access technology that not only enhances memory and data storage solutions, but also provides a framework for both optimized and traditional
More informationWhy AI Frameworks Need (not only) RDMA?
Why AI Frameworks Need (not only) RDMA? With Design and Implementation Experience of Networking Support on TensorFlow GDR, Apache MXNet, WeChat Amber, and Tencent Angel Bairen Yi (byi@connect.ust.hk) Jingrong
More informationiscsi Extensions for RDMA Updates and news Sagi Grimberg Mellanox Technologies
iscsi Extensions for RDMA Updates and news Sagi Grimberg Mellanox Technologies 1 Agenda iser (short) Overview Linux Updates and Improvements Data Integrity Offload (T10-DIF) Performance Future Plans Applications
More informationNVMe Takes It All, SCSI Has To Fall. Brave New Storage World. Lugano April Alexander Ruebensaal
Lugano April 2018 NVMe Takes It All, SCSI Has To Fall freely adapted from ABBA Brave New Storage World Alexander Ruebensaal 1 Design, Implementation, Support & Operating of optimized IT Infrastructures
More informationALLNET ALL0141-4SFP+-10G / PCIe 10GB Quad SFP+ Fiber Card Server
ALLNET ALL0141-4SFP+-10G / PCIe 10GB Quad SFP+ Fiber Card Server EAN CODE 4 0 3 8 8 1 6 0 6 9 1 2 2 Highlights: Quad-port 10GbE SFP+ server adapters PCI Express (PCIe) v3.0, 8.0 GT/s, x8 lanes SFP+ Connectivity
More informationMellanox CloudX, Mirantis Fuel 5.1/ 5.1.1/6.0 Solution Guide
Mellanox CloudX, Mirantis Fuel 5.1/ 5.1.1/6.0 Solution Guide Rev 1.2 www.mellanox.com NOTE: THIS HARDWARE, SOFTWARE OR TEST SUITE PRODUCT ( PRODUCT(S) ) AND ITS RELATED DOCUMENTATION ARE PROVIDED BY MELLANOX
More informationAgilio OVS Software Architecture
WHITE PAPER Agilio OVS Software Architecture FOR SERVER-BASED NETWORKING THERE IS CONSTANT PRESSURE TO IMPROVE SERVER- BASED NETWORKING PERFORMANCE DUE TO THE INCREASED USE OF SERVER AND NETWORK VIRTUALIZATION
More informationEnd to End SLA for Enterprise Multi-Tenant Applications
End to End SLA for Enterprise Multi-Tenant Applications Girish Moodalbail, Principal Engineer, Oracle Inc. Venugopal Iyer, Principal Engineer, Oracle Inc. The following is intended to outline our general
More informationAccessing NVM Locally and over RDMA Challenges and Opportunities
Accessing NVM Locally and over RDMA Challenges and Opportunities Wendy Elsasser Megan Grodowitz William Wang MSST - May 2018 Emerging NVM A wide variety of technologies with varied characteristics Address
More informationMWC 2015 End to End NFV Architecture demo_
MWC 2015 End to End NFV Architecture demo_ March 2015 demonstration @ Intel booth Executive summary The goal is to demonstrate how an advanced multi-vendor implementation of the ETSI ISG NFV architecture
More informationAll Roads Lead to Convergence
All Roads Lead to Convergence Greg Scherer VP, Server and Storage Strategy gscherer@broadcom.com Broadcom Corporation 2 Agenda The Trend Toward Convergence over Ethernet Reasons for Storage and Networking
More informationSmartNIC Data Plane Acceleration & Reconfiguration. Nic Viljoen, Senior Software Engineer, Netronome
SmartNIC Data Plane Acceleration & Reconfiguration Nic Viljoen, Senior Software Engineer, Netronome Need for Accelerators Validated by Mega-Scale Operators Large R&D budgets, deep acceleration software
More informationOpenFlow Software Switch & Intel DPDK. performance analysis
OpenFlow Software Switch & Intel DPDK performance analysis Agenda Background Intel DPDK OpenFlow 1.3 implementation sketch Prototype design and setup Results Future work, optimization ideas OF 1.3 prototype
More informationVoltaire. Fast I/O for XEN using RDMA Technologies. The Grid Interconnect Company. April 2005 Yaron Haviv, Voltaire, CTO
Voltaire The Grid Interconnect Company Fast I/O for XEN using RDMA Technologies April 2005 Yaron Haviv, Voltaire, CTO yaronh@voltaire.com The Enterprise Grid Model and ization VMs need to interact efficiently
More informationWindows Server System Center Azure Pack
Windows Server System Center Azure Pack Tenant Deployment Multi-Tier LOB Application Tenant Deployment Multi-Tier LOB Application Inbox feature for integrated management of IP addresses, domain
More information