ClearStream. Prototyping 40 Gbps Transparent End-to-End Connectivity. Cosmin Dumitru! Ralph Koning! Cees de Laat! and many others (see posters)!
|
|
|
- Monica Malone
- 5 years ago
- Views:
Transcription
1 ClearStream Prototyping 40 Gbps Transparent End-to-End Connectivity Cosmin Dumitru! Ralph Koning! Cees de Laat! and many others (see posters)! University of Amsterdam!
2 more data! Speed! Volume! Internet! developments" Deterministic! Real-time! more realtime! more users! Scalable! Secure!
3 Speed! Volume! UvA" Deterministic! Real-time! Scalable! Secure! Green-IT" X" Privacy/Trust" Authorization/policy" Programmable networks" Gig/TCP/WF/QoS" Topology/Architecture" Optical Photonic" X" X" X" X" X" X" X" X" X" X" X" X" X" X" X" X" X" X" X" X"
4 Speed! Volume! UvA" Deterministic! Real-time! Scalable! Secure! Green-IT" X" Privacy/Trust" Authorization/policy" Programmable networks" Gig/TCP/WF/QoS" Topology/Architecture" Optical Photonic" X" X" X" X" X" X" X" X" X" X" X" X" X" X" X" X" X" X" X" X"
5
6
7
8 UvA" Green-IT" X" Privacy/Trust" Authorization/policy" Programmable networks" Gig/TCP/WF/QoS" Topology/Architecture" Optical Photonic" X" X" X" X" X" X" X" X" X" X" X" X" X" X" X" X" X" X" X" X"
9 Big and small flows don t go together on the same wire!"
10 Goals" To demonstrate single stream single wave performance end to end operating without any obstruction." To break the 10 Gbps barrier." To test a real application on this infrastructure.! DiVinE"
11 Amsterdam Geneva (CERN) 1650KM (~1000Miles)" Setup" UvA" CERN" iperf" DiViNe" iperf" DiViNe" 2 quad core" Mellanox" 48 core" 2 quad core" DELL" CV" Mellanox" 48 core" 40G" Extreme" Extreme" 170 ms RTT" CIENA OME6500" CIENA OME6500"
12 What we demonstrated" Single server to single server performance memory to memory" Single stream single Lambda TCP" Multiple stream single Lambda TCP" UDP streaming" 48 core system to 48 core system" Running DiViNe model checker" Many small messages" Cluster in a box!"
13 Servers" Model! Supermicro X8DTT-HIBQF! Dell R815! CPU! 2 x Quad-Core Intel XEON E GHz" 4 x Twelve-Core AMD Opteron GHz" RAM! 24GB" 128GB ( 4 x 32GB)" NIC! Mellanox ConnectX2 40GE" Mellanox ConnectX2 40GE" OS! Linux " Linux "
14 LAN Setup" QSFP+ Active Multimode fiber" 40GBASE-SR4 4 x 10Gbit/s" MLD Multi Lane Distribution" 4 fibers for RX" 4 fibers for TX" Synchronization is done at the optical level" Mellanox Connect X2 40GE" PCI-E 2.0 8x"
15 WAN Setup" DWDM system" In production in the! SURFnet network" Ethernet packed in! OTU 3 frame" Ciena ActiveFlex (OME) 6500 " 40GE CFP Module"
16 Testcases " Single server to single server performance memory to memory" Single stream single Lambda TCP" Multiple stream single Lambda TCP" 48 core system to 48 core system" Running the DiVinE model checker" Already used by VU University Amsterdam to test the 100G link to Hamburg" state space explosion problem " Many small messages (~400MBbit/core)" Cluster in a box!"
17
18
19 " Preliminary results" Single flow iperf 1 core " "-> "21 Gbps" Single flow iperf 1 core " <> "-> "15+15 Gbps" Multi flow iperf 2 cores " "-> "25 Gbps" Multi flow iperf 2 cores " <> "-> "23+23 Gbps" DiViNe " " " " <> "-> "11 Gbps" Multi flow iperf + DiVine "-> "35 Gbps" Multi flow iperf + DiVine <> "-> " Gbps "
20
21 GLIF 2010 Measurements" Single Thread Iperf Perfomance 17 ms RTT! 25" 20" WS=16" WS=20" WS=24" WS=28" WS=32" WS=36" WS=40" WS=44" WS=48" Gbps! 15" 10" 0" 10" 20" 30" 40" 50" 60" 70" 80" 90" 100" 110" 120" 130" 140" 150" 160" 170" 180" 190" 200" 210" 220" 230" 240" 250" 260" 270" 280" 290" 300" 310" 320" 330" 340" 350" 360" 370" 380" 390" 400" 410" 420" 430" 440" 450" 460" 470" 480" 5" Seconds elapsed! Calculated TCP window size 40.5 MB for 19Gbit sustained throughput link -"
22 Performance Explained" Mellanox 40GE card is PCI-E 2.0 8x (5GT/s)" 40Gbit/s raw throughput but." PCI-E is a network-like protocol" 8/10 bit encoding -> 25% overhead -> 32Gbit/s maximum data throughput" Routing information" Extra overhead from IP/Ethernet framing" Server architecture matters!" 4P system performed worse in multithreaded iperf"
23 Server Architecture" DELL R815" 4 x AMD Opteron 6100" Supermicro X8DTT-HIBQF " 2 x Intel Xeon "
24 CPU Topology benchmark" 1.8E+10" cpu3" 1.6E+10" 1.4E+10" 1.2E+10" Bandwidth (bps)! 1E+10" 8E+09" 6E+09" cpu0" Bandwidth (bps)" 4E+09" 2E+09" Bandwidth (bps) for single iperf thread - testcees! 0" 0" 1" 2" 3" 4" 5" 6" 7" 8" 9" 10"11"12"13"14"15"16"17"18"19"20"21"22"23"24"25"26"27"28"29"30"31"32"33"34"35"36"37"38"39"40"41"42"43"44"45"46"47" CoreID! We used numactl to bind iperf to cores"
25 Supercomputing 2010" Dutch Research Booth Ciena Booth Ciena OME 6500 Ciena OME 6500 Supercomputing G Lambda Supermicro X8DTT-HIBQF CPU: 2 x Quad-Core Intel XEON E5620 RAM: 24GB RAM NIC: Mellanox Connect X2 40GE NIC OS: Linux (64bit) 40G OCI w/cfp 40GE Switch 40GE Switch Multimode Fiber w/ QSFP+ 40Gigabit Ethernet Mellanox ConnectX2 40GE NIC ID ID Supermicro X8DTT-HIBQF Supermicro X8DTT-HIBQF ID Supermicro X8DTT-HIBQF ID Supermicro X8DTT-HIBQF Dutch Research Consortium booth-to-booth " 40GE demonstration"
26 Demo setup codename: Flightcees" Ciena ActiveFlex(OME) 6500" Broadcom 40GE 18 port L2 Ethernet Switch" Supermicro Intel Server" Dell R815 Server"
27
28 Live stats - Supercomputing 2010"
29
30 Achievements" ~19 Gbps Core to Core throughput (single flow iperf)" We need a faster CPU core" ~ 25 Gbps CPU to CPU throughput (multi flow iperf)" PCI-E bottleneck" 22Gbps full duplex" Broke the 10G barrier using a real world application: DiVinE : peaks of 11Gbps" 40G pipe filled with just 2 servers" Demonstrated that 40G Ethernet can be transported over long distance"
31 Hybrid Networking <-> computing" Routers " " "! " "Supercomputers" " Ethernet switches "! " "Grid & Cloud" " Photonic transport "! " "GPU s" " What matters:" "Energy consumption/multiplication" "Energy consumption/bit transported"
32 delaat.net/posters! ClearStream " End-to-End Ultra Fast Transmission Over a Wide Area 40 Gbit/s Lambda Utilizing shared expertise in advanced photonic, leading edge hardware and high-performance computing, the team created a network application testbed using the 1650 km Cross Border Fiber between NetherLight and CERNLight, lit by SURFnet, connecting servers equipped with 40 Gigabit Ethernet network interface at the University of Amsterdam to remote servers with corresponding interfaces at GLIF 2010 in Geneva. Network Setup The Mellanox ConnectX-2 EN 40GbE is the first network interface that allows single stream ethernet transport far exceeding the common 10Gbps boundary limit. The achieved throughtput is 26Gbps from CPU to CPU which is the practical limit of the PCI-E interface. The network infrastructure is based on Ciena s Optical Multiservice Edge (OME) 6500 equipped with 40 GbE interfaces, which enables data speeds to be seamlessly upgraded from 10 Gbps to 40 Gbps. Application 2010 High Performance Node Using a flexible I/O architecture, the Supermicro X8DTT with two quadcore Intel E5620 CPUs, allows extreme speeds of over 25 Gbps to be reached. Following the succes of the GLIF 2010 demo, the Supercomputing 2010 setup demonstrates two high performance servers fully utilizing the 40Gbps clear channel WAN link between the Ciena Booth and the Dutch Research booth. University of Amsterdam Cosmin Dumitru Cees de Laat Ralph Koning SURFnet Erik-Jan Bos Gerben van Malenstein Roeland Nuijts Ciena David Yeung Jan-Willem Elion Harry Peng Kevin McKernan Martin Bluethner VU University Amsterdam Kees Verstoep Henri Bal Mellanox Erez Cohen Going beyond 10 Gbps leads to new challenges in applications, operating system tuning and system architecture design as new bottlenecks appear. Special attention needs to be given to the setup of multi-core machines in order to have the best I/O performance and maximize the network throughput. During the demo the PCI-E x8 2.0 interface of the network card is saturated when using UDP or TCP traffic. Dutch Research Booth GLIF 2010 Demo During the GLIF 2010 demonstration measurments showed constant throughtput between the two remote ends. Using two servers over 70Gbps of aggregated traffic was exchanged in both directions. Ciena Booth Ciena OME 6500 Ciena OME 6500 Supercomputing G Lambda Supermicro X8DTT-HIBQF CPU: 2 x Quad-Core Intel XEON E5620 RAM: 24GB RAM NIC: Mellanox Connect X2 40GE NIC OS: Linux (64bit) 40G OCI w/cfp 40GE Switch 40GE Switch Multimode Fiber w/ QSFP+ 40Gigabit Ethernet Mellanox ConnectX2 40GE NIC ID ID Supermicro X8DTT-HIBQF Supermicro X8DTT-HIBQF ID Supermicro X8DTT-HIBQF ID Supermicro X8DTT-HIBQF System and Network Engineering Research Group, Universiteit van Amsterdam
33 Questions?" UvA! SURFnet! Ciena! VU! Mellanox! Cees de Laat" Erik-Jan Bos" David Yeung" Kees Verstoep" Bill Lee" Ralph Koning" Gerben van Malenstein" Harry Peng" Henri Bal" Erez Cohen" Cosmin Dumitru" Roeland Nuijts" Martin Bluethner"
40 Gigabit Ethernet: Prototyping Transparent End-to-End Connectivity
40 Gigabit Ethernet: Prototyping Transparent End-to-End Connectivity Cosmin Dumitru Ralph Koning Cees De Laat University of Amsterdam, Science Park 904, 1098XH {c.dumitru,r.koning,delaat}@uva.nl Abstract
Ronald van der Pol Paul Wielinga
Ronald van der Pol Paul Wielinga Outline! " Goal of the project! " Streaming server! " GLIF demo over 40G 1650 km cross border fiber! " SC10 demo over local 2x 40GE! "
Ronald van der Pol
Ronald van der Pol Outline! Goal of this project! 40GE demonstration setup! Application description! Results! Conclusions Goal of the project! Optimize single server disk to network I/O!
Ronald van der Pol
Ronald van der Pol Outline! Goal of the project! 40GE and 100GE Status! Streaming server! GLIF demo! SC10 demo! Conclusions Goal of the 40GE project! Application to be used on SURFnet s
Ronald van der Pol
Ronald van der Pol Outline! " Goal of the project! " 40GE and 100GE Status! " Streaming server! " GLIF demo! " SC10 demo! " Conclusions Goal of the 40GE project! " Application to be used
Ronald van der Pol
Ronald van der Pol Outline! Goal of this project! 40G demonstration setup! Application description! Results! Conclusions Goal of the project! Optimize single server disk to network I/O!
ARISTA: Improving Application Performance While Reducing Complexity
ARISTA: Improving Application Performance While Reducing Complexity October 2008 1.0 Problem Statement #1... 1 1.1 Problem Statement #2... 1 1.2 Previous Options: More Servers and I/O Adapters... 1 1.3
Ronald van der Pol
Ronald van der Pol Contributors! " Ronald van der Pol! " Freek Dijkstra! " Pieter de Boer! " Igor Idziejczak! " Mark Meijerink! " Hanno Pet! " Peter Tavenier Outline! " Network bandwidth
Networks & protocols research in Grid5000 DAS3
1 Grid 5000 Networks & protocols research in Grid5000 DAS3 Date Pascale Vicat-Blanc Primet Senior Researcher at INRIA Leader of the RESO team LIP Laboratory UMR CNRS-INRIA-ENS-UCBL Ecole Normale Supérieure
Distributed ASCI Supercomputer DAS-1 DAS-2 DAS-3 DAS-4 DAS-5
Distributed ASCI Supercomputer DAS-1 DAS-2 DAS-3 DAS-4 DAS-5 Paper IEEE Computer (May 2016) What is DAS? Distributed common infrastructure for Dutch Computer Science Distributed: multiple (4-6) clusters
Ronald van der Pol
Ronald van der Pol Contributors! " Ronald van der Pol! " Freek Dijkstra! " Pieter de Boer! " Igor Idziejczak! " Mark Meijerink! " Hanno Pet! " Peter Tavenier (this work is partially funded
High Performance Ethernet for Grid & Cluster Applications. Adam Filby Systems Engineer, EMEA
High Performance Ethernet for Grid & Cluster Applications Adam Filby Systems Engineer, EMEA 1 Agenda Drivers & Applications The Technology Ethernet Everywhere Ethernet as a Cluster interconnect Ethernet
Optical Networking Activities in NetherLight
Optical Networking Activities in NetherLight TERENA Networking Conference 2003 Zagreb, May 19-22, 2003 Erik Radius Manager Network Services, SURFnet Outline NetherLight What is it Why: the rationale From
High bandwidth, Long distance. Where is my throughput? Robin Tasker CCLRC, Daresbury Laboratory, UK
High bandwidth, Long distance. Where is my throughput? Robin Tasker CCLRC, Daresbury Laboratory, UK [r.tasker@dl.ac.uk] DataTAG is a project sponsored by the European Commission - EU Grant IST-2001-32459
WHITE PAPER THE CASE FOR 25 AND 50 GIGABIT ETHERNET WHITE PAPER
THE CASE FOR 25 AND 50 GIGABIT ETHERNET OVERVIEW The demand for cloud-based solutions has grown rapidly, leaving many datacenters hungry for bandwidth. This has created a demand for cost-effective solutions
Analytics of Wide-Area Lustre Throughput Using LNet Routers
Analytics of Wide-Area Throughput Using LNet Routers Nagi Rao, Neena Imam, Jesse Hanley, Sarp Oral Oak Ridge National Laboratory User Group Conference LUG 2018 April 24-26, 2018 Argonne National Laboratory
SURFnet6 Integrating the IP and Optical worlds Erik-Jan Bos Director of Network Services SURFnet, The Netherlands TrefPunkt Kiruna, mars 2004
SURFnet6 Integrating the IP and Optical worlds Erik-Jan Bos Director of Network Services SURFnet, The Netherlands TrefPunkt Kiruna, 30-31 mars 2004 Presentation contents SURFnet and GigaPort: The environment
Cees de Laat University of Amsterdam
GreenClouds Cees de Laat University of Amsterdam Towards Hybrid Networking! Costs of photonic equipment 10% of switching 10 % of full routing for same throughput! Photonic vs Optical (optical used for
ASPERA HIGH-SPEED TRANSFER. Moving the world s data at maximum speed
ASPERA HIGH-SPEED TRANSFER Moving the world s data at maximum speed ASPERA HIGH-SPEED FILE TRANSFER Aspera FASP Data Transfer at 80 Gbps Elimina8ng tradi8onal bo
Benefits of 25, 40, and 50GbE Networks for Ceph and Hyper- Converged Infrastructure John F. Kim Mellanox Technologies
Benefits of 25, 40, and 50GbE Networks for Ceph and Hyper- Converged Infrastructure John F. Kim Mellanox Technologies Storage Transitions Change Network Needs Software Defined Storage Flash Storage Storage
IBM WebSphere MQ Low Latency Messaging Software Tested With Arista 10 Gigabit Ethernet Switch and Mellanox ConnectX
IBM WebSphere MQ Low Latency Messaging Software Tested With Arista 10 Gigabit Ethernet Switch and Mellanox ConnectX -2 EN with RoCE Adapter Delivers Reliable Multicast Messaging With Ultra Low Latency
SURFnet network developments 10th E-VLBI workshop 15 Nov Wouter Huisman SURFnet
SURFnet network developments 10th E-VLBI workshop 15 Nov 2011 Wouter Huisman SURFnet Engine for Innovation Mission To improve higher education and research by promoting, developing and operating a trusted,
Native Ethernet transmission beyond the LAN
Native Ethernet transmission beyond the LAN Cătălin Meiroşu CERN and Politehnica Bucureşti TERENA 05 Poznań Overview 10 GE, a distance independent Ethernet The WAN PHY long haul Ethernet and SONET-friendly
Data Sheet FUJITSU PLAN EP Intel X710-DA2 2x10GbE SFP+
Data Sheet FUJITSU PLAN EP Intel X710-DA2 2x10GbE SFP+ Data Sheet FUJITSU PLAN EP Intel X710-DA2 2x10GbE SFP+ Dual-port 10 Gbit PCIe 3.0 Ethernet cards enable data exchange between all the devices connected
SURFnet. Lambda Networking Research Cees de Laat
Lambda Networking Research www.science.uva.nl/~delaat www.science.uva.nl/research/air Cees de Laat EU SURFnet University of Amsterdam SARA NikHef Contents of this talk This space is intentionally left
The Lambda Grid GNEW-PANEL-2. SURFnet. University of Amsterdam SARA NIKHEF NCF. All rights reserved UvA
All rights reserved UvA The Lambda Grid λ GNEW-PANEL-2 www.science.uva.nl/~delaat www.science.uva.nl/~deλaat Cees de Laat λaat SURFnet EU University of Amsterdam SARA NIKHEF NCF eevn: : European VLBI Network
OnVector The Power of Change! Cees de Laat
OnVector 2010 The Power of Change! Cees de Laat Themes for next years 40 and 100 Gbit/s Network modeling and simulation Cloud Data - Computing Web Services based Authorization Network Services Interface
Delivering100G and Beyond. Steve Jones Phone: blog.cubeoptics.
Delivering100G and Beyond Steve Jones Phone: +44 7900 881729 steve.jones@hubersuhner.com www.hubersuhner.com www.cubeoptics.com blog.cubeoptics.com We don t want this to be you 2 100G Access/Metro Figures
40G and 100G Products
40G and 100G Products QSFP+ esr4 QSFP+ 40G extended range transceiver, in excess of 300m QSFP-40G-SR4 Application The Prolabs QSFP+ esr4 transceiver has been designed to reach distances which can be up
Improving Packet Processing Performance of a Memory- Bounded Application
Improving Packet Processing Performance of a Memory- Bounded Application Jörn Schumacher CERN / University of Paderborn, Germany jorn.schumacher@cern.ch On behalf of the ATLAS FELIX Developer Team LHCb
Intel PRO/1000 PT and PF Quad Port Bypass Server Adapters for In-line Server Appliances
Technology Brief Intel PRO/1000 PT and PF Quad Port Bypass Server Adapters for In-line Server Appliances Intel PRO/1000 PT and PF Quad Port Bypass Server Adapters for In-line Server Appliances The world
OptiDriver 100 Gbps Application Suite
OptiDriver Application Suite INTRODUCTION MRV s OptiDriver is designed to optimize both 10 Gbps and applications with the industry s most compact, low power, and flexible product line. Offering a variety
1-Port 10G SFP+ Fiber Optic Network Card - PCIe - Intel Chip - MM
1-Port 10G SFP+ Fiber Optic Network Card - PCIe - Intel Chip - MM Product ID: PEX10000SRI This fiber optic network card delivers reliable, high-performance network connectivity, providing an easy and cost-effective
Session based high bandwidth throughput testing
Universiteit van Amsterdam System and Network Engineering Research Project 2 Session based high bandwidth throughput testing Bram ter Borch bram.terborch@os3.nl 29 August 2017 Abstract To maximize and
Disclaimer This presentation may contain product features that are currently under development. This overview of new technology represents no commitme
NET1343BU NSX Performance Samuel Kommu #VMworld #NET1343BU Disclaimer This presentation may contain product features that are currently under development. This overview of new technology represents no
Wide-Area InfiniBand RDMA: Experimental Evaluation
Wide-Area InfiniBand RDMA: Experimental Evaluation Nagi Rao, Steve Poole, Paul Newman, Susan Hicks Oak Ridge National Laboratory High-Performance Interconnects Workshop August 31, 2009, New Orleans, LA
Human-Robot Interaction at a distance of 1800 km
Human-Robot Interaction at a distance of 1800 km using 4K/HD3D video feedback over a 40G connection Marc Lyonnais, Ciena Wladimir Mufty, SURFnet Migiel de Vos, SURFnet Roeland Nuijts, SURFnet, Ciena TIP
University of Amsterdam
The road to optical networking www.science.uva.nl/~delaat www.science.uva.nl/research/air Cees de Laat University of Amsterdam SURFnet λ λ λ λ λ λ λ λ λ λ λ λ λ λ λ λ λ λ λ λ λ λ λ λ λ Know the user #
Performance Optimizations via Connect-IB and Dynamically Connected Transport Service for Maximum Performance on LS-DYNA
Performance Optimizations via Connect-IB and Dynamically Connected Transport Service for Maximum Performance on LS-DYNA Pak Lui, Gilad Shainer, Brian Klaff Mellanox Technologies Abstract From concept to
Mellanox Technologies Maximize Cluster Performance and Productivity. Gilad Shainer, October, 2007
Mellanox Technologies Maximize Cluster Performance and Productivity Gilad Shainer, shainer@mellanox.com October, 27 Mellanox Technologies Hardware OEMs Servers And Blades Applications End-Users Enterprise
HP BladeSystem c-class Ethernet network adapters
HP BladeSystem c-class Ethernet network adapters Family data sheet HP NC552m 10 Gb Dual Port Flex-10 Ethernet Adapter HP NC551m Dual Port FlexFabric 10 Gb Converged Network Adapter HP NC550m 10 Gb Dual
OFC/NFOEC 2011 Interoperability Demonstration
OFC/NFOEC 2011 Interoperability Demonstration March 7, 2011 1. Overview The Ethernet Alliance has twelve members participating in the OFC/NFOEC 2011 demonstration. The participating companies include:
Network Adapters. FS Network adapter are designed for data center, and provides flexible and scalable I/O solutions. 10G/25G/40G Ethernet Adapters
Network Adapters IDEAL FOR DATACENTER, ENTERPRISE & ISP NETWORK SOLUTIONS FS Network adapter are designed for data center, and provides flexible and scalable I/O solutions. 10G/25G/40G Ethernet Adapters
Data Gathering in Optical Networks with the TL1 Toolkit
Data Gathering in Optical Networks with the TL1 Toolkit Ronald van der Pol 1 and Andree Toonk 2 1 SARA Computing & Networking Services, Kruislaan 415, 1098 SJ Amsterdam, The Netherlands rvdp@sara.nl http://nrg.sara.nl/
100 Gbit/s challenges for an operator as TDC
100 Gbit/s challenges for an operator as TDC Martin Skafte Michael Lyngbøl Bjarke Skjoldstrup 13. september 2012 Network Engineering Department (TDC Operations, Technology & Planning) Outline 100 Gigabit
(0 of 12) High Performance λnetworking for Grid Applications. Cees de Laat
High Performance λnetworking for Grid Applications www.science.uva.nl/~delaat Cees de Laat (0 of 12) λeu High Performance Networking for Grid Applications www.science.uva.nl/~delaat www.science.uva.nl/~deλaat
10 Gbit/s Challenge inside the Openlab framework
10 Gbit/s Challenge inside the Openlab framework Sverre Jarp IT Division CERN SJ Feb 2003 1 Agenda Introductions All Overview Sverre Feedback Enterasys HP Intel Further discussions Elaboration of plan
Accelerating Hadoop Applications with the MapR Distribution Using Flash Storage and High-Speed Ethernet
WHITE PAPER Accelerating Hadoop Applications with the MapR Distribution Using Flash Storage and High-Speed Ethernet Contents Background... 2 The MapR Distribution... 2 Mellanox Ethernet Solution... 3 Test
LS-DYNA Productivity and Power-aware Simulations in Cluster Environments
LS-DYNA Productivity and Power-aware Simulations in Cluster Environments Gilad Shainer 1, Tong Liu 1, Jacob Liberman 2, Jeff Layton 2 Onur Celebioglu 2, Scot A. Schultz 3, Joshua Mora 3, David Cownie 3,
DWDM RAM. A Platform for Data Intensive Services Enabled by Next Generation Dynamic Optical Networks
DWDM RAM Data@LIGHTspeed A Platform for Data Intensive Services Enabled by Next Generation Dynamic Optical Networks D. B. Hoang, T. Lavian, S. Figueira, J. Mambretti, I. Monga, S. Naiksatam, H. Cohen,
Distributed ASCI Supercomputer DAS-1 DAS-2 DAS-3 DAS-4 DAS-5
Distributed ASCI Supercomputer DAS-1 DAS-2 DAS-3 DAS-4 DAS-5 Paper IEEE Computer (May 2016) What is DAS? Distributed common infrastructure for Dutch Computer Science Distributed: multiple (4-6) clusters
Sun Dual Port 10GbE SFP+ PCIe 2.0 Networking Cards with Intel GbE Controller
Sun Dual Port 10GbE SFP+ PCIe 2.0 Networking Cards with Intel 82599 10GbE Controller Oracle's Sun Dual Port 10 GbE PCIe 2.0 Networking Cards with SFP+ pluggable transceivers, which incorporate the Intel
Real Parallel Computers
Real Parallel Computers Modular data centers Background Information Recent trends in the marketplace of high performance computing Strohmaier, Dongarra, Meuer, Simon Parallel Computing 2005 Short history
1 Port PCI Express 10 Gigabit Ethernet Network Card - PCIe x4 10Gb NIC
1 Port PCI Express 10 Gigabit Ethernet Network Card - PCIe x4 10Gb NIC Product ID: ST10000SPEX The ST10000SPEX PCI Express 10 Gbps Network Card lets you add a 10-Gigabit Ethernet port to your server or
BlueGene/L. Computer Science, University of Warwick. Source: IBM
BlueGene/L Source: IBM 1 BlueGene/L networking BlueGene system employs various network types. Central is the torus interconnection network: 3D torus with wrap-around. Each node connects to six neighbours
Ethernet Technologies
Ethernet Technologies CCNA 1 v3 Module 7 NESCOT CATC 1 10 Mbps Ethernet Legacy Ethernet means: 10BASE5 10BASE2 10BASE-T Common features are: frame format timing parameters transmission process basic design
Connecting the e-infrastructure chain
Connecting the e-infrastructure chain Internet2 Spring Meeting, Arlington, April 23 rd, 2012 Peter Hinrich & Migiel de Vos Topics - About SURFnet - Motivation: Big data & collaboration - Collaboration
Internet data transfer record between CERN and California. Sylvain Ravot (Caltech) Paolo Moroni (CERN)
Internet data transfer record between CERN and California Sylvain Ravot (Caltech) Paolo Moroni (CERN) Summary Internet2 Land Speed Record Contest New LSR DataTAG project and network configuration Establishing
Sun Lustre Storage System Simplifying and Accelerating Lustre Deployments
Sun Lustre Storage System Simplifying and Accelerating Lustre Deployments Torben Kling-Petersen, PhD Presenter s Name Principle Field Title andengineer Division HPC &Cloud LoB SunComputing Microsystems
StarPlane an Application Controlled Photonic Network
Expanding the Knowledge Economy: Issues, Applications, Case Studies Paul Cunningham and Miriam Cunningham (Eds) IOS Press, 2007 Amsterdam ISBN 978 1 58603 801-4 StarPlane an Application Controlled Photonic
Use of the Internet SCSI (iscsi) protocol
A unified networking approach to iscsi storage with Broadcom controllers By Dhiraj Sehgal, Abhijit Aswath, and Srinivas Thodati In environments based on Internet SCSI (iscsi) and 10 Gigabit Ethernet, deploying
National R&E Networks: Engines for innovation in research
National R&E Networks: Engines for innovation in research Erik-Jan Bos EGI Technical Forum 2010 Amsterdam, The Netherlands September 15, 2010 Erik-Jan Bos - Chief Technology Officer at Dutch NREN SURFnet
PCI Express x8 Single Port SFP+ 10 Gigabit Server Adapter (Intel 82599ES Based) Single-Port 10 Gigabit SFP+ Ethernet Server Adapters Provide Ultimate
NIC-PCIE-1SFP+-PLU PCI Express x8 Single Port SFP+ 10 Gigabit Server Adapter (Intel 82599ES Based) Single-Port 10 Gigabit SFP+ Ethernet Server Adapters Provide Ultimate Flexibility and Scalability in Virtual
HP BladeSystem c-class Ethernet network adaptors
HP BladeSystem c-class Ethernet network adaptors Family data sheet NC325m Quad-port Gigabit NC326m Dual-port Gigabit NC360m Dual-port Gigabit NC364m Quad-port Gigabit NC382m Dual-port Multifunction Gigabit
Performance Characteristics on Fast Ethernet and Gigabit networks
Version 2.5 Traffic Generator and Measurement Tool for IP Networks (IPv4 & IPv6) FTTx, LAN, MAN, WAN, WLAN, WWAN, Mobile, Satellite, PLC, etc Performance Characteristics on Fast Ethernet and Gigabit networks
Trends in Data Centre
Trends in Data Centre The impact on the IT infrastructure Thomas Ko Product Manager Market Situation Standards Update and Topology 40G and 100G Ethernet - Impact on IT Cabling Migration Options with Fiber
Lambda Networking Research
Lambda Networking Research www.science.uva.nl/~delaat/optical Cees de Laat University of Amsterdam Contents of this talk This space is intentionally left blank What is a Wave? X & _-rays visible light
Dual-Port QSFP+ Server NIC Card - PCI Express - Intel Chip
Dual-Port QSFP+ Server NIC Card - PCI Express - Intel Chip Product ID: PEX40GQSFDPI Get fast, high-bandwidth connectivity with this dual-port QSFP+ Network Interface Card. It adds two open QSFP+ slots
Comparing TCP performance of tunneled and non-tunneled traffic using OpenVPN. Berry Hoekstra Damir Musulin OS3 Supervisor: Jan Just Keijser Nikhef
Comparing TCP performance of tunneled and non-tunneled traffic using OpenVPN Berry Hoekstra Damir Musulin OS3 Supervisor: Jan Just Keijser Nikhef Outline Introduction Approach Research Results Conclusion
Arista 400G Transceivers and Cables: Q&A
Arista 400G Transceivers and Cables: Q&A What are the benefits of moving to 400G technology? 400G Transceivers and Cables Q&A Arista s 400G platforms allow data centers and high-performance computing environments
PCI Express x8 Quad Port 10Gigabit Server Adapter (Intel XL710 Based)
NIC-PCIE-4SFP+-PLU PCI Express x8 Quad Port 10Gigabit Server Adapter (Intel XL710 Based) Key Features Quad-port 10 GbE adapters PCI Express* (PCIe) 3.0, x8 Exceptional Low Power Adapters Network Virtualization
CN-100 Network Analyzer Product Overview
CN-100 Network Analyzer Product Overview CN-100 network analyzers offer an extremely powerful yet cost effective solution for today s complex networking requirements. Test Ethernet or ATM networks with
Communication has significant impact on application performance. Interconnection networks therefore have a vital role in cluster systems.
Cluster Networks Introduction Communication has significant impact on application performance. Interconnection networks therefore have a vital role in cluster systems. As usual, the driver is performance
Certification Document Supermicro SSG-6027R-E1R12T 04/30/2014. Supermicro SSG-6027R-E1R12T system
Supermicro SSG-6027R-E1R12T system Executive summary After performing all tests, the Supermicro SSG-6027R-E1R12T has been officially certified according to the Open-E Hardware Certification Program Guide
AcuSolve Performance Benchmark and Profiling. October 2011
AcuSolve Performance Benchmark and Profiling October 2011 Note The following research was performed under the HPC Advisory Council activities Participating vendors: AMD, Dell, Mellanox, Altair Compute
Network Design Considerations for Grid Computing
Network Design Considerations for Grid Computing Engineering Systems How Bandwidth, Latency, and Packet Size Impact Grid Job Performance by Erik Burrows, Engineering Systems Analyst, Principal, Broadcom
Programmable Information Highway (with no Traffic Jams)
Programmable Information Highway (with no Traffic Jams) Inder Monga Energy Sciences Network Scientific Networking Division Lawrence Berkeley National Lab Exponential Growth ESnet Accepted Traffic: Jan
Performance Evaluation of FDDI, ATM, and Gigabit Ethernet as Backbone Technologies Using Simulation
Performance Evaluation of FDDI, ATM, and Gigabit Ethernet as Backbone Technologies Using Simulation Sanjay P. Ahuja, Kyle Hegeman, Cheryl Daucher Department of Computer and Information Sciences University
High Speed Migration 100G & Beyond
High Speed Migration 100G & Beyond Moses Ngugi Field Application Engineer 5th September 2017 BANDWIDTH GROWTH Mobile Data IP Video Global Cloud IP Traffic Global IP Traffic Cisco CAGR: 50+% CAGR: 35%+
EXTENDING AN ASYNCHRONOUS MESSAGING LIBRARY USING AN RDMA-ENABLED INTERCONNECT. Konstantinos Alexopoulos ECE NTUA CSLab
EXTENDING AN ASYNCHRONOUS MESSAGING LIBRARY USING AN RDMA-ENABLED INTERCONNECT Konstantinos Alexopoulos ECE NTUA CSLab MOTIVATION HPC, Multi-node & Heterogeneous Systems Communication with low latency
40 GbE: What, Why & Its Market Potential
40 GbE: What, Why & Its Market Potential Contributors: Gautam Chanda, Cisco Systems Yinglin (Frank) Yang, CommScope, Inc. November 2010 1 P a g e Table of Contents Executive Summary...3 Introduction: The
Chapter 4: Network Access. Introduction to Networks v5.1
Chapter 4: Network Access Introduction to Networks v5.1 4.0 Introduction 4.1 Physical Layer Protocols 4.2 Network Media 4.3 Data Link Layer Protocols 4.4 Media Access Control 4.5 Summary 2013 Cisco and/or
QuickSpecs. HP Z 10GbE Dual Port Module. Models
Overview Models Part Number: 1Ql49AA Introduction The is a 10GBASE-T adapter utilizing the Intel X722 MAC and X557-AT2 PHY pairing to deliver full line-rate performance, utilizing CAT 6A UTP cabling (or
Tim Takala RCDD. Vice President Field Application Engineer APAC. Mobility is Driving Changing Network Architectures & Transceiver Evolutions
Tim Takala RCDD Vice President Field Application Engineer APAC Mobility is Driving Changing Network Architectures & Transceiver Evolutions 5TOP TRENDS SHAPING NETWORKS 1. Mobility 2. Connected Devices
PE2G4SFPI80 Quad Port SFP Gigabit Ethernet PCI Express Server Adapter Intel 82580EB Based
PE2G4SFPI80 Quad Port SFP Gigabit Ethernet PCI Express Server Adapter Intel 82580EB Based Product Description Silicom s Quad Port SFP Gigabit Ethernet PCI Express Server adapter is PCI-Express X4 SFP Gigabit
ASPERA HIGH-SPEED TRANSFER. Moving the world s data at maximum speed
ASPERA HIGH-SPEED TRANSFER Moving the world s data at maximum speed ASPERA HIGH-SPEED FILE TRANSFER 80 GBIT/S OVER IP USING DPDK Performance, Code, and Architecture Charles Shiflett Developer of next-generation
PCI Express 10 Gigabit Ethernet Fiber Network Card w/ Open SFP+ - PCIe x4 10Gb NIC SFP+ Adapter
PCI Express 10 Gigabit Ethernet Fiber Network Card w/ Open SFP+ - PCIe x4 10Gb NIC SFP+ Adapter Product ID: PEX10000SFP The PEX10000SFP 10 Gigabit Fiber Network Card is a cost-effective solution that delivers
A High-Performance Storage and Ultra- High-Speed File Transfer Solution for Collaborative Life Sciences Research
A High-Performance Storage and Ultra- High-Speed File Transfer Solution for Collaborative Life Sciences Research Storage Platforms with Aspera Overview A growing number of organizations with data-intensive
SMB Direct Update. Tom Talpey and Greg Kramer Microsoft Storage Developer Conference. Microsoft Corporation. All Rights Reserved.
SMB Direct Update Tom Talpey and Greg Kramer Microsoft 1 Outline Part I Ecosystem status and updates SMB 3.02 status SMB Direct applications RDMA protocols and networks Part II SMB Direct details Protocol
TECHNOLOGY BRIEF. 10 Gigabit Ethernet Technology Brief
TECHNOLOGY BRIEF 10 Gigabit Ethernet Technology Brief The 10 Gigabit Ethernet Standard In June 2002, the IEEE standard for 10 Gigabit Ethernet, IEEE Std 802.3ae- 2002, was unanimously approved by the IEEE
PE310G4TSF4I71 Quad Port SFP+ 10 Gigabit Ethernet PCI Express Time Stamp Server Adapter Intel Based
PE310G4TSF4I71 Quad Port SFP+ 10 Gigabit Ethernet PCI Express Time Stamp Server Adapter Intel Based Product Description Silicom s 40 Gigabit Ethernet PCI Express Time Stamping server adapter is designed
Ethernet 100G and Beyond
Ethernet 100G and Beyond Steve Jones Phone: +44 7900 881729 steve.jones@hubersuhner.com www.hubersuhner.com www.cubeoptics.com blog.cubeoptics.com We don t want this to be you 2 Global Data Center Traffic
GigaPort-RON dec 2008 From Routed to Hybrid Networking Cees de Laat University of Amsterdam
GigaPort-RON dec 2008 From Routed to Hybrid Networking Cees de Laat University of Amsterdam GP - Plans 2004-2008 1. Hybrid networking structure Network Architecture Optical Internet Exchange Architecture
Data center applications standards reference guide
White paper Data center applications standards reference guide Networking and storage Contents Scope 3 Introduction 3 Data center cabling standard ISO/IEC 24764 3 Ethernet (IEEE 802.3) 4 Proprietary 40
DESIGN, IMPLEMENTATION, AND OPERATION OF IPV6-ONLY IAAS SYSTEM WITH IPV4-IPV6 TRANSLATOR FOR TRANSITION TOWARD THE FUTURE INTERNET DATACENTER
DESIGN, IMPLEMENTATION, AND OPERATION OF IPV6-ONLY IAAS SYSTEM WITH IPV4-IPV6 TRANSLATOR FOR TRANSITION TOWARD THE FUTURE INTERNET DATACENTER Keiichi SHIMA 1 (Presenter) Wataru ISHIDA 2 Yuji SEKIYA 2 1
The Tofu Interconnect 2
The Tofu Interconnect 2 Yuichiro Ajima, Tomohiro Inoue, Shinya Hiramoto, Shun Ando, Masahiro Maeda, Takahide Yoshikawa, Koji Hosoe, and Toshiyuki Shimizu Fujitsu Limited Introduction Tofu interconnect
IT Business Management System Requirements Guide
IT Business Management System Requirements Guide IT Business Management Advanced or Enterprise Edition 8.1 This document supports the version of each product listed and supports all subsequent versions
LS-DYNA Best-Practices: Networking, MPI and Parallel File System Effect on LS-DYNA Performance
11 th International LS-DYNA Users Conference Computing Technology LS-DYNA Best-Practices: Networking, MPI and Parallel File System Effect on LS-DYNA Performance Gilad Shainer 1, Tong Liu 2, Jeff Layton
128GFC. Fiber Channel Leading Charge for Higher Speeds Skip Jones Date: Tuesday, October 15 Time: 2:10pm 2:50pm Location: Room 102B
128GFC Fiber Channel Leading Charge for Higher Speeds Skip Jones Date: Tuesday, October 15 Time: 2:10pm 2:50pm Location: Room 102B Skip.Jones@qlogic.com.com www.fibrechannel.org www.t11.org WHY 128GFC?
Chapter 9. Ethernet. Part II
Chapter 9 Ethernet Part II CCNA1-1 Chapter 9-2 Note for Instructors These presentations are the result of a collaboration among the instructors at St. Clair College in Windsor, Ontario. Thanks must go