Maelstrom: An Enterprise Continuity Protocol for Financial Datacenters
|
|
|
- Marlene Rodgers
- 5 years ago
- Views:
Transcription
1 Maelstrom: An Enterprise Continuity Protocol for Financial Datacenters Mahesh Balakrishnan, Tudor Marian, Hakim Weatherspoon Cornell University, Ithaca, NY
2 Datacenters Internet Services (90s) Websites, Search, Online Stores Since then: Millions # of low-end volume servers Installed Server Base 00-05: Commodity up by 100% High/Mid down by 40% 2007: 7 million new units Today: Datacenters are ubiquitous How have they evolved? Data partially sourced from IDC press releases (
3 Networks of Datacenters Why? Client Locality, Distributed Datasets or Operations, Enterprise Continuity RTT: 110 ms 100 ms 200 ms 220 ms 100 ms 110 ms 210 ms N W E S
4 Real-Time Enterprise Continuity Financial Datacenters: Real-Time, Mission-Critical Current State-of-the-art: Mirror from NYC to NJ Wanted: Arbitrarily far mirrors! Step Zero: How do we send data reliably across high-speed long-distance pipes?
5 Reliable Communication between Datacenters Open a TCP/IP socket from CA to NY. What happens? Throughput BufSize RTT BufSize = Receiver Buffer Size Current Solution: Manually reset buffer sizes
6 Reliable Communication between Datacenters Open a TCP/IP socket from CA to NY. What happens? Throughput BufSize RTT BufSize = Receiver Buffer Size Current Solution: Manually reset buffer sizes TCP/IP needs zero loss on high-speed long-distance links: Sensitive Congestion Control RTT dependence + Sequenced Delivery
7 Reliable Communication between Datacenters Open a TCP/IP socket from CA to NY. What happens? Throughput BufSize RTT BufSize = Receiver Buffer Size Current Solution: Manually reset buffer sizes TCP/IP needs zero loss on high-speed long-distance links: Sensitive Congestion Control RTT dependence + Sequenced Delivery Current State-of-the-Art Solution: $$$!
8 TeraGrid: Supercomputer Network SDSC, PSC, CTC, IU, NCSA... End-to-End UDP Probes: Zero Congestion, Non-Zero Loss! Possible Reasons: transient congestion degraded fiber malfunctioning HW misconfigured HW switching contention low receiver power end-host overflow... % of Measurements % of Lost Packets
9 TeraGrid: Supercomputer Network SDSC, PSC, CTC, IU, NCSA... End-to-End UDP Probes: Zero Congestion, Non-Zero Loss! Possible Reasons: transient congestion degraded fiber malfunctioning HW misconfigured HW switching contention low receiver power end-host overflow... % of Measurements All Measurements Without Indiana U. Site % of Lost Packets
10 TeraGrid: Supercomputer Network SDSC, PSC, CTC, IU, NCSA... End-to-End UDP Probes: Zero Congestion, Non-Zero Loss! Possible Reasons: transient congestion degraded fiber malfunctioning HW misconfigured HW switching contention low receiver power end-host overflow... % of Measurements All Measurements Without Indiana U. Site % of Lost Packets Problem Statement: Run unmodified TCP/IP over lossy high-speed long-distance networks
11 The Maelstrom Network Appliance Maelstrom Send-side Appliance Packet Loss Maelstrom Receive-side Appliance Sending End-hosts Commodity TCP Inserts FEC FEC+Data Recovers via FEC FEC = Forward Error Correction Transparent: No modification to end-host or network Receiving End-hosts Commodity TCP
12 What is FEC? A B C D E X X X C D E A B 3 repair packets from every 5 data packets Receiver can recover from any 3 lost packets Rate 1 : (r, c) c repair packets for every r data packets. Pro: No Feedback Loop, Constant Overhead Why not run FEC at end-hosts? Con: Recovery Latency dependent on channel data rate 1 Rateless codes are popular, but inapplicable to real-time streams
13 What is FEC? Maelstrom Conclusion A B C D E X X X C D E A B 3 repair packets from every 5 data packets Receiver can recover from any 3 lost packets Rate 1 : (r, c) c repair packets for every r data packets. Pro: No Feedback Loop, Constant Overhead Why not run FEC at end-hosts? Con: Recovery Latency dependent on channel data rate FEC in the Network: Where and What: At the appliance, across multiple channels 1 Rateless codes are popular, but inapplicable to real-time streams
14 The Maelstrom Network Appliance Maelstrom Send-side Appliance Packet Loss Maelstrom Receive-side Appliance Sending End-hosts Commodity TCP Inserts FEC FEC+Data Recovers via FEC FEC = Forward Error Correction Transparent: No modification to end-host or network Where: at the appliance, What: aggregated data Receiving End-hosts Commodity TCP
15 Maelstrom Mechanism Send-Side Appliance: Intercept IP packets Create repair packet = XOR + recipe of data packet IDs Receive-Side Appliance: Lost packet recovered using XOR and other data packets At receiver end-host: out of order, no loss Lambda Jumbo MTU LAN MTU Recipe List : 25,26,27,28,29 XOR Recovered Packet Appliance Appliance 27 X LOSS
16 Flow Control Maelstrom Conclusion Two Flow Control Modes for TCP/IP Traffic: End-Host Appliance Appliance End-Host A) End-to-End Flow Control End-Host Appliance Appliance End-Host B) Split Flow Control Recall: Two problems with TCP/IP loss and buffering End-to-end mode hides loss Split mode buffers data (standard PeP)
17 Layered Interleaving for Bursty Loss Recovery Latency Actual Burst Size, not Max Burst Size Data Stream XORs: X3 X2 X1 XORs at different interleaves Recovery latency degrades gracefully with loss burstiness: X1 catches random singleton losses X2 catches loss bursts of 10 or less X3 catches bursts of 100 or less 2
18 Layered Interleaving for Bursty Loss Recovery Latency Actual Burst Size, not Max Burst Size Data Stream XORs: X3 X2 X1 XORs at different interleaves Recovery latency degrades gracefully with loss burstiness: X1 catches random singleton losses X2 catches loss bursts of 10 or less X3 catches bursts of 100 or less Recovery probability Reed Solomon Maelstrom Loss probability Comparison of Recovery Probability: r=7, c=2 2
19 Implementation Details In Kernel Linux Module Commodity Box: 3 Ghz, 1 Gbps NIC ( 800$) Max speed: 1 Gbps, Memory Footprint: 10 MB 50-60% CPU NIC is the bottleneck (for c = 3) How do we efficiently store/access/clean a gigabit of data every second? Scaling to Multi-Gigabit: Partition IP space across proxies
20 Evaluation: FEC mode and loss Claim: Maelstrom effectively hides loss from TCP/IP Throughput (Mbps) TCP No Loss Maelstrom No Loss Maelstrom (0.1%) Maelstrom (1.0%) TCP/IP (0.1%) TCP (1% loss) One Way Link Latency (ms)
21 Evaluation: FEC mode and loss Claim: Maelstrom effectively hides loss from TCP/IP Throughput (Mbps) TCP/IP without loss TCP No Loss Maelstrom No Loss Maelstrom (0.1%) Maelstrom (1.0%) TCP/IP (0.1%) TCP (1% loss) One Way Link Latency (ms) TCP/IP with loss
22 Evaluation: FEC mode and loss Claim: Maelstrom effectively hides loss from TCP/IP Data + FEC = 1 Gbps Throughput (Mbps) TCP/IP without loss TCP No Loss { Maelstrom No Loss Maelstrom (0.1%) Maelstrom (1.0%) 600 TCP/IP (0.1%) 500 TCP (1% loss) One Way Link Latency (ms) TCP/IP with loss
23 Evaluation: FEC mode and loss Claim: Maelstrom effectively hides loss from TCP/IP Data + FEC = 1 Gbps Throughput (Mbps) TCP/IP without loss TCP No Loss { Maelstrom No Loss Maelstrom (0.1%) Maelstrom (1.0%) 600 TCP/IP (0.1%) 500 TCP (1% loss) Tput RTT One Way Link Latency (ms) TCP/IP with loss
24 Evaluation: Split Mode and buffering Claim: Maelstrom performance is independent of link length 600 Tput as a function of latency 500 Tput (Mbps) loss-rate= loss-rate=0.001 loss-rate= loss-rate= One-way link latency (ms)
25 Evaluation: Split mode and buffering Claim: Maelstrom split mode is as good as hand tuning of buffer sizes throughput 0.1% loss Throughput (Mbits/sec) client-buf M-ALL M-FEC M-BUF tcp RTT 100ms
26 Evaluation: Split mode and buffering Claim: Maelstrom split mode is as good as hand tuning of buffer sizes throughput 0.1% loss Throughput (Mbits/sec) Maelstrom FEC 0 client-buf M-ALL M-FEC M-BUF tcp RTT 100ms
27 Evaluation: Split mode and buffering Claim: Maelstrom split mode is as good as hand tuning of buffer sizes 600 throughput 0.1% loss Throughput (Mbits/sec) client-buf M-ALL M-FEC M-BUF tcp RTT 100ms Maelstrom FEC Maelstrom FEC + Hand-Tuned Buffers
28 Evaluation: Split mode and buffering Claim: Maelstrom split mode is as good as hand tuning of buffer sizes Maelstrom FEC + Split Mode throughput 0.1% loss Throughput (Mbits/sec) client-buf M-ALL M-FEC M-BUF tcp RTT 100ms Maelstrom FEC Maelstrom FEC + Hand-Tuned Buffers
29 Evaluation: Delivery Latency Claim: Maelstrom eliminates TCP/IP s loss-related jitter Delivery Latency (ms) TCP/IP: 0.1% Loss Delivery Latency (ms) Maelstrom: 0.1% Loss Packet # Packet # Receive-side buffering due to sequencing Send-side buffering due to congestion control
30 SMFS: The Smoke and Mirrors Filesystem Classic Mirroring Trade-off: Fast return to user after sending to mirror Safe return to user after ACK from mirror Maelstrom: Lossy Network Lossless Network Disk! SMFS return to user after sending enough FEC Result: Fast, Safe Mirroring independent of link length! General Principle: Gray-box Exposure of Protocol State
31 Future Work: User-Mode Packet Processors Common need: packet processing at gigabit speeds on commodity HW/OS Examples: overlay routing, deep packet inspection, application/protocol acceleration (Maelstrom)... Current option: write in-kernel code Proposed solution: Lightweight User-Mode Processes Narrow packet-specific interface to kernel Developer writes C code against custom library Pinned memory, circular buffers
32 Conclusion How do enterprises recover from failures in real-time? Enabling networks of remote datacenters Step 0: Reliable Communication Maelstrom Step 1: Data Mirroring SMFS What s next?
Reliable Communication for Datacenters
Cornell University Datacenters Internet Services (90s) Websites, Search, Online Stores Since then: # of low-end volume servers Millions 30 25 20 15 10 5 0 2000 2001 2002 2003 2004 2005 Installed Server
IEEE/ACM TRANSACTIONS ON NETWORKING, VOL. 19, NO. 3, JUNE
IEEE/ACM TRANSACTIONS ON NETWORKING, VOL. 19, NO. 3, JUNE 2011 617 Maelstrom: Transparent Error Correction for Communication Between Data Centers Mahesh Balakrishnan, Tudor Marian, Kenneth P. Birman, Fellow,
presenter Hakim Weatherspoon CS 6464 February 5 th, 2009
presenter Hakim Weatherspoon CS 6464 February 5 th, 2009 U.S. Department of Treasury Study Financial Sector vulnerable to significant data loss in disaster Need new technical options Risks are real, technology
Maelstrom: Transparent Error Correction for Lambda Networks
Maelstrom: Transparent Error Correction for Lambda Networks Mahesh Balakrishnan, Tudor Marian, Ken Birman, Hakim Weatherspoon, Einar Vollset {mahesh, tudorm, ken, hweather, einar}@cs.cornell.edu Cornell
Smoke and Mirrors: Reflecting Files at a Geographically Remote Location Without Loss of Performance
Smoke and Mirrors: Reflecting Files at a Geographically Remote Location Without Loss of Performance Hakim Weatherspoon, Lakshmi Ganesh, Tudor Marian, Mahesh Balakrishnan, and Ken Birman Cornell University,
Smoke and Mirrors: Reflecting Files at a Geographically Remote Location Without Loss of Performance
Smoke and Mirrors: Reflecting Files at a Geographically Remote Location Without Loss of Performance Hakim Weatherspoon, Lakshmi Ganesh, Tudor Marian, Mahesh Balakrishnan, and Ken Birman Cornell University,
Data Center Networks and Switching and Queueing and Covert Timing Channels
Data Center Networks and Switching and Queueing and Covert Timing Channels Hakim Weatherspoon Associate Professor, Dept of Computer Science CS 5413: High Performance Computing and Networking March 10,
CS 514: Transport Protocols for Datacenters
Department of Computer Science Cornell University Outline Motivation 1 Motivation 2 3 Commodity Datacenters Blade-servers, Fast Interconnects Different Apps: Google -> Search Amazon -> Etailing Computational
Presentation_ID. 2002, Cisco Systems, Inc. All rights reserved.
1 Gigabit to the Desktop Session Number 2 Gigabit to the Desktop What we are seeing: Today s driver for Gigabit Ethernet to the Desktop is not a single application but the simultaneous use of multiple
Optimizing Performance: Intel Network Adapters User Guide
Optimizing Performance: Intel Network Adapters User Guide Network Optimization Types When optimizing network adapter parameters (NIC), the user typically considers one of the following three conditions
Why Your Application only Uses 10Mbps Even the Link is 1Gbps?
Why Your Application only Uses 10Mbps Even the Link is 1Gbps? Contents Introduction Background Information Overview of the Issue Bandwidth-Delay Product Verify Solution How to Tell Round Trip Time (RTT)
FUJITSU Software Interstage Information Integrator V11
FUJITSU Software V11 An Innovative WAN optimization solution to bring out maximum network performance October, 2013 Fujitsu Limited Contents Overview Key technologies Supported network characteristics
HyperIP : SRDF Application Note
HyperIP : SRDF Application Note Introduction HyperIP is a Linux software application that quantifiably and measurably enhances large data movement over big bandwidth and long-haul IP networks. HyperIP
Traffic Characteristics of Bulk Data Transfer using TCP/IP over Gigabit Ethernet
Traffic Characteristics of Bulk Data Transfer using TCP/IP over Gigabit Ethernet Aamir Shaikh and Kenneth J. Christensen Department of Computer Science and Engineering University of South Florida Tampa,
Probe or Wait : Handling tail losses using Multipath TCP
Probe or Wait : Handling tail losses using Multipath TCP Kiran Yedugundla, Per Hurtig, Anna Brunstrom 12/06/2017 Probe or Wait : Handling tail losses using Multipath TCP Outline Introduction Handling tail
ETSF10 Internet Protocols Transport Layer Protocols
ETSF10 Internet Protocols Transport Layer Protocols 2012, Part 2, Lecture 2.1 Kaan Bür, Jens Andersson Transport Layer Protocols Process-to-process delivery [ed.4 ch.23.1] [ed.5 ch.24.1] Transmission Control
Outline Computer Networking. TCP slow start. TCP modeling. TCP details AIMD. Congestion Avoidance. Lecture 18 TCP Performance Peter Steenkiste
Outline 15-441 Computer Networking Lecture 18 TCP Performance Peter Steenkiste Fall 2010 www.cs.cmu.edu/~prs/15-441-f10 TCP congestion avoidance TCP slow start TCP modeling TCP details 2 AIMD Distributed,
Chapter 13 TRANSPORT. Mobile Computing Winter 2005 / Overview. TCP Overview. TCP slow-start. Motivation Simple analysis Various TCP mechanisms
Overview Chapter 13 TRANSPORT Motivation Simple analysis Various TCP mechanisms Distributed Computing Group Mobile Computing Winter 2005 / 2006 Distributed Computing Group MOBILE COMPUTING R. Wattenhofer
MASV Accelerator Technology Overview
MASV Accelerator Technology Overview Introduction Most internet applications, FTP and HTTP to name a few, achieve network transport via the ubiquitous TCP protocol. But TCP suffers from latency, packet
A TRANSPORT PROTOCOL FOR DEDICATED END-TO-END CIRCUITS
A TRANSPORT PROTOCOL FOR DEDICATED END-TO-END CIRCUITS MS Thesis Final Examination Anant P. Mudambi Computer Engineering University of Virginia December 6, 2005 Outline Motivation CHEETAH Background UDP-based
The Future of High-Performance Networking (The 5?, 10?, 15? Year Outlook)
Workshop on New Visions for Large-Scale Networks: Research & Applications Vienna, VA, USA, March 12-14, 2001 The Future of High-Performance Networking (The 5?, 10?, 15? Year Outlook) Wu-chun Feng feng@lanl.gov
Perfect Video over Any Network. State-of-the-art Technology for Live Video Comunications
Perfect Video over Any Network State-of-the-art Technology for Live Video Comunications Who We Are Established in 2004 Focus on the Professional Video Market Over 30 years of combined experience in Broadcast
A transport-layer approach for achieving predictable throughput for Internet applications
Seventh International Conference on Networking A transport-layer approach for achieving predictable throughput for Internet applications Go Hasegawa, Kana Yamanegi and Masayuki Murata Graduate School of
WHITE PAPER: PROFISHARK PERFORMANCE RESULTS WIRESHARK HEROES SERIES VISIT
WHITE PAPER: PROFISHARK PERFORMANCE WIRESHARK HEROES SERIES VISIT WWW.PROFITAP.COM TABLE OF CONTENT TONY FORTUNATO NETWORK PERFORMANCE SPECIALIST Tony Fortunato is a Senior Network Performance Specialist
Intel PRO/1000 PT and PF Quad Port Bypass Server Adapters for In-line Server Appliances
Technology Brief Intel PRO/1000 PT and PF Quad Port Bypass Server Adapters for In-line Server Appliances Intel PRO/1000 PT and PF Quad Port Bypass Server Adapters for In-line Server Appliances The world
Network Design Considerations for Grid Computing
Network Design Considerations for Grid Computing Engineering Systems How Bandwidth, Latency, and Packet Size Impact Grid Job Performance by Erik Burrows, Engineering Systems Analyst, Principal, Broadcom
Good Ideas So Far Computer Networking. Outline. Sequence Numbers (reminder) TCP flow control. Congestion sources and collapse
Good Ideas So Far 15-441 Computer Networking Lecture 17 TCP & Congestion Control Flow control Stop & wait Parallel stop & wait Sliding window Loss recovery Timeouts Acknowledgement-driven recovery (selective
Ultra high-speed transmission technology for wide area data movement
Ultra high-speed transmission technology for wide area data movement Michelle Munson, president & co-founder Aspera Outline Business motivation Moving ever larger file sets over commodity IP networks (public,
On the cost of tunnel endpoint processing in overlay virtual networks
J. Weerasinghe; NVSDN2014, London; 8 th December 2014 On the cost of tunnel endpoint processing in overlay virtual networks J. Weerasinghe & F. Abel IBM Research Zurich Laboratory Outline Motivation Overlay
Wireless TCP Performance Issues
Wireless TCP Performance Issues Issues, transport layer protocols Set up and maintain end-to-end connections Reliable end-to-end delivery of data Flow control Congestion control Udp? Assume TCP for the
Using Proxies to Enhance TCP Performance over Hybrid Fiber Coaxial Networks
Using Proxies to Enhance TCP Performance over Hybrid Fiber Coaxial Networks Reuven Cohen * Dept. of Computer Science, Technion, Haifa 32, Israel and Srinivas Ramanathan Hewlett-Packard Laboratories, 151
IX: A Protected Dataplane Operating System for High Throughput and Low Latency
IX: A Protected Dataplane Operating System for High Throughput and Low Latency Adam Belay et al. Proc. of the 11th USENIX Symp. on OSDI, pp. 49-65, 2014. Presented by Han Zhang & Zaina Hamid Challenges
Master s Thesis. TCP Congestion Control Mechanisms for Achieving Predictable Throughput
Master s Thesis Title TCP Congestion Control Mechanisms for Achieving Predictable Throughput Supervisor Prof. Hirotaka Nakano Author Kana Yamanegi February 14th, 2007 Department of Information Networking
Chapter 4. Routers with Tiny Buffers: Experiments. 4.1 Testbed experiments Setup
Chapter 4 Routers with Tiny Buffers: Experiments This chapter describes two sets of experiments with tiny buffers in networks: one in a testbed and the other in a real network over the Internet2 1 backbone.
ECS-087: Mobile Computing
ECS-087: Mobile Computing TCP over wireless TCP and mobility Most of the Slides borrowed from Prof. Sridhar Iyer s lecture IIT Bombay Diwakar Yagyasen 1 Effect of Mobility on Protocol Stack Application:
Outline 9.2. TCP for 2.5G/3G wireless
Transport layer 9.1 Outline Motivation, TCP-mechanisms Classical approaches (Indirect TCP, Snooping TCP, Mobile TCP) PEPs in general Additional optimizations (Fast retransmit/recovery, Transmission freezing,
Exercises TCP/IP Networking With Solutions
Exercises TCP/IP Networking With Solutions Jean-Yves Le Boudec Fall 2009 3 Module 3: Congestion Control Exercise 3.2 1. Assume that a TCP sender, called S, does not implement fast retransmit, but does
Mobile Transport Layer
Mobile Transport Layer 1 Transport Layer HTTP (used by web services) typically uses TCP Reliable transport between TCP client and server required - Stream oriented, not transaction oriented - Network friendly:
XCo: Explicit Coordination for Preventing Congestion in Data Center Ethernet
XCo: Explicit Coordination for Preventing Congestion in Data Center Ethernet Vijay Shankar Rajanna, Smit Shah, Anand Jahagirdar and Kartik Gopalan Computer Science, State University of New York at Binghamton
WarpTCP WHITE PAPER. Technology Overview. networks. -Improving the way the world connects -
WarpTCP WHITE PAPER Technology Overview -Improving the way the world connects - WarpTCP - Attacking the Root Cause TCP throughput reduction is often the bottleneck that causes data to move at slow speed.
Supporting Scalability and Adaptability via ADAptive Middleware And Network Transports (ADAMANT)
Supporting Scalability and Adaptability via ADAptive Middleware And Network Transports (ADAMANT) Joe Hoffert, Doug Schmidt Vanderbilt University Mahesh Balakrishnan, Ken Birman Cornell University Motivation
Issues related to TCP performance in heterogeneous networks
Issues related to TCP performance in heterogeneous networks Chadi BARAKAT INRIA Sophia Antipolis, France PLANETE group EPFL Summer Research Institute July 16, 2002 Heterogeneity of networks The Internet
Multiple unconnected networks
TCP/IP Life in the Early 1970s Multiple unconnected networks ARPAnet Data-over-cable Packet satellite (Aloha) Packet radio ARPAnet satellite net Differences Across Packet-Switched Networks Addressing Maximum
The Best Protocol for Real-time Data Transport
The Definitive Guide to: The Best Protocol for Real-time Data Transport Assessing the most common protocols on 6 important categories Identifying the Best Protocol For strategic applications using real-time
Toward a Reliable Data Transport Architecture for Optical Burst-Switched Networks
Toward a Reliable Data Transport Architecture for Optical Burst-Switched Networks Dr. Vinod Vokkarane Assistant Professor, Computer and Information Science Co-Director, Advanced Computer Networks Lab University
Linux Plumbers Conference TCP-NV Congestion Avoidance for Data Centers
Linux Plumbers Conference 2010 TCP-NV Congestion Avoidance for Data Centers Lawrence Brakmo Google TCP Congestion Control Algorithm for utilizing available bandwidth without too many losses No attempt
TCP Congestion Control
6.033, Spring 2014 TCP Congestion Control Dina Katabi & Sam Madden nms.csail.mit.edu/~dina Sharing the Internet How do you manage resources in a huge system like the Internet, where users with different
iscsi : A loss-less Ethernet fabric with DCB Jason Blosil, NetApp Gary Gumanow, Dell
iscsi : A loss-less Ethernet fabric with DCB Jason Blosil, NetApp Gary Gumanow, Dell SNIA Legal Notice The material contained in this tutorial is copyrighted by the SNIA. Member companies and individual
VoIP over Wi- Fi using Riverbed Simulation
VoIP over Wi- Fi using Riverbed Simulation ENSC 427: Communication Networks Spring 2015 Team 10 Zhang Yuanjie 301178462 yuanjiez@sfu.ca Jiaqi Li 301132843 lijiaqil@sfu.ca Owen Au 301155843 owena@sfu..ca
WebSphere MQ Low Latency Messaging V2.1. High Throughput and Low Latency to Maximize Business Responsiveness IBM Corporation
WebSphere MQ Low Latency Messaging V2.1 High Throughput and Low Latency to Maximize Business Responsiveness 2008 IBM Corporation WebSphere MQ Low Latency Messaging Extends the WebSphere MQ messaging family
Recap. TCP connection setup/teardown Sliding window, flow control Retransmission timeouts Fairness, max-min fairness AIMD achieves max-min fairness
Recap TCP connection setup/teardown Sliding window, flow control Retransmission timeouts Fairness, max-min fairness AIMD achieves max-min fairness 81 Feedback Signals Several possible signals, with different
Transport layer issues
Transport layer issues Dmitrij Lagutin, dlagutin@cc.hut.fi T-79.5401 Special Course in Mobility Management: Ad hoc networks, 28.3.2007 Contents Issues in designing a transport layer protocol for ad hoc
Motivation CPUs can not keep pace with network
Deferred Segmentation For Wire-Speed Transmission of Large TCP Frames over Standard GbE Networks Bilic Hrvoye (Billy) Igor Chirashnya Yitzhak Birk Zorik Machulsky Technion - Israel Institute of technology
RPT: Re-architecting Loss Protection for Content-Aware Networks
RPT: Re-architecting Loss Protection for Content-Aware Networks Dongsu Han, Ashok Anand ǂ, Aditya Akella ǂ, and Srinivasan Seshan Carnegie Mellon University ǂ University of Wisconsin-Madison Motivation:
High bandwidth, Long distance. Where is my throughput? Robin Tasker CCLRC, Daresbury Laboratory, UK
High bandwidth, Long distance. Where is my throughput? Robin Tasker CCLRC, Daresbury Laboratory, UK [r.tasker@dl.ac.uk] DataTAG is a project sponsored by the European Commission - EU Grant IST-2001-32459
CMSC 417. Computer Networks Prof. Ashok K Agrawala Ashok Agrawala. October 30, 2018
CMSC 417 Computer Networks Prof. Ashok K Agrawala 2018 Ashok Agrawala October 30, 2018 Message, Segment, Packet, and Frame host host HTTP HTTP message HTTP TCP TCP segment TCP router router IP IP packet
RCRT:Rate-Controlled Reliable Transport Protocol for Wireless Sensor Networks
RCRT:Rate-Controlled Reliable Transport Protocol for Wireless Sensor Networks JEONGYEUP PAEK, RAMESH GOVINDAN University of Southern California 1 Applications that require the transport of high-rate data
Multi-path Forward Error Correction Control Scheme with Path Interleaving
Multi-path Forward Error Correction Control Scheme with Path Interleaving Ming-Fong Tsai, Chun-Yi Kuo, Chun-Nan Kuo and Ce-Kuen Shieh Department of Electrical Engineering, National Cheng Kung University,
Networks & protocols research in Grid5000 DAS3
1 Grid 5000 Networks & protocols research in Grid5000 DAS3 Date Pascale Vicat-Blanc Primet Senior Researcher at INRIA Leader of the RESO team LIP Laboratory UMR CNRS-INRIA-ENS-UCBL Ecole Normale Supérieure
Low-latency Network Monitoring via Oversubscribed Port Mirroring
Low-latency Network Monitoring via Oversubscribed Port Mirroring Jeff Rasley, Brent tephens,! Colin Dixon, Eric Rozner,! Wes Felter, Kanak Agarwal,! John Carter, Rodrigo Fonseca elf-tuning Networks Control
TCP over wireless links
CSc 450/550 Computer Communications & Networks TCP over wireless links Jianping Pan (stand-in for Dr. Wu) 1/31/06 CSc 450/550 1 TCP over wireless links TCP a quick review on how TCP works Wireless links
Why Performance Matters When Building Your New SD-WAN
Why Performance Matters When Building Your New SD-WAN Not all SD-WANs are created equal. Brought to you by Silver Peak The New Generation of High Performance SD-WANs As enterprise IT considers ways to
1-800-OVERLAYS: Using Overlay Networks to Improve VoIP Quality. Yair Amir, Claudiu Danilov, Stuart Goose, David Hedqvist, Andreas Terzis
1-800-OVERLAYS: Using Overlay Networks to Improve VoIP Quality Yair Amir, Claudiu Danilov, Stuart Goose, David Hedqvist, Andreas Terzis Voice over IP To call or not to call The Internet started as an overlay
Understanding TCP Parallelization. Qiang Fu. TCP Performance Issues TCP Enhancements TCP Parallelization (research areas of interest)
Understanding TCP Parallelization Qiang Fu qfu@swin.edu.au Outline TCP Performance Issues TCP Enhancements TCP Parallelization (research areas of interest) Related Approaches TCP Parallelization vs. Single
Multi-class Applications for Parallel Usage of a Guaranteed Rate and a Scavenger Service
Department of Computer Science 1/18 Multi-class Applications for Parallel Usage of a Guaranteed Rate and a Scavenger Service Markus Fidler fidler@informatik.rwth-aachen.de Volker Sander sander@fz.juelich.de
Analysis of TCP Latency over Wireless Links Supporting FEC/ARQ-SR for Error Recovery
Analysis of TCP Latency over Wireless Links Supporting FEC/ARQ-SR for Error Recovery Raja Abdelmoumen CRISTAL Laboratory, Tunisia Email: Raja.Abdelmoumen@ensi.rnu.tn Chadi Barakat Projet Planète, INRIA-Sophia
1. What is a Computer Network? interconnected collection of autonomous computers connected by a communication technology
Review Questions for exam Preparation (22-07-2017) 1. What is a Computer Network? interconnected collection of autonomous computers connected by a communication technology 2. What is the Internet? "network
Got Loss? Get zovn! Daniel Crisan, Robert Birke, Gilles Cressier, Cyriel Minkenberg, and Mitch Gusat. ACM SIGCOMM 2013, August, Hong Kong, China
Got Loss? Get zovn! Daniel Crisan, Robert Birke, Gilles Cressier, Cyriel Minkenberg, and Mitch Gusat ACM SIGCOMM 2013, 12-16 August, Hong Kong, China Virtualized Server 1 Application Performance in Virtualized
Packet Scheduling in Data Centers. Lecture 17, Computer Networks (198:552)
Packet Scheduling in Data Centers Lecture 17, Computer Networks (198:552) Datacenter transport Goal: Complete flows quickly / meet deadlines Short flows (e.g., query, coordination) Large flows (e.g., data
CSE 123A Computer Networks
CSE 123A Computer Networks Winter 2005 Lecture 14 Congestion Control Some images courtesy David Wetherall Animations by Nick McKeown and Guido Appenzeller The bad news and the good news The bad news: new
Fast packet processing in the cloud. Dániel Géhberger Ericsson Research
Fast packet processing in the cloud Dániel Géhberger Ericsson Research Outline Motivation Service chains Hardware related topics, acceleration Virtualization basics Software performance and acceleration
Advanced Computer Networks. Flow Control
Advanced Computer Networks 263 3501 00 Flow Control Patrick Stuedi Spring Semester 2017 1 Oriana Riva, Department of Computer Science ETH Zürich Last week TCP in Datacenters Avoid incast problem - Reduce
Check Point DDoS Protector Introduction
Check Point DDoS Protector Introduction Petr Kadrmas SE Eastern Europe pkadrmas@checkpoint.com Agenda 1 (D)DoS Trends 2 3 4 DDoS Protector Overview Protections in Details Summary 2 (D)DoS Attack Methods
CSE 4215/5431: Mobile Communications Winter Suprakash Datta
CSE 4215/5431: Mobile Communications Winter 2013 Suprakash Datta datta@cse.yorku.ca Office: CSEB 3043 Phone: 416-736-2100 ext 77875 Course page: http://www.cse.yorku.ca/course/4215 Some slides are adapted
Communication Networks
Communication Networks Spring 2018 Laurent Vanbever nsg.ee.ethz.ch ETH Zürich (D-ITET) April 30 2018 Materials inspired from Scott Shenker & Jennifer Rexford Last week on Communication Networks We started
ECSE-6600: Internet Protocols Spring 2007, Exam 1 SOLUTIONS
ECSE-6600: Internet Protocols Spring 2007, Exam 1 SOLUTIONS Time: 75 min (strictly enforced) Points: 50 YOUR NAME (1 pt): Be brief, but DO NOT omit necessary detail {Note: Simply copying text directly
Comparing TCP performance of tunneled and non-tunneled traffic using OpenVPN. Berry Hoekstra Damir Musulin OS3 Supervisor: Jan Just Keijser Nikhef
Comparing TCP performance of tunneled and non-tunneled traffic using OpenVPN Berry Hoekstra Damir Musulin OS3 Supervisor: Jan Just Keijser Nikhef Outline Introduction Approach Research Results Conclusion
Chapter III. congestion situation in Highspeed Networks
Chapter III Proposed model for improving the congestion situation in Highspeed Networks TCP has been the most used transport protocol for the Internet for over two decades. The scale of the Internet and
What is New in Cisco ACE 4710 Application Control Engine Software Release 3.1
What is New in Cisco ACE 4710 Application Control Engine Software Release 3.1 PB478675 Product Overview The Cisco ACE Application Control Engine 4710 represents the next generation of application switches
Measurement Study of Lowbitrate Internet Video Streaming
Measurement Study of Lowbitrate Internet Video Streaming Dmitri Loguinov and Hayder Radha CS Dept at CUNY NY and EE/ECE at MSU. In Proceedings of ACM SIGCOMM Workshop on Internet Measurement November 2002
TCP Tuning Domenico Vicinanza DANTE, Cambridge, UK
TCP Tuning Domenico Vicinanza DANTE, Cambridge, UK domenico.vicinanza@dante.net EGI Technical Forum 2013, Madrid, Spain TCP! Transmission Control Protocol (TCP)! One of the original core protocols of the
The Case for Informed Transport Protocols
The Case for Informed Transport Protocols Stefan Savage Neal Cardwell Tom Anderson University of Washington Our position Wide-area network performance: is important is limited by inefficient congestion
XCo: Explicit Coordination to Prevent Network Fabric Congestion in Cloud Computing Cluster Platforms. Presented by Wei Dai
XCo: Explicit Coordination to Prevent Network Fabric Congestion in Cloud Computing Cluster Platforms Presented by Wei Dai Reasons for Congestion in Cloud Cloud operators use virtualization to consolidate
Introduction to TCP/IP Offload Engine (TOE)
Introduction to TCP/IP Offload Engine (TOE) Version 1.0, April 2002 Authored By: Eric Yeh, Hewlett Packard Herman Chao, QLogic Corp. Venu Mannem, Adaptec, Inc. Joe Gervais, Alacritech Bradley Booth, Intel
PE2G4B19L Quad Port Copper Gigabit Ethernet PCI Express Server Adapter Broadcom BCM5719 Based
PE2G4B19L Quad Port Copper Gigabit Ethernet PCI Express Server Adapter Broadcom BCM5719 Based Product Description Silicom s Quad Port Copper Gigabit Ethernet PCI Express Server adapter is PCI-Express X4
Lecture 15: TCP over wireless networks. Mythili Vutukuru CS 653 Spring 2014 March 13, Thursday
Lecture 15: TCP over wireless networks Mythili Vutukuru CS 653 Spring 2014 March 13, Thursday TCP - recap Transport layer TCP is the dominant protocol TCP provides in-order reliable byte stream abstraction
Tudor S. Marian 4124 Upson Hall, Cornell University, Ithaca NY
Tudor S. Marian 4124 Upson Hall, Cornell University, Ithaca NY 14853 tudor.marian@cornell.edu 607-254-6507 EMPLOYMENT Postdoctoral Associate 2010 2011 Department of Computer Science, Cornell University
RealMedia Streaming Performance on an IEEE b Wireless LAN
RealMedia Streaming Performance on an IEEE 802.11b Wireless LAN T. Huang and C. Williamson Proceedings of IASTED Wireless and Optical Communications (WOC) Conference Banff, AB, Canada, July 2002 Presented
Lecture 21: Congestion Control" CSE 123: Computer Networks Alex C. Snoeren
Lecture 21: Congestion Control" CSE 123: Computer Networks Alex C. Snoeren Lecture 21 Overview" How fast should a sending host transmit data? Not to fast, not to slow, just right Should not be faster than
TRANSMISSION CONTROL PROTOCOL
COMP 635: WIRELESS & MOBILE COMMUNICATIONS TRANSMISSION CONTROL PROTOCOL Jasleen Kaur Fall 2017 1 Impact of Wireless on Protocol Layers Application layer Transport layer Network layer Data link layer Physical
CMSC 417. Computer Networks Prof. Ashok K Agrawala Ashok Agrawala. October 25, 2018
CMSC 417 Computer Networks Prof. Ashok K Agrawala 2018 Ashok Agrawala Message, Segment, Packet, and Frame host host HTTP HTTP message HTTP TCP TCP segment TCP router router IP IP packet IP IP packet IP
PE2G4SFPI80 Quad Port SFP Gigabit Ethernet PCI Express Server Adapter Intel 82580EB Based
PE2G4SFPI80 Quad Port SFP Gigabit Ethernet PCI Express Server Adapter Intel 82580EB Based Product Description Silicom s Quad Port SFP Gigabit Ethernet PCI Express Server adapter is PCI-Express X4 SFP Gigabit
Analysis of Multiple Target Network Storage Access using Multi-routing VPN Connections
Analysis of Multiple Network Storage Access using Multi-routing Connections Nozomi Chishima Ochanomizu University 2 1 1, Otsuka, Bunkyo-ku Tokyo 112 861, JAPAN nozomi@ogl.is.ocha.ac.jp Saneyasu Yamaguchi
IBM Europe Announcement ZP , dated November 6, 2007
IBM Europe Announcement ZP07-0484, dated November 6, 2007 IBM WebSphere Front Office for Financial Markets V2.0 and IBM WebSphere MQ Low Latency Messaging V2.0 deliver high speed and high throughput market
Chapter III: Transport Layer
Chapter III: Transport Layer UG3 Computer Communications & Networks (COMN) Mahesh Marina mahesh@ed.ac.uk Slides thanks to Myungjin Lee and copyright of Kurose and Ross Principles of congestion control
double split driver model
software defining system devices with the BANANA double split driver model Dan WILLIAMS, Hani JAMJOOM IBM Watson Research Center Hakim WEATHERSPOON Cornell University Decoupling gives Flexibility Cloud
CS 268: Wireless Transport Protocols. Kevin Lai Feb 13, 2002
CS 268: Wireless Transport Protocols Kevin Lai Feb 13, 2002 Motivation! Wireless connectivity proliferating - Satellite, line-of-sight microwave, line-of-sight laser, cellular data (CDMA, GPRS, 3G), wireless
ARISTA: Improving Application Performance While Reducing Complexity
ARISTA: Improving Application Performance While Reducing Complexity October 2008 1.0 Problem Statement #1... 1 1.1 Problem Statement #2... 1 1.2 Previous Options: More Servers and I/O Adapters... 1 1.3
Solace Message Routers and Cisco Ethernet Switches: Unified Infrastructure for Financial Services Middleware
Solace Message Routers and Cisco Ethernet Switches: Unified Infrastructure for Financial Services Middleware What You Will Learn The goal of zero latency in financial services has caused the creation of
Mobile Communications Chapter 9: Mobile Transport Layer
Prof. Dr.-Ing Jochen H. Schiller Inst. of Computer Science Freie Universität Berlin Germany Mobile Communications Chapter 9: Mobile Transport Layer Motivation, TCP-mechanisms Classical approaches (Indirect