Stateless Datacenter Load Balancing with Beamer

Size: px
Start display at page:

Download "Stateless Datacenter Load Balancing with Beamer"

Transcription

1 Stateless Datacenter Load Balancing with Beamer Vladimir Olteanu, Alexandru Agache, Andrei Voinescu, Costin Raiciu University Politehnica of Bucharest Thanks to

2 Datacenter load balancing

3 Datacenter load balancing today Border router ECMP VIP MUX VIP MUX DIP 1 DIP 2 DIP 3 Server Server Server srcip dstip payload 1 C VIP 2 C VIP 3 M DIP 3 C VIP 4 VIP C

4 Strawman approach HASH FUNCTION Server 1 MUX

5 Strawman approach HASH FUNCTION Server 1 MUX X X Server 2 Adding/removing servers breaks connection affinity

6 Load balancers use state to ensure connection affinity Flow DIP Server 1 Server 2 MUX

7 Load balancers use state to ensure connection affinity Flow DIP Server 1 Server 2 MUX Only new connections are hashed

8 Load balancers use state to ensure connection affinity MUX 1 Flow DIP Server 1 Flow DIP Server 2 MUX 2

9 Load balancers use state to ensure connection affinity MUX 1 MUX 2 Flow DIP Flow DIP 2 2 X Server 1 Server 2 Scaling mux pool may reset some connections

10 Load balancers use state to ensure connection affinity Flow DIP Server 1 Server 2 MUX

11 SYN floods use up state memory N Flow DIP Server 1 MUX Server 2

12 SYN floods use up state memory N Flow N N N DIP Server 1 N N Server 2 MUX

13 SYN floods use up state memory N Flow N N N DIP Server 1 N N MUX HASH FUNCTION X Server 2 Back to the straw man approach

14 Stateful designs don t guarantee connection affinity

15 Beamer: stateless load balancing Beamer muxes do not keep per-connection state; each packet is forwarded independently. When the target server changes, connections may break. Beamer uses state stored in servers to redirect stray packets.

16 Beamer daisy chaining Server 1 Want to POWER OFF MUX DATAPLANE MUX Server 2 Used when reassigning traffic

17 Beamer daisy chaining Server 1 Want to POWER OFF MUX DATAPLANE MUX Server 2 Used when reassigning traffic

18 Beamer daisy chaining Server 1 Want to POWER OFF MUX DATAPLANE MUX Server 2 Daisy-chained connections die off in time

19 Balancing packets in Beamer Which hashing algorithm is best? Low churn Good load balancing Few rules in dataplane ECMP Consistent Hashing Maglev Hashing

20 Beamer hashing Indirection layer Pick number of buckets B > N, number of servers Mux dataplane: Assign each bucket to one server Bucket-to-server mappings known by all muxes Maintained by a centralized controller Mux algorithm: Hash each packet modulo B Send to corresponding server

21 Beamer at work Bkt DIP PDIP TS Server 1 Server 2 MUX

22 Beamer at work Bkt DIP PDIP TS t t Server 1 IP DIP 1 t IP TCP Server 2 MUX IP Option Packets contain previous server and time of reassignment

23 Beamer at work Bkt DIP PDIP TS t t Server 1 Server 2 MUX New connections are handled locally

24 Beamer at work Bkt DIP PDIP TS t t Server 1 Server 2 MUX Daisy chained connections die off in time

25 Benefits of Beamer muxes Less memory usage and cache thrashing Implementable in hardware: P4 Interchangeable Resilient to SYN flood attacks Cost: 16B encapsulation overhead per packet

26 Beamer mux performance Software implementation on top of netmap Machine: Xeon E GHz, Intel NIC Compared against: Stateful similar performance to Google s Maglev [NSDI 16]

27 Single mux performance

28 Realistic traffic HTTP traffic from recent MAWI trace Packets replayed back-to-back 36Gbps of upstream traffic on 7 cores 15 times more downstream traffic: 540Gbps Rough estimate: servers/mux Assuming servers source 1-10Gbps of traffic

29 Testbed evaluation 20 machines 10Gbps NICs IBM RackSwitch 8264 as border router Software muxes P4 reference implementation also used

30 Adding and removing muxes Mux failures and churn are handled smoothly

31 Adding servers Beamer spreads traffic evenly across servers

32 Connection affinity under SYN flood attacks 1Mpps SYN flood 2 muxes, 8 servers, 700 running connections Drain servers during SYN flood DIPs Drained Stateful 0 87±2 148±8 351±21 Beamer

33 Control plane ZooKeeper Cluster MUX MUX MUX MUX Controller A centralized fault-tolerant controller manages the dataplane

34 Control plane DIP PDIP TS D1 D3 TS1 D2 D4 TS2 ZooKeeper Cluster MUX MUX MUX MUX Controller v1 v1 v1 v1 v1

35 Control plane ZooKeeper Cluster MUX MUX MUX MUX Controller v1 v1 v1 v1 v2 DIP PDIP TS D4 D1 NOW D2 D4 TS2

36 Control plane ZooKeeper Cluster MUX MUX MUX MUX Controller v2 v1 v2 v1 v2 Muxes download update Daisy chaining allows for temporarily stale muxes

37 Control plane experiments Tested on Amazon EC2 3 ZooKeeper daemons, 100 muxes Large simulated service: 64K servers, 6.4M buckets Stress-tested controller

38 Control plane experiments When adding servers: Controller takes 1-10s to update ZooKeeper Muxes take 0.5-6s to get new dataplane information Total control traffic: 1GB (10MB/mux)

39 Please see paper for: MPTCP support in Beamer Minimizing # of rules required in muxes 1 rule / server, rather than 1 rule / bucket Avoiding reset connections in corner cases

40 Conclusions Stateless load balancing using daisy chaining 36Gbps of HTTP traffic on 7 cores 540Gbps of downlink traffic Scalable, fault tolerant control plane Beamer is open-source:

Stateless Datacenter Load-balancing with Beamer

Stateless Datacenter Load-balancing with Beamer Stateless Datacenter Load-balancing with Beamer Vladimir Olteanu, Alexandru Agache, Andrei Voinescu, and Costin Raiciu, University Politehnica of Bucharest https://www.usenix.org/conference/nsdi18/presentation/olteanu

More information

Super Fast Packet Filtering with ebpf and XDP Helen Tabunshchyk, Systems Engineer, Cloudflare

Super Fast Packet Filtering with ebpf and XDP Helen Tabunshchyk, Systems Engineer, Cloudflare Super Fast Packet Filtering with ebpf and XDP Helen Tabunshchyk, Systems Engineer, Cloudflare @advance_lunge Agenda 1. Background. 2. A tiny bit of theory about routing. 3. Problems that have to be solved.

More information

S tateless H ardware- E nabled L oad-aware L oad-balancing SHELL: Stateless Load-Aware Load Balancing in P4

S tateless H ardware- E nabled L oad-aware L oad-balancing SHELL: Stateless Load-Aware Load Balancing in P4 S tateless H ardware- E nabled L oad-aware L oad-balancing SHELL: Stateless Load-Aware Load Balancing in P4 Benoît Pit-Claudel*, Yoann Desmouceaux*, Pierre Pfister, Mark Townsley *, Thomas Clausen* *École

More information

Stateless Network Functions:

Stateless Network Functions: Stateless Network Functions: Breaking the Tight Coupling of State and Processing Murad Kablan, Azzam Alsudais, Eric Keller, Franck Le University of Colorado IBM Networks Need Network Functions Firewall

More information

Utilizing Datacenter Networks: Centralized or Distributed Solutions?

Utilizing Datacenter Networks: Centralized or Distributed Solutions? Utilizing Datacenter Networks: Centralized or Distributed Solutions? Costin Raiciu Department of Computer Science University Politehnica of Bucharest We ve gotten used to great applications Enabling Such

More information

Routing Domains in Data Centre Networks. Morteza Kheirkhah. Informatics Department University of Sussex. Multi-Service Networks July 2011

Routing Domains in Data Centre Networks. Morteza Kheirkhah. Informatics Department University of Sussex. Multi-Service Networks July 2011 Routing Domains in Data Centre Networks Morteza Kheirkhah Informatics Department University of Sussex Multi-Service Networks July 2011 What is a Data Centre? Large-scale Data Centres (DC) consist of tens

More information

GRIN: Utilizing the Empty Half of Full Bisection Networks

GRIN: Utilizing the Empty Half of Full Bisection Networks GRIN: Utilizing the Empty Half of Full Bisection Networks Alexandru Agache University Politehnica of Bucharest Costin Raiciu University Politehnica of Bucharest Abstract Various full bisection designs

More information

Making Multipath TCP friendlier to Load Balancers and Anycast

Making Multipath TCP friendlier to Load Balancers and Anycast Making Multipath TCP friendlier to Load Balancers and Anycast Fabien Duchêne Olivier Bonaventure Université Catholique de Louvain ICNP 2017

More information

TCP Sendbuffer Advertising. Costin Raiciu University Politehnica of Bucharest

TCP Sendbuffer Advertising. Costin Raiciu University Politehnica of Bucharest TCP Sendbuffer Advertising Costin Raiciu University Politehnica of Bucharest Problem statement There is only so much we can find about about a connection by looking at in flight packets (losses, retransmissions,

More information

Enabling Fast, Dynamic Network Processing with ClickOS

Enabling Fast, Dynamic Network Processing with ClickOS Enabling Fast, Dynamic Network Processing with ClickOS Joao Martins*, Mohamed Ahmed*, Costin Raiciu, Roberto Bifulco*, Vladimir Olteanu, Michio Honda*, Felipe Huici* * NEC Labs Europe, Heidelberg, Germany

More information

Building Efficient and Reliable Software-Defined Networks. Naga Katta

Building Efficient and Reliable Software-Defined Networks. Naga Katta FPO Talk Building Efficient and Reliable Software-Defined Networks Naga Katta Jennifer Rexford (Advisor) Readers: Mike Freedman, David Walker Examiners: Nick Feamster, Aarti Gupta 1 Traditional Networking

More information

TRex Realistic Traffic Generator

TRex Realistic Traffic Generator DEVNET-1120 TRex Realistic Traffic Generator Hanoch Haim, Principal Engineer Cisco Spark How Questions? Use Cisco Spark to communicate with the speaker after the session 1. Find this session in the Cisco

More information

Anti-DDoS. User Guide. Issue 05 Date

Anti-DDoS. User Guide. Issue 05 Date Issue 05 Date 2017-02-08 Contents Contents 1 Introduction... 1 1.1 Functions... 1 1.2 Application Scenarios...1 1.3 Accessing and Using Anti-DDoS... 2 1.3.1 How to Access Anti-DDoS...2 1.3.2 How to Use

More information

Data Centers. Tom Anderson

Data Centers. Tom Anderson Data Centers Tom Anderson Transport Clarification RPC messages can be arbitrary size Ex: ok to send a tree or a hash table Can require more than one packet sent/received We assume messages can be dropped,

More information

SAND: A Fault-Tolerant Streaming Architecture for Network Traffic Analytics

SAND: A Fault-Tolerant Streaming Architecture for Network Traffic Analytics 1 SAND: A Fault-Tolerant Streaming Architecture for Network Traffic Analytics Qin Liu, John C.S. Lui 1 Cheng He, Lujia Pan, Wei Fan, Yunlong Shi 2 1 The Chinese University of Hong Kong 2 Huawei Noah s

More information

The Power of Batching in the Click Modular Router

The Power of Batching in the Click Modular Router The Power of Batching in the Click Modular Router Joongi Kim, Seonggu Huh, Keon Jang, * KyoungSoo Park, Sue Moon Computer Science Dept., KAIST Microsoft Research Cambridge, UK * Electrical Engineering

More information

libvnf: building VNFs made easy

libvnf: building VNFs made easy libvnf: building VNFs made easy Priyanka Naik, Akash Kanase, Trishal Patel, Mythili Vutukuru Dept. of Computer Science and Engineering Indian Institute of Technology, Bombay SoCC 18 11 th October, 2018

More information

Reliably Scalable Name Prefix Lookup! Haowei Yuan and Patrick Crowley! Washington University in St. Louis!! ANCS 2015! 5/8/2015!

Reliably Scalable Name Prefix Lookup! Haowei Yuan and Patrick Crowley! Washington University in St. Louis!! ANCS 2015! 5/8/2015! Reliably Scalable Name Prefix Lookup! Haowei Yuan and Patrick Crowley! Washington University in St. Louis!! ANCS 2015! 5/8/2015! ! My Topic for Today! Goal: a reliable longest name prefix lookup performance

More information

Scaling Internet TV Content Delivery ALEX GUTARIN DIRECTOR OF ENGINEERING, NETFLIX

Scaling Internet TV Content Delivery ALEX GUTARIN DIRECTOR OF ENGINEERING, NETFLIX Scaling Internet TV Content Delivery ALEX GUTARIN DIRECTOR OF ENGINEERING, NETFLIX Inventing Internet TV Available in more than 190 countries 104+ million subscribers Lots of Streaming == Lots of Traffic

More information

DPDK Summit China 2017

DPDK Summit China 2017 Summit China 2017 Embedded Network Architecture Optimization Based on Lin Hao T1 Networks Agenda Our History What is an embedded network device Challenge to us Requirements for device today Our solution

More information

Large-Scale Web Applications

Large-Scale Web Applications Large-Scale Web Applications Mendel Rosenblum Web Application Architecture Web Browser Web Server / Application server Storage System HTTP Internet CS142 Lecture Notes - Intro LAN 2 Large-Scale: Scale-Out

More information

NetBricks: Taking the V out of NFV. Aurojit Panda, Sangjin Han, Keon Jang, Melvin Walls, Sylvia Ratnasamy, Scott Shenker UC Berkeley, Google, ICSI

NetBricks: Taking the V out of NFV. Aurojit Panda, Sangjin Han, Keon Jang, Melvin Walls, Sylvia Ratnasamy, Scott Shenker UC Berkeley, Google, ICSI NetBricks: Taking the V out of NFV Aurojit Panda, Sangjin Han, Keon Jang, Melvin Walls, Sylvia Ratnasamy, Scott Shenker UC Berkeley, Google, ICSI What the heck is NFV? A Short Introduction to NFV A Short

More information

Design Challenges for High Performance, Scalable NFV Interconnects

Design Challenges for High Performance, Scalable NFV Interconnects Design Challenges for High Performance, Scalable V Interconnects Guyue Liu The George Washington University K. K. Ramakrishnan University of California, Riverside Mike Schlansker Hewlett Packard Labs ABSTRACT

More information

Network Virtualization in Multi-tenant Datacenters

Network Virtualization in Multi-tenant Datacenters Network Virtualization in Multi-tenant Datacenters Teemu Koponen, Keith Amidon, Peter Balland, Martín Casado, Anupam Chanda, Bryan Fulton, Igor Ganichev, Jesse Gross, Natasha Gude, Paul Ingram, Ethan Jackson,

More information

Improving PF's performance and reliability Lessons learned from bashing pf with DDoS attacks and other malicious traffic. By Kajetan Staszkiewicz,

Improving PF's performance and reliability Lessons learned from bashing pf with DDoS attacks and other malicious traffic. By Kajetan Staszkiewicz, Improving PF's performance and reliability Lessons learned from bashing pf with DDoS attacks and other malicious traffic. By Kajetan Staszkiewicz, Senior Network Enginneer @ InnoGames Let me introduce

More information

CSE 123b Communications Software

CSE 123b Communications Software CSE 123b Communications Software Spring 2002 Lecture 13: Content Distribution Networks (plus some other applications) Stefan Savage Some slides courtesy Srini Seshan Today s class Quick examples of other

More information

Session based high bandwidth throughput testing

Session based high bandwidth throughput testing Universiteit van Amsterdam System and Network Engineering Research Project 2 Session based high bandwidth throughput testing Bram ter Borch bram.terborch@os3.nl 29 August 2017 Abstract To maximize and

More information

Today s class. CSE 123b Communications Software. Telnet. Network File System (NFS) Quick descriptions of some other sample applications

Today s class. CSE 123b Communications Software. Telnet. Network File System (NFS) Quick descriptions of some other sample applications CSE 123b Communications Software Spring 2004 Today s class Quick examples of other application protocols Mail, telnet, NFS Content Distribution Networks (CDN) Lecture 12: Content Distribution Networks

More information

Flat Datacenter Storage. Edmund B. Nightingale, Jeremy Elson, et al. 6.S897

Flat Datacenter Storage. Edmund B. Nightingale, Jeremy Elson, et al. 6.S897 Flat Datacenter Storage Edmund B. Nightingale, Jeremy Elson, et al. 6.S897 Motivation Imagine a world with flat data storage Simple, Centralized, and easy to program Unfortunately, datacenter networks

More information

Improve Performance of Kube-proxy and GTP-U using VPP

Improve Performance of Kube-proxy and GTP-U using VPP Improve Performance of Kube-proxy and GTP-U using VPP Hongjun Ni (hongjun.ni@intel.com) Danny Zhou (danny.zhou@intel.com) Johnson Li (johnson.li@intel.com) Network Platform Group, DCG, Intel Acknowledgement:

More information

Check Point DDoS Protector Introduction

Check Point DDoS Protector Introduction Check Point DDoS Protector Introduction Petr Kadrmas SE Eastern Europe pkadrmas@checkpoint.com Agenda 1 (D)DoS Trends 2 3 4 DDoS Protector Overview Protections in Details Summary 2 (D)DoS Attack Methods

More information

소프트웨어기반고성능침입탐지시스템설계및구현

소프트웨어기반고성능침입탐지시스템설계및구현 소프트웨어기반고성능침입탐지시스템설계및구현 KyoungSoo Park Department of Electrical Engineering, KAIST M. Asim Jamshed *, Jihyung Lee*, Sangwoo Moon*, Insu Yun *, Deokjin Kim, Sungryoul Lee, Yung Yi* Department of Electrical

More information

Expeditus: Congestion-Aware Load Balancing in Clos Data Center Networks

Expeditus: Congestion-Aware Load Balancing in Clos Data Center Networks Expeditus: Congestion-Aware Load Balancing in Clos Data Center Networks Peng Wang, Hong Xu, Zhixiong Niu, Dongsu Han, Yongqiang Xiong ACM SoCC 2016, Oct 5-7, Santa Clara Motivation Datacenter networks

More information

Improving Multipath TCP. PhD Thesis - Christoph Paasch

Improving Multipath TCP. PhD Thesis - Christoph Paasch Improving Multipath TCP PhD Thesis - Christoph Paasch The Internet is like a map... highly connected Communicating over the Internet A 1 A A 2 A 3 A 4 A 5 Multipath communication A 1 A 2 A 3 A 4 A 5 A

More information

Experiences in Building a 100 Gbps (D)DoS Traffic Generator

Experiences in Building a 100 Gbps (D)DoS Traffic Generator Experiences in Building a 100 Gbps (D)DoS Traffic Generator DIY with a Single Commodity-off-the-shelf (COTS) Server March 31, 2018 Umeda Sky Building Escalators Surasak Sanguanpong Surasak.S@ku.ac.th About

More information

Hashing on broken assumptions

Hashing on broken assumptions Hashing on broken assumptions Lorenzo Saino (@lorenzosaino) Fastly Name of Presentation Problem: Spreading traffic across multiple links, paths, hosts Solutions: Link Aggregation Equal Cost Multipath (ECMP)

More information

DeTail Reducing the Tail of Flow Completion Times in Datacenter Networks. David Zats, Tathagata Das, Prashanth Mohan, Dhruba Borthakur, Randy Katz

DeTail Reducing the Tail of Flow Completion Times in Datacenter Networks. David Zats, Tathagata Das, Prashanth Mohan, Dhruba Borthakur, Randy Katz DeTail Reducing the Tail of Flow Completion Times in Datacenter Networks David Zats, Tathagata Das, Prashanth Mohan, Dhruba Borthakur, Randy Katz 1 A Typical Facebook Page Modern pages have many components

More information

Ananta: Cloud Scale Load Balancing. Nitish Paradkar, Zaina Hamid. EECS 589 Paper Review

Ananta: Cloud Scale Load Balancing. Nitish Paradkar, Zaina Hamid. EECS 589 Paper Review Ananta: Cloud Scale Load Balancing Nitish Paradkar, Zaina Hamid EECS 589 Paper Review 1 Full Reference Patel, P. et al., " Ananta: Cloud Scale Load Balancing," Proc. of ACM SIGCOMM '13, 43(4):207-218,

More information

Windows Azure Services - At Different Levels

Windows Azure Services - At Different Levels Windows Azure Windows Azure Services - At Different Levels SaaS eg : MS Office 365 Paas eg : Azure SQL Database, Azure websites, Azure Content Delivery Network (CDN), Azure BizTalk Services, and Azure

More information

Load Balance Mechanism

Load Balance Mechanism Load Balance Application in Dual-WAN Interface Load Balance Mechanism To which WAN port the traffic will be routed is determined according to the Load Balance mechanism. Below diagram shows how Vigor router

More information

Anti-DDoS. User Guide (Paris) Issue 01 Date HUAWEI TECHNOLOGIES CO., LTD.

Anti-DDoS. User Guide (Paris) Issue 01 Date HUAWEI TECHNOLOGIES CO., LTD. Issue 01 Date 2018-08-15 HUAWEI TECHNOLOGIES CO., LTD. Copyright Huawei Technologies Co., Ltd. 2018. All rights reserved. No part of this document may be reproduced or transmitted in any form or by any

More information

Be Fast, Cheap and in Control with SwitchKV. Xiaozhou Li

Be Fast, Cheap and in Control with SwitchKV. Xiaozhou Li Be Fast, Cheap and in Control with SwitchKV Xiaozhou Li Goal: fast and cost-efficient key-value store Store, retrieve, manage key-value objects Get(key)/Put(key,value)/Delete(key) Target: cluster-level

More information

Precept 6. Hashing & Partitioning. Server Load Balancing. Limitations of Round Robin. Multipath Load Balancing. Limitations of Round Robin

Precept 6. Hashing & Partitioning. Server Load Balancing. Limitations of Round Robin. Multipath Load Balancing. Limitations of Round Robin Server Load Balancing Precept 6 Hashing & Partitioning Balance load across servers Normal techniques: Round-robin? Peng Sun 1 2 Limitations of Round Robin Multipath Load Balancing Packets of a single connection

More information

Is it Still Possible to Extend TCP?

Is it Still Possible to Extend TCP? Is it Still Possible to Extend TCP? Michio Honda, Keio University Yoshifumi Nishida, Keio University Costin Raiciu, Universitatea Politehnica Bucuresti Adam Greenhalgh, University College London Mark Handley,

More information

Tales of the Tail Hardware, OS, and Application-level Sources of Tail Latency

Tales of the Tail Hardware, OS, and Application-level Sources of Tail Latency Tales of the Tail Hardware, OS, and Application-level Sources of Tail Latency Jialin Li, Naveen Kr. Sharma, Dan R. K. Ports and Steven D. Gribble February 2, 2015 1 Introduction What is Tail Latency? What

More information

Transparent Edge Gateway for Mobile Networks

Transparent Edge Gateway for Mobile Networks Transparent Edge Gateway for Mobile Networks Ashkan Aghdai *, Mark Huang, David Dai, Yang Xu *, and Jonathan Chao * * NYU Tandon School of Engineering Huawei Technologies 1st P4 European Workshop (P4EU)

More information

TrafficDB: HERE s High Performance Shared-Memory Data Store Ricardo Fernandes, Piotr Zaczkowski, Bernd Göttler, Conor Ettinoffe, and Anis Moussa

TrafficDB: HERE s High Performance Shared-Memory Data Store Ricardo Fernandes, Piotr Zaczkowski, Bernd Göttler, Conor Ettinoffe, and Anis Moussa TrafficDB: HERE s High Performance Shared-Memory Data Store Ricardo Fernandes, Piotr Zaczkowski, Bernd Göttler, Conor Ettinoffe, and Anis Moussa EPL646: Advanced Topics in Databases Christos Hadjistyllis

More information

Elastic Load Balancing

Elastic Load Balancing Elastic Load Balancing Deep Dive & Best Practices Mariano Vecchioli, Sr. Technical Account Manager AWS Michaela Kurkiewicz, Principal Service Manager Co-op Tina Howell, Platform Lead - Co-op June 28 th,

More information

Survey of ETSI NFV standardization documents BY ABHISHEK GUPTA FRIDAY GROUP MEETING FEBRUARY 26, 2016

Survey of ETSI NFV standardization documents BY ABHISHEK GUPTA FRIDAY GROUP MEETING FEBRUARY 26, 2016 Survey of ETSI NFV standardization documents BY ABHISHEK GUPTA FRIDAY GROUP MEETING FEBRUARY 26, 2016 VNFaaS (Virtual Network Function as a Service) In our present work, we consider the VNFaaS use-case

More information

NFVnice: Dynamic Backpressure and Scheduling for NFV Service Chains

NFVnice: Dynamic Backpressure and Scheduling for NFV Service Chains NFVnice: Dynamic Backpressure and Scheduling for NFV Service Chains Sameer G Kulkarni 1, Wei Zhang 2, Jinho Hwang 3, Shriram Rajagopalan 3, K.K. Ramakrishnan 4, Timothy Wood 2, Mayutan Arumaithurai 1 &

More information

A Ten Minute Introduction to Middleboxes. Justine Sherry, UC Berkeley

A Ten Minute Introduction to Middleboxes. Justine Sherry, UC Berkeley A Ten Minute Introduction to Middleboxes Justine Sherry, UC Berkeley This Talk: Three Questions! What is a middlebox? What are some recent trends in middlebox engineering? What research challenges do middleboxes

More information

Camdoop Exploiting In-network Aggregation for Big Data Applications Paolo Costa

Camdoop Exploiting In-network Aggregation for Big Data Applications Paolo Costa Camdoop Exploiting In-network Aggregation for Big Data Applications costa@imperial.ac.uk joint work with Austin Donnelly, Antony Rowstron, and Greg O Shea (MSR Cambridge) MapReduce Overview Input file

More information

CONGA: Distributed Congestion-Aware Load Balancing for Datacenters

CONGA: Distributed Congestion-Aware Load Balancing for Datacenters CONGA: Distributed Congestion-Aware Load Balancing for Datacenters By Alizadeh,M et al. Motivation Distributed datacenter applications require large bisection bandwidth Spine Presented by Andrew and Jack

More information

Executive Summary. Introduction. Test Highlights

Executive Summary. Introduction. Test Highlights Executive Summary Today, LTE mobile operators typically deploy All-IP and flat network architectures. This elegant and flexible solution requires deployment of an adequate security infrastructure. One

More information

Scotch: Elastically Scaling up SDN Control-Plane using vswitch based Overlay

Scotch: Elastically Scaling up SDN Control-Plane using vswitch based Overlay Scotch: Elastically Scaling up SDN Control-Plane using vswitch based Overlay An Wang George Mason University awang1@gmu.edu T. V. Lakshman Bell Labs, Alcatel-Lucent T.V.Lakshman@alcatellucent.com Yang

More information

A Network-centric TCP for Interactive Video Delivery Networks (VDN)

A Network-centric TCP for Interactive Video Delivery Networks (VDN) A Network-centric TCP for Interactive Video Delivery Networks (VDN) MD Iftakharul Islam, Javed I Khan Department of Computer Science Kent State University Kent, OH 1 / 44 Outline 1 Interactive Video Network

More information

Singapore. Service Proxy, Container Networking & K8s. Acknowledgement: Pierre Pfister, Jerome John DiGiglio, Ray

Singapore. Service Proxy, Container Networking & K8s. Acknowledgement: Pierre Pfister, Jerome John DiGiglio, Ray Singapore Service Proxy, Container Networking & K8s Hongjun Ni Intel Email: hongjun.ni@intel.com Acknowledgement: Pierre Pfister, Jerome Tollet @Cisco John DiGiglio, Ray Kinsella @Intel Agenda What is

More information

Elastic Scaling of Stateful Network Functions

Elastic Scaling of Stateful Network Functions NSDI 2018 Elastic Scaling of Stateful Network Functions Shinae Woo *+, Justine Sherry *, Sangjin Han *, Sue Moon +, Sylvia Ratnasamy *, Scott Shenker * + KAIST, * UC Berkeley Elastic Scaling of NFs NFV

More information

RIGHTNOW A C E

RIGHTNOW A C E RIGHTNOW A C E 2 0 1 4 2014 Aras 1 A C E 2 0 1 4 Scalability Test Projects Understanding the results 2014 Aras Overview Original Use Case Scalability vs Performance Scale to? Scaling the Database Server

More information

Stateless Network Functions: Breaking the Tight Coupling of State and Processing

Stateless Network Functions: Breaking the Tight Coupling of State and Processing Stateless Network Functions: Breaking the Tight Coupling of State and Processing Murad Kablan, Azzam Alsudais, and Eric Keller, University of Colorado Boulder; Franck Le, IBM Research https://www.usenix.org/conference/nsdi17/technical-sessions/presentation/kablan

More information

On Smart Query Routing: For Distributed Graph Querying with Decoupled Storage

On Smart Query Routing: For Distributed Graph Querying with Decoupled Storage On Smart Query Routing: For Distributed Graph Querying with Decoupled Storage Arijit Khan Nanyang Technological University (NTU), Singapore Gustavo Segovia ETH Zurich, Switzerland Donald Kossmann Microsoft

More information

Racs-EV-Java. Gary Zibrat (gdz4)

Racs-EV-Java. Gary Zibrat (gdz4) Racs-EV-Java Gary Zibrat (gdz4) Motivation Large organizations want to store data in the cloud (e.g. Library of Congress, Netflix, Reddit) Not only does do users pay per byte of data currently in the cloud,

More information

A Security Orchestration System for CDN Edge Servers

A Security Orchestration System for CDN Edge Servers A Security Orchestration System for CDN Edge Servers ELAHEH JALALPOUR STERE PREDA MILAD GHAZNAVI MAKAN POURZANDI DANIEL MIGAULT RAOUF BOUTABA 1 Outline Introduction Edge Server Security Orchestration Implementation

More information

Session objectives and takeaways

Session objectives and takeaways Session objectives and takeaways Objectives Explain SDN Core Concepts Deploy SDN Fabric with SCVMM 2016 Takeaways: Deploying SDN Fabric components with SCVMM requires planning Deploying Tenant Resources

More information

Overlay Networks. Behnam Momeni Computer Engineering Department Sharif University of Technology

Overlay Networks. Behnam Momeni Computer Engineering Department Sharif University of Technology CE443 Computer Networks Overlay Networks Behnam Momeni Computer Engineering Department Sharif University of Technology Acknowledgments: Lecture slides are from Computer networks course thought by Jennifer

More information

TriScale Clustering Tech Note

TriScale Clustering Tech Note TriScale Clustering Tech Note www.citrix.com Table of Contents Expanding Capacity with TriScale Clustering... 2 How Clustering Works... 2 Cluster Communication... 3 Cluster Configuration and Synchronization...

More information

Jinho Hwang (IBM Research) Wei Zhang, Timothy Wood, H. Howie Huang (George Washington Univ.) K.K. Ramakrishnan (Rutgers University)

Jinho Hwang (IBM Research) Wei Zhang, Timothy Wood, H. Howie Huang (George Washington Univ.) K.K. Ramakrishnan (Rutgers University) Jinho Hwang (IBM Research) Wei Zhang, Timothy Wood, H. Howie Huang (George Washington Univ.) K.K. Ramakrishnan (Rutgers University) Background: Memory Caching Two orders of magnitude more reads than writes

More information

Deploying Liferay Digital Experience Platform in Amazon Web Services

Deploying Liferay Digital Experience Platform in Amazon Web Services Deploying Liferay Digital Experience Platform in Amazon Web Services Table of Contents Introduction................................. 1 Reference Architecture........................ 1 Overview..................................

More information

Micro load balancing in data centers with DRILL

Micro load balancing in data centers with DRILL Micro load balancing in data centers with DRILL Soudeh Ghorbani (UIUC) Brighten Godfrey (UIUC) Yashar Ganjali (University of Toronto) Amin Firoozshahian (Intel) Where should the load balancing functionality

More information

Independent Scalability and Functionality Test: Sandvine Virtualized Traffic Steering Engine (TSE) and Virtualized Policy Traffic Switch (PTS)

Independent Scalability and Functionality Test: Sandvine Virtualized Traffic Steering Engine (TSE) and Virtualized Policy Traffic Switch (PTS) Independent Scalability and Functionality Test: Virtualized Traffic Steering Engine (TSE) and Virtualized Policy Traffic Switch (PTS) Introduction Network Functions Virtualization (NFV) has kicked off

More information

Today s Paper. Routers forward packets. Networks and routers. EECS 262a Advanced Topics in Computer Systems Lecture 18

Today s Paper. Routers forward packets. Networks and routers. EECS 262a Advanced Topics in Computer Systems Lecture 18 EECS 262a Advanced Topics in Computer Systems Lecture 18 Software outers/outebricks October 29 th, 2012 John Kubiatowicz and Anthony D. Joseph Electrical Engineering and Computer Sciences University of

More information

Ixia Test Solutions to Ensure Stability of its New, LXC-based Virtual Customer Premises Equipment (vcpe) Framework for Residential and SMB Markets

Ixia Test Solutions to Ensure Stability of its New, LXC-based Virtual Customer Premises Equipment (vcpe) Framework for Residential and SMB Markets Innovate, Integrate, Transform Ixia Test Solutions to Ensure Stability of its New, LXC-based Virtual Customer Premises Equipment (vcpe) Framework for Residential and SMB Markets www.altencalsoftlabs.com

More information

Balancing on the Edge: Transport Affinity without Network State

Balancing on the Edge: Transport Affinity without Network State Balancing on the Edge: Transport Affinity without Network State João Taveira Araújo, Lorenzo Saino, Lennert Buytenhek, and Raul Landa, Fastly https://www.usenix.org/conference/nsdi18/presentation/araujo

More information

Multipath TCP: Goals and Background. Mark Handley, UCL

Multipath TCP: Goals and Background. Mark Handley, UCL Multipath TCP: Goals and Background Mark Handley, UCL Not your grandfather s Internet Once upon a time the Internet did email, ftp, and telnet. And it fell over due to congestion. TCP congestion control

More information

VXLAN Overview: Cisco Nexus 9000 Series Switches

VXLAN Overview: Cisco Nexus 9000 Series Switches White Paper VXLAN Overview: Cisco Nexus 9000 Series Switches What You Will Learn Traditional network segmentation has been provided by VLANs that are standardized under the IEEE 802.1Q group. VLANs provide

More information

CompSci 356: Computer Network Architectures. Lecture 13: Dynamic routing protocols: Link State Chapter 3.3.3, Xiaowei Yang

CompSci 356: Computer Network Architectures. Lecture 13: Dynamic routing protocols: Link State Chapter 3.3.3, Xiaowei Yang CompSci 356: Computer Network Architectures Lecture 13: Dynamic routing protocols: Link State Chapter 3.3.3, 3.2.9 Xiaowei Yang xwy@cs.duke.edu Today Clarification on RIP Link-state routing Algorithm Protocol:

More information

Efficient Memory Disaggregation with Infiniswap. Juncheng Gu, Youngmoon Lee, Yiwen Zhang, MosharafChowdhury, Kang G. Shin

Efficient Memory Disaggregation with Infiniswap. Juncheng Gu, Youngmoon Lee, Yiwen Zhang, MosharafChowdhury, Kang G. Shin Efficient Memory Disaggregation with Juncheng Gu, Youngmoon Lee, Yiwen Zhang, MosharafChowdhury, Kang G. Shin Agenda Motivation and related work Design and system overview Implementation and evaluation

More information

Content Overlays. Nick Feamster CS 7260 March 12, 2007

Content Overlays. Nick Feamster CS 7260 March 12, 2007 Content Overlays Nick Feamster CS 7260 March 12, 2007 Content Overlays Distributed content storage and retrieval Two primary approaches: Structured overlay Unstructured overlay Today s paper: Chord Not

More information

A Look at Intel s Dataplane Development Kit

A Look at Intel s Dataplane Development Kit A Look at Intel s Dataplane Development Kit Dominik Scholz Chair for Network Architectures and Services Department for Computer Science Technische Universität München June 13, 2014 Dominik Scholz: A Look

More information

Data Center Network Topologies II

Data Center Network Topologies II Data Center Network Topologies II Hakim Weatherspoon Associate Professor, Dept of Computer cience C 5413: High Performance ystems and Networking April 10, 2017 March 31, 2017 Agenda for semester Project

More information

The Network Stack. Chapter Network stack functions 216 CHAPTER 21. THE NETWORK STACK

The Network Stack. Chapter Network stack functions 216 CHAPTER 21. THE NETWORK STACK 216 CHAPTER 21. THE NETWORK STACK 21.1 Network stack functions Chapter 21 The Network Stack In comparison with some other parts of OS design, networking has very little (if any) basis in formalism or algorithms

More information

Citrix NetScaler Make web applications run five times better

Citrix NetScaler Make web applications run five times better Citrix NetScaler Make web applications run five times better Citrix NetScaler is a web application delivery solution that makes applications five times better by accelerating performance, ensuring that

More information

PacketShader: A GPU-Accelerated Software Router

PacketShader: A GPU-Accelerated Software Router PacketShader: A GPU-Accelerated Software Router Sangjin Han In collaboration with: Keon Jang, KyoungSoo Park, Sue Moon Advanced Networking Lab, CS, KAIST Networked and Distributed Computing Systems Lab,

More information

Cisco 4000 Series Integrated Services Routers: Architecture for Branch-Office Agility

Cisco 4000 Series Integrated Services Routers: Architecture for Branch-Office Agility White Paper Cisco 4000 Series Integrated Services Routers: Architecture for Branch-Office Agility The Cisco 4000 Series Integrated Services Routers (ISRs) are designed for distributed organizations with

More information

Jinho Hwang and Timothy Wood George Washington University

Jinho Hwang and Timothy Wood George Washington University Jinho Hwang and Timothy Wood George Washington University Background: Memory Caching Two orders of magnitude more reads than writes Solution: Deploy memcached hosts to handle the read capacity 6. HTTP

More information

Developing Multipath TCP. Damon Wischik, Mark Handley, Costin Raiciu

Developing Multipath TCP. Damon Wischik, Mark Handley, Costin Raiciu Developing Multipath TCP Damon Wischik, Mark Handley, Costin Raiciu 1982 1984 1986 1988 1990 1992 1994 1996 1998 2000 2002 2004 2006 2008 2010 2 * * 1980 1982 1984 1986 1988 1990 1992 1994 1996 1998 2000

More information

This release of the product includes these new features that have been added since NGFW 5.5.

This release of the product includes these new features that have been added since NGFW 5.5. Release Notes Revision B McAfee Next Generation Firewall 5.7.4 Contents About this release New features Enhancements Known limitations Resolved issues System requirements Installation instructions Upgrade

More information

A Study of Two Different Attacks to IPv6 Network

A Study of Two Different Attacks to IPv6 Network IOSR Journal of Computer Engineering (IOSR-JCE) e-issn: 2278-0661,p-ISSN: 2278-8727, Volume 19, Issue 5, Ver. IV (Sep.- Oct. 2017), PP 66-70 www.iosrjournals.org A Study of Two Different Attacks to IPv6

More information

An Empirical Study of High Availability in Stream Processing Systems

An Empirical Study of High Availability in Stream Processing Systems An Empirical Study of High Availability in Stream Processing Systems Yu Gu, Zhe Zhang, Fan Ye, Hao Yang, Minkyong Kim, Hui Lei, Zhen Liu Stream Processing Model software operators (PEs) Ω Unexpected machine

More information

Application-Specific Configuration Selection in the Cloud: Impact of Provider Policy and Potential of Systematic Testing

Application-Specific Configuration Selection in the Cloud: Impact of Provider Policy and Potential of Systematic Testing Application-Specific Configuration Selection in the Cloud: Impact of Provider Policy and Potential of Systematic Testing Mohammad Hajjat +, Ruiqi Liu*, Yiyang Chang +, T.S. Eugene Ng*, Sanjay Rao + + Purdue

More information

Project Calico v3.2. Overview. Architecture and Key Components. Project Calico provides network security for containers and virtual machine workloads.

Project Calico v3.2. Overview. Architecture and Key Components. Project Calico provides network security for containers and virtual machine workloads. Project Calico v3.2 Overview Benefits Simplicity. Traditional Software Defined Networks (SDNs) are complex, making them hard to deploy and troubleshoot. Calico removes that complexity, with a simplified

More information

TLDK Overview. Transport Layer Development Kit Keith Wiles April Contributions from Ray Kinsella & Konstantin Ananyev

TLDK Overview. Transport Layer Development Kit Keith Wiles April Contributions from Ray Kinsella & Konstantin Ananyev TLDK Overview Transport Layer Development Kit Keith Wiles April 2017 Contributions from Ray Kinsella & Konstantin Ananyev Notices and Disclaimers Intel technologies features and benefits depend on system

More information

Titan: Fair Packet Scheduling for Commodity Multiqueue NICs. Brent Stephens, Arjun Singhvi, Aditya Akella, and Mike Swift July 13 th, 2017

Titan: Fair Packet Scheduling for Commodity Multiqueue NICs. Brent Stephens, Arjun Singhvi, Aditya Akella, and Mike Swift July 13 th, 2017 Titan: Fair Packet Scheduling for Commodity Multiqueue NICs Brent Stephens, Arjun Singhvi, Aditya Akella, and Mike Swift July 13 th, 2017 Ethernet line-rates are increasing! 2 Servers need: To drive increasing

More information

Security+ Guide to Network Security Fundamentals, Fourth Edition. Network Attacks Denial of service Attacks

Security+ Guide to Network Security Fundamentals, Fourth Edition. Network Attacks Denial of service Attacks Security+ Guide to Network Security Fundamentals, Fourth Edition Network Attacks Denial of service Attacks Introduction: What is DoS? DoS attack is an attempt (malicious or selfish) by an attacker to cause

More information

Sharing CPUs via endpoint congestion control

Sharing CPUs via endpoint congestion control Sharing CPUs via endpoint congestion control Laura Vasilescu laura.vasilescu@cs.pub.ro Vladimir Olteanu vladimir.olteanu@cs.pub.ro University Politehnica of Bucharest Splaiul Independentei 313a Bucharest,

More information

416 Distributed Systems. March 23, 2018 CDNs

416 Distributed Systems. March 23, 2018 CDNs 416 Distributed Systems March 23, 2018 CDNs Outline DNS Design (317) Content Distribution Networks 2 Typical Workload (Web Pages) Multiple (typically small) objects per page File sizes are heavy-tailed

More information

Fast packet processing in the cloud. Dániel Géhberger Ericsson Research

Fast packet processing in the cloud. Dániel Géhberger Ericsson Research Fast packet processing in the cloud Dániel Géhberger Ericsson Research Outline Motivation Service chains Hardware related topics, acceleration Virtualization basics Software performance and acceleration

More information

Advanced Computer Networks Exercise Session 7. Qin Yin Spring Semester 2013

Advanced Computer Networks Exercise Session 7. Qin Yin Spring Semester 2013 Advanced Computer Networks 263-3501-00 Exercise Session 7 Qin Yin Spring Semester 2013 1 LAYER 7 SWITCHING 2 Challenge: accessing services Datacenters are designed to be scalable Datacenters are replicated

More information

CSE 123A Computer Netwrking

CSE 123A Computer Netwrking CSE 123A Computer Netwrking Winter 2005 Mobile Networking Alex Snoeren presenting in lieu of Stefan Savage Today s s issues What are implications of hosts that move? Remember routing? It doesn t work anymore

More information

Configuring Network Load Balancing

Configuring Network Load Balancing Configuring Network Load Balancing LESSON 1 70-412 EXAM OBJECTIVE Objective 1.1 Configure Network Load Balancing (NLB). This objective may include but is not limited to: Install NLB nodes; configure NLB

More information