Consistency in SDN. Aurojit Panda, Wenting Zheng, Xiaohe Hu, Arvind Krishnamurthy, Scott Shenker

Size: px
Start display at page:

Download "Consistency in SDN. Aurojit Panda, Wenting Zheng, Xiaohe Hu, Arvind Krishnamurthy, Scott Shenker"

Transcription

1 Consistency in SDN Aurojit Panda, Wenting Zheng, Xiaohe Hu, Arvind Krishnamurthy, Scott Shenker

2 Distributed SDN Today Replicated Replicated Replicated Consistency Layer

3 Distributed SDN Today Replicated Replicated Replicated Consistency Layer Sequences Events

4 Distributed SDN Today Replicated Replicated Replicated Consistency Layer Sequences Events Today: Paxos, Raft, etc. used to implement serializability

5 Our Approach Consistent Policy Database Consistency Layer Independent Independent Independent

6 Our Approach Consistent Policy Database Consistency Layer Independent Independent Independent Respond instantaneously

7 Our Approach Consistent Policy Database Consistency Layer Eventual Correctness Independent Independent Independent Respond instantaneously

8 Our Approach Consistent Policy Database Consistent view of policy Consistency Layer Eventual Correctness Independent Independent Independent Respond instantaneously

9 Performance Allows greater scalability and resilience.

10 Performance Allows greater scalability and resilience. Faster convergence: we do better than when consistency is used.

11 Performance Allows greater scalability and resilience. Faster convergence: we do better than when consistency is used. 1 SCL Coordination 0.8 CDF Convergence Time (ms) Convergence Time in Data Centers

12 Performance Allows greater scalability and resilience. Faster convergence: we do better than when consistency is used. 1 SCL Coordination 1 SCL Coordination CDF CDF Convergence Time (ms) Convergence Time (S) Convergence Time in Data Centers Convergence Time in AS topology

13 Our approach ensures: Correctness

14 Correctness Our approach ensures: Eventually all controllers agree on the sequence of network events seen.

15 Correctness Our approach ensures: Eventually all controllers agree on the sequence of network events seen. Eventually each controller and network agree on state of the network.

16 Correctness Our approach ensures: Eventually all controllers agree on the sequence of network events seen. Eventually each controller and network agree on state of the network. Therefore eventually computed and installed states are correct.

17 Correctness Our approach ensures: Eventually all controllers agree on the sequence of network events seen. Eventually each controller and network agree on state of the network. Therefore eventually computed and installed states are correct. Assuming deterministic controllers and idempotent switch updates.

18 What about Consistency?

19 What about Consistency? Correctness: Needed to ensure flow tables, controllers are correct.

20 What about Consistency? Correctness: Needed to ensure flow tables, controllers are correct. Programmability: Needed to make it easier to program networks.

21 What about Consistency? Correctness: Needed to ensure flow tables, controllers are correct. Programmability: Needed to make it easier to program networks. Performance: Needed for faster convergence.

22 What about Consistency? Correctness: Needed to ensure flow tables, controllers are correct. Programmability: Needed to make it easier to program networks. Performance: Needed for faster convergence.

23 Why Does This Work? Networks are open world systems.

24 Why Does This Work? Networks are open world systems. Open World: Truth resides in an external entity (e.g., network).

25 Why Does This Work? Networks are open world systems. Open World: Truth resides in an external entity (e.g., network). Closed World: Truth resides in the system itself (e.g., a database).

26 Why Does This Work? Networks are open world systems. Open World: Truth resides in an external entity (e.g., network). Closed World: Truth resides in the system itself (e.g., a database). With open world systems

27 Why Does This Work? Networks are open world systems. Open World: Truth resides in an external entity (e.g., network). Closed World: Truth resides in the system itself (e.g., a database). With open world systems Truth can be recovered from the external system.

28 Why Does This Work? Networks are open world systems. Open World: Truth resides in an external entity (e.g., network). Closed World: Truth resides in the system itself (e.g., a database). With open world systems Truth can be recovered from the external system. Consistency with ground truth is more important than within the system.

29 Why is this relevant?

30 Sources of Network Updates Planned Updates Network Events

31 Sources of Network Updates Planned Updates Policy updates, link recovery, etc. Network Events Link failures, switch failure, etc.

32 Sources of Network Updates Planned Updates Policy updates, link recovery, etc. Network Events Link failures, switch failure, etc. Working Network Working Network Broken Network Working Network

33 Sources of Network Updates Planned Updates Policy updates, link recovery, etc. Network Events Link failures, switch failure, etc. Working Network Working Network Broken Network Working Network Goal

34 Sources of Network Updates Planned Updates Policy updates, link recovery, etc. Network Events Link failures, switch failure, etc. Working Network Working Network Broken Network Working Network Goal Maintain correctness during transition Minimize time to connectivity restored.

35 Sources of Network Updates Planned Updates Policy updates, link recovery, etc. Network Events Link failures, switch failure, etc. Working Network Working Network Broken Network Working Network Goal Maintain correctness during transition Minimize time to connectivity restored. Consistency helps (required?) Consistency adds latency.

36 Edge-Core Separation Fabric Provides connectivity Routing, Traffic Engineering

37 Edge-Core Separation Endhost Edge Richer Policies ACLs Traffic Priorities Fabric Provides connectivity

38 Conclusion Existence proof that controller consistency is not necessary. In fact slows down network recovery in response to failures. Should we require consistency for SDN controllers? Question is similar to the ACID vs NoSQL debate in data stores.

39 Open Questions What about data plane consistency? Ensures each packet processed according to consistent policy. Do we need data plane consistency? For planned updates: Helps with correctness during policy changes. For network events: Adds latency before connectivity is restored.

Model Checking Dynamic Datapaths

Model Checking Dynamic Datapaths Model Checking Dynamic Datapaths Aurojit Panda, Katerina Argyraki, Scott Shenker UC Berkeley, ICSI, EPFL Networks: Not Just for Delivery Enforce a variety of invariants: Packet Isolation: Packets from

More information

Megastore: Providing Scalable, Highly Available Storage for Interactive Services & Spanner: Google s Globally- Distributed Database.

Megastore: Providing Scalable, Highly Available Storage for Interactive Services & Spanner: Google s Globally- Distributed Database. Megastore: Providing Scalable, Highly Available Storage for Interactive Services & Spanner: Google s Globally- Distributed Database. Presented by Kewei Li The Problem db nosql complex legacy tuning expensive

More information

Revisiting Network Support for RDMA

Revisiting Network Support for RDMA Revisiting Network Support for RDMA Radhika Mittal 1, Alex Shpiner 3, Aurojit Panda 1, Eitan Zahavi 3, Arvind Krishnamurthy 2, Sylvia Ratnasamy 1, Scott Shenker 1 (1: UC Berkeley, 2: Univ. of Washington,

More information

Large-Scale Key-Value Stores Eventual Consistency Marco Serafini

Large-Scale Key-Value Stores Eventual Consistency Marco Serafini Large-Scale Key-Value Stores Eventual Consistency Marco Serafini COMPSCI 590S Lecture 13 Goals of Key-Value Stores Export simple API put(key, value) get(key) Simpler and faster than a DBMS Less complexity,

More information

SpecPaxos. James Connolly && Harrison Davis

SpecPaxos. James Connolly && Harrison Davis SpecPaxos James Connolly && Harrison Davis Overview Background Fast Paxos Traditional Paxos Implementations Data Centers Mostly-Ordered-Multicast Network layer Speculative Paxos Protocol Application layer

More information

CPS 512 midterm exam #1, 10/7/2016

CPS 512 midterm exam #1, 10/7/2016 CPS 512 midterm exam #1, 10/7/2016 Your name please: NetID: Answer all questions. Please attempt to confine your answers to the boxes provided. If you don t know the answer to a question, then just say

More information

Advanced Topics in Routing

Advanced Topics in Routing Advanced Topics in Routing EE122 Fall 2012 Scott Shenker http://inst.eecs.berkeley.edu/~ee122/ Materials with thanks to Jennifer Rexford, Ion Stoica, Vern Paxson and other colleagues at Princeton and UC

More information

Software Defined Networking Data centre perspective: Open Flow

Software Defined Networking Data centre perspective: Open Flow Software Defined Networking Data centre perspective: Open Flow Seminar: Prof. Timothy Roscoe & Dr. Desislava Dimitrova D. Dimitrova, T. Roscoe 04.03.2016 1 OpenFlow Specification, protocol, architecture

More information

OTSDN What is it? Does it help?

OTSDN What is it? Does it help? OTSDN What is it? Does it help? Dennis Gammel Schweitzer Engineering Laboratories, Inc. Funded by the U.S. Department of Energy and the U.S. Department of Homeland Security cred-c.org Important Aspects

More information

Designing Distributed Systems using Approximate Synchrony in Data Center Networks

Designing Distributed Systems using Approximate Synchrony in Data Center Networks Designing Distributed Systems using Approximate Synchrony in Data Center Networks Dan R. K. Ports Jialin Li Naveen Kr. Sharma Vincent Liu Arvind Krishnamurthy University of Washington CSE Today s most

More information

DATA CENTER FABRIC COOKBOOK

DATA CENTER FABRIC COOKBOOK Do It Yourself! DATA CENTER FABRIC COOKBOOK How to prepare something new from well known ingredients Emil Gągała WHAT DOES AN IDEAL FABRIC LOOK LIKE? 2 Copyright 2011 Juniper Networks, Inc. www.juniper.net

More information

Building Consistent Transactions with Inconsistent Replication

Building Consistent Transactions with Inconsistent Replication Building Consistent Transactions with Inconsistent Replication Irene Zhang, Naveen Kr. Sharma, Adriana Szekeres, Arvind Krishnamurthy, Dan R. K. Ports University of Washington Distributed storage systems

More information

NoSQL systems: sharding, replication and consistency. Riccardo Torlone Università Roma Tre

NoSQL systems: sharding, replication and consistency. Riccardo Torlone Università Roma Tre NoSQL systems: sharding, replication and consistency Riccardo Torlone Università Roma Tre Data distribution NoSQL systems: data distributed over large clusters Aggregate is a natural unit to use for data

More information

GUIDE. Optimal Network Designs with Cohesity

GUIDE. Optimal Network Designs with Cohesity Optimal Network Designs with Cohesity TABLE OF CONTENTS Introduction...3 Key Concepts...4 Five Common Configurations...5 3.1 Simple Topology...5 3.2 Standard Topology...6 3.3 Layered Topology...7 3.4 Cisco

More information

Scalability and Resilience in SDN: an overview. Nicola Rustignoli

Scalability and Resilience in SDN: an overview. Nicola Rustignoli Scalability and Resilience in SDN: an overview Nicola Rustignoli rnicola@student.ethz.ch Nicola Rustignoli 11.03.2016 1 Software-Defined networking CONTROL LAYER SWITCH FORWARDING LAYER Graphs source:[1]

More information

Replication in Distributed Systems

Replication in Distributed Systems Replication in Distributed Systems Replication Basics Multiple copies of data kept in different nodes A set of replicas holding copies of a data Nodes can be physically very close or distributed all over

More information

From Routing to Traffic Engineering

From Routing to Traffic Engineering 1 From Routing to Traffic Engineering Robert Soulé Advanced Networking Fall 2016 2 In the beginning B Goal: pair-wise connectivity (get packets from A to B) Approach: configure static rules in routers

More information

Thinking Architecturally (80 Minutes Inside Scott s Head)

Thinking Architecturally (80 Minutes Inside Scott s Head) Thinking Architecturally (80 Minutes Inside Scott s Head) EE122 Fall 2012 Scott Shenker http://inst.eecs.berkeley.edu/~ee122/ Materials with thanks to Jennifer Rexford, Ion Stoica, Vern Paxson and other

More information

Database Architectures

Database Architectures Database Architectures CPS352: Database Systems Simon Miner Gordon College Last Revised: 4/15/15 Agenda Check-in Parallelism and Distributed Databases Technology Research Project Introduction to NoSQL

More information

Networking Recap Storage Intro. CSE-291 (Cloud Computing), Fall 2016 Gregory Kesden

Networking Recap Storage Intro. CSE-291 (Cloud Computing), Fall 2016 Gregory Kesden Networking Recap Storage Intro CSE-291 (Cloud Computing), Fall 2016 Gregory Kesden Networking Recap Storage Intro Long Haul/Global Networking Speed of light is limiting; Latency has a lower bound (.) Throughput

More information

TAPIR. By Irene Zhang, Naveen Sharma, Adriana Szekeres, Arvind Krishnamurthy, and Dan Ports Presented by Todd Charlton

TAPIR. By Irene Zhang, Naveen Sharma, Adriana Szekeres, Arvind Krishnamurthy, and Dan Ports Presented by Todd Charlton TAPIR By Irene Zhang, Naveen Sharma, Adriana Szekeres, Arvind Krishnamurthy, and Dan Ports Presented by Todd Charlton Outline Problem Space Inconsistent Replication TAPIR Evaluation Conclusion Problem

More information

Data Modeling and Databases Ch 14: Data Replication. Gustavo Alonso, Ce Zhang Systems Group Department of Computer Science ETH Zürich

Data Modeling and Databases Ch 14: Data Replication. Gustavo Alonso, Ce Zhang Systems Group Department of Computer Science ETH Zürich Data Modeling and Databases Ch 14: Data Replication Gustavo Alonso, Ce Zhang Systems Group Department of Computer Science ETH Zürich Database Replication What is database replication The advantages of

More information

Upgrading From a Successful Emergency Control System to a Complete WAMPAC System for Georgian State Energy System

Upgrading From a Successful Emergency Control System to a Complete WAMPAC System for Georgian State Energy System Upgrading From a Successful Emergency Control System to a Complete WAMPAC System for Georgian State Energy System Dave Dolezilek International Technical Director Schweitzer Engineering Laboratories SEL

More information

Cybersecurity was nonexistent for most network data exchanges until around 1994.

Cybersecurity was nonexistent for most network data exchanges until around 1994. 1 The Advanced Research Projects Agency Network (ARPANET) started with the Stanford Research Institute (now SRI International) and the University of California, Los Angeles (UCLA) in 1960. In 1970, ARPANET

More information

Implementation and Performance of a SDN Cluster- Controller Based on the OpenDayLight Framework

Implementation and Performance of a SDN Cluster- Controller Based on the OpenDayLight Framework POLITECNICO DI MILANO Dipartimento di Elettronica, Informazione e Bioingegneria Master of Science in Telecommunication Engineering Implementation and Performance of a SDN Cluster- Controller Based on the

More information

Paxos and Raft (Lecture 21, cs262a) Ion Stoica, UC Berkeley November 7, 2016

Paxos and Raft (Lecture 21, cs262a) Ion Stoica, UC Berkeley November 7, 2016 Paxos and Raft (Lecture 21, cs262a) Ion Stoica, UC Berkeley November 7, 2016 Bezos mandate for service-oriented-architecture (~2002) 1. All teams will henceforth expose their data and functionality through

More information

Routing Strategies. Fixed Routing. Fixed Flooding Random Adaptive

Routing Strategies. Fixed Routing. Fixed Flooding Random Adaptive Routing Strategies Fixed Flooding Random Adaptive Fixed Routing Single permanent route for each source to destination pair Determine routes using a least cost algorithm Route fixed, at least until a change

More information

Distributed Consensus Protocols

Distributed Consensus Protocols Distributed Consensus Protocols ABSTRACT In this paper, I compare Paxos, the most popular and influential of distributed consensus protocols, and Raft, a fairly new protocol that is considered to be a

More information

A High Performance Packet Core for Next Generation Cellular Networks

A High Performance Packet Core for Next Generation Cellular Networks A High Performance Packet Core for Next Generation Cellular Networks Zafar Qazi + Melvin Walls, Aurojit Panda +, Vyas Sekar, Sylvia Ratnasamy +, Scott Shenker + + 1 Explosive Cellular Growth Many Diverse

More information

Fault Tolerance. Goals: transparent: mask (i.e., completely recover from) all failures, or predictable: exhibit a well defined failure behavior

Fault Tolerance. Goals: transparent: mask (i.e., completely recover from) all failures, or predictable: exhibit a well defined failure behavior Fault Tolerance Causes of failure: process failure machine failure network failure Goals: transparent: mask (i.e., completely recover from) all failures, or predictable: exhibit a well defined failure

More information

The Impact of Control Path Survivability on Data Plane Survivability in SDN. Sedef Savas Networks Lab, Group Meeting Aug 11, 2017

The Impact of Control Path Survivability on Data Plane Survivability in SDN. Sedef Savas Networks Lab, Group Meeting Aug 11, 2017 The Impact of Control Path Survivability on Data Plane Survivability in SDN Sedef Savas Networks Lab, Group Meeting Aug 11, 2017 1 1 1 3 2 4 3 2 4 6 6 5 5 7 7 a) 9-node network topology, controller is

More information

Large scale SPVC ATM network

Large scale SPVC ATM network Written by Paul Holland and Don Wells Large scale SPVC ATM network Introduction: Asynchronous Transfer Mode (ATM) Data Networks differ from Internet Protocol (IP) Data Networks in many ways, but one of

More information

Plexxi Theory of Operations White Paper

Plexxi Theory of Operations White Paper White Paper Introduction Cloud computing, virtualization, and distributed application architectures are reshaping data center traffic flows, escalating bandwidth and performance demands, and introducing

More information

CS October 2017

CS October 2017 Atomic Transactions Transaction An operation composed of a number of discrete steps. Distributed Systems 11. Distributed Commit Protocols All the steps must be completed for the transaction to be committed.

More information

ResQ: Enabling SLOs in Network Function Virtualization

ResQ: Enabling SLOs in Network Function Virtualization ResQ: Enabling SLOs in Network Function Virtualization Amin Tootoonchian* Aurojit Panda Chang Lan Melvin Walls Katerina Argyraki Sylvia Ratnasamy Scott Shenker *Intel Labs UC Berkeley ICSI NYU Nefeli EPFL

More information

Today: Fault Tolerance

Today: Fault Tolerance Today: Fault Tolerance Agreement in presence of faults Two army problem Byzantine generals problem Reliable communication Distributed commit Two phase commit Three phase commit Paxos Failure recovery Checkpointing

More information

THOUGHTS ON SDN IN DATA INTENSIVE SCIENCE APPLICATIONS

THOUGHTS ON SDN IN DATA INTENSIVE SCIENCE APPLICATIONS THOUGHTS ON SDN IN DATA INTENSIVE SCIENCE APPLICATIONS Artur Barczyk/Caltech Internet2 Technology Exchange Indianapolis, October 30 th, 2014 October 29, 2014 Artur.Barczyk@cern.ch 1 HEP context - for this

More information

Next Generation Architecture for NVM Express SSD

Next Generation Architecture for NVM Express SSD Next Generation Architecture for NVM Express SSD Dan Mahoney CEO Fastor Systems Copyright 2014, PCI-SIG, All Rights Reserved 1 NVMExpress Key Characteristics Highest performance, lowest latency SSD interface

More information

Eventual Consistency Today: Limitations, Extensions and Beyond

Eventual Consistency Today: Limitations, Extensions and Beyond Eventual Consistency Today: Limitations, Extensions and Beyond Peter Bailis and Ali Ghodsi, UC Berkeley - Nomchin Banga Outline Eventual Consistency: History and Concepts How eventual is eventual consistency?

More information

Network Design Clinic

Network Design Clinic Network Design Clinic A Network Design should be as simple as possible, but no simpler! Presented by: Jason Bomar, CCIE #9316 Introduction We will cover a number of topics, at a high level they are: Hierarchy

More information

Robust Networking with IPv6

Robust Networking with IPv6 Robust Networking with IPv6 Phil Edholm, CTO, Enterprise Networks December 10, 2003 Nortel Networks Restricted PG 1 Nortel Networks Solutions for Mission-critical Government Networks Credentials for Network

More information

InfluxDB and the Raft consensus protocol. Philip O'Toole, Director of Engineering (SF) InfluxDB San Francisco Meetup, December 2015

InfluxDB and the Raft consensus protocol. Philip O'Toole, Director of Engineering (SF) InfluxDB San Francisco Meetup, December 2015 InfluxDB and the Raft consensus protocol Philip O'Toole, Director of Engineering (SF) InfluxDB San Francisco Meetup, December 2015 Agenda What is InfluxDB and why is it distributed? What is the problem

More information

Introduction to OSPF

Introduction to OSPF Campus Networking Introduction to OSPF Workshop Campus Layer-2 Networking Network Workshop Design These materials are licensed under the Creative Commons Attribution-Noncommercial 3.0 Unported license

More information

Huawei Technologies engaged Miercom to evaluate the S12700

Huawei Technologies engaged Miercom to evaluate the S12700 Key findings and conclusions: Huawei S12708 agile switch demonstrates 100% line rate throughput with 384 10GE ports in full line rate throughput tests Lab Testing Summary Report August 2013 Report SR130801

More information

Fault Tolerance. Distributed Systems. September 2002

Fault Tolerance. Distributed Systems. September 2002 Fault Tolerance Distributed Systems September 2002 Basics A component provides services to clients. To provide services, the component may require the services from other components a component may depend

More information

F10: A Fault- Tolerant Engineered Network

F10: A Fault- Tolerant Engineered Network F10: A Fault- Tolerant Engineered Network Vincent Liu, Daniel Halperin, Arvind Krishnamurthy, Thomas Anderson University of Washington Today s Data Centers *From Al- Fares et al. SIGCOMM 08 Today s data

More information

Distributed Systems. Day 9: Replication [Part 1]

Distributed Systems. Day 9: Replication [Part 1] Distributed Systems Day 9: Replication [Part 1] Hash table k 0 v 0 k 1 v 1 k 2 v 2 k 3 v 3 ll Facebook Data Does your client know about all of F s servers? Security issues? Performance issues? How do clients

More information

NOX, POX, and lessons learned. James Murphy McCauley

NOX, POX, and lessons learned. James Murphy McCauley NOX, POX, and lessons learned James Murphy McCauley Organization A Bit of History Lessons Learned Part 1: Two little lessons Part 2: Thinking big Ongoing Work Wrap-Up 2 Current NOX and POX Collaborators

More information

Feature Comparison Summary

Feature Comparison Summary Feature Comparison Summary, and The cloud-ready operating system Thanks to cloud technology, the rate of change is faster than ever before, putting more pressure on IT. Organizations demand increased security,

More information

Bringing SDN to the Internet, one exchange point at the time

Bringing SDN to the Internet, one exchange point at the time Bringing SDN to the Internet, one exchange point at the time Joint work with: Arpit Gupta, Muhammad Shahbaz, Sean P. Donovan, Russ Clark, Brandon Schlinker, E. Katz-Bassett, Nick Feamster, Jennifer Rexford

More information

Fault Tolerance Causes of failure: process failure machine failure network failure Goals: transparent: mask (i.e., completely recover from) all

Fault Tolerance Causes of failure: process failure machine failure network failure Goals: transparent: mask (i.e., completely recover from) all Fault Tolerance Causes of failure: process failure machine failure network failure Goals: transparent: mask (i.e., completely recover from) all failures or predictable: exhibit a well defined failure behavior

More information

Discrete Event (time) Simulation

Discrete Event (time) Simulation Discrete Event (time) Simulation What is a simulation? Simulation is the process of designing a model of a real system and conducting experiments with this model for the purpose either of understanding

More information

CAP for Networks. Aurojit Panda Colin Scott Ali Ghodsi Teemu Koponen Scott Shenker UC Berkeley KTH/Royal Institute of Technology VMware ICSI ABSTRACT

CAP for Networks. Aurojit Panda Colin Scott Ali Ghodsi Teemu Koponen Scott Shenker UC Berkeley KTH/Royal Institute of Technology VMware ICSI ABSTRACT CAP for Networks Aurojit Panda Colin Scott Ali Ghodsi Teemu Koponen Scott Shenker UC Berkeley KTH/Royal Institute of Technology VMware ICSI Alice laughed. There s no use trying, she said: one can t believe

More information

The CAP theorem. The bad, the good and the ugly. Michael Pfeiffer Advanced Networking Technologies FG Telematik/Rechnernetze TU Ilmenau

The CAP theorem. The bad, the good and the ugly. Michael Pfeiffer Advanced Networking Technologies FG Telematik/Rechnernetze TU Ilmenau The CAP theorem The bad, the good and the ugly Michael Pfeiffer Advanced Networking Technologies FG Telematik/Rechnernetze TU Ilmenau 2017-05-15 1 / 19 1 The bad: The CAP theorem s proof 2 The good: A

More information

Motivation. The Impact of DHT Routing Geometry on Resilience and Proximity. Different components of analysis. Approach:Component-based analysis

Motivation. The Impact of DHT Routing Geometry on Resilience and Proximity. Different components of analysis. Approach:Component-based analysis The Impact of DHT Routing Geometry on Resilience and Proximity Presented by Karthik Lakshminarayanan at P2P Systems class (Slides liberally borrowed from Krishna s SIGCOMM talk) Krishna Gummadi, Ramakrishna

More information

MDCC MULTI DATA CENTER CONSISTENCY. amplab. Tim Kraska, Gene Pang, Michael Franklin, Samuel Madden, Alan Fekete

MDCC MULTI DATA CENTER CONSISTENCY. amplab. Tim Kraska, Gene Pang, Michael Franklin, Samuel Madden, Alan Fekete MDCC MULTI DATA CENTER CONSISTENCY Tim Kraska, Gene Pang, Michael Franklin, Samuel Madden, Alan Fekete gpang@cs.berkeley.edu amplab MOTIVATION 2 3 June 2, 200: Rackspace power outage of approximately 0

More information

Five Reasons Why You Should Choose Cisco MDS 9000 Family Directors Cisco and/or its affiliates. All rights reserved.

Five Reasons Why You Should Choose Cisco MDS 9000 Family Directors Cisco and/or its affiliates. All rights reserved. Five Reasons Why You Should Choose Cisco MDS 9000 Family Directors 2017 Cisco and/or its affiliates. All rights reserved. Contents Overview... 2 1. Integrated Analytics for Deep Visibility...3 2. Performance

More information

The Impact of DHT Routing Geometry on Resilience and Proximity. Acknowledgement. Motivation

The Impact of DHT Routing Geometry on Resilience and Proximity. Acknowledgement. Motivation The Impact of DHT Routing Geometry on Resilience and Proximity Presented by Noorullah Moghul Krishna Gummadi, Ramakrishna Gummadi, Sylvia Ratnasamy, Steve Gribble, Scott Shenker, Ion Stoica Acknowledgement

More information

Network Configuration Example

Network Configuration Example Network Configuration Example Managing Unintended Traffic Black-Hole Conditions in a T Series Router Modified: 2017-01-23 Juniper Networks, Inc. 1133 Innovation Way Sunnyvale, California 94089 USA 408-745-2000

More information

SCALABLE CONSISTENCY AND TRANSACTION MODELS

SCALABLE CONSISTENCY AND TRANSACTION MODELS Data Management in the Cloud SCALABLE CONSISTENCY AND TRANSACTION MODELS 69 Brewer s Conjecture Three properties that are desirable and expected from realworld shared-data systems C: data consistency A:

More information

1 Network Function Virtualization

1 Network Function Virtualization Networks increasingly use software in both the control and the data plane. Software Defined Networking (SDN) use software controllers running on remote servers to make control plane decisions (e.g., select

More information

Distributed Systems 11. Consensus. Paul Krzyzanowski

Distributed Systems 11. Consensus. Paul Krzyzanowski Distributed Systems 11. Consensus Paul Krzyzanowski pxk@cs.rutgers.edu 1 Consensus Goal Allow a group of processes to agree on a result All processes must agree on the same value The value must be one

More information

Modern Database Concepts

Modern Database Concepts Modern Database Concepts Basic Principles Doc. RNDr. Irena Holubova, Ph.D. holubova@ksi.mff.cuni.cz NoSQL Overview Main objective: to implement a distributed state Different objects stored on different

More information

Distributed Systems 24. Fault Tolerance

Distributed Systems 24. Fault Tolerance Distributed Systems 24. Fault Tolerance Paul Krzyzanowski pxk@cs.rutgers.edu 1 Faults Deviation from expected behavior Due to a variety of factors: Hardware failure Software bugs Operator errors Network

More information

Internet Indirection Infrastructure (i3) Ion Stoica, Daniel Adkins, Shelley Zhuang, Scott Shenker, Sonesh Surana. UC Berkeley SIGCOMM 2002

Internet Indirection Infrastructure (i3) Ion Stoica, Daniel Adkins, Shelley Zhuang, Scott Shenker, Sonesh Surana. UC Berkeley SIGCOMM 2002 Internet Indirection Infrastructure (i3) Ion Stoica, Daniel Adkins, Shelley Zhuang, Scott Shenker, Sonesh Surana UC Berkeley SIGCOMM 2002 Motivations Today s Internet is built around a unicast pointto-point

More information

SEL-5056 Software-Defined Network (SDN) Flow Controller

SEL-5056 Software-Defined Network (SDN) Flow Controller SEL-5056 Software-Defined Network (SDN) Flow Controller SDN Configuration, Orchestration, and Monitoring Software Major Features and Benefits The SEL-5056 SDN Flow Controller is enterprise software based

More information

Data Center Applications and MRV Solutions

Data Center Applications and MRV Solutions Data Center Applications and MRV Solutions Introduction For more than 25 years MRV has supplied the optical transport needs of customers around the globe. Our solutions are powering access networks for

More information

No Compromises. Distributed Transactions with Consistency, Availability, Performance

No Compromises. Distributed Transactions with Consistency, Availability, Performance No Compromises Distributed Transactions with Consistency, Availability, Performance Aleksandar Dragojevic, Dushyanth Narayanan, Edmund B. Nightingale, Matthew Renzelmann, Alex Shamis, Anirudh Badam, Miguel

More information

Revisiting Network Support for RDMA

Revisiting Network Support for RDMA Revisiting Network Support for RDMA Radhika Mittal, Alex Shpiner, Aurojit Panda, Eitan Zahavi, Arvind Krishnamurthy, Sylvia Ratnasamy, Scott Shenker UC Berkeley, ICSI, Mellanox, Univ. of Washington Abstract

More information

ONOS OVERVIEW. Architecture, Abstractions & Application

ONOS OVERVIEW. Architecture, Abstractions & Application ONOS OVERVIEW Architecture, Abstractions & Application WHAT IS ONOS? Open Networking Operating System (ONOS) is an open source SDN network operating system (controller). Mission: to enable Service Providers

More information

ETSF05/ETSF10 Internet Protocols. Routing on the Internet

ETSF05/ETSF10 Internet Protocols. Routing on the Internet ETSF05/ETSF10 Internet Protocols Routing on the Internet Circuit switched routing ETSF05/ETSF10 - Internet Protocols 2 Routing in Packet Switching Networks Key design issue for (packet) switched networks

More information

6.033 Spring 2016 Lecture #18. Distributed transactions Multi-site atomicity Two-phase commit

6.033 Spring 2016 Lecture #18. Distributed transactions Multi-site atomicity Two-phase commit 6.033 Spring 2016 Lecture #18 Distributed transactions Multi-site atomicity Two-phase Katrina LaCurts lacurts@mit 6.033 2016 goal: build reliable systems from unreliable components the abstraction that

More information

Discretized Streams. An Efficient and Fault-Tolerant Model for Stream Processing on Large Clusters

Discretized Streams. An Efficient and Fault-Tolerant Model for Stream Processing on Large Clusters Discretized Streams An Efficient and Fault-Tolerant Model for Stream Processing on Large Clusters Matei Zaharia, Tathagata Das, Haoyuan Li, Scott Shenker, Ion Stoica UC BERKELEY Motivation Many important

More information

Replicated State Machine in Wide-area Networks

Replicated State Machine in Wide-area Networks Replicated State Machine in Wide-area Networks Yanhua Mao CSE223A WI09 1 Building replicated state machine with consensus General approach to replicate stateful deterministic services Provide strong consistency

More information

Distributed Systems. Characteristics of Distributed Systems. Lecture Notes 1 Basic Concepts. Operating Systems. Anand Tripathi

Distributed Systems. Characteristics of Distributed Systems. Lecture Notes 1 Basic Concepts. Operating Systems. Anand Tripathi 1 Lecture Notes 1 Basic Concepts Anand Tripathi CSci 8980 Operating Systems Anand Tripathi CSci 8980 1 Distributed Systems A set of computers (hosts or nodes) connected through a communication network.

More information

Distributed Systems. Characteristics of Distributed Systems. Characteristics of Distributed Systems. Goals in Distributed System Designs

Distributed Systems. Characteristics of Distributed Systems. Characteristics of Distributed Systems. Goals in Distributed System Designs 1 Anand Tripathi CSci 8980 Operating Systems Lecture Notes 1 Basic Concepts Distributed Systems A set of computers (hosts or nodes) connected through a communication network. Nodes may have different speeds

More information

Building Infrastructure for Private Clouds Cloud InterOp 2014"

Building Infrastructure for Private Clouds Cloud InterOp 2014 Building Infrastructure for Private Clouds Cloud Connect @ InterOp 2014" Paul Savill Senior Vice President Product Management, Core Network Services Level 3 Communications Key Network Strategy/ Design

More information

Strong Consistency & CAP Theorem

Strong Consistency & CAP Theorem Strong Consistency & CAP Theorem CS 240: Computing Systems and Concurrency Lecture 15 Marco Canini Credits: Michael Freedman and Kyle Jamieson developed much of the original material. Consistency models

More information

Investigating the Use of Synchronized Clocks in TCP Congestion Control

Investigating the Use of Synchronized Clocks in TCP Congestion Control Investigating the Use of Synchronized Clocks in TCP Congestion Control Michele Weigle (UNC-CH) November 16-17, 2001 Univ. of Maryland Symposium The Problem TCP Reno congestion control reacts only to packet

More information

CMU SCS CMU SCS Who: What: When: Where: Why: CMU SCS

CMU SCS CMU SCS Who: What: When: Where: Why: CMU SCS Carnegie Mellon Univ. Dept. of Computer Science 15-415/615 - DB s C. Faloutsos A. Pavlo Lecture#23: Distributed Database Systems (R&G ch. 22) Administrivia Final Exam Who: You What: R&G Chapters 15-22

More information

31270 Networking Essentials Focus, Pre-Quiz, and Sample Exam Answers

31270 Networking Essentials Focus, Pre-Quiz, and Sample Exam Answers 31270 Networking Essentials Focus, Pre-Quiz, and Sample Exam Answers CONTENTS Focus Questions... 2 Chapter 1: Explore the Network... 2 Chapter 2: Configure a Network Operating System... 5 Chapter 3: Network

More information

THE NETWORK AND THE CLOUD

THE NETWORK AND THE CLOUD THE NETWORK AND THE CLOUD BUILDING THE FOUNDATION FOR THE MODERN DATA CENTER Andy Ingram SVP Worldwide Data Centers 1 Copyright 2012 Juniper Networks, Inc. www.juniper.net Occam s Razor: When faced with

More information

6.033 Spring Lecture #18. Distributed transactions Multi-site atomicity Two-phase commit spring 2018 Katrina LaCurts

6.033 Spring Lecture #18. Distributed transactions Multi-site atomicity Two-phase commit spring 2018 Katrina LaCurts 6.033 Spring 2018 Lecture #18 Distributed transactions Multi-site atomicity Two-phase 1 goal: build reliable systems from unreliable components the abstraction that makes that easier is transactions, which

More information

Cloud Backup and Recovery for Healthcare and ecommerce

Cloud Backup and Recovery for Healthcare and ecommerce Get Your Cloud Backup On Cloud Backup and Recovery for Healthcare and ecommerce Peter Smails, Vice President, Marketing & Business Development Shalabh Goyal, Director, Product Management October 12 th,

More information

Top-Down Network Design

Top-Down Network Design Top-Down Network Design Chapter Seven Selecting Switching and Routing Protocols Original slides by Cisco Press & Priscilla Oppenheimer Selection Criteria for Switching and Routing Protocols Network traffic

More information

Inter-Domain Routing: BGP

Inter-Domain Routing: BGP Inter-Domain Routing: BGP Brad Karp UCL Computer Science (drawn mostly from lecture notes by Hari Balakrishnan and Nick Feamster, MIT) CS 3035/GZ01 4 th December 2014 Outline Context: Inter-Domain Routing

More information

CS 425 / ECE 428 Distributed Systems Fall 2017

CS 425 / ECE 428 Distributed Systems Fall 2017 CS 425 / ECE 428 Distributed Systems Fall 2017 Indranil Gupta (Indy) Nov 7, 2017 Lecture 21: Replication Control All slides IG Server-side Focus Concurrency Control = how to coordinate multiple concurrent

More information

Stateless Network Functions:

Stateless Network Functions: Stateless Network Functions: Breaking the Tight Coupling of State and Processing Murad Kablan, Azzam Alsudais, Eric Keller, Franck Le University of Colorado IBM Networks Need Network Functions Firewall

More information

Cisco Group Encrypted Transport VPN

Cisco Group Encrypted Transport VPN Cisco Group Encrypted Transport VPN Q. What is Cisco Group Encrypted Transport VPN? A. Cisco Group Encrypted Transport is a next-generation WAN VPN solution that defines a new category of VPN, one that

More information

The Virtualisation Journey at Perpetual. Business Technology Group November 2009

The Virtualisation Journey at Perpetual. Business Technology Group November 2009 The Virtualisation Journey at Perpetual Business Technology Group November 2009 Agenda Who Is Perpetual? Strategic Context The virtualisation journey Business benefits Lessons learnt Questions 1 Perpetual

More information

Modeling, Analyzing, and Extending Megastore using Real-Time Maude

Modeling, Analyzing, and Extending Megastore using Real-Time Maude Modeling, Analyzing, and Extending Megastore using Real-Time Maude Jon Grov 1 and Peter Ölveczky 1,2 1 University of Oslo 2 University of Illinois at Urbana-Champaign Thanks to Indranil Gupta (UIUC) and

More information

CS 4226: Internet Architecture

CS 4226: Internet Architecture Software Defined Networking Richard T. B. Ma School of Computing National University of Singapore Material from: Scott Shenker (UC Berkeley), Nick McKeown (Stanford), Jennifer Rexford (Princeton) CS 4226:

More information

Storage Networking Strategy for the Next Five Years

Storage Networking Strategy for the Next Five Years White Paper Storage Networking Strategy for the Next Five Years 2018 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public Information. Page 1 of 8 Top considerations for storage

More information

Azure Development Course

Azure Development Course Azure Development Course About This Course This section provides a brief description of the course, audience, suggested prerequisites, and course objectives. COURSE DESCRIPTION This course is intended

More information

Reinforcement learning algorithms for non-stationary environments. Devika Subramanian Rice University

Reinforcement learning algorithms for non-stationary environments. Devika Subramanian Rice University Reinforcement learning algorithms for non-stationary environments Devika Subramanian Rice University Joint work with Peter Druschel and Johnny Chen of Rice University. Supported by a grant from Southwestern

More information

Deploy Microsoft SQL Server 2014 on a Cisco Application Centric Infrastructure Policy Framework

Deploy Microsoft SQL Server 2014 on a Cisco Application Centric Infrastructure Policy Framework White Paper Deploy Microsoft SQL Server 2014 on a Cisco Application Centric Infrastructure Policy Framework August 2015 2015 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public.

More information

SDN Evolution of networks. Raul Caldeira

SDN Evolution of networks. Raul Caldeira SDN Evolution of networks Raul Caldeira The networked society SDN - Evolution of Networks Commercial in confidence Ericsson Telecomunicações, Lda 2013 2013-04-09 Page 2 Realizing the networked society

More information

Information Data Reliability With The XGbE WAN PHY

Information Data Reliability With The XGbE WAN PHY Information Data Reliability With The XGbE WAN PHY Roy Bynum MCI WorldCom January 17, 2000 802.3 HSSG (P802.3ae) 1 GbE: Native IP Over Transport 95% of IP Data originates on 802.3 GbE is direct 802.3 GbE

More information

What is Hyperconvergence?

What is Hyperconvergence? + + eplus Enables Smooth Enterprise ITaaS Transformation Supporting Cloud-Based Hyperconvergence Infrastructure Converting IT service delivery to the cloud is becoming inevitable for most organizations.

More information