LB-MAP: LOAD-BALANCED MIDDLEBOX ASSIGNMENT IN POLICY-DRIVEN DATA CENTERS

Similar documents
LB-MAP: Load-Balanced Middlebox Assignment in Policy-Driven Data Centers

Policy-preserving Middlebox Placement in SDN-Enabled Data Centers

JOINT VIRTUAL MACHINE PLACEMENT AND MIGRATION IN DYNAMIC POLICY-DRIVEN DATA CENTERS. A Thesis. Presented. to the Faculty of

Data Center Network Topologies II

CS 498 Hot Topics in High Performance Computing. Networks and Fault Tolerance. 9. Routing and Flow Control

Multiple Virtual Network Function Service Chain Placement and Routing using Column Generation

NetFlow-based bandwidth estimation in IP networks

VMP 2 : Policy-Aware Virtual Machine Placement in Policy Driven Data Centers

Multi-resource Energy-efficient Routing in Cloud Data Centers with Network-as-a-Service

Impact of Ethernet Multipath Routing on Data Center Network Consolidations

c-through: Part-time Optics in Data Centers

Generating (n,2) De Bruijn Sequences with Some Balance and Uniformity Properties. Abstract

QoS-Constrained Multi-path Routing for High-End Network App.

WDM Network Provisioning

Batch Scheduling Algorithms for Optical Burst Switching Networks

Efficient Cluster Based Data Collection Using Mobile Data Collector for Wireless Sensor Network

Interconnection Network

Interconnection Networks: Topology. Prof. Natalie Enright Jerger

Combining In-Transit Buffers with Optimized Routing Schemes to Boost the Performance of Networks with Source Routing?

C3PO: Computation Congestion Control (PrOactive)

CHAPTER 5 ANT-FUZZY META HEURISTIC GENETIC SENSOR NETWORK SYSTEM FOR MULTI - SINK AGGREGATED DATA TRANSMISSION

WDM Network Provisioning

TRAFFIC PRIORITY MAXIMIZATION IN POLICY ENABLED TREE BASED DATA CENTERS. A Thesis. Presented. to the Faculty of

Let s Stay Together: Towards Traffic Aware Virtual Machine Placement in Data Centers. Manar Alqarni Proff. Tang

Balancing the Migration of Virtual Network Functions with Replications in Data Centers

Benefit-based Data Caching in Ad Hoc. Networks

Reducing Power Consumption in Data Centers by Jointly Considering VM Placement and Flow Scheduling

Abstraction-Driven Network Verification and Design (a personal odyssey) Geoffrey Xie Naval Postgraduate School

An Ant-Based Routing Algorithm to Achieve the Lifetime Bound for Target Tracking Sensor Networks

TECHNOLOGY MAPPING FOR THE ATMEL FPGA CIRCUITS

A Performance Evaluation Architecture for Hierarchical PNNI and Performance Evaluation of Different Aggregation Algorithms in Large ATM Networks

Benefit-based Data Caching in Ad Hoc Networks

Lecture 12: Interconnection Networks. Topics: communication latency, centralized and decentralized switches, routing, deadlocks (Appendix E)

IO2654 Optical Networking. WDM network design. Lena Wosinska KTH/ICT. The aim of the next two lectures. To introduce some new definitions

(b) Linking and dynamic graph t=

LID Assignment In InfiniBand Networks

ε-machine Estimation and Forecasting

CQNCR: Optimal VM Migration Planning in Cloud Data Centers

Center for Networked Computing

Cross-Virtual Concatenation for Ethernet-over-SONET/SDH Networks

From Routing to Traffic Engineering

Interconnection topologies (cont.) [ ] In meshes and hypercubes, the average distance increases with the dth root of N.

Introduction. Network Architecture Requirements of Data Centers in the Cloud Computing Era

Network Function Virtualization in GTS

Communication System Design Projects

OPTIMAL LINK CAPACITY ASSIGNMENTS IN TELEPROCESSING AND CENTRALIZED COMPUTER NETWORKS *

Basic Switch Organization

Interconnection Networks: Routing. Prof. Natalie Enright Jerger

Distributed Code Assignment in Multihop Radio Networks: Object-Oriented Software Simulations

Benefit-based Data Caching in Ad Hoc Networks

Network Function Virtualization. CSU CS557, Spring 2018 Instructor: Lorenzo De Carli

Data Caching under Number Constraint

On Test Generation for Transition Faults with Minimized Peak Power Dissipation

Trees. Q: Why study trees? A: Many advance ADTs are implemented using tree-based data structures.

Combining In-Transit Buffers with Optimized Routing Schemes to Boost the Performance of Networks with Source Routing

A Scalable Content- Addressable Network

CHAPTER-III WAVELENGTH ROUTING ALGORITHMS

COT 6405 Introduction to Theory of Algorithms

1 extrema notebook. November 25, 2012

Machine Learning for Software Engineering

Transductive Learning: Motivation, Model, Algorithms

Outsourcing Privacy-Preserving Social Networks to a Cloud

Topology basics. Constraints and measures. Butterfly networks.

VNF Chain Allocation and Management at Data Center Scale

A Genetic Algorithm Framework

! Parallel machines are becoming quite common and affordable. ! Databases are growing increasingly large

Chapter 20: Parallel Databases

Chapter 20: Parallel Databases. Introduction

Increasing the Throughput of Network Appliances through Virtualization

arxiv: v3 [cs.dm] 12 Jun 2014

15-744: Computer Networking. Middleboxes and NFV

Optimising OSPF Routing for Link Failure Scenarios

Deploying Multiple Service Chain (SC) Instances per Service Chain BY ABHISHEK GUPTA FRIDAY GROUP MEETING APRIL 21, 2017

Femto-Matching: Efficient Traffic Offloading in Heterogeneous Cellular Networks

GIAN Course on Distributed Network Algorithms. Network Topologies and Local Routing

On Minimizing Packet Loss Rate and Delay for Mesh-based P2P Streaming Services

KTH ROYAL INSTITUTE OF TECHNOLOGY. Lecture 14 Machine Learning. K-means, knn

Chapter 18: Parallel Databases

Chapter 18: Parallel Databases. Chapter 18: Parallel Databases. Parallelism in Databases. Introduction

Questions and Objectives

AS the increasing number of smart devices and various

An Evolutionary Algorithm for the Multi-objective Shortest Path Problem

Peer-to-Peer Systems Exercise Winter Term 2014/2015

The ILP approach to the layered graph drawing. Ago Kuusik

DAT (cont d) Assume a page size of 256 bytes. physical addresses. Note: Virtual address (page #) is not stored, but is used as an index into the table

Elements of Graph Theory

A Thermal-aware Application specific Routing Algorithm for Network-on-chip Design

Performing Data Replication and Virtual Machine Migrations to Mitigate Network Overhead between Traditional Cloud and Mobile Cloud Systems

ProgrammableFlow: OpenFlow Network Fabric

Optical Communications and Networking 朱祖勍. Nov. 27, 2017

Artificial Intelligence

Survey on Reliability Control Using CLR Method with Tour Planning Mechanism in WSN

Optimal Cache Allocation for Content-Centric Networking

Overview Problem Statement Related Work KLEE The Histogram Bloom Structure Candidate Filtering Evaluation Conclusion / Future Work

FireScope Presentation. Updated: July 14, 2017

KLEE: A Framework for Distributed Top-k Query Algorithms

Getting to Know Your Data

Connected Point Coverage in Wireless Sensor Networks using Robust Spanning Trees

Energy Management Issue in Ad Hoc Networks

Robust validation of network designs under uncertain demands and failures

Transcription:

LB-MAP: LOAD-BALANCED MIDDLEBOX ASSIGNMENT IN POLICY-DRIVEN DATA CENTERS MANAR ALQARNI DEPARTMENT OF COMPUTER SCIENCE CALIFORNIA STATE UNIVERSITY DOMINGUEZ HILLS 1

INTRODUCTION - Middleboxes network appliances or network functions (NFs) are intermediary computer networking Devices. -NFV is a network virtualization technology that virtualizes middleboxes (or network functions) into building blocks that create communication services. 2

DATA CENTER TOPOLOGY - Fat tree networks. 3

DATA CENTER TOPOLOGY - A k-ary fat-tree with k = 4, where k is the number of ports of each switch. Core switches handles huge amount of traffic across the entire data center, therefore consuming lots of energy power. Aggregate switches and edge switches transmit less amount of traffic therefore consume less power. The lower two layers are separated into k pods. each containing k/2 aggregation switches and k/2 edge switches There are k^2/ 4 k-port core switches 4

LOAD BALANCED MIDDLEBOX ASSIGNMENT PROBLEM (LB-MAP) Network Model: We model a data center as an undirected general graph G(V, E). V = Vp Vs includes the set of PMs Middlebox Model: Among all the network devices in data center, load balancers have the highest failure probability. -This is due to high number of software faults and hardware faults related to application-specific integrated circuit (ASIC) and memory. - mbj (1 j m) is located at switch sw(j) Vs, it must traverse one of the instances. 5

LOAD BALANCED MIDDLEBOX ASSIGNMENT PROBLEM (LB-MAP) Energy Model: -We use re, ra, and rc to denote the power consumption, when it transmits a VM communication. Uniform Energy Model: the energy consumption of VM communication is measured as the minimum number of switches it traverses. Skewed Energy Model: The core switches handle more traffic therefore usually consume more energy power than aggregate switches, which consume more energy power than edge switches. 6

EXAMPLE 1 7

EXAMPLE 2 8

PROBLEM FORMULATION OF LB-MAP -Let c(i, j) denote the minimum energy consumption between PM (or switch) i and j. -Let c i,j be the minimum power consumption for VM pair (v i, v i ) when it is assigned to middlebox instance mb j 9

PROBLEM FORMULATION OF LB-MAP -Now we define the load balanced middlebox assignment function as p : P M, signifying that VM pair (v i, v i ) P is assigned to middlebox instance p(i) M. Given any middlebox assignment function p, the power consumption for VM pair (v i, v i ) is then 10

PROBLEM FORMULATION OF LB-MAP - Denote the total energy consumption of all the l VM pairs with middlebox assignment p as C p. Then 11

MINIMUM COST FLOW PROBLEM (MCF) 12

MINIMUM COST FLOW PROBLEM (MCF) - It can be solved efficiently by many combinatorial algorithms. - For any flow network, the algorithm has the time complexity of O(a^ 2 b log(a c)), where a, b, and c are the number of nodes, number of edges, and maximum edge capacity in the flow network. 13

VM-BASED ALGORITHM VM-Based Algorithm: For each VM pair, it is assigned to an MB instance such that it gives the minimum energy consumption for this VM pair among all the MB instances, while satisfying this MB instance s capacity. 14

MB-BASED ALGORITHM MB-Based Algorithm: For each MB instance,it is assigned κ VM pairs among all the VM pairs that give the minimum energy consumption when going through that MB instance. 15

VM-MB-BASED ALGORITHM VM-MB-Based Algorithm: In each round, it checks which VM pair is assigned to which MB instance, such that when that VM pair traverses that MB instance, it yields the minimum energy consumption among all the unassigned VM pairs and all the MB instances in that round. 16

PERFORMANCE EVALUATION -The source and destination VMs of each VM pair are randomly placed on the PMs and the MB instances are randomly placed on the switches. -In all the simulation plots, each data point is an average of 10 runs, and the error bars indicate 95% of confidence interval. 17

EFFECT OF NUMBER OF VM PAIRS L 18

EFFECT OF NUMBER OF MB INSTANCES M 19

COMPARISON IN LARGE DATA CENTERS 20

COMPARISON UNDER SKEWED ENERGY MODEL 21

COMPARISON UNDER SKEWED ENERGY MODEL 22

CONCLUSION -The goal of LBMAPis to minimize the energy cost of all the communicating virtual machine pairs who must traverse a middlebox for policy requirement, while taking into account of the limited capacity of the middlebox. -We formulated LB-MAP formally and proved that LB-MAP is equivalent to the well-known minimum cost flow problem (MCF). 23

CONCLUSION - We also designed a suite of efficient heuristic algorithms based on different criteria. - Via extensive simulations, we showed that all the heuristic algorithms perform close to the optimal minimum cost flow algorithm, while VM+MB-Based performs best among all the heuristic algorithms. 24

FUTURE WORK - We assume that there is only one middlebox type such as load balancers. In the future, we will consider a more general problem wherein multiple types of middleboxes exist, each having multiple instances. 25