Solution Biasing for Optimized Cloud Workload Placement

Similar documents
Prediction-Based Admission Control for IaaS Clouds with Multiple Service Classes

Consolidating Complementary VMs with Spatial/Temporalawareness

Effective probabilistic stopping rules for randomized metaheuristics: GRASP implementations

A Tabu Search solution algorithm

Simplicial Global Optimization

Network-Aware Resource Allocation in Distributed Clouds

PASS Sample Size Software. Randomization Lists

Optimization Techniques for Design Space Exploration

polygonal approximations

RIAL: Resource Intensity Aware Load Balancing in Clouds

Unsupervised Learning and Clustering

A SIMULATED ANNEALING ALGORITHM FOR SOME CLASS OF DISCRETE-CONTINUOUS SCHEDULING PROBLEMS. Joanna Józefowska, Marek Mika and Jan Węglarz

Variable Neighborhood Search

A PACKAGE FOR DEVELOPMENT OF ALGORITHMS FOR GLOBAL OPTIMIZATION 1

A scheduling model of virtual machine based on time and energy efficiency in cloud computing environment 1

Module 1 Lecture Notes 2. Optimization Problem and Model Formulation

UX Research in the Product Lifecycle

Hardware-Software Codesign

Autonomic Workload Execution Control Using Throttling

IBM Research Report. Enabling Efficient Placement of Virtual Infrastructures in the Cloud

Variable Neighborhood Search for Solving the Balanced Location Problem

PushPull: Short Path Padding for Timing Error Resilient Circuits YU-MING YANG IRIS HUI-RU JIANG SUNG-TING HO. IRIS Lab National Chiao Tung University

Introduction (7.1) Genetic Algorithms (GA) (7.2) Simulated Annealing (SA) (7.3) Random Search (7.4) Downhill Simplex Search (DSS) (7.

Automated Control for Elastic Storage

Support vector machines

Classification: Linear Discriminant Functions

Enhancing Cloud Resource Utilisation using Statistical Analysis

Gianluca Palermo Sapienza - Università di Roma. Paolo Gaudenzi Sapienza - Università di Roma

Perceptron Learning Algorithm

Using Multi-Level Graphs for Timetable Information. Frank Schulz, Dorothea Wagner, and Christos Zaroliagis

ELEN E4830 Digital Image Processing. Homework 6 Solution

Fundamentals of Integer Programming

Computational Economics and Finance

Particle Swarm Optimization Approach with Parameter-wise Hill-climbing Heuristic for Task Allocation of Workflow Applications on the Cloud

Application in a Systems Design Environment. EE 498/499 Capstone Design Classes Klipsch School of Electrical & Computer Engineering

Neural Network Weight Selection Using Genetic Algorithms

CRF Feature Induction

Application Placement and Demand Distribution in a Global Elastic Cloud: A Unified Approach

8. CONCLUSION AND FUTURE WORK. To address the formulated research issues, this thesis has achieved each of the objectives delineated in Chapter 1.

Venice: Reliable Virtual Data Center Embedding in Clouds

VNS-based heuristic with an exponential neighborhood for the server load balancing problem

A Native Approach to Cell to Switch Assignment Using Firefly Algorithm

GRASP. Greedy Randomized Adaptive. Search Procedure

A dynamic pivot selection technique for similarity search

CLOUD adoption by government, industrial, and academic

Nowadays data-intensive applications play a

A Modified Black hole-based Task Scheduling Technique for Cloud Computing Environment

Unsupervised Learning and Clustering

Rules for Identifying the Initial Design Points for Use in the Quick Convergent Inflow Algorithm

Distributed Autonomous Virtual Resource Management in Datacenters Using Finite- Markov Decision Process

Solving the Maximum Cardinality Bin Packing Problem with a Weight Annealing-Based Algorithm

OVERHEADS ENHANCEMENT IN MUTIPLE PROCESSING SYSTEMS BY ANURAG REDDY GANKAT KARTHIK REDDY AKKATI

A Tabu Search Heuristic for the Generalized Traveling Salesman Problem

ADAPTIVE AND DYNAMIC LOAD BALANCING METHODOLOGIES FOR DISTRIBUTED ENVIRONMENT

Simple mechanisms for escaping from local optima:

Simulated Annealing. G5BAIM: Artificial Intelligence Methods. Graham Kendall. 15 Feb 09 1

VLSI Physical Design: From Graph Partitioning to Timing Closure

A Design Framework for Real-Time Embedded Systems with Code Size and Energy Constraints

Channel Allocation for IEEE Mesh Networks

How to Find the Optimal Configuration for Your Virtualized Environment. Iordan K. Iotzov Blog:

Lecture 4 of Artificial Intelligence. Heuristic Search. Produced by Qiangfu Zhao (2008), All rights reserved

A New Empirical Analysis Technique for Shale Reservoirs

Analysis and optimization methods of graph based meta-models for data flow simulation

Computational Economics and Finance

Modeling and Optimization of Resource Allocation in Cloud

MIRROR SITE ORGANIZATION ON PACKET SWITCHED NETWORKS USING A SOCIAL INSECT METAPHOR

Microsoft Office Illustrated. Analyzing Table Data

a local optimum is encountered in such a way that further improvement steps become possible.

CQNCR: Optimal VM Migration Planning in Cloud Data Centers

CHAPTER 3 RESEARCH METHODOLOGY

COMPARISON OF ALGORITHMS FOR NONLINEAR REGRESSION ESTIMATES

INFO0948 Fitting and Shape Matching

Using Machine Learning to Optimize Storage Systems

2010 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media,

Training Restricted Boltzmann Machines using Approximations to the Likelihood Gradient. Ali Mirzapour Paper Presentation - Deep Learning March 7 th

Symmetrical Buffered Clock-Tree Synthesis with Supply-Voltage Alignment

Chapter 7: Competitive learning, clustering, and self-organizing maps

Complete Local Search with Memory

Leveraging Set Relations in Exact Set Similarity Join

Quality Payments Scheme 2018/19

An Autonomic Framework for Integrating Security and Quality of Service Support in Databases

A Load Balancing Approach to Minimize the Resource Wastage in Cloud Computing

Variable Neighborhood Search Based Algorithm for University Course Timetabling Problem

COLA: Optimizing Stream Processing Applications Via Graph Partitioning

Coriolis: Scalable VM Clustering in Clouds

Volley: Automated Data Placement for Geo-Distributed Cloud Services

Lecture 18 Solving Shortest Path Problem: Dijkstra s Algorithm. October 23, 2009

Efficient Iterative Semi-supervised Classification on Manifold

Large Scale Manifold Transduction

LECTURE NOTES Non-Linear Programming

Lipschitzian Optimization, DIRECT Algorithm, and Applications

Generalized subinterval selection criteria for interval global optimization

CS229 Lecture notes. Raphael John Lamarre Townshend

Solving Zero-One Mixed Integer Programming Problems Using Tabu Search

SoftNAS Cloud Performance Evaluation on Microsoft Azure

Efficient Regression for Computational Imaging: from Color Management to Omnidirectional Superresolution

CS 331: Artificial Intelligence Local Search 1. Tough real-world problems

A Parallel Evolutionary Algorithm for Discovery of Decision Rules

Task Allocation for Minimizing Programs Completion Time in Multicomputer Systems

Star: Sla-Aware Autonomic Management of Cloud Resources

Transcription:

Solution Biasing for Optimized Cloud Workload Placement Asser N. Tantawi 2016 IEEE International Conference on Autonomic Computing Summarized by Uma Tadakamalla 1

I. Introduction Outline II. III. Problem Statement Solution IV. Functional Definitions V. Experimental Results 2

I. Introduction Problem domain: cloud computing Problem: workload placement in the cloud 3

II. Problem Statement Mapping of Logical Entities (LE) onto Physical Entities (PE) in such a way as to Optimize an Objective Function subject to Constraints 4

II. Problem Statement, cont. Logical Entities (LE): Virtual Machines (VM), Data Volumes, Communication links, and Containers Physical Entities (PE): Physical Machines (PM), Storage Devices, and Communication networks Objective Function: User and Provider Objectives Constraints: Properties and/or Resource Demands, Communications needs, Collocation(or anticollocation) of member LEs of the group 5

II. Problem Statement, cont. N physical entities, M logical entities X is a variable mapping logical to physical entities S the set of possible solutions satisfying constraints Objective function: f(x) A is a particular mapping (solution) 6

III. Solution Optimization problem is formulated as a General Search Problem based on Random Search Methods Uses biasing and sampling Does not depend on properties such as convexity or heuristics 7

III. Solution, cont. Generalized Random Search Method 8

III. Solution, cont. Biased Sampling Algorithm (BSA) a random search algorithm uses sampling and biasing makes the following choices: Neighborhood H(k) is characterized by the marginal probability distributions Candidate solution X (k) is generated using a modified Gibbs sampling Next point X(k + 1) is the generated point X (k) Estimate of optimal solution X (k) is generated using importance sampling technique. 9

III. Solution, cont. Biased Sampling Algorithm (BSA) 10

Stopping criteria could be: number of iterations or III. Solution, cont. reaching diminishing return After the stopping criterion is met, the sample with the minimum f() is the solution. Time complexity is O(NM 2 ). 11

IV. Functional Definitions Biasing helps in finding good solutions in less time Biasing functions push the solution towards one that satisfies the constraints and optimizes the objective function. Biasing functions are designed to have parameters, also known as bias factors. Setting the values for bias factors appropriately is critical to the quality of the results. 12

IV. Functional Definitions, cont. Usage Biasing: non-increasing function of resource utilization Location Biasing: non-increasing function in the amount of deviation from the location preferences set by the user 13

IV. Functional Definitions, cont. Objective. Function: weighted sum of system (provider) objective and pattern (user) objective System objective: standard deviation of the utilization of resources The objective is to balance the load across the cloud Pattern objective: deviation from the desired location constraints specified in the pattern request 14

V. Experimental Results Cloud System Configuration (simulated) 15

V. Experimental Results, cont. Three experiments were conducted with several pattern configurations to: demonstrate the efficiency of the BSA algorithm investigate the sensitivity of the bias factors. 16

V. Experimental Results (Exp #1) 17

V. Experimental Results (Exp #1) Conducted several experiments with β usg = [0, 8] The rate of improvement decreases from an initial 0.0192, going from 0 to 0.5, to an insignificant 0.0017, going from 6 to 8. Used a default value of β usg = 2 The algorithm execution time is < 100 msec 18

V. Experimental Results (Exp #1) 19

V. Experimental Results (Exp #1) Experiment #1: Optimality Test Optimal Policy: a VM is placed in the PM with the smallest CPU utilization The results of the BSA algorithm are within the 20% of optimum solution obtained using the best-fit policy. 20

V. Experimental Results (Exp #2) 21

V. Experimental Results (Exp #2) Conducted several experiments with β loc = [2, 6] As β loc increases, the pattern value decreases, and at the same time, system value increases At β loc = 4, the total value is a minimum (one of the goals) The algorithm execution time ~ 200 msec 22

V. Experimental Results (Exp #2) 23

V. Experimental Results (Exp #3) 24

V. Experimental Results (Exp #3) 25

V. Experimental Results (Exp #3) Conducted several experiments with β loc = [0, 8] As β usg increases, the system value decreases and the pattern value increases, resulting in a fairly constant total value around 0.17 The algorithm execution time ~ 25 msec. 26

Conclusions & Critique 1. The BSA algorithm appears to be fast -- finds solutions in 25 to 200 msec for the experiments conducted. 2. Author claimed: In a case where an optimal solution may be obtained, we show that our method is within 20% of optimality The above happens to be for a very simple case, i.e., Exp. #1 How can one be sure that is case for a more general scenarios with user objective function and/or constraints? 3. The BSA algorithm has not been compared (either time complexity or accuracy) with state of the art algorithms! 27