PROXIMITY AWARE LOAD BALANCING FOR HETEROGENEOUS NODES Mrs. Yogita A. Dalvi Dr. R. Shankar Mr. Atesh Kumar

Similar documents
International Journal of Advanced Research in Computer Science and Software Engineering

ADAPTIVE AND DYNAMIC LOAD BALANCING METHODOLOGIES FOR DISTRIBUTED ENVIRONMENT

MediaTek CorePilot 2.0. Delivering extreme compute performance with maximum power efficiency

Study of Load Balancing Schemes over a Video on Demand System

ANALYSIS OF A DYNAMIC LOAD BALANCING IN MULTIPROCESSOR SYSTEM

Supplementary File: Dynamic Resource Allocation using Virtual Machines for Cloud Computing Environment

A Comparative Study of Load Balancing Algorithms: A Review Paper

Distributed Scheduling for the Sombrero Single Address Space Distributed Operating System

GRID SIMULATION FOR DYNAMIC LOAD BALANCING

Chapter 3. Design of Grid Scheduler. 3.1 Introduction

ANALYSIS OF LOAD BALANCERS IN CLOUD COMPUTING

Load Balancing in Distributed System through Task Migration

A Load Balancing Approach to Minimize the Resource Wastage in Cloud Computing

Load balancing with Modify Approach Ranjan Kumar Mondal 1, Enakshmi Nandi 2, Payel Ray 3, Debabrata Sarddar 4

Dynamic Queue Based Enhanced HTV Dynamic Load Balancing Algorithm in Cloud Computing

Load Balancing Algorithms in Cloud Computing: A Comparative Study

A Survey of Task Allocation and Load Balancing in Distributed Systems

Load Balancing in Cloud Computing

A New Fuzzy Algorithm for Dynamic Load Balancing In Distributed Environment

The 7 deadly sins of cloud computing [2] Cloud-scale resource management [1]

LOAD BALANCING USING THRESHOLD AND ANT COLONY OPTIMIZATION IN CLOUD COMPUTING

Managing VMware Distributed Resource Scheduler

Task Load Balancing Strategy for Grid Computing

LOAD BALANCING ALGORITHMS ROUND-ROBIN (RR), LEAST- CONNECTION, AND LEAST LOADED EFFICIENCY

Load Balancing in Cloud Computing Priya Bag 1 Rakesh Patel 2 Vivek Yadav 3

Load Balancing with Random Information Exchanged based Policy

Traffic-aware Virtual Machine Placement without Power Consumption Increment in Cloud Data Center

International Journal of Advanced Networking & Applications (IJANA) ISSN:

CHAPTER 7 CONCLUSION AND FUTURE SCOPE

A Level-wise Priority Based Task Scheduling for Heterogeneous Systems

Balancing Fairness and Efficiency in Tiered Storage Systems with Bottleneck-Aware Allocation

A Study on Load Balancing in Cloud Computing * Parveen Kumar,* Er.Mandeep Kaur Guru kashi University, Talwandi Sabo

Two-Level Dynamic Load Balancing Algorithm Using Load Thresholds and Pairwise Immigration

Mobile Edge Computing for 5G: The Communication Perspective

Two Hierarchical Dynamic Load Balancing Algorithms in Distributed Systems

Enhanced Live Migration of Virtual Machine Using Comparison of Modified and Unmodified Pages

Epilogue. Thursday, December 09, 2004

Figure 1: Virtualization

Performance Evaluation of Mobile Agent-based Dynamic Load Balancing Algorithm

Double Threshold Based Load Balancing Approach by Using VM Migration for the Cloud Computing Environment

Various Strategies of Load Balancing Techniques and Challenges in Distributed Systems

Distributed Operating Systems

Load Balancing Algorithm over a Distributed Cloud Network

Distributed Computing: PVM, MPI, and MOSIX. Multiple Processor Systems. Dr. Shaaban. Judd E.N. Jenne

Analysis of Various Load Balancing Techniques in Cloud Computing: A Review

Prof. Darshika Lothe Assistant Professor, Imperial College of Engineering & Research, Pune, Maharashtra

Subject Name:Operating system. Subject Code:10EC35. Prepared By:Remya Ramesan and Kala H.S. Department:ECE. Date:

Load Balancing. Minsoo Ryu. Department of Computer Science and Engineering. Hanyang University. Real-Time Computing and Communications Lab.

Survey on Novel Load Rebalancing for Distributed File Systems

A Process Scheduling Algorithm Based on Threshold for the Cloud Computing Environment

A Novel Approach for Dynamic Load Balancing with Effective Bin Packing and VM Reconfiguration in Cloud

A SURVEY ON CLOUD RESOURCE ALLOCATION STRATEGIES

PAC485 Managing Datacenter Resources Using the VirtualCenter Distributed Resource Scheduler

Novel Scheduling Algorithms for Efficient Deployment of MapReduce Applications in Heterogeneous Computing Environments

CPU Scheduling. Operating Systems (Fall/Winter 2018) Yajin Zhou ( Zhejiang University

A Semi-Distributed Load Balancing Algorithm Using Clustered Approach

A Simulation-Based Analysis of Scheduling Policies for Multimedia Servers

Distributed Systems 27. Process Migration & Allocation

Consolidating Complementary VMs with Spatial/Temporalawareness

Co-operative Scheduled Energy Aware Load-Balancing technique for an Efficient Computational Cloud

COMPARISON OF ENERGY EFFICIENT DATA TRANSMISSION APPROACHES FOR FLAT WIRELESS SENSOR NETWORKS

Efficient Technique for Allocation of Processing Elements to Virtual Machines in Cloud Environment

Improved dynamic multimedia resource adaptation-based Peer-to-Peer system through locality-based clustering and service

Nowadays data-intensive applications play a

MediaTek CorePilot. Heterogeneous Multi-Processing Technology. Delivering extreme compute performance with maximum power efficiency

Dynamic Load Balancing Techniques for Improving Performance in Cloud Computing

CHAPTER 6 ENERGY AWARE SCHEDULING ALGORITHMS IN CLOUD ENVIRONMENT

A Resource Discovery Algorithm in Mobile Grid Computing Based on IP-Paging Scheme

OVERHEADS ENHANCEMENT IN MUTIPLE PROCESSING SYSTEMS BY ANURAG REDDY GANKAT KARTHIK REDDY AKKATI

Announcements. Reading. Project #1 due in 1 week at 5:00 pm Scheduling Chapter 6 (6 th ed) or Chapter 5 (8 th ed) CMSC 412 S14 (lect 5)

Task allocation in distributed systems

A priority based dynamic bandwidth scheduling in SDN networks 1

An Efficient Queuing Model for Resource Sharing in Cloud Computing

An Efficient Clustered Based P2P File Sharing System Using Bloom Filters

Grid Computing with Voyager

Effective Load Balancing in Grid Environment

Evaluation of Performance of Cooperative Web Caching with Web Polygraph

Performance & Scalability Testing in Virtual Environment Hemant Gaidhani, Senior Technical Marketing Manager, VMware

Dynamic Load Balancing By Scheduling In Computational Grid System

A LOAD BALANCING ALGORITHM BASED ON MOVEMENT OF NODE DATA FOR DYNAMIC STRUCTURED P2P SYSTEMS

A Comparative Analysis of Traffic Flows for AODV and DSDV Protocols in Manet

Venice: Reliable Virtual Data Center Embedding in Clouds

Stretch-Optimal Scheduling for On-Demand Data Broadcasts

Volume 2, Issue 4, April 2014 International Journal of Advance Research in Computer Science and Management Studies

Managing Performance Variance of Applications Using Storage I/O Control

Distributed Autonomous Virtual Resource Management in Datacenters Using Finite- Markov Decision Process

Location Efficient Proximity and Interest Clustered P2p File Sharing System

Advanced Topics UNIT 2 PERFORMANCE EVALUATIONS

Improving the Performance of the Peer to Peer Network by Introducing an Assortment of Methods

SANDPIPER: BLACK-BOX AND GRAY-BOX STRATEGIES FOR VIRTUAL MACHINE MIGRATION

Network-Aware Resource Allocation in Distributed Clouds

AN EFFICIENT SERVICE ALLOCATION & VM MIGRATION IN CLOUD ENVIRONMENT

Design of Parallel Algorithms. Course Introduction

Job sample: SCOPE (VLDBJ, 2012)

Towards Fair and Efficient SMP Virtual Machine Scheduling

An Optimized Virtual Machine Migration Algorithm for Energy Efficient Data Centers

Redundancy for Routers using Enhanced VRRP

Performance evaluation of Load Balancing with Service Broker policies for various workloads in cloud computing

Hybrid Auto-scaling of Multi-tier Web Applications: A Case of Using Amazon Public Cloud

8th Slide Set Operating Systems

Transcription:

ISSN 2320-9194 1 International Journal of Advance Research, IJOAR.org Volume 1, Issue 9, September 2013, Online: ISSN 2320-9194 PROXIMITY AWARE LOAD BALANCING FOR HETEROGENEOUS NODES Mrs. Yogita A. Dalvi Dr. R. Shankar Mr. Atesh Kumar M.TECH.[C.S.E.] (Pursuing), IES, Bhopal IES, Bhopal M.TECH.[CTA], IES, Bhopal. Email: syogita_dalvi@rediffmail.com Email: ateshsingh@yahoo.com Abstract Conventional load balancing schemes are efficient at increasing the utilization of CPU, memory, and disk I/O resources in a Distributed environment. Most of the existing load-balancing schemes ignore network proximity and heterogeneity of nodes. Load balancing becomes more challenging as load variation is very large and the load on each server may change dramatically over time, by the time when a server is to make the load migration decision, the collected load status from other servers may no longer be valid. This will affect the accuracy, and hence the performance, of the load balancing algorithms. All the existing methods neglect the heterogeneity of nodes and contextual load balancing. In this seminar, context based load balancing and task allocation with network proximity of heterogeneous nodes will be studied. Index Terms: Proximity-aware, peer-to-peer, virtual server, load balancing, distributed algorithms, random walks.

ISSN 2320-9194 2 Introduction Advancement in computer networking technologies have led to increase interest in the use of large-scale parallel and distributed computing systems. Distributed systems are gaining popularity by one of its key feature: resource sharing. A Load balancing algorithm tries to balance the total systems load by transparently transferring the workload from heavily loaded nodes to lightly loaded nodes in an attempt to ensure good overall performance relative to some specific metric of system performance. Effective load balancing algorithms/techniques are used to distribute the processes/load of a parallel program on multiple hosts to achieve goal(s) such as minimizing execution time, minimizing communication delays, maximizing resource utilization and maximizing throughputs. Load balancing on multi computers is a challenge due to the autonomy of the processors and the interprocessor communication overhead incurred in the collection of state information, communication delays, redistribution of load etc. Parallel and distributed computing environment is inherently best choice for solving/running distributed and parallel program applications. In such type of applications, a large process/task is divided and then distributed among multiple hosts for parallel computation. In a system of multiple hosts the probability of one of the hosts being idle while other host has multiple jobs queued up can be very high. Here load balancing is likely to improve performance. Such imbalances in system load suggest that performance can be improved by either transferring jobs from the currently heavily loaded hosts to the lightly loaded ones or distributing load evenly/fairly among the hosts.the processors are categorized according to workload in their CPU queues as heavily loaded, lightly loaded and idle processors/hosts. Here CPU queue length is used as an indicator of workload at a particular processor. Distributed systems are characterized by resource multiplicity and system transparency. A variety of widely differing techniques and methodologies for scheduling processes of a distributed system have been proposed. These techniques are broadly classified into three types: task allocation approach, load balancing, load sharing. The main goal of load balancing is to equalize the workload among the nodes by minimizing execution time, minimizing communication delays, maximizing resource utilization and maximizing throughput.the main motivation for our study is to improve the efficiency and usability of networks and processing units in cluster computing environments considering the context information of nodes.

ISSN 2320-9194 3 Features homogeneity of network but ignore distance between nodes. Load Balancing: - The computing power of any distributed system can be realized by allowing its constituent computational elements (CEs), or nodes, to work cooperatively so that large loads are allocated among them in a fair and effective manner. Any strategy for load distribution among CEs is called load balancing (LB). Distribution of computational load across available resources is referred to as the load balancing problem. Context based load balancing: - The context of an agent can be simply regarded as the environment it is situated which includes the physical context and the social context (organizational one). The physical context is produced by the agent s physical environment, which can be regarded as the agent s physical location, and the physically nearby agents within the subsystem; the resources owned by the agents within its physical context are called the physically contextual resources. On the other hand, agents in the complex system should be organized within some social organizations. Existing System: - All the existing context based algorithms are based on Proposed System: - The proposed algorithm will take care of the social context of nodes in the network at the time of making load balancing decision. All the nodes in the network are heterogeneous in the sense of their functionality and (or) resources. For this purpose, virtual server concept is used which is not actually present on nodes it is just a notion of load transfer between nodes in network. Virtual server is used in cluster environment. Virtual server is the notion of load transfer and it can transfer active jobs from one node to another. In case of agent based approaches administrative control is required which will guide load transfer. Using virtual machine we can handle security boundaries for job transfer. Rearranging the topology will reduce the load migration cost and bound the contextual similar nodes in one closure.

ISSN 2320-9194 4 In the social organizations, it is more likely that the near individuals may have more similarities and, being closer together in the organizational hierarchy, share more common interests than the remote individuals Therefore, in the social organizations of complex systems, each agent will negotiate with other agents for the requested resources gradually from near places to remote places. Let a be an agent that will negotiate with other agents within its social context and the agents in the nth round of negotiation of agent a be called the social contexts with gradation n. In the hierarchical structures, each agent can interact directly only to its superiors and subordinates; thus, each agent will first negotiate with its superiors or subordinates for resources. Moreover, in the hierarchical organizations, resource negotiation always happens between pairs of agents that share the same immediate superior; and agents will always negotiate resources through the lowest common ancestor. Therefore, let there be an agent a that can negotiate with other agents within the hierarchical structure according to the following orders: 1. The subordinates of agent a in the hierarchical structure; 2. The immediate superior of agent a; 3. The sibling agents with the lowest common superiors. When CRM (context based task allocation model) is used, the allocated agents will always incline to be located within the near physical contexts or social contexts, so the communication time will be reduced; however, the allocated agents in SRM (self owned resource based task allocation model) will always be distributed through the system, so the communication time among agents will incline to be more than the one of CRM model. Therefore, the task execution time of CRM model is always less than the one of the SRM model and while the number of tasks increases, the communication time will also increase System Architecture In the state of the system there are number of nodes present on network. Each node belongs to some of the network. On each node there are some agents present which initiate load balancing process. Different agents are present on nodes in the network. We have assumed proximity related information for all agents on nodes. All the nodes are allocated with certain resources and computations. At the time of task execution each node will verify the required resources present on it. If they are not present the nodes need to negotiate with other nodes considering their context physical and social. Each node in turn is provided with virtual machine (VM). A VM, like a PM (physical machine), has associated resource

TOTAL EXECUTION TIME INTERNATIONAL JOURNAL OF ADVANCE RESEARCH, IJOAR.ORG ISSN 2320-9194 5 levels of CPU, memory, and input/output (I/O) devices. While instantiating VMs, each machine needs to be provisioned/allocated these resources. These resources can be overcommitted, and multiplexing them across VMs is the hypervisor s responsibility. Typically, a sizing process, based on resource-usage profiles of applications or estimations to meet load requirement and so on, is used to determine initial provisioninglevels of a VM. Changes in workload conditions of VMs can lead to hot spots not enough resources provisioned to meet demand or cold spots provisioned resources are not utilized efficiently. In each case, resource allocations are varied dynamically to address the situation under consideration. Each virtual machine can be transferred from one node to other to satisfy resource requirement of the nodes. Before transfer we have to identify certain parameters of nodes like resources of agents themselves, which is always used in the previous related work. Now, we introduce the SRM model briefly. When a task requires more than one resource, we can also use the three criterions as First Required Resource-First Satisfy (FRFS). Most Important Resource-First Satisfy (MIFS). All Resources-Averagely Satisfy (AAS) Now, let there be a task t, the set of resources called by task t is R t { N 1 R 1 ; N 2 R 2 ; NnRn} N j i denotes the number of R i owned by agent Aj, R i denotes the set of resources owned by agent A i. Then, we will make a series of case simulations to test the two models. We can use SRM and CRM models to make task allocation; the allocated agents will execute the tasks, then the total execution time of tasks is tested. The proposed results are shown in Figure a. a) heavy node b) light node c) neutral node Proposed Simulation In this section, we will validate the correctness of proposed algorithm, so we will compare the performances of the following two models: 1) Contextual resource-based SRM MODELS CRM NO OF TASKS task allocation model, CRM and 2) Selfowned resource based task allocation model, SRM. In the SRM, the task allocation is Figure a. Execution time comparisons implemented according to the self-owned between SRM and CRM models.

ISSN 2320-9194 6 From the results, we will obtain the following: 1) when CRM model is used, the allocated agents will always incline to be located within the near physical contexts or social contexts, so the communication time will be reduced; however, the allocated agents in SRM model will always be distributed through the system, so the communication time among agents will incline to be more than the one of CRM model. Therefore, the task execution time of CRM model is always less than the one of the SRM model and 2) while the number of tasks increases, the communication time will also increase; so the difference between the two models will increase accordingly. Therefore, we can conclude that the CRM model can reduce the total communication time among allocated agents so as to reduce the total task execution time compared to SRM, especially while the number of tasks is large. Conclusion outperforms the previous methods based on the self-owned resource distribution of agents. Relocation of nodes in network according to their social context is possible and hence it reduces the resource migration cost within the social context. Virtual server can be used as a unit of load migration which can transfer active jobs from one node to other as per requirement. In this project we studied contextual load balancing techniques for distributed systems considering the homogeneous and heterogeneous environment of network. We come to following conclusions:- The task allocation and load balancing can be done based on contextual resource negotiation which

ISSN 2320-9194 7 REFERENCES [1] Load Balance with Imperfect Information in Structured Peer-to-Peer Systems Hung- Chang Hsiao, Member, IEEE Computer Society, Hao Liao, Ssu-Ta Chen, and Kuo- Chan Huang IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, VOL. 22, NO. 4, APRIL 2011 [2] Contextual Resource Negotiation based Task Allocation and Load balancing in complex software systems Yichuan Jiang and Jiuchuan Jiang, Senior Member, IEEE IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, VOL. 20, NO. 5, MARCH 2009 [3] Efficient Proximity Aware Load Balancing For DHT-Based P2p Systems Yingwa Zhu and Yiming Hu,. Senior Member IEEE IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, VOL. 16, NO. 4, APRIL 2005