Adaptive QoS Control Beyond Embedded Systems

Size: px
Start display at page:

Download "Adaptive QoS Control Beyond Embedded Systems"

Transcription

1 Adaptive QoS Control Beyond Embedded Systems Chenyang Lu! CSE 520S!

2 Outline! Control-theoretic Framework! Service delay control on Web servers! On-line data migration in storage servers! ControlWare: adaptive QoS control middleware for Internet servers 2"

3 QoS in Unpredictable Environments Absolute Guarantees 10 sec stock trade guarantee!! #user???! request rate???! resource requirement???! Internet! 3"

4 QoS in Unpredictable Environments Relative Guarantees Delay contract! Premium : Basic = 1 : 3! #user???! request rate???! resource requirement???! " Web hosting: paid sites vs. free sites! " E-business: VIPs vs. others! 4"

5 State of the Art! Non-adaptive resource allocation " Over-provisioning # high cost! Queuing theory " Capacity planning based on offline prediction " Dependence on known arrival process! Adaptation heuristics " Lack of analysis " Laborious design/tuning/testing iterations! Feedback control theory " Mathematical analysis & design of adaptive systems 5"

6 Feedback Control Theory! Robust against modeling errors and variations! Success in mechanical/electrical systems! How to apply feedback control theory to QoS in computing systems? 6"

7 Challenges 1. QoS Mapping: How to map QoS to software feedback control loops? 2. Modeling: How to establish dynamic models for computing systems? 3. Design & Implementation: How to build practical QoS architectures? 7"

8 Feedback Control Loop Software Feedback Control Loop! Computing! System! Controller! control! input! Actuator! change! Manipulated! variable! + error! - Monitor! sample! Controlled! variable! Reference! 8"

9 Feedback Control Loop Software Feedback Control Loop! Computing! System! Controller! control! input! Actuator! change! Manipulated! variable! (#servers)! + error! - Monitor! sample! Controlled! variable! (delay)! Reference! (5 sec)! 9"

10 Dynamic Response Controlled! variable! Reference!!!!!!! Settling time! Stability! Transient State! Steady state error! Steady State! Time! 10"

11 Control-theoretic QoS Framework guarantee! QoS Guarantee! QoS Control Software! QoS Mapping! Control Loop! Architecture! Controllers! System Identification! Dynamic! Response! Specs! Dynamic! Model! Controller Design! 11"

12 Outline! Control-theoretic Framework! Service delay control on Web servers! On-line data migration in storage servers! ControlWare: Adaptive QoS control middleware 12"

13 Web Servers Relative Delay Guarantee Delay contract! Premium : Basic = 1 : 3! #user???! arrival rate???! resource requirement???!! Enforce delay ratio between service classes on Web servers 13"

14 Challenges 1. QoS Mapping: How to map QoS to software feedback control loops? " Identify control variables " Design control loop structures 2. Modeling: How to establish dynamic models for computing systems? 3. Architecture: How to build practical QoS architectures? 14"

15 Web servers HTTP Protocols TCP connection HTTP request! Apache server " Multi-process architecture " Study focused on HTTP 1.1 protocol User A User A server server server server HTTP1.0 HTTP1.1 15"

16 Web servers HTTP Protocols HTTP Request User A User B User A User B server server server server HTTP1.0 HTTP1.1 16"

17 Web servers HTTP Protocols User A User B User A User B server server server server HTTP1.0 HTTP1.1 17"

18 Web servers HTTP Protocols HTTP Request TCP Connection Request User A User B User C User A User B User C server server server server Connection delay in TCP listen queue! HTTP1.0 HTTP1.1 18"

19 HTTP 1.1 Protocol connection delay processing delay processing delay Time TCP connection Request Start 1 st HTTP request Finish 1 st HTTP request Start 2 nd HTTP request Finish 2 nd HTTP request! Focus of this work: connection delay. 19"

20 Apache HTTP 1.1 Server Control Variables! Controlled variable: (connection) delay ratio D 1 (k)/d 0 (k)! Manipulated variable: (process) budget ratio B 0 (k)/b 1 (k) A! B! New users! processing delay network delay! server! TCP listen queue! connection delay!! server! TCP Connection Request! 20"

21 QoS Mapping Relative delay for two classes Controller! B 1 (k+1)/b 0 (k+1)! budget ratio! Actuator! Apache! error! + - W 0 /W 1! desired delay ratio! Monitor! D 0 (k)/d 1 (k)! delay ratio! 21"

22 QoS Mapping Relative delay for two classes (cont.) W 1 : W 0 W 1 /W 0 TCP conn req! listen queue! HTTP requests/responses! Controller 0! B 0 /B 1! Connection! Scheduler! D Monitor! 1 /D 0! Server! Server! 22"

23 QoS Mapping Relative delay for three classes W 0 : W 1 : W 2! W 2 /W 1! W 1 /W 0! TCP conn req! listen queue! Controller 1! B 1 /B 2! Controller 0! B 0 /B 1! Connection! Scheduler! D 2 /D 1! Monitor! D 1 /D 0! Server! Server! HTTP requests/responses! 23"

24 Challenges 1. QoS Mapping: How to map QoS to software feedback control loops? 2. Modeling: How to establish dynamic models for computing systems? 3. Architecture: How to build practical QoS architectures? 24"

25 Modeling Computing Systems! Servers are dynamic systems " Current output depends on history " Queuing delays! Difference equation V ( k) = n j= 1 a V ( k j j) + j= 1 " V(k): controlled variable in k th sampling period " U(k): manipulated variable in k th sampling period " Order n: #sampling-period that affects current performance n b U( k j j) 25"

26 Web Server System Identification V ( k) = n j= 1 a V ( k j j) + n j= 1 b U( k j j) {a j, b j }! white! noise! B 0 (k)/b 1 (k)! B 0 (k)/b 1 (k)! Least! Squares! Estimator! D 0 (k)/d 1 (k)! monitor! TCP connection requests! listen queue! HTTP requests/responses! connection! scheduler! Server! Server! 26"

27 Web Server Estimation of model parameters 1.5 Estimation! estimate Time (s) a1 a2 b1 b2 " V(k) = 0.74V(k-1) V(k-2) U(k-1) 0.12U(k-2)! " Delay ratio: V(k) = D 0 (k)/d 1 (k)! " Budget ratio: U(k) = D 0 (k)/d 1 (k)! 27"

28 Web Server Experimental Validation of the Model Delay Ratio! ratio Time (s) Apache Model prediction " 2 nd order difference equation is sufficient for Apache!! 28"

29 Web Server Controller design 1 Imaginary Axis! -1-1 Real Axis! 1 Root Locus " PI Control! U ( k) = K k ( E " Root-Locus Method! P k j= 0 " Designed dynamic response! " Stability! " Steady state error: 0! " Settling time: 4.5 min! k ( k) + K I E k ( j)) Closed Loop Poles 29"

30 Challenges 1. QoS Mapping: How to map QoS to software feedback control loops? 2. Modeling: How to establish dynamic models for computing systems? 3. Architecture: How to build practical QoS architectures? 30"

31 Web Server Implementation server! server! TCP socket! Unix domain socket! TCP listen queue! TCP listen queue! server! server! monitor/controller! accept! classify! scheduler! Connection Manager! Apache! Modified Apache! server! server! server! server! 31"

32 Web Server Experimental setup! Baseline for comparison " Fixed allocation of server processes between service classes " Fine-tuned for nominal workload! Workload " Nominal: 100 premium & 200 basic users " Change #users at run-time " Realistic workload generated by SURGE 32"

33 Web Server: Evaluation Results #premium100#200! designed settling time! 4 Delay Ratio! (Basic/Premium)! Time (s) Feeback Control Baseline Reference 33"

34 Summary: Web Server Meeting the challenges 1. QoS mapping " Relative delay guarantees # feedback control loops 2. Modeling " Estimate difference equation models using system identification " Second-order difference equation model is sufficient for Apache 3. Architecture " QoS architecture on Apache " Relative delay guarantees despite variations in user populations 34"

35 Reference! C. Lu, Y. Lu, T.F. Abdelzaher, J.A. Stankovic and S.H. Son, Feedback Control Architecture and Design Methodology for Service Delay Guarantees in Web Servers, IEEE Transactions on Parallel and Distributed Systems, 17(9): , September 2006.! 35"

A Feedback Control Approach for Guaranteeing Relative Delays in Web Servers *

A Feedback Control Approach for Guaranteeing Relative Delays in Web Servers * A Feedback Control Approach for Guaranteeing Relative Delays in Web Servers * Chenyang Lu Tarek F. Abdelzaher John A. Stankovic Sang H. Son Department of Computer Science, University of Virginia Charlottesville,

More information

THE increasing diversity of applications supported by the

THE increasing diversity of applications supported by the 1014 IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, VOL. 17, NO. 9, SEPTEMBER 2006 Feedback Control Architecture and Design Methodology for Service Delay Guarantees in Web Servers Chenyang Lu,

More information

Feedback Control Real-Time Scheduling

Feedback Control Real-Time Scheduling Feedback Control Real-Time Scheduling A Dissertation Presented to the Faculty of the School of Engineering and Applied Science University of Virginia In Partial Fulfillment of the Requirements for the

More information

REGULATING RESPONSE TIME IN AN AUTONOMIC COMPUTING SYSTEM: A COMPARISON OF PROPORTIONAL CONTROL AND FUZZY CONTROL APPROACHES

REGULATING RESPONSE TIME IN AN AUTONOMIC COMPUTING SYSTEM: A COMPARISON OF PROPORTIONAL CONTROL AND FUZZY CONTROL APPROACHES REGULATING RESPONSE TIME IN AN AUTONOMIC COMPUTING SYSTEM: A COMPARISON OF PROPORTIONAL CONTROL AND FUZZY CONTROL APPROACHES Harish S. Venkatarama 1 and Kandasamy Chandra Sekaran 2 1 Reader, Computer Science

More information

Achieving Fair or Differentiated Cache Sharing in Power-Constrained Chip Multiprocessors

Achieving Fair or Differentiated Cache Sharing in Power-Constrained Chip Multiprocessors Achieving Fair or Differentiated Cache Sharing in Power-Constrained Chip Multiprocessors Xiaorui Wang, Kai Ma, and Yefu Wang Department of Electrical Engineering and Computer Science University of Tennessee,

More information

Service Differentiation in Real-Time Main Memory Databases

Service Differentiation in Real-Time Main Memory Databases Service Differentiation in Real-Time Main Memory Databases Kyoung-Don Kang Sang H. Son John A. Stankovic Department of Computer Science University of Virginia kk7v, son, stankovic @cs.virginia.edu Abstract

More information

Feedback Control Scheduling in Distributed Real-Time Systems *

Feedback Control Scheduling in Distributed Real-Time Systems * Feedback Control Scheduling in Distributed Real-Time Systems * John A. Stankovic, Tian He, Tarek Abdelzaher, ike arley, Gang Tao, Sang Son and Chenyang Lu Department of Computer Science, niversity of Virginia

More information

DISCRETE TIME ADAPTIVE LINEAR CONTROL

DISCRETE TIME ADAPTIVE LINEAR CONTROL DISCRETE TIME ADAPTIVE LINEAR CONTROL FOR SOFTWARE SYSTEMS Martina Maggio Lund University From wikipedia: CONTROL THEORY Control theory is an interdisciplinary branch of engineering and mathematics that

More information

Middleware Support for Aperiodic Tasks in Distributed Real-Time Systems

Middleware Support for Aperiodic Tasks in Distributed Real-Time Systems Outline Middleware Support for Aperiodic Tasks in Distributed Real-Time Systems Yuanfang Zhang, Chenyang Lu and Chris Gill Department of Computer Science and Engineering Washington University in St. Louis

More information

Congestion Control. Andreas Pitsillides University of Cyprus. Congestion control problem

Congestion Control. Andreas Pitsillides University of Cyprus. Congestion control problem Congestion Control Andreas Pitsillides 1 Congestion control problem growing demand of computer usage requires: efficient ways of managing network traffic to avoid or limit congestion in cases where increases

More information

Adaptation in distributed NoSQL data stores

Adaptation in distributed NoSQL data stores Adaptation in distributed NoSQL data stores Kostas Magoutis Department of Computer Science and Engineering University of Ioannina, Greece Institute of Computer Science (ICS) Foundation for Research and

More information

Power-Aware Throughput Control for Database Management Systems

Power-Aware Throughput Control for Database Management Systems Power-Aware Throughput Control for Database Management Systems Zichen Xu, Xiaorui Wang, Yi-Cheng Tu * The Ohio State University * The University of South Florida Power-Aware Computer Systems (PACS) Lab

More information

Predictable Time-Sharing for DryadLINQ Cluster. Sang-Min Park and Marty Humphrey Dept. of Computer Science University of Virginia

Predictable Time-Sharing for DryadLINQ Cluster. Sang-Min Park and Marty Humphrey Dept. of Computer Science University of Virginia Predictable Time-Sharing for DryadLINQ Cluster Sang-Min Park and Marty Humphrey Dept. of Computer Science University of Virginia 1 DryadLINQ What is DryadLINQ? LINQ: Data processing language and run-time

More information

Predicting Web Service Levels During VM Live Migrations

Predicting Web Service Levels During VM Live Migrations Predicting Web Service Levels During VM Live Migrations 5th International DMTF Academic Alliance Workshop on Systems and Virtualization Management: Standards and the Cloud Helmut Hlavacs, Thomas Treutner

More information

FEL-H Robust Control Real-Time Scheduling

FEL-H Robust Control Real-Time Scheduling J. Softare Engineering & Applications, 009, :60-65 Published Online April 009 in SciRes (.SciRP.org/journal/jsea) FEL-H Robust Control Real-Time Scheduling Bing Du 1, Chun Ruan 1 School of Electrical and

More information

Managing Web server performance with AutoTune agents

Managing Web server performance with AutoTune agents Managing Web server performance with AutoTune agents by Y. Diao, J. L. Hellerstein, S. Parekh, J. P. Bigus Pipat Waitayaworanart Woohyung Han Outline Introduction Apache web server and performance tuning

More information

IBM Research Report. Control of Weighted Fair Queueing: Modeling, Implementation, and Experiences

IBM Research Report. Control of Weighted Fair Queueing: Modeling, Implementation, and Experiences RC23437 (W4-6) November 7, 24 Computer Science IBM Research Report Control of Weighted Fair Queueing: Modeling, Implementation, and Experiences Ronghua Zhang*, Sujay Parekh, Yixin Diao, Maheswaran Surendra

More information

IBM Research Report. A Control Theory Foundation for Self-Managing Computing Systems

IBM Research Report. A Control Theory Foundation for Self-Managing Computing Systems RC23646 (W0506-124) June 29, 2005 Computer Science IBM Research Report A Control Theory Foundation for Self-Managing Computing Systems Yixin Diao, Joseph L. Hellerstein, Sujay Parekh IBM Research Division

More information

An Adaptive Closed-Loop Approach for Timely Data Services

An Adaptive Closed-Loop Approach for Timely Data Services An Adaptive Closed-Loop Approach for Timely Data Services Dinuni Fernando, Kyoung-Don Kang State University of New York at Binghamton {dferna15, kang}@binghamton.edu Yan Zhou Rackspace, Inc. yan.zhou@rackspace.com

More information

STAR: Secure Real-Time Transaction Processing with Timeliness Guarantees y

STAR: Secure Real-Time Transaction Processing with Timeliness Guarantees y STAR: Secure Real-Time Transaction Processing with Timeliness Guarantees y Kyoung-Don Kang Sang H. Son John A. Stankovic Department of Computer Science University of Virginia fkk7v, son, stankovicg@cs.virginia.edu

More information

Adaptive Entitlement Control of Resource Containers on Shared Servers

Adaptive Entitlement Control of Resource Containers on Shared Servers Adaptive Entitlement Control of Resource Containers on Shared Servers Xue Liu, Xiaoyun Zhu, Sharad Singhal, Martin Arlitt Internet Systems and Storage Laboratory HP Laboratories Palo Alto HPL-2004-178

More information

ControlWare: A Middleware Architecture for Feedback Control of Software Performance

ControlWare: A Middleware Architecture for Feedback Control of Software Performance ControlWare: A Middleware Architecture for Feedback Control of Ronghua Zhang, Chenyang Lu, Tarek F. Abdelzaher, John A. Stankovic Department of Computer Science University of Virginia Charlottesville,

More information

COL862: Low Power Computing Maximizing Performance Under a Power Cap: A Comparison of Hardware, Software, and Hybrid Techniques

COL862: Low Power Computing Maximizing Performance Under a Power Cap: A Comparison of Hardware, Software, and Hybrid Techniques COL862: Low Power Computing Maximizing Performance Under a Power Cap: A Comparison of Hardware, Software, and Hybrid Techniques Authors: Huazhe Zhang and Henry Hoffmann, Published: ASPLOS '16 Proceedings

More information

Using MIMO Feedback Control to Enforce Policies for Interrelated Metrics With Application to the Apache Web Server

Using MIMO Feedback Control to Enforce Policies for Interrelated Metrics With Application to the Apache Web Server Using MIMO Feedback Control to Enforce Policies for Interrelated Metrics With Application to the Apache Web Server Yixin Diao, Neha Gandhi 2, Joseph L. Hellerstein 3, Sujay Parekh 4, and Dawn M. Tilbury

More information

Mohammad Hossein Manshaei 1393

Mohammad Hossein Manshaei 1393 Mohammad Hossein Manshaei manshaei@gmail.com 1393 Voice and Video over IP Slides derived from those available on the Web site of the book Computer Networking, by Kurose and Ross, PEARSON 2 Multimedia networking:

More information

Department of Electrical Engineering. Indian Institute of Technology Dharwad EE 303: Control Systems Practical Assignment - 6

Department of Electrical Engineering. Indian Institute of Technology Dharwad EE 303: Control Systems Practical Assignment - 6 Department of Electrical Engineering Indian Institute of Technology Dharwad EE 303: Control Systems Practical Assignment - 6 Adapted from Take Home Labs, Oklahoma State University Root Locus Design 1 OBJECTIVE

More information

Robust Pole Placement using Linear Quadratic Regulator Weight Selection Algorithm

Robust Pole Placement using Linear Quadratic Regulator Weight Selection Algorithm 329 Robust Pole Placement using Linear Quadratic Regulator Weight Selection Algorithm Vishwa Nath 1, R. Mitra 2 1,2 Department of Electronics and Communication Engineering, Indian Institute of Technology,

More information

Guidelines for MATLAB s SISO Design Tool GUI

Guidelines for MATLAB s SISO Design Tool GUI Dr. Farzad Pourboghrat Guidelines for MATLAB s SISO Design Tool GUI The SISO Design Tool is a graphical user interface (GUI) that facilitates the design of compensators for single-input, single-output

More information

Design and Evaluation of a Feedback Control EDF Scheduling Algorithm

Design and Evaluation of a Feedback Control EDF Scheduling Algorithm Clint Moulds cmould1@gl.umbc.edu Design and Evaluation of a Feedback Control EDF Scheduling Algorithm by Lu, Stankovic, Tao, and Son A summary presentation CMSC 691S Younis Spring 2005 Table of Section

More information

Lecture 5: Performance Analysis I

Lecture 5: Performance Analysis I CS 6323 : Modeling and Inference Lecture 5: Performance Analysis I Prof. Gregory Provan Department of Computer Science University College Cork Slides: Based on M. Yin (Performability Analysis) Overview

More information

Design, Implementation and Evaluation of Differentiated Caching Services

Design, Implementation and Evaluation of Differentiated Caching Services Design, Implementation and Evaluation of Differentiated Caching Services Ying Lu, Tarek F. Abdelzaher and Avneesh Saxena Department of Computer Science University of Virginia ying,zaher,avneesh @cs.virginia.edu

More information

Analysis and Design of Controllers for AQM Routers Supporting TCP Flows. C. V. Hollot, V. Misra, D. Towsley and W. Gong

Analysis and Design of Controllers for AQM Routers Supporting TCP Flows. C. V. Hollot, V. Misra, D. Towsley and W. Gong A Study Group Presentation Analysis and esign of Controllers for AQM outers Supporting TCP Flows C. V. Hollot, V. Misra,. Towsley and W. Gong Presented by: Tan Chee-Wei Advisors: Professor Winston Chiu,

More information

Queueing Model Based Network Server Performance Control

Queueing Model Based Network Server Performance Control Queueing Model Based Network Server Performance Control Lui Sha and Xue Liu, UIUC lrs, xueliu@cs.uiuc.edu Abstract Controlling the timing performance of a network server is a challenging problem. This

More information

Queueing Model Based Network Server Performance Control

Queueing Model Based Network Server Performance Control Queueing Model Based Network Server Performance Control Lui Sha and Xue Liu, UIUC lrs, xueliu@cs.uiuc.edu Abstract Controlling the timing performance of a network server is a challenging problem. This

More information

Lecture 24: Scheduling and QoS

Lecture 24: Scheduling and QoS Lecture 24: Scheduling and QoS CSE 123: Computer Networks Alex C. Snoeren HW 4 due Wednesday Lecture 24 Overview Scheduling (Weighted) Fair Queuing Quality of Service basics Integrated Services Differentiated

More information

METE: Meeting End-to-End QoS in Multicores through System-Wide Resource Management

METE: Meeting End-to-End QoS in Multicores through System-Wide Resource Management METE: Meeting End-to-End QoS in Multicores through System-Wide Resource Management Akbar Sharifi, Shekhar Srikantaiah, Asit K. Mishra, Mahmut Kandemir and Chita R. Das Department of CSE The Pennsylvania

More information

IN the past decade, we have seen an increasing demand for

IN the past decade, we have seen an increasing demand for 964 IEEE TRANSACTIONS ON COMPUTERS, VOL. 54, NO. 8, AUGUST 2005 Robust Processing Rate Allocation for Proportional Slowdown Differentiation on Internet Servers Jianbin Wei, Student Member, IEEE, Xiaobo

More information

Developing a MATLAB-Based Control System Design and Analysis Tool for Enhanced Learning Environment in Control System Education

Developing a MATLAB-Based Control System Design and Analysis Tool for Enhanced Learning Environment in Control System Education Developing a MATLAB-Based Control System Design and Analysis Tool for Enhanced Learning Environment in Control System Education Frank S. Cheng and Lin Zhao Industrial and Engineering Technology Department

More information

Nested QoS: Providing Flexible Performance in Shared IO Environment

Nested QoS: Providing Flexible Performance in Shared IO Environment Nested QoS: Providing Flexible Performance in Shared IO Environment Hui Wang Peter Varman Rice University Houston, TX 1 Outline Introduction System model Analysis Evaluation Conclusions and future work

More information

Improved Prediction for Web Server Delay Control

Improved Prediction for Web Server Delay Control Improved Prediction for Web Server Delay Control Dan Henriksson Department of Automatic Control Lund Institute of Technology Box 118, SE-221 00 Lund, Sweden dan@control.lth.se Ying Lu, Tarek Abdelzaher

More information

IN recent years, power control (also called power capping)

IN recent years, power control (also called power capping) IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, VOL. 22, NO. 2, FEBRUARY 2011 245 Coordinating Power Control and Performance Management for Virtualized Server Clusters Xiaorui Wang, Member, IEEE,

More information

On Network Dimensioning Approach for the Internet

On Network Dimensioning Approach for the Internet On Dimensioning Approach for the Internet Masayuki Murata ed Environment Division Cybermedia Center, (also, Graduate School of Engineering Science, ) e-mail: murata@ics.es.osaka-u.ac.jp http://www-ana.ics.es.osaka-u.ac.jp/

More information

Adapting Mixed Workloads to Meet SLOs in Autonomic DBMSs

Adapting Mixed Workloads to Meet SLOs in Autonomic DBMSs Adapting Mixed Workloads to Meet SLOs in Autonomic DBMSs Baoning Niu, Patrick Martin, Wendy Powley School of Computing, Queen s University Kingston, Ontario, Canada, K7L 3N6 {niu martin wendy}@cs.queensu.ca

More information

Impact of Upper Layer Adaptation on End-to-end Delay Management in Wireless Ad Hoc Networks

Impact of Upper Layer Adaptation on End-to-end Delay Management in Wireless Ad Hoc Networks Impact of Upper Layer Adaptation on End-to-end Delay Management in Wireless Ad Hoc Networks Wenbo He Klara Nahrstedt Department of Computer Science University of Illinois at Urbana-Champaign Siebel Center,

More information

E105: RLTOOL Tutorial

E105: RLTOOL Tutorial E105: RLTOOL Tutorial Andrew C. Smith 7/30/2007 Thanks to Sean Augenstein for his tutorial. 1. Introduction What is RLTOOL? RLTOOL is a tool in MATLAB, that provides a GUI for performing Root Locus analysis

More information

CHAPTER 6 SOLUTION TO NETWORK TRAFFIC PROBLEM IN MIGRATING PARALLEL CRAWLERS USING FUZZY LOGIC

CHAPTER 6 SOLUTION TO NETWORK TRAFFIC PROBLEM IN MIGRATING PARALLEL CRAWLERS USING FUZZY LOGIC CHAPTER 6 SOLUTION TO NETWORK TRAFFIC PROBLEM IN MIGRATING PARALLEL CRAWLERS USING FUZZY LOGIC 6.1 Introduction The properties of the Internet that make web crawling challenging are its large amount of

More information

Real-Time & Feedback Control. Moris Behnam

Real-Time & Feedback Control. Moris Behnam Real-Time & Feedback Control Moris Behnam Outline Introduction Feedback control Real-time and control systems Using control theories in real-time scheduling Introduction Control systems constitute an important

More information

TCP performance analysis through. processor sharing modeling

TCP performance analysis through. processor sharing modeling TCP performance analysis through processor sharing modeling Pasi Lassila a,b, Hans van den Berg a,c, Michel Mandjes a,d, and Rob Kooij c a Faculty of Mathematical Sciences, University of Twente b Networking

More information

Lecture 22: Buffering & Scheduling. CSE 123: Computer Networks Alex C. Snoeren

Lecture 22: Buffering & Scheduling. CSE 123: Computer Networks Alex C. Snoeren Lecture 22: Buffering & Scheduling CSE 123: Computer Networks Alex C. Snoeren Lecture 23 Overview Buffer Management FIFO RED Traffic Policing/Scheduling 2 Key Router Challenges Buffer management: which

More information

Root Locus Controller Design

Root Locus Controller Design Islamic University of Gaza Faculty of Engineering Electrical Engineering department Control Systems Design Lab Eng. Mohammed S. Jouda Eng. Ola M. Skeik Experiment 4 Root Locus Controller Design Overview

More information

Integrating Proactive and Reactive Approaches for Robust Real-Time Data Services

Integrating Proactive and Reactive Approaches for Robust Real-Time Data Services Integrating Proactive and Reactive Approaches for Robust Real-Time Data Services Yan Zhou and Kyoung-Don Kang Department of Computer Science State University of New York at Binghamton {yzhou,kang}@cs.binghamton.edu

More information

Kernel Korner. Analysis of the HTB Queuing Discipline. Yaron Benita. Abstract

Kernel Korner. Analysis of the HTB Queuing Discipline. Yaron Benita. Abstract 1 of 9 6/18/2006 7:41 PM Kernel Korner Analysis of the HTB Queuing Discipline Yaron Benita Abstract Can Linux do Quality of Service in a way that both offers high throughput and does not exceed the defined

More information

Decentralized Utilization Control in Distributed Real-Time Systems

Decentralized Utilization Control in Distributed Real-Time Systems Decentralized Utilization Control in Distributed Real-Time Systems Xiaorui Wang, Dong Jia, Chenyang Lu, Xenofon Koutsoukos Department of Computer Science and Engineering, Washington University in St. Louis,

More information

Lecture Topics. Announcements. Today: Uniprocessor Scheduling (Stallings, chapter ) Next: Advanced Scheduling (Stallings, chapter

Lecture Topics. Announcements. Today: Uniprocessor Scheduling (Stallings, chapter ) Next: Advanced Scheduling (Stallings, chapter Lecture Topics Today: Uniprocessor Scheduling (Stallings, chapter 9.1-9.3) Next: Advanced Scheduling (Stallings, chapter 10.1-10.4) 1 Announcements Self-Study Exercise #10 Project #8 (due 11/16) Project

More information

Neuro-Dynamic Programming An Overview

Neuro-Dynamic Programming An Overview 1 Neuro-Dynamic Programming An Overview Dimitri Bertsekas Dept. of Electrical Engineering and Computer Science M.I.T. May 2006 2 BELLMAN AND THE DUAL CURSES Dynamic Programming (DP) is very broadly applicable,

More information

Overview Computer Networking What is QoS? Queuing discipline and scheduling. Traffic Enforcement. Integrated services

Overview Computer Networking What is QoS? Queuing discipline and scheduling. Traffic Enforcement. Integrated services Overview 15-441 15-441 Computer Networking 15-641 Lecture 19 Queue Management and Quality of Service Peter Steenkiste Fall 2016 www.cs.cmu.edu/~prs/15-441-f16 What is QoS? Queuing discipline and scheduling

More information

Time-Step Network Simulation

Time-Step Network Simulation Time-Step Network Simulation Andrzej Kochut Udaya Shankar University of Maryland, College Park Introduction Goal: Fast accurate performance evaluation tool for computer networks Handles general control

More information

Lecture 14: Performance Architecture

Lecture 14: Performance Architecture Lecture 14: Performance Architecture Prof. Shervin Shirmohammadi SITE, University of Ottawa Prof. Shervin Shirmohammadi CEG 4185 14-1 Background Performance: levels for capacity, delay, and RMA. Performance

More information

CAMRIT: Control-based Adaptive Middleware for Real-time Image Transmission

CAMRIT: Control-based Adaptive Middleware for Real-time Image Transmission CAMRIT: Control-based Adaptive Middleware for Real-time Transmission Xiaorui Wang, Huang-Ming Huang, Venkita Subramonian, Chenyang Lu, Christopher Gill Department of Computer Science and Engineering Washington

More information

Appendix A. Methodology

Appendix A. Methodology 193 Appendix A Methodology In this appendix, I present additional details of the evaluation of Sync-TCP described in Chapter 4. In Section A.1, I discuss decisions made in the design of the network configuration.

More information

International Journal of Advance Engineering and Research Development. Flow Control Loop Analysis for System Modeling & Identification

International Journal of Advance Engineering and Research Development. Flow Control Loop Analysis for System Modeling & Identification Scientific Journal of Impact Factor(SJIF): 3.134 e-issn(o): 2348-4470 p-issn(p): 2348-6406 International Journal of Advance Engineering and Research Development Volume 2,Issue 5, May -2015 Flow Control

More information

Data Mining. 3.5 Lazy Learners (Instance-Based Learners) Fall Instructor: Dr. Masoud Yaghini. Lazy Learners

Data Mining. 3.5 Lazy Learners (Instance-Based Learners) Fall Instructor: Dr. Masoud Yaghini. Lazy Learners Data Mining 3.5 (Instance-Based Learners) Fall 2008 Instructor: Dr. Masoud Yaghini Outline Introduction k-nearest-neighbor Classifiers References Introduction Introduction Lazy vs. eager learning Eager

More information

Performance Assurance in Virtualized Data Centers

Performance Assurance in Virtualized Data Centers Autonomic Provisioning with Self-Adaptive Neural Fuzzy Control for End-to-end Delay Guarantee Palden Lama Xiaobo Zhou Department of Computer Science University of Colorado at Colorado Springs Performance

More information

Networking Quality of service

Networking Quality of service System i Networking Quality of service Version 6 Release 1 System i Networking Quality of service Version 6 Release 1 Note Before using this information and the product it supports, read the information

More information

Adaptive Fuzzy Control for Utilization Management

Adaptive Fuzzy Control for Utilization Management Adaptive Fuzzy Control for Utilization Management Mehmet H. Suzer and Kyoung-Don Kang Department of Computer Science State University of New York at Binghamton {msuzer,kang}@cs.binghamton.edu Abstract

More information

CHAPTER 1 INTRODUCTION

CHAPTER 1 INTRODUCTION 1 CHAPTER 1 INTRODUCTION 1.1 Motivation The presence of uncertainties and disturbances has always been a vital issue in the control of dynamic systems. The classical linear controllers, PI and PID controllers

More information

Cache-Aware Utilization Control for Energy-Efficient Multi-Core Real-Time Systems

Cache-Aware Utilization Control for Energy-Efficient Multi-Core Real-Time Systems Cache-Aware Utilization Control for Energy-Efficient Multi-Core Real-Time Systems Xing Fu, Khairul Kabir, and Xiaorui Wang Dept. of Electrical Engineering and Computer Science, University of Tennessee,

More information

Self-Managing Systems: A Control Theory Foundation

Self-Managing Systems: A Control Theory Foundation Self-Managing Systems: A Control Theory Foundation Yixin Diao, Joseph L. Hellerstein, and Sujay Parekh IBM Thomas J. Watson Research Center Hawthorne, New York, USA {diao, hellers, sujay}@us.ibm.com Rean

More information

PYTHIA: Improving Datacenter Utilization via Precise Contention Prediction for Multiple Co-located Workloads

PYTHIA: Improving Datacenter Utilization via Precise Contention Prediction for Multiple Co-located Workloads PYTHIA: Improving Datacenter Utilization via Precise Contention Prediction for Multiple Co-located Workloads Ran Xu (Purdue), Subrata Mitra (Adobe Research), Jason Rahman (Facebook), Peter Bai (Purdue),

More information

Control System Toolbox

Control System Toolbox The Almighty University of Mohaghegh Ardabili Control System Toolbox The SISO Design Tool 1 Transfer Function TF = 2s + 4 s 2 + 6s + 5 TF = TF = 2(s + 2) (s + 1)(s + 5) 2(s + 2) (s + 1)(s + 5) 0 1 A= 5

More information

CLOSED LOOP SYSTEM IDENTIFICATION USING GENETIC ALGORITHM

CLOSED LOOP SYSTEM IDENTIFICATION USING GENETIC ALGORITHM CLOSED LOOP SYSTEM IDENTIFICATION USING GENETIC ALGORITHM Lucchesi Alejandro (a), Campomar Guillermo (b), Zanini Aníbal (c) (a,b) Facultad Regional San Nicolás Universidad Tecnológica Nacional (FRSN-UTN),

More information

Typical scenario in shared infrastructures

Typical scenario in shared infrastructures Got control? AutoControl: Automated Control of MultipleVirtualized Resources Pradeep Padala, Karen Hou, Xiaoyun Zhu*, Mustfa Uysal, Zhikui Wang, Sharad Singhal, Arif Merchant, Kang G. Shin University of

More information

Basics (cont.) Characteristics of data communication technologies OSI-Model

Basics (cont.) Characteristics of data communication technologies OSI-Model 48 Basics (cont.) Characteristics of data communication technologies OSI-Model Topologies Packet switching / Circuit switching Medium Access Control (MAC) mechanisms Coding Quality of Service (QoS) 49

More information

Lab # 8 Parallel Port Interface with LabView & Root Locus Design

Lab # 8 Parallel Port Interface with LabView & Root Locus Design Islamic University of Gaza Faculty of Engineering Computer Engineering Dep. Feedback Control Systems Lab Eng. Tareq Abu Aisha Lab # 8 Lab # 8 Parallel Port Interface with LabView & Root Locus Design Introduction:

More information

Priority Traffic CSCD 433/533. Advanced Networks Spring Lecture 21 Congestion Control and Queuing Strategies

Priority Traffic CSCD 433/533. Advanced Networks Spring Lecture 21 Congestion Control and Queuing Strategies CSCD 433/533 Priority Traffic Advanced Networks Spring 2016 Lecture 21 Congestion Control and Queuing Strategies 1 Topics Congestion Control and Resource Allocation Flows Types of Mechanisms Evaluation

More information

A Rant on Queues. Van Jacobson. July 26, MIT Lincoln Labs Lexington, MA

A Rant on Queues. Van Jacobson. July 26, MIT Lincoln Labs Lexington, MA A Rant on Queues Van Jacobson July 26, 2006 MIT Lincoln Labs Lexington, MA Unlike the phone system, the Internet supports communication over paths with diverse, time varying, bandwidth. This means we often

More information

An Observation-based Approach Towards Self-managing Web Servers

An Observation-based Approach Towards Self-managing Web Servers An Observation-based Approach Towards Self-managing Web Servers Prashant Pradhan, Renu Tewari, Sambit Sahu Abhishek Chandra, Prashant Shenoy Networking Software and Services Department of Computer Science

More information

What are Embedded Systems? Lecture 1 Introduction to Embedded Systems & Software

What are Embedded Systems? Lecture 1 Introduction to Embedded Systems & Software What are Embedded Systems? 1 Lecture 1 Introduction to Embedded Systems & Software Roopa Rangaswami October 9, 2002 Embedded systems are computer systems that monitor, respond to, or control an external

More information

A Flexible IIR Filtering Implementation for Audio Processing Juergen Schmidt, Technicolor R&I, Hannover

A Flexible IIR Filtering Implementation for Audio Processing Juergen Schmidt, Technicolor R&I, Hannover A Flexible IIR Filtering Implementation for Audio Processing Juergen Schmidt, Technicolor R&I, Hannover Motivation 3D audio 2 Motivation - Loudspeaker Equalization 3 Outline Infinite Impulse Response (IIR)

More information

A Predictive-Reactive Method for Improving the Robustness of Real-Time Data Services

A Predictive-Reactive Method for Improving the Robustness of Real-Time Data Services IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING A Predictive-Reactive Method for Improving the Robustness of Real-Time Data Services Jisu Oh and Kyoung-Don Kang Member, IEEE Abstract Supporting timely

More information

On the Use of Performance Models in Autonomic Computing

On the Use of Performance Models in Autonomic Computing On the Use of Performance Models in Autonomic Computing Daniel A. Menascé Department of Computer Science George Mason University 1 2012. D.A. Menasce. All Rights Reserved. 2 Motivation for AC main obstacle

More information

Adaptive RTP Rate Control Method

Adaptive RTP Rate Control Method 2011 35th IEEE Annual Computer Software and Applications Conference Workshops Adaptive RTP Rate Control Method Uras Tos Department of Computer Engineering Izmir Institute of Technology Izmir, Turkey urastos@iyte.edu.tr

More information

POWER MANAGEMENT IN THE CLUSTER SYSTEM

POWER MANAGEMENT IN THE CLUSTER SYSTEM University of Nebraska - Lincoln DigitalCommons@University of Nebraska - Lincoln Computer Science and Engineering: Theses, Dissertations, and Student Research Computer Science and Engineering, Department

More information

Resource Allocation Strategies for Multiple Job Classes

Resource Allocation Strategies for Multiple Job Classes Resource Allocation Strategies for Multiple Job Classes by Ye Hu A thesis presented to the University of Waterloo in fulfillment of the thesis requirement for the degree of Master of Mathematics in Computer

More information

RECENT years have seen the rapid growth of a new

RECENT years have seen the rapid growth of a new IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, VOL. 19, NO. 6, JUNE 2008 779 Control-Based Adaptive Middleware for Real-Time Image Transmission over Bandwidth-Constrained Networks Xiaorui Wang,

More information

CSE 123b Communications Software

CSE 123b Communications Software CSE 123b Communications Software Spring 2002 Lecture 10: Quality of Service Stefan Savage Today s class: Quality of Service What s wrong with Best Effort service? What kinds of service do applications

More information

Differentiated Services

Differentiated Services Diff-Serv 1 Differentiated Services QoS Problem Diffserv Architecture Per hop behaviors Diff-Serv 2 Problem: QoS Need a mechanism for QoS in the Internet Issues to be resolved: Indication of desired service

More information

QoS-aware resource allocation and load-balancing in enterprise Grids using online simulation

QoS-aware resource allocation and load-balancing in enterprise Grids using online simulation QoS-aware resource allocation and load-balancing in enterprise Grids using online simulation * Universität Karlsruhe (TH) Technical University of Catalonia (UPC) Barcelona Supercomputing Center (BSC) Samuel

More information

Algorithms for Event-Driven Application Brownout

Algorithms for Event-Driven Application Brownout Algorithms for Event-Driven Application Brownout David Desmeurs April 3, 2015 Master s Thesis in Computing Science, 30 credits Supervisor at CS-UmU: Johan Tordsson, Co-Supervisor: Cristian Klein Examiner:

More information

! Network bandwidth shared by all users! Given routing, how to allocate bandwidth. " efficiency " fairness " stability. !

! Network bandwidth shared by all users! Given routing, how to allocate bandwidth.  efficiency  fairness  stability. ! Motivation Network Congestion Control EL 933, Class10 Yong Liu 11/22/2005! Network bandwidth shared by all users! Given routing, how to allocate bandwidth efficiency fairness stability! Challenges distributed/selfish/uncooperative

More information

Control Technology. motion controller and power amplifier

Control Technology. motion controller and power amplifier Control Technology motion controller and power amplifier Erik van Hilten Rik Prins National Instruments Agenda Controller, the central element Tools for controller design in drive systems: - in PC-based

More information

7. Completing a Design: Loop Shaping

7. Completing a Design: Loop Shaping 7. Completing a Design: Loop Shaping Now that we understand how to analyze stability using Nichols plots, recall the design problem from Chapter 5: consider the following feedback system R C U P Y where

More information

Computer Networking. Queue Management and Quality of Service (QOS)

Computer Networking. Queue Management and Quality of Service (QOS) Computer Networking Queue Management and Quality of Service (QOS) Outline Previously:TCP flow control Congestion sources and collapse Congestion control basics - Routers 2 Internet Pipes? How should you

More information

Study Abroad Programme

Study Abroad Programme MODULE SPECIFICATION UNDERGRADUATE PROGRAMMES KEY FACTS Module name Module code School Department or equivalent Networks and Operating Systems IN2011 Mathematics, Computer Science and Engineering Department

More information

Chapter 14 Performance and Processor Design

Chapter 14 Performance and Processor Design Chapter 14 Performance and Processor Design Outline 14.1 Introduction 14.2 Important Trends Affecting Performance Issues 14.3 Why Performance Monitoring and Evaluation are Needed 14.4 Performance Measures

More information

THE demand for real-time data services is increasing in

THE demand for real-time data services is increasing in 1200 IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, VOL. 16, NO. 10, OCTOBER 2004 Managing Deadline Miss Ratio and Sensor Data Freshness in Real-Time Databases Kyoung-Don Kang, Sang H. Son, Senior

More information

Ch. 13: Measuring Performance

Ch. 13: Measuring Performance Ch. 13: Measuring Performance Kenneth Mitchell School of Computing & Engineering, University of Missouri-Kansas City, Kansas City, MO 64110 Kenneth Mitchell, CS & EE dept., SCE, UMKC p. 1/3 Introduction

More information

A Probabilistic Graphical Model-based Approach for Minimizing Energy under Performance Constraints

A Probabilistic Graphical Model-based Approach for Minimizing Energy under Performance Constraints A Probabilistic Graphical Model-based Approach for Minimizing Energy under Performance Constraints Nikita Mishra, Huazhe Zhang, John Lafferty and Hank Hoffmann University of Chicago Fraction of time CPU

More information

Introduction to Computational Mathematics

Introduction to Computational Mathematics Introduction to Computational Mathematics Introduction Computational Mathematics: Concerned with the design, analysis, and implementation of algorithms for the numerical solution of problems that have

More information

REcent real-time systems are required to deal with not

REcent real-time systems are required to deal with not Feedback-Controlled Server for Scheduling Aperiodic Tasks Shinpei Kato and Nobuyuki Yamasaki Abstract This paper proposes a scheduling scheme using feedback control to reduce the response time of aperiodic

More information