CHAPTER 5 MAINTENANCE OPTIMIZATION OF WATER DISTRIBUTION SYSTEM: SIMULATED ANNEALING APPROACH

Size: px
Start display at page:

Download "CHAPTER 5 MAINTENANCE OPTIMIZATION OF WATER DISTRIBUTION SYSTEM: SIMULATED ANNEALING APPROACH"

Transcription

1 79 CHAPTER 5 MAINTENANCE OPTIMIZATION OF WATER DISTRIBUTION SYSTEM: SIMULATED ANNEALING APPROACH 5.1 INTRODUCTION Water distribution systems are complex interconnected networks that require extensive planning and maintenance to ensure that the drinking water is delivered to the consumers. Lack of adequate water supply in urban areas is due to aging water distribution systems and inadequate maintenance of this critical infrastructure (Bhave 2003). The reliability of such deteriorating systems is continually decreasing and therefore good maintenance planning is required to improve the reliability of these aging water distribution systems. The various maintenance activities of pipe network that are buried underground involve cost. Hence it is necessary to consider maintenance of existing water distribution systems as economically as possible. Maintenance optimization problem of existing water distribution systems considering various maintenance alternatives such as different scheduled maintenance time periods, employing different maintenance actions such as replacing or rehabilitating a pipe, cleaning and leaving the pipe or cleaning and lining with cement mortar, replacing the pipe with different pipe materials as well as with different pipe diameters has received less attention in the literature than it deserves. The problem of determining the near-optimal

2 80 maintenance strategy to minimize the total discounted maintenance cost is computationally hard. The stochastic search methods such as Simulated Annealing, Tabu Search, and Genetic Algorithms have created an immense interest among researchers to solve this type of combinatorial optimization problems. Simulated Annealing (SA) is a randomized local search method that has been used to derive near-optimal solutions for computationally complex optimization problems (Johnson et al 1991) Applications of SA algorithm to solve optimization problems in the area of telecommunication network design (Fetterolf and Anandalingam 1992), production scheduling (Palmer 1996), water distribution network design (Cunha and Sousa 1999), and reservoir system operation (Ramesh et al 2002), have been reported in the literature. But the use of Simulated Annealing algorithm for maintenance optimization problem in water supply distribution systems has not received much attention in the literature. In this chapter, the application of Simulated Annealing technique to solve the maintenance optimization problem with large computational complexity, in a real-life water distribution system is presented. The objective is to determine the near-optimal maintenance strategy that maximizes system availability at minimum total discounted maintenance cost over the planning horizon. The Velachery water distribution system considered in the study is described in chapter 3 (Section 3.5). The organization of this chapter is as follows. The need for the application of the stochastic search algorithms for the maintenance optimization problem is presented in Section 5.2. In Section 5.3, a description of Simulated Annealing technique is presented. The implementation of the SA algorithm for the WDS maintenance optimization

3 81 study is detailed in Section 5.4. The results along with discussions are presented in Section 5.5. A summary is given in Section NEED FOR STOCHASTIC SEARCH ALGORITHMS The maintenance optimization problem of WDS under study involves various maintenance actions on the pipes in the water distribution system, in order to maximize the system availability at minimum cost. The various maintenance alternatives considered in the study are: different maintenance time periods 10 years, 15 years, or 20 years; the type of maintenance activity - pipe replacement or pipe rehabilitation; the pipe material used in replacement Cast Iron (CI), Ductile Iron (DI) or Prestressed Concrete (PSC); Cleaning and lining with cement mortar or cleaning and leaving without lining while rehabilitation and the pipe diameter using a pipe with same diameter or with commercially available next higher diameter, while replacing, for one or more of the eleven pipes in the water distribution system. Therefore, the number of possible combinations of maintenance strategies (solutions) for the pipes in the water distribution system is very large. It is not easy to search for the global optimal solution from such a large solution space. It requires a large computational time for local traditional optimization methods to search for quality solutions. Moreover, the cost equations used in the maintenance problem under study are non linear. The literature reveals that the deterministic optimization methods are unable to cope up with the non linear water distribution network problems and that the stochastic optimization algorithms are quite successful in solving such problems, though requiring large number of evaluations (Mohan and Babu 2010). Hence, the use of search algorithms such as Simulated Annealing the tool used to solve combinatorial optimization problems, is inevitable.

4 SIMULATED ANNEALING TECHNIQUE Simulated annealing is a randomized improvement algorithm that has been successfully applied to yield good results for combinatorial intractable problems (Kirkpatrick et al 1983). Simulated Annealing is based on the analogy between the annealing of a solid and the optimisation of a system with many independent variables. Solids are annealed by raising the temperature to a (maximal) value for which the particles randomly arrange in the liquid phase, followed by cooling to force the particles into the lowenergy states of a regular lattice. At high temperatures all possible states can be reached, although low-energy states are occupied with a larger probability; lowering the temperature decreases the number of accessible states and the system finally will be frozen into its ground state, provided that the maximum temperature is high enough and the cooling is sufficiently low. In combinatorial optimization a similar situation occurs; the system may occur in many different configurations. Any configuration has a cost that is given by the value of the cost function for that particular configuration. Similar to the simulation of the annealing of solids, one can statistically model the evolution of the system that has to be optimized into a state that corresponds with the minimum value of the cost function (Aarts and van Laarhoven 1985). 5.4 OPTIMAL MAINTENANCE STRATEGY SA APPROACH WDS Simulation Model to Compute Z The objective function value Z is calculated using simulation of the water distribution system for a period of 25 years, since a twenty five year planning horizon is considered. The assumptions made in the WDS simulation model are given in Section

5 Notations and Terminology Z Objective function value p m Scheduled maintenance time period a m Type of maintenance action (rehabilitation or replacement) m n Pipe material to be used during replacement D Diameter of a pipe r s Rehabilitation action (clean & leave or clean & line) R j T j H j Unscheduled repair cost of pipe j Replacement cost of pipe j Rehabilitation cost of pipe j P Average repair cost of pumping system per hour Q Average repair cost of a junction joint per hour T ie Total WDS ineffective utilization time T ie ' WDS ineffective utilization time due to a repair action on a pipe or pump component T ie " WDS ineffective utilization time due to a rehabilitation or replacement action on a pipe Failure rate of a pipe or a pump component MTTR Mean time to repair of a pipe or a pump component T f Failure time of a pipe or a pump component T c T a Current clock time Time of occurrence of a failure

6 84 E s T r T rc End simulation time Repair time of a pipe or a pump component Repair completion time T sc Scheduled maintenance action completion time NMIE Next most imminent event C Total discounted maintenance cost of WDS The Simulation Logic The flowchart of the WDS simulation model is shown in Figure 5.1. The logic of the WDS simulation model in order to compute the objective function value, Z is briefly described below. Initially, the life characteristics viz., the failure rate and the mean time to repair (MTTR) of the pipes in the network and the pumping components are determined. When a pipe in the water distribution network or a component in the pumping system fails, then repair action is initiated on that pipe/component immediately. The WDS ineffective utilization time is updated after each unscheduled repair action whenever a pipe/component in the system fails, and also after each scheduled replacement/rehabilitation action carried out on a pipe. The failure rate of the pipe or pump component is updated after each unscheduled repair. Simulation is terminated after the simulation clock time reaches twenty five years, as the maintenance planning horizon considered is twenty five years.

7 85 Start Set T c = T ie = 0 Input E s, P and Q Input maintenance strategy: p m, a m, r s, m n and D of all pipes Input R j, T j and H j of all pipes Input and MTTR of all pipes and pump components Determine T f of all pipes and pump components T a = min (T f ) T c = T a Remove T a from the set of failure times, (T f ) Make crew busy; Determine T r Compute T rc p m NMIE Repair completion E s Carry out Scheduled maintenance T c = T sc ; Update T ie " and Calculate total discounted maintenance cost, C T c = T rc Update T ie ' and T ie =T ie ' + T ie " Calculate Availability, A Compute Z Stop Figure 5.1 Flowchart of WDS Simulation Model

8 Setting the Run Length of the WDS Simulation Experiment The run length of the WDS simulation experiment used to compute Z has been varied for a given combination of maintenance actions on the WDS pipes and the results are given in Table 5.1. Table 5.1 Objective Function values for Various Run Lengths Objective function value, Z Replication 1 Replication 2 Replication Run length Replication H o H 1 : No significant difference in objective function value Z due to changes in run length. : Significant difference in objective function value Z due to changes in run length. ANOVA is conducted with the Z values and the ANOVA for run length is given in Table 5.2. Table 5.2 ANOVA for Run Length Source of Sum of Degrees of Mean sum Variation squares freedom of squares F cal Run length Error Total

9 87 Since the value obtained for F cal does not exceed 2.57, the value of F 0.05, with 6 and 21 degrees of freedom, the null hypothesis H o is accepted at the 0.05 level of significance. Therefore the run length of the WDS simulation experiment is fixed at 40. An initial ANOVA conducted with the Z values for less than 40 runs showed that there is a significant difference in the objective function value due to changes in run length Simulated Annealing Methodology Simulated Annealing (SA) is a combinatorial optimization approach that uses the Metropolis algorithm to evaluate the acceptability of alternate strategies and slowly converge to an optimum solution (Kirkpatrick et al 1983). The SA approach is based on ideas from statistical mechanics and motivated by an analogy to the behaviour of physical systems in the presence of heat bath. The non-physicist, however, can view it simply as an enhanced version of the familiar technique of local optimization or iterative improvement, in which an initial solution is repeatedly improved by making small local alterations until no such alteration yields a better solution. Simulated Annealing randomises this procedure in a way that allows for occasional uphill moves (changes that worsen solution), in an attempt to reduce the probability of becoming stuck in a poor but locally optimal solution. Because of its ability to avoid poor local optima, it offers hope of obtaining significantly better results (Johnson et al 1989). The temperature T 0 is a parameter, which acts like an iteration/time counter for the algorithm. The temperature is successively reduced by means of a temperature reduction factor (cooling rate). When the temperature reaches a pre-specified value (called the freezing temperature) the procedure is said to be frozen and is terminated. At every temperature, iterations are carried out (L p is the iteration limit) in the search for better solutions. The strength of the method lies in the fact that inferior solutions are accepted (with

10 88 a certain acceptance probability) with the hope that the procedure can clear local optimal troughs and find a global optimum. The Simulated Annealing algorithm used for the problem of determining the near-optimal maintenance strategy of the water distribution system under study is given below: Notations and Terminology T 0 T f L p Z * Z c P a Initial Temperature Final Temperature Cooling Rate Length of Plateau (i.e. number of iterations at every stage of refinement) The best objective function value Computed objective function value Probability of accepting a bad solution R no Uniform random number from [0,1] SA Algorithm Initialization Determine T 0, T f,, L p. Generate randomly an initial solution S. Call WDS simulation model and compute Z c. Z * Z c Phase transformation Do the following L p times: Pick a random neighbor S 1 from S. Call WDS simulation model and compute Z c. If (Z c Z * ) then {

11 Z * Z c S * S 1 89 else Z * Z c S * S 1 } { determine P a = / 0 e m T where m = Z c Z * ; and generate a random number R no U[0,1]. then if (R no P a ) { else } leave Z c as bad solution } Reducing T 0 T 0 x T 0 Stopping Criterion If (T 0 T f ) then goto Phase transformation else report Z * and the corresponding best solution S *. S * gives the best maintenance strategy yielded by SA algorithm.

12 SA Parameter Setting using Orthogonal Experiments Simulated Annealing (SA) parameters, namely the initial temperature T 0, final temperature T f, cooling rate and the length of plateau L p play a vital role in finding the solution to the given problem. Orthogonal experiments are used to determine suitable values for these SA parameters. Initially these parameters viz., T 0, T f, and L p are assigned the values 200, 5, 0.80 and 60 respectively. These values are assumed to be the mid-values to be considered in the 3-level orthogonal experiments. A set of values for each parameter with a certain percentage deviation from the mid-values is then considered. Based on the observations made on the quality of solutions obtained with this set of values during the pilot runs conducted on the SA, a lower limit and upper limit values for each parameter are selected. The SA parameters and the levels considered in the study are given in Table 5.3. Table 5.3 Simulated Annealing Parameters and Level Settings SA parameter Level 1 Level 2 Level 3 Initial temperature T 0 (A) Final temperature T f (B) Cooling rate (C) Length of plateau L p (D) The L Orthogonal Array (OA) is used in the study (Ross 2005). 9 The experiment settings and the objective function value, Z obtained from the orthogonal experiments for a given maintenance strategy, are shown in Table 5.4.

13 91 Table 5.4 SA-Orthogonal Experiment Settings and Objective Function values Parameter settings Objective function value, Z Sl. No A B C D Replication 1 Replication H 0 : No significant difference in the objective function value Z due to changes in SA parameter values. H 1 : Significant difference in the objective function value Z due to changes in SA parameter values. The ANOVA of L 9 OA for SA parameters is given in Table 5.5. Table 5.5 ANOVA of L 9 OA for SA Parameters Source Sum of squares Degrees of freedom Mean sum of squares F cal F table at =0.05, 1 =2 and 2 =9 A B C D Error Total

14 92 Based on the ANOVA of the orthogonal experiments conducted with the objective function values, the following values are fixed for the SA parameters. Initial temperature, T 0 = 100 Final temperature, T f = 10 Cooling rate, = 0.70 Length of plateau, L p = Neighborhood Structure In order to implement Simulated Annealing, it is necessary to define the neighborhood structure for the specific problem under consideration. The neighborhood structure has a significant effect on the efficiency of the search and the quality of solutions produced. The generation procedure of this neighborhood structure considered in this water distribution maintenance optimization study is described below. The maintenance alternative for each pipe in the water distribution network viz., the maintenance time period, type of maintenance action, the pipe material and the pipe diameter, is represented using a four digit code respectively. The first digit with a value 1 or 2 or 3 represents maintenance time period of 10 years or 15 years or 20 years respectively. The second digit with a value 1 or 2 represents pipe rehabilitation or pipe replacement respectively. When the second digit assumed the value 1, then the third digit with a value 1 or 2 would represent cleaning and lining with cement mortar or cleaning and leaving respectively. If the second digit assumed the value 2, then the third digit with a value 1 or 2 or 3 would represent, using a Cast Iron pipe or a DI pipe or a PSC pipe respectively. And the fourth digit with a value 1 or 2 indicates replacing the pipe with the same diameter or replacing with

15 93 the next higher commercially available diameter. Hence a 44 digit code is used to represent maintenance alternative on each of the eleven pipes in the water distribution system. An example of a code representing a solution is illustrated below The description detail of the above solution code is given in Table 5.6. Table 5.6 Description of Solution Code Pipe ID P 1 P 2 P 3 P 4 P 5 P 6 P 7 P 8 P 9 P 10 P 11 Maintenance period (yrs) Maintenance action H R R R H H H H R H R Maintenance effort CLe CI CI DI CLi CLi CLe CLi PSC CLe PSC Pipe diameter SD SD SD ND SD SD SD SD SD SD ND (R- replace, H- rehabilitate, SD- same diameter, and ND- next higher available diameter, CI-use cast iron pipe, PSC-use PSC pipe, DI-use DI pipe, CLe-Clean and leave, CLi-Clean and line with cement mortar) Neighborhood Generation Procedure The perturbation on a given solution is performed by generating a random number for each of the four digits representing the maintenance alternative on a pipe. Hence, totally 44 random numbers are considered in order to generate several maintenance strategies for the eleven pipes in the water distribution network. This procedure is described below: For j = 1 to 11 do the following: /To fix the maintenance time period Generate a random number R no U[0,1] If R no < then

16 94 else S(i) 1 If R no < then else /To fix the maintenance action S(i) 2 S(i) 3 Generate a random number R no U[0,1] If R no <0.50 then else S(i+1) 1 S(i+1) 2 /To fix the maintenance effort If S(i+1) = 1 then { Generate a random number R no U[0,1] If R no < 0.50 then else } S(i+2) 1 S(i+3) 1 S(i+2) 2 S(i+3) 1 If S(i+1) = 2 then { Generate a random number R no U[0,1] If R no < then else S(i+2) 1

17 95 If R no < then else S(i+2) 2 S(i+2) 3 /To decide diameter Generate a random number R no U[0,1] ` } Next j If R no < 0.50 then S(i+3) 1 else S(i+3) RESULTS AND DISCUSSIONS In this Chapter, the application of Simulated Annealing algorithm to determine the near-optimal maintenance strategy with the objective of minimizing the total discounted maintenance cost over the specified planning horizon and maximizing system availability in a real-life water distribution system is addressed. The measure of performance considered in the study is the total discounted maintenance cost of WDS over the planning horizon subject to satisfying the target availability. The Simulated Annealing algorithm is proposed to solve this combinatorial maintenance optimization problem. The optimal SA parameter values are obtained from the Taguchi orthogonal experiments. The SA algorithm and the Monte Carlo simulation procedure to compute the objective function value Z are coded in C++ and executed on a personal computer with Pentium GHz processor and 760 MB RAM. The convergence graph of the SA algorithm is shown in Figure 5.2. It is found from Figure 5.2 that the near-optimal solution is obtained at 177 th

18 96 iteration and there is no improvement in the quality of the solution after this iteration number. From Figures 5.2, it is observed that the SA heuristic (under the perturbation scheme used in the study) has successfully searched for solutions to the maintenance optimization problem Z Iteration Number Figure 5.2 Convergence Graph SA Algorithm The results of Simulated Annealing algorithm are shown in Table 5.7. Table 5.7 Simulated Annealing Algorithm Results Search Algorithm Simulated Annealing Total Cost, Z * (Rs. X10 6 ) Maximum Availability achieved Ineffective utilization time per year (days) Iteration Number CPU Time (seconds) It is found from Table 5.7 that the maximum availability is achieved with the minimum total discounted cost (Rs x 10 6 ) when the maintenance strategy proposed by the SA algorithm is adopted. The total

19 97 ineffective utilization time of WDS when the maintenance strategy proposed by Simulated Annealing algorithm is implemented is 25.5 days. The proposed maintenance strategy (yielded by SA algorithm) to be implemented on the water distribution system in order to minimize the total discounted WDS maintenance cost over the planning horizon is shown in Table 5.8. Table 5.8 Proposed WDS Maintenance Strategy (SA Algorithm) Pipe ID Maintenance period (years) Maintenance action Pipe material/ Rehabilitation strategy Pipe diameter (mm) P 1 15 Rehabilitation CLe 200 P 2 10 Replacement DI 100 P 3 10 Rehabilitation CLe 80 P 4 10 Rehabilitation CLi 100 P 5 10 Rehabilitation CLe 80 P 6 20 Rehabilitation CLe 125 P 7 15 Rehabilitation CLi 100 P 8 10 Replacement PSC 100 P 9 20 Replacement CI 100 P Rehabilitation CLi 125 P Replacement CI 80 The water management expert can make an appropriate decision to adopt the maintenance strategy depending on the maintenance budgetconstraint and the availability of resources needed to carry out maintenance. The results obtained in the study provide insights into the working of the Simulated Annealing search technique and its application to water distribution system maintenance problems.

20 SUMMARY Despite a lot of earlier work in the field of water distribution system design optimization, there is scarcity of techniques to tackle maintenance optimization problems of urban water distribution system. The evaluation of large number of maintenance strategies to arrive at a nearoptimal maintenance strategy for maximum water distribution system performance is a complex combinatorial optimization problem. The Stochastic search technique, Simulated Annealing, is effective in tackling such problems which are computationally hard. In this chapter, the application of Simulated Annealing technique to evaluate various maintenance strategies, and thereby to assist the management select the best maintenance strategy which maximizes the water distribution system infrastructure availability at least cost is demonstrated. The total discounted maintenance cost of the water distribution system over the planning horizon is considered as the measure of performance. Monte Carlo simulation technique is employed taking into account the failure characteristics of pipe network and the pumping components. A Simulated Annealing algorithm is implemented on the maintenance optimization problem for a real-life urban water distribution system. Results obtained from this application suggest that Simulated Annealing can be used for obtaining near-optimal solutions for water distribution system maintenance problems that are computationally intractable.

Simulated Annealing. Slides based on lecture by Van Larhoven

Simulated Annealing. Slides based on lecture by Van Larhoven Simulated Annealing Slides based on lecture by Van Larhoven Iterative Improvement 1 General method to solve combinatorial optimization problems Principle: Start with initial configuration Repeatedly search

More information

Algorithm Design (4) Metaheuristics

Algorithm Design (4) Metaheuristics Algorithm Design (4) Metaheuristics Takashi Chikayama School of Engineering The University of Tokyo Formalization of Constraint Optimization Minimize (or maximize) the objective function f(x 0,, x n )

More information

Non-deterministic Search techniques. Emma Hart

Non-deterministic Search techniques. Emma Hart Non-deterministic Search techniques Emma Hart Why do local search? Many real problems are too hard to solve with exact (deterministic) techniques Modern, non-deterministic techniques offer ways of getting

More information

Note: In physical process (e.g., annealing of metals), perfect ground states are achieved by very slow lowering of temperature.

Note: In physical process (e.g., annealing of metals), perfect ground states are achieved by very slow lowering of temperature. Simulated Annealing Key idea: Vary temperature parameter, i.e., probability of accepting worsening moves, in Probabilistic Iterative Improvement according to annealing schedule (aka cooling schedule).

More information

Simple mechanisms for escaping from local optima:

Simple mechanisms for escaping from local optima: The methods we have seen so far are iterative improvement methods, that is, they get stuck in local optima. Simple mechanisms for escaping from local optima: I Restart: re-initialise search whenever a

More information

March 19, Heuristics for Optimization. Outline. Problem formulation. Genetic algorithms

March 19, Heuristics for Optimization. Outline. Problem formulation. Genetic algorithms Olga Galinina olga.galinina@tut.fi ELT-53656 Network Analysis and Dimensioning II Department of Electronics and Communications Engineering Tampere University of Technology, Tampere, Finland March 19, 2014

More information

Local Search and Optimization Chapter 4. Mausam (Based on slides of Padhraic Smyth, Stuart Russell, Rao Kambhampati, Raj Rao, Dan Weld )

Local Search and Optimization Chapter 4. Mausam (Based on slides of Padhraic Smyth, Stuart Russell, Rao Kambhampati, Raj Rao, Dan Weld ) Local Search and Optimization Chapter 4 Mausam (Based on slides of Padhraic Smyth, Stuart Russell, Rao Kambhampati, Raj Rao, Dan Weld ) 1 Outline Local search techniques and optimization Hill-climbing

More information

CS 331: Artificial Intelligence Local Search 1. Tough real-world problems

CS 331: Artificial Intelligence Local Search 1. Tough real-world problems CS 331: Artificial Intelligence Local Search 1 1 Tough real-world problems Suppose you had to solve VLSI layout problems (minimize distance between components, unused space, etc.) Or schedule airlines

More information

Local Search and Optimization Chapter 4. Mausam (Based on slides of Padhraic Smyth, Stuart Russell, Rao Kambhampati, Raj Rao, Dan Weld )

Local Search and Optimization Chapter 4. Mausam (Based on slides of Padhraic Smyth, Stuart Russell, Rao Kambhampati, Raj Rao, Dan Weld ) Local Search and Optimization Chapter 4 Mausam (Based on slides of Padhraic Smyth, Stuart Russell, Rao Kambhampati, Raj Rao, Dan Weld ) 1 2 Outline Local search techniques and optimization Hill-climbing

More information

Local Search and Optimization Chapter 4. Mausam (Based on slides of Padhraic Smyth, Stuart Russell, Rao Kambhampati, Raj Rao, Dan Weld )

Local Search and Optimization Chapter 4. Mausam (Based on slides of Padhraic Smyth, Stuart Russell, Rao Kambhampati, Raj Rao, Dan Weld ) Local Search and Optimization Chapter 4 Mausam (Based on slides of Padhraic Smyth, Stuart Russell, Rao Kambhampati, Raj Rao, Dan Weld ) 1 2 Outline Local search techniques and optimization Hill-climbing

More information

Gradient Descent. 1) S! initial state 2) Repeat: Similar to: - hill climbing with h - gradient descent over continuous space

Gradient Descent. 1) S! initial state 2) Repeat: Similar to: - hill climbing with h - gradient descent over continuous space Local Search 1 Local Search Light-memory search method No search tree; only the current state is represented! Only applicable to problems where the path is irrelevant (e.g., 8-queen), unless the path is

More information

Simulated Annealing. G5BAIM: Artificial Intelligence Methods. Graham Kendall. 15 Feb 09 1

Simulated Annealing. G5BAIM: Artificial Intelligence Methods. Graham Kendall. 15 Feb 09 1 G5BAIM: Artificial Intelligence Methods Graham Kendall 15 Feb 09 1 G5BAIM Artificial Intelligence Methods Graham Kendall Simulated Annealing Simulated Annealing Motivated by the physical annealing process

More information

Solving Traveling Salesman Problem Using Parallel Genetic. Algorithm and Simulated Annealing

Solving Traveling Salesman Problem Using Parallel Genetic. Algorithm and Simulated Annealing Solving Traveling Salesman Problem Using Parallel Genetic Algorithm and Simulated Annealing Fan Yang May 18, 2010 Abstract The traveling salesman problem (TSP) is to find a tour of a given number of cities

More information

Artificial Intelligence

Artificial Intelligence Artificial Intelligence Local Search Vibhav Gogate The University of Texas at Dallas Some material courtesy of Luke Zettlemoyer, Dan Klein, Dan Weld, Alex Ihler, Stuart Russell, Mausam Systematic Search:

More information

Term Paper for EE 680 Computer Aided Design of Digital Systems I Timber Wolf Algorithm for Placement. Imran M. Rizvi John Antony K.

Term Paper for EE 680 Computer Aided Design of Digital Systems I Timber Wolf Algorithm for Placement. Imran M. Rizvi John Antony K. Term Paper for EE 680 Computer Aided Design of Digital Systems I Timber Wolf Algorithm for Placement By Imran M. Rizvi John Antony K. Manavalan TimberWolf Algorithm for Placement Abstract: Our goal was

More information

SLS Algorithms. 2.1 Iterative Improvement (revisited)

SLS Algorithms. 2.1 Iterative Improvement (revisited) SLS Algorithms Stochastic local search (SLS) has become a widely accepted approach to solving hard combinatorial optimisation problems. An important characteristic of many recently developed SLS methods

More information

Hardware-Software Codesign

Hardware-Software Codesign Hardware-Software Codesign 4. System Partitioning Lothar Thiele 4-1 System Design specification system synthesis estimation SW-compilation intellectual prop. code instruction set HW-synthesis intellectual

More information

Optimization Techniques for Design Space Exploration

Optimization Techniques for Design Space Exploration 0-0-7 Optimization Techniques for Design Space Exploration Zebo Peng Embedded Systems Laboratory (ESLAB) Linköping University Outline Optimization problems in ERT system design Heuristic techniques Simulated

More information

Evolutionary Computation Algorithms for Cryptanalysis: A Study

Evolutionary Computation Algorithms for Cryptanalysis: A Study Evolutionary Computation Algorithms for Cryptanalysis: A Study Poonam Garg Information Technology and Management Dept. Institute of Management Technology Ghaziabad, India pgarg@imt.edu Abstract The cryptanalysis

More information

Advanced Search Simulated annealing

Advanced Search Simulated annealing Advanced Search Simulated annealing Yingyu Liang yliang@cs.wisc.edu Computer Sciences Department University of Wisconsin, Madison [Based on slides from Jerry Zhu, Andrew Moore http://www.cs.cmu.edu/~awm/tutorials

More information

Origins of Operations Research: World War II

Origins of Operations Research: World War II ESD.83 Historical Roots Assignment METHODOLOGICAL LINKS BETWEEN OPERATIONS RESEARCH AND STOCHASTIC OPTIMIZATION Chaiwoo Lee Jennifer Morris 11/10/2010 Origins of Operations Research: World War II Need

More information

The Automation of the Feature Selection Process. Ronen Meiri & Jacob Zahavi

The Automation of the Feature Selection Process. Ronen Meiri & Jacob Zahavi The Automation of the Feature Selection Process Ronen Meiri & Jacob Zahavi Automated Data Science http://www.kdnuggets.com/2016/03/automated-data-science.html Outline The feature selection problem Objective

More information

n Informally: n How to form solutions n How to traverse the search space n Systematic: guarantee completeness

n Informally: n How to form solutions n How to traverse the search space n Systematic: guarantee completeness Advanced Search Applications: Combinatorial Optimization Scheduling Algorithms: Stochastic Local Search and others Analyses: Phase transitions, structural analysis, statistical models Combinatorial Problems

More information

Random Search Report An objective look at random search performance for 4 problem sets

Random Search Report An objective look at random search performance for 4 problem sets Random Search Report An objective look at random search performance for 4 problem sets Dudon Wai Georgia Institute of Technology CS 7641: Machine Learning Atlanta, GA dwai3@gatech.edu Abstract: This report

More information

Efficiency and Quality of Solution of Parallel Simulated Annealing

Efficiency and Quality of Solution of Parallel Simulated Annealing Proceedings of the 11th WSEAS International Conference on SYSTEMS, Agios Nikolaos, Crete Island, Greece, July 23-2, 27 177 Efficiency and Quality of Solution of Parallel Simulated Annealing PLAMENKA BOROVSKA,

More information

OPTIMISATION OF PIN FIN HEAT SINK USING TAGUCHI METHOD

OPTIMISATION OF PIN FIN HEAT SINK USING TAGUCHI METHOD CHAPTER - 5 OPTIMISATION OF PIN FIN HEAT SINK USING TAGUCHI METHOD The ever-increasing demand to lower the production costs due to increased competition has prompted engineers to look for rigorous methods

More information

CHAPTER 6 ORTHOGONAL PARTICLE SWARM OPTIMIZATION

CHAPTER 6 ORTHOGONAL PARTICLE SWARM OPTIMIZATION 131 CHAPTER 6 ORTHOGONAL PARTICLE SWARM OPTIMIZATION 6.1 INTRODUCTION The Orthogonal arrays are helpful in guiding the heuristic algorithms to obtain a good solution when applied to NP-hard problems. This

More information

Parallel Simulated Annealing for VLSI Cell Placement Problem

Parallel Simulated Annealing for VLSI Cell Placement Problem Parallel Simulated Annealing for VLSI Cell Placement Problem Atanu Roy Karthik Ganesan Pillai Department Computer Science Montana State University Bozeman {atanu.roy, k.ganeshanpillai}@cs.montana.edu VLSI

More information

COMPARATIVE STUDY OF CIRCUIT PARTITIONING ALGORITHMS

COMPARATIVE STUDY OF CIRCUIT PARTITIONING ALGORITHMS COMPARATIVE STUDY OF CIRCUIT PARTITIONING ALGORITHMS Zoltan Baruch 1, Octavian Creţ 2, Kalman Pusztai 3 1 PhD, Lecturer, Technical University of Cluj-Napoca, Romania 2 Assistant, Technical University of

More information

An evolutionary annealing-simplex algorithm for global optimisation of water resource systems

An evolutionary annealing-simplex algorithm for global optimisation of water resource systems FIFTH INTERNATIONAL CONFERENCE ON HYDROINFORMATICS 1-5 July 2002, Cardiff, UK C05 - Evolutionary algorithms in hydroinformatics An evolutionary annealing-simplex algorithm for global optimisation of water

More information

International Journal of Current Research and Modern Education (IJCRME) ISSN (Online): & Impact Factor: Special Issue, NCFTCCPS -

International Journal of Current Research and Modern Education (IJCRME) ISSN (Online): & Impact Factor: Special Issue, NCFTCCPS - TO SOLVE ECONOMIC DISPATCH PROBLEM USING SFLA P. Sowmya* & Dr. S. P. Umayal** * PG Scholar, Department Electrical and Electronics Engineering, Muthayammal Engineering College, Rasipuram, Tamilnadu ** Dean

More information

Simulated Annealing Algorithm for U- Shaped Line Balancing Problem

Simulated Annealing Algorithm for U- Shaped Line Balancing Problem International Journal of Advanced Research in Science and Technology journal homepage: www.ijarst.com ISSN 2319 1783 (Print) ISSN 2320 1126 (Online) Simulated Annealing Algorithm for U- Shaped Line Balancing

More information

Artificial Intelligence

Artificial Intelligence Artificial Intelligence Informed Search and Exploration Chapter 4 (4.3 4.6) Searching: So Far We ve discussed how to build goal-based and utility-based agents that search to solve problems We ve also presented

More information

Introduction to Design Optimization: Search Methods

Introduction to Design Optimization: Search Methods Introduction to Design Optimization: Search Methods 1-D Optimization The Search We don t know the curve. Given α, we can calculate f(α). By inspecting some points, we try to find the approximated shape

More information

Chapter 14 Global Search Algorithms

Chapter 14 Global Search Algorithms Chapter 14 Global Search Algorithms An Introduction to Optimization Spring, 2015 Wei-Ta Chu 1 Introduction We discuss various search methods that attempts to search throughout the entire feasible set.

More information

CHAPTER 6 MODIFIED FUZZY TECHNIQUES BASED IMAGE SEGMENTATION

CHAPTER 6 MODIFIED FUZZY TECHNIQUES BASED IMAGE SEGMENTATION CHAPTER 6 MODIFIED FUZZY TECHNIQUES BASED IMAGE SEGMENTATION 6.1 INTRODUCTION Fuzzy logic based computational techniques are becoming increasingly important in the medical image analysis arena. The significant

More information

A Randomized Algorithm for Minimizing User Disturbance Due to Changes in Cellular Technology

A Randomized Algorithm for Minimizing User Disturbance Due to Changes in Cellular Technology A Randomized Algorithm for Minimizing User Disturbance Due to Changes in Cellular Technology Carlos A. S. OLIVEIRA CAO Lab, Dept. of ISE, University of Florida Gainesville, FL 32611, USA David PAOLINI

More information

Module 4. Constraint satisfaction problems. Version 2 CSE IIT, Kharagpur

Module 4. Constraint satisfaction problems. Version 2 CSE IIT, Kharagpur Module 4 Constraint satisfaction problems Lesson 10 Constraint satisfaction problems - II 4.5 Variable and Value Ordering A search algorithm for constraint satisfaction requires the order in which variables

More information

x n+1 = x n f(x n) f (x n ), (1)

x n+1 = x n f(x n) f (x n ), (1) 1 Optimization The field of optimization is large and vastly important, with a deep history in computer science (among other places). Generally, an optimization problem is defined by having a score function

More information

A Late Acceptance Hill-Climbing algorithm the winner of the International Optimisation Competition

A Late Acceptance Hill-Climbing algorithm the winner of the International Optimisation Competition The University of Nottingham, Nottingham, United Kingdom A Late Acceptance Hill-Climbing algorithm the winner of the International Optimisation Competition Yuri Bykov 16 February 2012 ASAP group research

More information

Simulated Annealing Overview

Simulated Annealing Overview Simulated Annealing Overview Zak Varty March 2017 Annealing is a technique initially used in metallurgy, the branch of materials science concerned with metals and their alloys. The technique consists of

More information

A SIMULATED ANNEALING ALGORITHM FOR SOME CLASS OF DISCRETE-CONTINUOUS SCHEDULING PROBLEMS. Joanna Józefowska, Marek Mika and Jan Węglarz

A SIMULATED ANNEALING ALGORITHM FOR SOME CLASS OF DISCRETE-CONTINUOUS SCHEDULING PROBLEMS. Joanna Józefowska, Marek Mika and Jan Węglarz A SIMULATED ANNEALING ALGORITHM FOR SOME CLASS OF DISCRETE-CONTINUOUS SCHEDULING PROBLEMS Joanna Józefowska, Marek Mika and Jan Węglarz Poznań University of Technology, Institute of Computing Science,

More information

BEYOND CLASSICAL SEARCH

BEYOND CLASSICAL SEARCH 4 BEYOND CLASSICAL In which we relax the simplifying assumptions of the previous chapter, thereby getting closer to the real world. Chapter 3 addressed a single category of problems: observable, deterministic,

More information

a local optimum is encountered in such a way that further improvement steps become possible.

a local optimum is encountered in such a way that further improvement steps become possible. Dynamic Local Search I Key Idea: Modify the evaluation function whenever a local optimum is encountered in such a way that further improvement steps become possible. I Associate penalty weights (penalties)

More information

INF Biologically inspired computing Lecture 1: Marsland chapter 9.1, Optimization and Search Jim Tørresen

INF Biologically inspired computing Lecture 1: Marsland chapter 9.1, Optimization and Search Jim Tørresen INF3490 - Biologically inspired computing Lecture 1: Marsland chapter 9.1, 9.4-9.6 2017 Optimization and Search Jim Tørresen Optimization and Search 2 Optimization and Search Methods (selection) 1. Exhaustive

More information

APPLICATION OF HEURISTIC SEARCH METHODS TO PHASE VELOCITY INVERSION IN MICROTREMOR ARRAY EXPLORATION

APPLICATION OF HEURISTIC SEARCH METHODS TO PHASE VELOCITY INVERSION IN MICROTREMOR ARRAY EXPLORATION 13 th World Conference on Earthquake Engineering Vancouver, B.C., Canada August 1-6, 2004 Paper No. 1161 APPLICATION OF HEURISTIC SEARCH METHODS TO PHASE VELOCITY INVERSION IN MICROTREMOR ARRAY EXPLORATION

More information

Graph Coloring Algorithms for Assignment Problems in Radio Networks

Graph Coloring Algorithms for Assignment Problems in Radio Networks c 1995 by Lawrence Erlbaum Assoc. Inc. Pub., Hillsdale, NJ 07642 Applications of Neural Networks to Telecommunications 2 pp. 49 56 (1995). ISBN 0-8058-2084-1 Graph Coloring Algorithms for Assignment Problems

More information

Introduction to Artificial Intelligence 2 nd semester 2016/2017. Chapter 4: Beyond Classical Search

Introduction to Artificial Intelligence 2 nd semester 2016/2017. Chapter 4: Beyond Classical Search Introduction to Artificial Intelligence 2 nd semester 2016/2017 Chapter 4: Beyond Classical Search Mohamed B. Abubaker Palestine Technical College Deir El-Balah 1 Outlines local search algorithms and optimization

More information

CHAPTER 4. OPTIMIZATION OF PROCESS PARAMETER OF TURNING Al-SiC p (10P) MMC USING TAGUCHI METHOD (SINGLE OBJECTIVE)

CHAPTER 4. OPTIMIZATION OF PROCESS PARAMETER OF TURNING Al-SiC p (10P) MMC USING TAGUCHI METHOD (SINGLE OBJECTIVE) 55 CHAPTER 4 OPTIMIZATION OF PROCESS PARAMETER OF TURNING Al-SiC p (0P) MMC USING TAGUCHI METHOD (SINGLE OBJECTIVE) 4. INTRODUCTION This chapter presents the Taguchi approach to optimize the process parameters

More information

THE integration of data and voice in an integrated services

THE integration of data and voice in an integrated services 1292 IEEE TRANSACTIONS ON NEURAL NETWORKS, VOL. 9, NO. 6, NOVEMBER 1998 Searching for Optimal Frame Patterns in an Integrated TDMA Communication System Using Mean Field Annealing Gangsheng Wang Nirwan

More information

A Fuzzy Logic Approach to Assembly Line Balancing

A Fuzzy Logic Approach to Assembly Line Balancing Mathware & Soft Computing 12 (2005), 57-74 A Fuzzy Logic Approach to Assembly Line Balancing D.J. Fonseca 1, C.L. Guest 1, M. Elam 1, and C.L. Karr 2 1 Department of Industrial Engineering 2 Department

More information

International Journal of Multidisciplinary Research and Modern Education (IJMRME) ISSN (Online): (

International Journal of Multidisciplinary Research and Modern Education (IJMRME) ISSN (Online): ( OPTIMIZATION OF TURNING PROCESS THROUGH TAGUCHI AND SIMULATED ANNEALING ALGORITHM S. Ganapathy Assistant Professor, Department of Mechanical Engineering, Jayaram College of Engineering and Technology,

More information

Short Note: Some Implementation Aspects of Multiple-Point Simulation

Short Note: Some Implementation Aspects of Multiple-Point Simulation Short Note: Some Implementation Aspects of Multiple-Point Simulation Steven Lyster 1, Clayton V. Deutsch 1, and Julián M. Ortiz 2 1 Department of Civil & Environmental Engineering University of Alberta

More information

A Parallel Simulated Annealing Algorithm for Weapon-Target Assignment Problem

A Parallel Simulated Annealing Algorithm for Weapon-Target Assignment Problem A Parallel Simulated Annealing Algorithm for Weapon-Target Assignment Problem Emrullah SONUC Department of Computer Engineering Karabuk University Karabuk, TURKEY Baha SEN Department of Computer Engineering

More information

Algorithms & Complexity

Algorithms & Complexity Algorithms & Complexity Nicolas Stroppa - nstroppa@computing.dcu.ie CA313@Dublin City University. 2006-2007. November 21, 2006 Classification of Algorithms O(1): Run time is independent of the size of

More information

An objective function to address production sequencing with minimal tooling replacements

An objective function to address production sequencing with minimal tooling replacements International Journal of Production Research, Vol. 44, No. 12, 15 June 2006, 2465 2478 An objective function to address production sequencing with minimal tooling replacements P. R. MCMULLEN* Babcock Graduate

More information

Uninformed Search Methods. Informed Search Methods. Midterm Exam 3/13/18. Thursday, March 15, 7:30 9:30 p.m. room 125 Ag Hall

Uninformed Search Methods. Informed Search Methods. Midterm Exam 3/13/18. Thursday, March 15, 7:30 9:30 p.m. room 125 Ag Hall Midterm Exam Thursday, March 15, 7:30 9:30 p.m. room 125 Ag Hall Covers topics through Decision Trees and Random Forests (does not include constraint satisfaction) Closed book 8.5 x 11 sheet with notes

More information

SIMULATED ANNEALING TECHNIQUES AND OVERVIEW. Daniel Kitchener Young Scholars Program Florida State University Tallahassee, Florida, USA

SIMULATED ANNEALING TECHNIQUES AND OVERVIEW. Daniel Kitchener Young Scholars Program Florida State University Tallahassee, Florida, USA SIMULATED ANNEALING TECHNIQUES AND OVERVIEW Daniel Kitchener Young Scholars Program Florida State University Tallahassee, Florida, USA 1. INTRODUCTION Simulated annealing is a global optimization algorithm

More information

Sparse Matrices Reordering using Evolutionary Algorithms: A Seeded Approach

Sparse Matrices Reordering using Evolutionary Algorithms: A Seeded Approach 1 Sparse Matrices Reordering using Evolutionary Algorithms: A Seeded Approach David Greiner, Gustavo Montero, Gabriel Winter Institute of Intelligent Systems and Numerical Applications in Engineering (IUSIANI)

More information

OPTIMIZING THE TOTAL COMPLETION TIME IN PROCESS PLANNING USING THE RANDOM SIMULATION ALGORITHM

OPTIMIZING THE TOTAL COMPLETION TIME IN PROCESS PLANNING USING THE RANDOM SIMULATION ALGORITHM OPTIMIZING THE TOTAL COMPLETION TIME IN PROCESS PLANNING USING THE RANDOM SIMULATION ALGORITHM Baskar A. and Anthony Xavior M. School of Mechanical and Building Sciences, VIT University, Vellore, India

More information

Lecture 4. Convexity Robust cost functions Optimizing non-convex functions. 3B1B Optimization Michaelmas 2017 A. Zisserman

Lecture 4. Convexity Robust cost functions Optimizing non-convex functions. 3B1B Optimization Michaelmas 2017 A. Zisserman Lecture 4 3B1B Optimization Michaelmas 2017 A. Zisserman Convexity Robust cost functions Optimizing non-convex functions grid search branch and bound simulated annealing evolutionary optimization The Optimization

More information

OPTIMAL DESIGN OF WATER DISTRIBUTION SYSTEMS BY A COMBINATION OF STOCHASTIC ALGORITHMS AND MATHEMATICAL PROGRAMMING

OPTIMAL DESIGN OF WATER DISTRIBUTION SYSTEMS BY A COMBINATION OF STOCHASTIC ALGORITHMS AND MATHEMATICAL PROGRAMMING 2008/4 PAGES 1 7 RECEIVED 18. 5. 2008 ACCEPTED 4. 11. 2008 M. ČISTÝ, Z. BAJTEK OPTIMAL DESIGN OF WATER DISTRIBUTION SYSTEMS BY A COMBINATION OF STOCHASTIC ALGORITHMS AND MATHEMATICAL PROGRAMMING ABSTRACT

More information

k-center Problems Joey Durham Graphs, Combinatorics and Convex Optimization Reading Group Summer 2008

k-center Problems Joey Durham Graphs, Combinatorics and Convex Optimization Reading Group Summer 2008 k-center Problems Joey Durham Graphs, Combinatorics and Convex Optimization Reading Group Summer 2008 Outline General problem definition Several specific examples k-center, k-means, k-mediod Approximation

More information

Machine Learning for Software Engineering

Machine Learning for Software Engineering Machine Learning for Software Engineering Single-State Meta-Heuristics Prof. Dr.-Ing. Norbert Siegmund Intelligent Software Systems 1 2 Recap: Goal is to Find the Optimum Challenges of general optimization

More information

Introduction to Optimization Using Metaheuristics. The Lecturer: Thomas Stidsen. Outline. Name: Thomas Stidsen: Nationality: Danish.

Introduction to Optimization Using Metaheuristics. The Lecturer: Thomas Stidsen. Outline. Name: Thomas Stidsen: Nationality: Danish. The Lecturer: Thomas Stidsen Name: Thomas Stidsen: tks@imm.dtu.dk Outline Nationality: Danish. General course information Languages: Danish and English. Motivation, modelling and solving Education: Ph.D.

More information

Monte Carlo Statics: The Last Frontier

Monte Carlo Statics: The Last Frontier Monte Carlo Statics: The Last Frontier David LeMeur* CGG Canada, Calgary, Alberta, Canada dlemeur@cgg.com and Sophie Merrer CGG Canada, Calgary, Alberta, Canada Abstract Summary Most surface-consistent

More information

Operations Research and Optimization: A Primer

Operations Research and Optimization: A Primer Operations Research and Optimization: A Primer Ron Rardin, PhD NSF Program Director, Operations Research and Service Enterprise Engineering also Professor of Industrial Engineering, Purdue University Introduction

More information

Kapitel 5: Local Search

Kapitel 5: Local Search Inhalt: Kapitel 5: Local Search Gradient Descent (Hill Climbing) Metropolis Algorithm and Simulated Annealing Local Search in Hopfield Neural Networks Local Search for Max-Cut Single-flip neighborhood

More information

Solving the Large Scale Next Release Problem with a Backbone Based Multilevel Algorithm

Solving the Large Scale Next Release Problem with a Backbone Based Multilevel Algorithm IEEE TRANSACTIONS ON JOURNAL NAME, MANUSCRIPT ID 1 Solving the Large Scale Next Release Problem with a Backbone Based Multilevel Algorithm Jifeng Xuan, He Jiang, Member, IEEE, Zhilei Ren, and Zhongxuan

More information

HEURISTIC OPTIMIZATION USING COMPUTER SIMULATION: A STUDY OF STAFFING LEVELS IN A PHARMACEUTICAL MANUFACTURING LABORATORY

HEURISTIC OPTIMIZATION USING COMPUTER SIMULATION: A STUDY OF STAFFING LEVELS IN A PHARMACEUTICAL MANUFACTURING LABORATORY Proceedings of the 1998 Winter Simulation Conference D.J. Medeiros, E.F. Watson, J.S. Carson and M.S. Manivannan, eds. HEURISTIC OPTIMIZATION USING COMPUTER SIMULATION: A STUDY OF STAFFING LEVELS IN A

More information

Optimal Design of Water Distribution Network Using Differential Evolution

Optimal Design of Water Distribution Network Using Differential Evolution Optimal Design of Water Distribution Network Using Differential Evolution R. Uma Assistant Professor, Department of Civil Engineering, P.S.R. Engineering College, Sivakasi (India) Abstract: A water distribution

More information

The Plan: Basic statistics: Random and pseudorandom numbers and their generation: Chapter 16.

The Plan: Basic statistics: Random and pseudorandom numbers and their generation: Chapter 16. Scientific Computing with Case Studies SIAM Press, 29 http://www.cs.umd.edu/users/oleary/sccswebpage Lecture Notes for Unit IV Monte Carlo Computations Dianne P. O Leary c 28 What is a Monte-Carlo method?

More information

Optimization in Brachytherapy. Gary A. Ezzell, Ph.D. Mayo Clinic Scottsdale

Optimization in Brachytherapy. Gary A. Ezzell, Ph.D. Mayo Clinic Scottsdale Optimization in Brachytherapy Gary A. Ezzell, Ph.D. Mayo Clinic Scottsdale Outline General concepts of optimization Classes of optimization techniques Concepts underlying some commonly available methods

More information

Computer Experiments. Designs

Computer Experiments. Designs Computer Experiments Designs Differences between physical and computer Recall experiments 1. The code is deterministic. There is no random error (measurement error). As a result, no replication is needed.

More information

Solving stochastic job shop scheduling problems by a hybrid method

Solving stochastic job shop scheduling problems by a hybrid method Solving stochastic job shop scheduling problems by a hybrid method By Pervaiz Ahmed, Reza Tavakkoli- Moghaddam, Fariborz Jolai & Farzaneh Vaziri Working Paper Series 004 Number WP006/04 ISSN Number 6-689

More information

Ant Colony Optimization

Ant Colony Optimization Ant Colony Optimization CompSci 760 Patricia J Riddle 1 Natural Inspiration The name Ant Colony Optimization was chosen to reflect its original inspiration: the foraging behavior of some ant species. It

More information

A COMPARATIVE STUDY OF HEURISTIC OPTIMIZATION ALGORITHMS

A COMPARATIVE STUDY OF HEURISTIC OPTIMIZATION ALGORITHMS Michigan Technological University Digital Commons @ Michigan Tech Dissertations, Master's Theses and Master's Reports - Open Dissertations, Master's Theses and Master's Reports 2013 A COMPARATIVE STUDY

More information

Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science

Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science 6.685 Electric Machines Class Notes 11: Design Synthesis and Optimization February 11, 2004 c 2003 James

More information

Scientific Computing with Case Studies SIAM Press, Lecture Notes for Unit IV Monte Carlo

Scientific Computing with Case Studies SIAM Press, Lecture Notes for Unit IV Monte Carlo Scientific Computing with Case Studies SIAM Press, 2009 http://www.cs.umd.edu/users/oleary/sccswebpage Lecture Notes for Unit IV Monte Carlo Computations Dianne P. O Leary c 2008 1 What is a Monte-Carlo

More information

Introduction (7.1) Genetic Algorithms (GA) (7.2) Simulated Annealing (SA) (7.3) Random Search (7.4) Downhill Simplex Search (DSS) (7.

Introduction (7.1) Genetic Algorithms (GA) (7.2) Simulated Annealing (SA) (7.3) Random Search (7.4) Downhill Simplex Search (DSS) (7. Chapter 7: Derivative-Free Optimization Introduction (7.1) Genetic Algorithms (GA) (7.2) Simulated Annealing (SA) (7.3) Random Search (7.4) Downhill Simplex Search (DSS) (7.5) Jyh-Shing Roger Jang et al.,

More information

CHAPTER 2 CONVENTIONAL AND NON-CONVENTIONAL TECHNIQUES TO SOLVE ORPD PROBLEM

CHAPTER 2 CONVENTIONAL AND NON-CONVENTIONAL TECHNIQUES TO SOLVE ORPD PROBLEM 20 CHAPTER 2 CONVENTIONAL AND NON-CONVENTIONAL TECHNIQUES TO SOLVE ORPD PROBLEM 2.1 CLASSIFICATION OF CONVENTIONAL TECHNIQUES Classical optimization methods can be classified into two distinct groups:

More information

An Efficient Heuristic Algorithm for Capacitated Lot Sizing Problem with Overtime Decisions

An Efficient Heuristic Algorithm for Capacitated Lot Sizing Problem with Overtime Decisions An Efficient Heuristic Algorithm for Capacitated Lot Sizing Problem with Overtime Decisions Cagatay Iris and Mehmet Mutlu Yenisey Department of Industrial Engineering, Istanbul Technical University, 34367,

More information

Advanced A* Improvements

Advanced A* Improvements Advanced A* Improvements 1 Iterative Deepening A* (IDA*) Idea: Reduce memory requirement of A* by applying cutoff on values of f Consistent heuristic function h Algorithm IDA*: 1. Initialize cutoff to

More information

Numerical Robustness. The implementation of adaptive filtering algorithms on a digital computer, which inevitably operates using finite word-lengths,

Numerical Robustness. The implementation of adaptive filtering algorithms on a digital computer, which inevitably operates using finite word-lengths, 1. Introduction Adaptive filtering techniques are used in a wide range of applications, including echo cancellation, adaptive equalization, adaptive noise cancellation, and adaptive beamforming. These

More information

Ar#ficial)Intelligence!!

Ar#ficial)Intelligence!! Introduc*on! Ar#ficial)Intelligence!! Roman Barták Department of Theoretical Computer Science and Mathematical Logic We know how to use heuristics in search BFS, A*, IDA*, RBFS, SMA* Today: What if the

More information

Hill Climbing. Assume a heuristic value for each assignment of values to all variables. Maintain an assignment of a value to each variable.

Hill Climbing. Assume a heuristic value for each assignment of values to all variables. Maintain an assignment of a value to each variable. Hill Climbing Many search spaces are too big for systematic search. A useful method in practice for some consistency and optimization problems is hill climbing: Assume a heuristic value for each assignment

More information

Single Candidate Methods

Single Candidate Methods Single Candidate Methods In Heuristic Optimization Based on: [3] S. Luke, "Essentials of Metaheuristics," [Online]. Available: http://cs.gmu.edu/~sean/book/metaheuristics/essentials.pdf. [Accessed 11 May

More information

Hybrid Particle Swarm-Based-Simulated Annealing Optimization Techniques

Hybrid Particle Swarm-Based-Simulated Annealing Optimization Techniques Hybrid Particle Swarm-Based-Simulated Annealing Optimization Techniques Nasser Sadati Abstract Particle Swarm Optimization (PSO) algorithms recently invented as intelligent optimizers with several highly

More information

Using Genetic Algorithms to Solve the Box Stacking Problem

Using Genetic Algorithms to Solve the Box Stacking Problem Using Genetic Algorithms to Solve the Box Stacking Problem Jenniffer Estrada, Kris Lee, Ryan Edgar October 7th, 2010 Abstract The box stacking or strip stacking problem is exceedingly difficult to solve

More information

CHAPTER 3 AN OVERVIEW OF DESIGN OF EXPERIMENTS AND RESPONSE SURFACE METHODOLOGY

CHAPTER 3 AN OVERVIEW OF DESIGN OF EXPERIMENTS AND RESPONSE SURFACE METHODOLOGY 23 CHAPTER 3 AN OVERVIEW OF DESIGN OF EXPERIMENTS AND RESPONSE SURFACE METHODOLOGY 3.1 DESIGN OF EXPERIMENTS Design of experiments is a systematic approach for investigation of a system or process. A series

More information

Effective Optimizer Development for Solving Combinatorial Optimization Problems *

Effective Optimizer Development for Solving Combinatorial Optimization Problems * Proceedings of the 11th WSEAS International Conference on SYSTEMS, Agios Nikolaos, Crete Island, Greece, July 23-25, 2007 311 Effective Optimizer Development for Solving Combinatorial Optimization s *

More information

Outline. Best-first search. Greedy best-first search A* search Heuristics Local search algorithms

Outline. Best-first search. Greedy best-first search A* search Heuristics Local search algorithms Outline Best-first search Greedy best-first search A* search Heuristics Local search algorithms Hill-climbing search Beam search Simulated annealing search Genetic algorithms Constraint Satisfaction Problems

More information

Global Optimization Simulated Annealing and Tabu Search. Doron Pearl

Global Optimization Simulated Annealing and Tabu Search. Doron Pearl Global Optimization Simulated Annealing and Tabu Search Doron Pearl 1 A Greedy Approach Iteratively minimize current state, by replacing it by successor state that has lower value. When successor is higher

More information

Design and Analysis of Algorithms

Design and Analysis of Algorithms CSE 101, Winter 2018 Design and Analysis of Algorithms Lecture 17: Coping With Intractability Class URL: http://vlsicad.ucsd.edu/courses/cse101-w18/ Branch-and-Bound (B&B) Variant of backtrack with costs

More information

AI Programming CS S-08 Local Search / Genetic Algorithms

AI Programming CS S-08 Local Search / Genetic Algorithms AI Programming CS662-2013S-08 Local Search / Genetic Algorithms David Galles Department of Computer Science University of San Francisco 08-0: Overview Local Search Hill-Climbing Search Simulated Annealing

More information

Comparison of TSP Algorithms

Comparison of TSP Algorithms Comparison of TSP Algorithms Project for Models in Facilities Planning and Materials Handling December 1998 Participants: Byung-In Kim Jae-Ik Shim Min Zhang Executive Summary Our purpose in this term project

More information

Two approaches. Local Search TSP. Examples of algorithms using local search. Local search heuristics - To do list

Two approaches. Local Search TSP. Examples of algorithms using local search. Local search heuristics - To do list Unless P=NP, there is no polynomial time algorithm for SAT, MAXSAT, MIN NODE COVER, MAX INDEPENDENT SET, MAX CLIQUE, MIN SET COVER, TSP,. But we have to solve (instances of) these problems anyway what

More information

HEURISTICS FOR THE NETWORK DESIGN PROBLEM

HEURISTICS FOR THE NETWORK DESIGN PROBLEM HEURISTICS FOR THE NETWORK DESIGN PROBLEM G. E. Cantarella Dept. of Civil Engineering University of Salerno E-mail: g.cantarella@unisa.it G. Pavone, A. Vitetta Dept. of Computer Science, Mathematics, Electronics

More information

Local Search (Greedy Descent): Maintain an assignment of a value to each variable. Repeat:

Local Search (Greedy Descent): Maintain an assignment of a value to each variable. Repeat: Local Search Local Search (Greedy Descent): Maintain an assignment of a value to each variable. Repeat: Select a variable to change Select a new value for that variable Until a satisfying assignment is

More information

Genetic algorithm based on number of children and height task for multiprocessor task Scheduling

Genetic algorithm based on number of children and height task for multiprocessor task Scheduling Genetic algorithm based on number of children and height task for multiprocessor task Scheduling Marjan Abdeyazdan 1,Vahid Arjmand 2,Amir masoud Rahmani 3, Hamid Raeis ghanavati 4 1 Department of Computer

More information