CS5401 FS2015 Exam 1 Key

Size: px
Start display at page:

Download "CS5401 FS2015 Exam 1 Key"

Transcription

1 CS5401 FS2015 Exam 1 Key This is a closed-book, closed-notes exam. The only items you are allowed to use are writing implements. Mark each sheet of paper you use with your name and the string cs5401fs2015 exam1. If you are caught cheating, you will receive a zero grade for this exam. The max number of points per question is indicated in square brackets after each question. The sum of the max points for all the questions is 60, but note that the max exam score will be capped at 58 (i.e., there are 2 bonus points, but you can t score more than 100%). You have exactly 75 minutes to complete this exam. Keep your answers clear and concise while complete. Good luck! Multiple Choice Questions - write the letter of your choice on your answer paper Alice and Bob have been working on a wonderful assignment about MAXSAT and have each implemented an EA to solve this challenging problem. Each bit in their genotype indicates whether the corresponding boolean variable is true or false. Let s call Alice s EA EA-A and Bob s EA EA-B. Note that l indicates the length of the bit string representing a solution for this problem. They decide to compare their EAs. Following are their configurations, a results plot, and several associated questions. Operators/parameters EA-A EA-B Initialization Uniform random Uniform random Parent selection k-tournament w/ k = 0.5 µ binary-tournament Recombination Uniform crossover 3-point crossover Mutation Bit flip with 0.5 bitwise Bit flip with number of bits flipping, uniform mutation chance randomly selected from [0, 0.5 l] Survival type (µ, λ)-strategy (µ + λ)-strategy Survival selection Fitness proportional Truncation Termination 10K evals 10K evals µ λ Number of runs 30 30

2 The green lines are for EA-A and the red lines are for EA-B. The dotted lines indicate average population fitness averaged over 30 runs. The solid lines indicate best population fitness averaged over 30 runs. The box plots for the final populations indicate variation (the upper whisker is the best of the runs, the lower whisker is the worst of the runs, the bottom of the box is the first quartile and the top of the box is the third quartile). 1. A MAXSAT problem with the neighborhood structure imposed by EA-A is: [2] (a) unimodal with the possibility of a plateau at the global optimum [true, as it s possible for any subset of bits to flip simultaneously, thus making all global optima neighbors of every other point in the search space, including each other, hence the possibility of a plateau] (b) unimodal with exactly two global optima [1] (false, because in general we cannot know how many global optima there are for this problem) (c) multimodal with at least two local optima [ 1 2 ] (false, as this problem with the neighborhood structure imposed by EA-B is unimodal) (d) multimodal with no more than one local optimum [0] (false, both for this problem and in general per the definition of multimodal) 2. Is the genotypic encoding: [2] (a) pleitropic but not polygenetic [1] (false, as it is not pleiotropic; one bit in the genotype corresponds with the truth value of one paired boolean variable in the phenotype) (b) polygenetic but not pleitropic [1] (false, as it is not polygenetic; one bit in the genotype corresponds with the truth value of one paired boolean variable (c) pleitropic and polygenetic [0] (d) none of the above 3. Is the genotype-phenotype decoding function: [2] (a) surjective but not injective [1] (false, because it s injective; the specified genotype is identical to the phenotype, which is the direct representation of the trial solutions) (b) injective but not surjective [1] (false, because it s surjective; the specified genotype is identical to the phenotype, which is the direct representation of the trial solutions) (c) bijective (d) none of the above [0] 4. Is the phenotype to fitness mapping: [2] (a) surjective but not injective [1] (false, because it s not surjective; e.g., the MAXSAT version of an unsatisfiable SAT problem has an unreachable fitness value equal to the number of clauses) (b) injective but not surjective [1] (false, because it s not injective; i.e., there exist MAXSAT instances where multiple unique solutions satisfy an equal number of clauses) (c) bijective [0] (d) none of the above

3 5. Based on this results plot, Alice proclaims EA-A the better configuration for addressing MAXSAT in the future when the number of evals is immaterial and the use case is finding the best solution over all runs; is she, statistically speaking, correct? [2] (a) no, because EA-A has a much higher variation at convergence than EA-B, so its higher average best fitness is not statistically relevant [1] (b) yes, because the first quartile of the average best of EA-A is higher than anything that EA-B found (c) no, because EA-A is non-elitist and is therefore not guaranteed to preserve the best solution found during a run [ 1 2 ] (d) no, because the average population fitness averaged over all runs of EA-A is lower than EA-B. and this measure is more predictive of future performance [ 1 2 ] 6. Which of the following configuration changes has a high chance of improving the performance of EA-A: [2] (a) decrease the bit mutation chance and use a smaller k value for the parent selection k-tournament (b) change k to 0.75 µ [1] (false, because while this does increase selective pressure which is a bit low, it does not address the principal reason which is the far too high mutation rate) (c) decrease λ [0] (false, because λ is already too low for generational survival and it does not address the far too high mutation rate) (d) change the survival selection to random [0] (false, because the high mutation rate coupled with random survival selection has a high chance of loosing the fittest individuals) (e) change the recombination type to 3-point crossover just like EA-B [0] 7. Which of the following configuration changes has a high chance of improving the performance of EA-B: [2] (a) change to bitwise mutation chance and use a bitwise mutation chance of 1/l and change survival selection to a k-tournament without replacement with a k of 5 (b) increase the parent selection tournament k value [0] (EA-B is already suffering from premature convergence so needs lower selective pressure, not higher) (c) decrease population size [0] (EA-B is already suffering from premature convergence so needs more genetic diversity, not less) (d) all of the above [1] 8. Why is MAXSAT a more appropriate fitness function for an EA than SAT? [2] (a) Fitness evaluation for MAXSAT is more efficient [0] (false, because MAXSAT always has to evaluate all clauses where SAT does not always have to do so) (b) All of MAXSAT s local optima will always be global optima [1] (false, local optima may not be fully satisfiable) (c) Unlike SAT, MAXSAT provides a fitness landscape with a gradient, making an informed search more effective (d) Because I can t get no SATisfaction [0] (false, as this is a lame joke with no bearing on the question)

4 9. EA-B runs for the following number of generations: [2] (a) 199 [1] (b) 200 (this rounds up to complete the final generation) [ 1 2 ] (c) 500 [0] (d) ( )/10=9950/10=995 (e) 1000 [1] (f) [0] The following are some general multiple choice questions: 10. A Hamming cliff is: [2] (a) a cliff-like plot associated with a binary encoded fitness function belonging to an NP-Complete problem class [0] (b) A pair of binary strings which differ in many of their bits (i.e., have a large Hamming distance) exhibit a Hamming cliff (c) a population of individuals with binary representation whose genotypes are very similar and who all have a large Hamming distance to the global optimum causing premature convergence [ 1 2 ] (d) all of the above [0] 11. Binary gray code is: [2] (a) a binary coding system where the Hamming distance between consecutive corresponding integers is proportional to their magnitude [1] (b) a binary coding system specifically developed to represent gray scales in digital images [ 1 2 ] (c) a binary coding system with consecutive corresponding integers differing by no more than 2 bits [1 1 2 ] (d) all of the above [0] (e) none of the above 12. One advantage of implementing survivor selection by employing a so-called reverse k-tournament selection to select who dies is that: [2] (a) you guarantee 1-elitism (i.e., the fittest individual is guaranteed to survive) [ 1 2 ] (b) you guarantee (k)-elitism [1] (c) you guarantee (k 1)-elitism (d) the probability of surviving is proportional to your fitness rank [0] 13. In Evolution Strategies with uncorrelated mutation with n step sizes, the conceptual motivation for updating the mutation step sizes with the formula σ i = σ i e τ N(0,1)+τ N i(0,1) is: [2] (a) the sum of two normally distributed variables is also normally distributed [ 1 2 ] (b) the common base mutation e τ N(0,1) allows for an overall change of the mutability, guaranteeing the preservation of all degrees of freedom [1] (c) the coordinate-specific e τ Ni(0,1) provides the flexibility to use different mutation strategies in different directions [1] (d) all of the above

5 14. Rechenberg s 1/5 success rule: [2] (a) refers to the minimum succesful mutation rate threshold necessary for an Evolution Strategy to reach the global optimum [1] (b) refers to the ratio of offspring created by mutations versus recombination in Genetic Programming [0] (c) refers to a rule of thumb for the optimal ratio of successful versus total mutations in Evolution Strategies where mutation step size is increased if the ratio is greater than 1 5 and decreased if the ratio is smaller than 1 5 (d) refers to the minimum ratio of succesful offspring creation versus total offspring creation in order for a parent to survive to the next generation [ 1 2 ] 15. Parameter Control is important in EAs because: [2] (a) optimal strategy parameter values may change during evolution [1] (b) it may somewhat relieve users from parameter tuning as parameter control may make an EA less sensitive to initial strategy parameter values [1] (c) all of the above (d) none of the above [0] 16. Blind Parameter Control is a better name for the class of parameter control mechanisms named Deterministic Parameter Control in the textbook because that class: [2] (a) does not use any feedback from the evolutionary process [1] (b) includes stochastic mechanisms [1] (c) all of the above (d) none of the above [0] 17. If we employ self-adaptation to control the value of penalty coefficients for an EA with an evaluation function which includes a penalty function, then: [2] (a) this cannot be done because it is inherently impossible to self-adapt any part of the evaluation function [0] (b) the penalty coefficients will be self-adapted, but the increase in fitness achieved may not be correlated with better performance on the objective function (c) the penalty coefficients will be self-adapted to cause fitness improvement just like, for instance, mutation step sizes [ 1 2 ] (d) all of the above [ 1 2 ] The following are some regular questions: 18. (a) What is the binary gray code for the standard binary number ? [2] (b) What is the standard binary number encoded by the binary gray code ? [2]

6 19. Given the following two parents with permutation representation: p1 = ( ) p2 = ( ) (a) Compute the first offspring with Cycle Crossover. [4] Cycle 1: 9-7-4, Cycle 2: , Cycle 3: 2-5 Construction of first offspring by scanning parents from left to right, starting at parent 1 and alternating parents: i. Add cycle 1 from parent 1: ii. Add cycle 2 from parent 2: iii. Add cycle 3 from parent 1: (b) Compute the first offspring with PMX, using crossover points between the 2nd and 3rd loci and between the 6th and 7th loci. [5] i ii iii (c) Compute the first offspring with Edge Crossover, except that for each random choice you instead select the lowest element. [10] 1 9,2,3,6 6 5,3,1,4 2 1,4,9,3 7 8+,9,4 Original Edge Table: 3 6,8,2,1 8 3,7+,5 4 2,5,6,7 9 7,1,5,2 Construction Table: Edge Table After Step 1: Edge Table After Step 2: Edge Table After Step 3: Element selected Reason Partial result 1 Lowest 1 2 Equal list size, so lowest ,9 equal shortest list size, so lowest Equal list size, so lowest Shortest list Equal list size, so lowest Equal list size, so lowest Only element Last element ,2,3,6 6 5,3,4 2 4,9,3 7 8+,9,4 3 6,8,2 8 3,7+,5 4 2,5,6,7 9 7,5,2 6 5,3,4 2 4,9,3 7 8+,9,4 3 6,8 8 3,7+,5 4 5,6,7 9 7,5 6 5,4 7 8+,9,4 3 6,8 8 7+,5 4 5,6,7 9 7,5

7 Edge Table After Step 4: Edge Table After Step 5: Edge Table After Step 6: Edge Table After Step 7: 6 5,4 7 8+,9,4 8 7+,5 4 5,7 9 7,5 5 4,8,9 7 8+,9 8 7+,5 4 5,7 9 7,5 5 8,9 5 8,9 7 8+, (d) Compute the first offspring with Order Crossover, using crossover points between the 3rd and 4th loci and between the 7th and 8th loci. [3] i. Child 1: 4563 ii. Child 1:

Mutations for Permutations

Mutations for Permutations Mutations for Permutations Insert mutation: Pick two allele values at random Move the second to follow the first, shifting the rest along to accommodate Note: this preserves most of the order and adjacency

More information

Genetic Algorithms. Chapter 3

Genetic Algorithms. Chapter 3 Chapter 3 1 Contents of this Chapter 2 Introductory example. Representation of individuals: Binary, integer, real-valued, and permutation. Mutation operator. Mutation for binary, integer, real-valued,

More information

Hybridization EVOLUTIONARY COMPUTING. Reasons for Hybridization - 1. Naming. Reasons for Hybridization - 3. Reasons for Hybridization - 2

Hybridization EVOLUTIONARY COMPUTING. Reasons for Hybridization - 1. Naming. Reasons for Hybridization - 3. Reasons for Hybridization - 2 Hybridization EVOLUTIONARY COMPUTING Hybrid Evolutionary Algorithms hybridization of an EA with local search techniques (commonly called memetic algorithms) EA+LS=MA constructive heuristics exact methods

More information

METAHEURISTICS Genetic Algorithm

METAHEURISTICS Genetic Algorithm METAHEURISTICS Genetic Algorithm Jacques A. Ferland Department of Informatique and Recherche Opérationnelle Université de Montréal ferland@iro.umontreal.ca Genetic Algorithm (GA) Population based algorithm

More information

Genetic Algorithms. Kang Zheng Karl Schober

Genetic Algorithms. Kang Zheng Karl Schober Genetic Algorithms Kang Zheng Karl Schober Genetic algorithm What is Genetic algorithm? A genetic algorithm (or GA) is a search technique used in computing to find true or approximate solutions to optimization

More information

Artificial Intelligence Application (Genetic Algorithm)

Artificial Intelligence Application (Genetic Algorithm) Babylon University College of Information Technology Software Department Artificial Intelligence Application (Genetic Algorithm) By Dr. Asaad Sabah Hadi 2014-2015 EVOLUTIONARY ALGORITHM The main idea about

More information

CHAPTER 6 REAL-VALUED GENETIC ALGORITHMS

CHAPTER 6 REAL-VALUED GENETIC ALGORITHMS CHAPTER 6 REAL-VALUED GENETIC ALGORITHMS 6.1 Introduction Gradient-based algorithms have some weaknesses relative to engineering optimization. Specifically, it is difficult to use gradient-based algorithms

More information

Introduction to Optimization

Introduction to Optimization Introduction to Optimization Approximation Algorithms and Heuristics November 6, 2015 École Centrale Paris, Châtenay-Malabry, France Dimo Brockhoff INRIA Lille Nord Europe 2 Exercise: The Knapsack Problem

More information

Introduction to Optimization

Introduction to Optimization Introduction to Optimization Approximation Algorithms and Heuristics November 21, 2016 École Centrale Paris, Châtenay-Malabry, France Dimo Brockhoff Inria Saclay Ile-de-France 2 Exercise: The Knapsack

More information

Computational Intelligence

Computational Intelligence Computational Intelligence Module 6 Evolutionary Computation Ajith Abraham Ph.D. Q What is the most powerful problem solver in the Universe? ΑThe (human) brain that created the wheel, New York, wars and

More information

Introduction to Evolutionary Computation

Introduction to Evolutionary Computation Introduction to Evolutionary Computation The Brought to you by (insert your name) The EvoNet Training Committee Some of the Slides for this lecture were taken from the Found at: www.cs.uh.edu/~ceick/ai/ec.ppt

More information

CS348 FS Solving NP-Complete Light Up Puzzle

CS348 FS Solving NP-Complete Light Up Puzzle CS348 FS2013 - Solving NP-Complete Light Up Puzzle Daniel Tauritz, Ph.D. October 7, 2013 Synopsis The goal of this assignment set is for you to become familiarized with (I) representing problems in mathematically

More information

Geometric Semantic Genetic Programming ~ Theory & Practice ~

Geometric Semantic Genetic Programming ~ Theory & Practice ~ Geometric Semantic Genetic Programming ~ Theory & Practice ~ Alberto Moraglio University of Exeter 25 April 2017 Poznan, Poland 2 Contents Evolutionary Algorithms & Genetic Programming Geometric Genetic

More information

Pseudo-code for typical EA

Pseudo-code for typical EA Extra Slides for lectures 1-3: Introduction to Evolutionary algorithms etc. The things in slides were more or less presented during the lectures, combined by TM from: A.E. Eiben and J.E. Smith, Introduction

More information

Neural Network Weight Selection Using Genetic Algorithms

Neural Network Weight Selection Using Genetic Algorithms Neural Network Weight Selection Using Genetic Algorithms David Montana presented by: Carl Fink, Hongyi Chen, Jack Cheng, Xinglong Li, Bruce Lin, Chongjie Zhang April 12, 2005 1 Neural Networks Neural networks

More information

Escaping Local Optima: Genetic Algorithm

Escaping Local Optima: Genetic Algorithm Artificial Intelligence Escaping Local Optima: Genetic Algorithm Dae-Won Kim School of Computer Science & Engineering Chung-Ang University We re trying to escape local optima To achieve this, we have learned

More information

Outline. CS 6776 Evolutionary Computation. Numerical Optimization. Fitness Function. ,x 2. ) = x 2 1. , x , 5.0 x 1.

Outline. CS 6776 Evolutionary Computation. Numerical Optimization. Fitness Function. ,x 2. ) = x 2 1. , x , 5.0 x 1. Outline CS 6776 Evolutionary Computation January 21, 2014 Problem modeling includes representation design and Fitness Function definition. Fitness function: Unconstrained optimization/modeling Constrained

More information

Information Fusion Dr. B. K. Panigrahi

Information Fusion Dr. B. K. Panigrahi Information Fusion By Dr. B. K. Panigrahi Asst. Professor Department of Electrical Engineering IIT Delhi, New Delhi-110016 01/12/2007 1 Introduction Classification OUTLINE K-fold cross Validation Feature

More information

Advanced Search Genetic algorithm

Advanced Search Genetic algorithm Advanced Search Genetic algorithm Yingyu Liang yliang@cs.wisc.edu Computer Sciences Department University of Wisconsin, Madison [Based on slides from Jerry Zhu, Andrew Moore http://www.cs.cmu.edu/~awm/tutorials

More information

CS5401 FS Solving NP-Complete Light Up Puzzle

CS5401 FS Solving NP-Complete Light Up Puzzle CS5401 FS2018 - Solving NP-Complete Light Up Puzzle Daniel Tauritz, Ph.D. September 3, 2018 Synopsis The goal of this assignment set is for you to become familiarized with (I) representing problems in

More information

Introduction to Genetic Algorithms. Based on Chapter 10 of Marsland Chapter 9 of Mitchell

Introduction to Genetic Algorithms. Based on Chapter 10 of Marsland Chapter 9 of Mitchell Introduction to Genetic Algorithms Based on Chapter 10 of Marsland Chapter 9 of Mitchell Genetic Algorithms - History Pioneered by John Holland in the 1970s Became popular in the late 1980s Based on ideas

More information

Adaptive Elitist-Population Based Genetic Algorithm for Multimodal Function Optimization

Adaptive Elitist-Population Based Genetic Algorithm for Multimodal Function Optimization Adaptive Elitist-Population Based Genetic Algorithm for Multimodal Function ptimization Kwong-Sak Leung and Yong Liang Department of Computer Science & Engineering, The Chinese University of Hong Kong,

More information

Suppose you have a problem You don t know how to solve it What can you do? Can you use a computer to somehow find a solution for you?

Suppose you have a problem You don t know how to solve it What can you do? Can you use a computer to somehow find a solution for you? Gurjit Randhawa Suppose you have a problem You don t know how to solve it What can you do? Can you use a computer to somehow find a solution for you? This would be nice! Can it be done? A blind generate

More information

Heuristic Optimisation

Heuristic Optimisation Heuristic Optimisation Part 10: Genetic Algorithm Basics Sándor Zoltán Németh http://web.mat.bham.ac.uk/s.z.nemeth s.nemeth@bham.ac.uk University of Birmingham S Z Németh (s.nemeth@bham.ac.uk) Heuristic

More information

Preliminary Background Tabu Search Genetic Algorithm

Preliminary Background Tabu Search Genetic Algorithm Preliminary Background Tabu Search Genetic Algorithm Faculty of Information Technology University of Science Vietnam National University of Ho Chi Minh City March 2010 Problem used to illustrate General

More information

Optimizing Flow Shop Sequencing Through Simulation Optimization Using Evolutionary Methods

Optimizing Flow Shop Sequencing Through Simulation Optimization Using Evolutionary Methods Optimizing Flow Shop Sequencing Through Simulation Optimization Using Evolutionary Methods Sucharith Vanguri 1, Travis W. Hill 2, Allen G. Greenwood 1 1 Department of Industrial Engineering 260 McCain

More information

METAHEURISTIC. Jacques A. Ferland Department of Informatique and Recherche Opérationnelle Université de Montréal.

METAHEURISTIC. Jacques A. Ferland Department of Informatique and Recherche Opérationnelle Université de Montréal. METAHEURISTIC Jacques A. Ferland Department of Informatique and Recherche Opérationnelle Université de Montréal ferland@iro.umontreal.ca March 2015 Overview Heuristic Constructive Techniques: Generate

More information

CHAPTER 4 FEATURE SELECTION USING GENETIC ALGORITHM

CHAPTER 4 FEATURE SELECTION USING GENETIC ALGORITHM CHAPTER 4 FEATURE SELECTION USING GENETIC ALGORITHM In this research work, Genetic Algorithm method is used for feature selection. The following section explains how Genetic Algorithm is used for feature

More information

The Binary Genetic Algorithm. Universidad de los Andes-CODENSA

The Binary Genetic Algorithm. Universidad de los Andes-CODENSA The Binary Genetic Algorithm Universidad de los Andes-CODENSA 1. Genetic Algorithms: Natural Selection on a Computer Figure 1 shows the analogy between biological i l evolution and a binary GA. Both start

More information

Chapter 9: Genetic Algorithms

Chapter 9: Genetic Algorithms Computational Intelligence: Second Edition Contents Compact Overview First proposed by Fraser in 1957 Later by Bremermann in 1962 and Reed et al in 1967 Popularized by Holland in 1975 Genetic algorithms

More information

What is GOSET? GOSET stands for Genetic Optimization System Engineering Tool

What is GOSET? GOSET stands for Genetic Optimization System Engineering Tool Lecture 5: GOSET 1 What is GOSET? GOSET stands for Genetic Optimization System Engineering Tool GOSET is a MATLAB based genetic algorithm toolbox for solving optimization problems 2 GOSET Features Wide

More information

The Genetic Algorithm for finding the maxima of single-variable functions

The Genetic Algorithm for finding the maxima of single-variable functions Research Inventy: International Journal Of Engineering And Science Vol.4, Issue 3(March 2014), PP 46-54 Issn (e): 2278-4721, Issn (p):2319-6483, www.researchinventy.com The Genetic Algorithm for finding

More information

ARTIFICIAL INTELLIGENCE (CSCU9YE ) LECTURE 5: EVOLUTIONARY ALGORITHMS

ARTIFICIAL INTELLIGENCE (CSCU9YE ) LECTURE 5: EVOLUTIONARY ALGORITHMS ARTIFICIAL INTELLIGENCE (CSCU9YE ) LECTURE 5: EVOLUTIONARY ALGORITHMS Gabriela Ochoa http://www.cs.stir.ac.uk/~goc/ OUTLINE Optimisation problems Optimisation & search Two Examples The knapsack problem

More information

Multi-Objective Optimization Using Genetic Algorithms

Multi-Objective Optimization Using Genetic Algorithms Multi-Objective Optimization Using Genetic Algorithms Mikhail Gaerlan Computational Physics PH 4433 December 8, 2015 1 Optimization Optimization is a general term for a type of numerical problem that involves

More information

arxiv: v1 [cs.ne] 5 Jan 2013

arxiv: v1 [cs.ne] 5 Jan 2013 Hybridization of Evolutionary Algorithms Iztok Fister, Marjan Mernik, and Janez Brest Abstract Evolutionary algorithms are good general problem solver but suffer from a lack of domain specific knowledge.

More information

COMP SCI 5401 FS Iterated Prisoner s Dilemma: A Coevolutionary Genetic Programming Approach

COMP SCI 5401 FS Iterated Prisoner s Dilemma: A Coevolutionary Genetic Programming Approach COMP SCI 5401 FS2017 - Iterated Prisoner s Dilemma: A Coevolutionary Genetic Programming Approach Daniel Tauritz, Ph.D. November 17, 2017 Synopsis The goal of this assignment set is for you to become familiarized

More information

Evolutionary Computation for Combinatorial Optimization

Evolutionary Computation for Combinatorial Optimization Evolutionary Computation for Combinatorial Optimization Günther Raidl Vienna University of Technology, Vienna, Austria raidl@ads.tuwien.ac.at EvoNet Summer School 2003, Parma, Italy August 25, 2003 Evolutionary

More information

CHAPTER 2 CONVENTIONAL AND NON-CONVENTIONAL TECHNIQUES TO SOLVE ORPD PROBLEM

CHAPTER 2 CONVENTIONAL AND NON-CONVENTIONAL TECHNIQUES TO SOLVE ORPD PROBLEM 20 CHAPTER 2 CONVENTIONAL AND NON-CONVENTIONAL TECHNIQUES TO SOLVE ORPD PROBLEM 2.1 CLASSIFICATION OF CONVENTIONAL TECHNIQUES Classical optimization methods can be classified into two distinct groups:

More information

Lecture 6: Genetic Algorithm. An Introduction to Meta-Heuristics, Produced by Qiangfu Zhao (Since 2012), All rights reserved

Lecture 6: Genetic Algorithm. An Introduction to Meta-Heuristics, Produced by Qiangfu Zhao (Since 2012), All rights reserved Lecture 6: Genetic Algorithm An Introduction to Meta-Heuristics, Produced by Qiangfu Zhao (Since 2012), All rights reserved Lec06/1 Search and optimization again Given a problem, the set of all possible

More information

Local Search. CS 486/686: Introduction to Artificial Intelligence Winter 2016

Local Search. CS 486/686: Introduction to Artificial Intelligence Winter 2016 Local Search CS 486/686: Introduction to Artificial Intelligence Winter 2016 1 Overview Uninformed Search Very general: assumes no knowledge about the problem BFS, DFS, IDS Informed Search Heuristics A*

More information

Using Genetic Algorithms to Solve the Box Stacking Problem

Using Genetic Algorithms to Solve the Box Stacking Problem Using Genetic Algorithms to Solve the Box Stacking Problem Jenniffer Estrada, Kris Lee, Ryan Edgar October 7th, 2010 Abstract The box stacking or strip stacking problem is exceedingly difficult to solve

More information

Evolutionary Computation Part 2

Evolutionary Computation Part 2 Evolutionary Computation Part 2 CS454, Autumn 2017 Shin Yoo (with some slides borrowed from Seongmin Lee @ COINSE) Crossover Operators Offsprings inherit genes from their parents, but not in identical

More information

[Premalatha, 4(5): May, 2015] ISSN: (I2OR), Publication Impact Factor: (ISRA), Journal Impact Factor: 2.114

[Premalatha, 4(5): May, 2015] ISSN: (I2OR), Publication Impact Factor: (ISRA), Journal Impact Factor: 2.114 IJESRT INTERNATIONAL JOURNAL OF ENGINEERING SCIENCES & RESEARCH TECHNOLOGY GENETIC ALGORITHM FOR OPTIMIZATION PROBLEMS C. Premalatha Assistant Professor, Department of Information Technology Sri Ramakrishna

More information

Genetic Algorithm Performance with Different Selection Methods in Solving Multi-Objective Network Design Problem

Genetic Algorithm Performance with Different Selection Methods in Solving Multi-Objective Network Design Problem etic Algorithm Performance with Different Selection Methods in Solving Multi-Objective Network Design Problem R. O. Oladele Department of Computer Science University of Ilorin P.M.B. 1515, Ilorin, NIGERIA

More information

A Comparison of the Iterative Fourier Transform Method and. Evolutionary Algorithms for the Design of Diffractive Optical.

A Comparison of the Iterative Fourier Transform Method and. Evolutionary Algorithms for the Design of Diffractive Optical. A Comparison of the Iterative Fourier Transform Method and Evolutionary Algorithms for the Design of Diffractive Optical Elements Philip Birch, Rupert Young, Maria Farsari, David Budgett, John Richardson,

More information

Genetic Algorithms for Vision and Pattern Recognition

Genetic Algorithms for Vision and Pattern Recognition Genetic Algorithms for Vision and Pattern Recognition Faiz Ul Wahab 11/8/2014 1 Objective To solve for optimization of computer vision problems using genetic algorithms 11/8/2014 2 Timeline Problem: Computer

More information

An Introduction to Evolutionary Algorithms

An Introduction to Evolutionary Algorithms An Introduction to Evolutionary Algorithms Karthik Sindhya, PhD Postdoctoral Researcher Industrial Optimization Group Department of Mathematical Information Technology Karthik.sindhya@jyu.fi http://users.jyu.fi/~kasindhy/

More information

Local Search (Greedy Descent): Maintain an assignment of a value to each variable. Repeat:

Local Search (Greedy Descent): Maintain an assignment of a value to each variable. Repeat: Local Search Local Search (Greedy Descent): Maintain an assignment of a value to each variable. Repeat: Select a variable to change Select a new value for that variable Until a satisfying assignment is

More information

Local Search. CS 486/686: Introduction to Artificial Intelligence

Local Search. CS 486/686: Introduction to Artificial Intelligence Local Search CS 486/686: Introduction to Artificial Intelligence 1 Overview Uninformed Search Very general: assumes no knowledge about the problem BFS, DFS, IDS Informed Search Heuristics A* search and

More information

Job Shop Scheduling Problem (JSSP) Genetic Algorithms Critical Block and DG distance Neighbourhood Search

Job Shop Scheduling Problem (JSSP) Genetic Algorithms Critical Block and DG distance Neighbourhood Search A JOB-SHOP SCHEDULING PROBLEM (JSSP) USING GENETIC ALGORITHM (GA) Mahanim Omar, Adam Baharum, Yahya Abu Hasan School of Mathematical Sciences, Universiti Sains Malaysia 11800 Penang, Malaysia Tel: (+)

More information

Genetic Algorithms Variations and Implementation Issues

Genetic Algorithms Variations and Implementation Issues Genetic Algorithms Variations and Implementation Issues CS 431 Advanced Topics in AI Classic Genetic Algorithms GAs as proposed by Holland had the following properties: Randomly generated population Binary

More information

Introduction to Optimization

Introduction to Optimization Introduction to Optimization Randomized Search Heuristics + Introduction to Continuous Optimization I November 25, 2016 École Centrale Paris, Châtenay-Malabry, France Dimo Brockhoff INRIA Saclay Ile-de-France

More information

1. Introduction. 2. Motivation and Problem Definition. Volume 8 Issue 2, February Susmita Mohapatra

1. Introduction. 2. Motivation and Problem Definition. Volume 8 Issue 2, February Susmita Mohapatra Pattern Recall Analysis of the Hopfield Neural Network with a Genetic Algorithm Susmita Mohapatra Department of Computer Science, Utkal University, India Abstract: This paper is focused on the implementation

More information

Dr.-Ing. Johannes Will CAD-FEM GmbH/DYNARDO GmbH dynamic software & engineering GmbH

Dr.-Ing. Johannes Will CAD-FEM GmbH/DYNARDO GmbH dynamic software & engineering GmbH Evolutionary and Genetic Algorithms in OptiSLang Dr.-Ing. Johannes Will CAD-FEM GmbH/DYNARDO GmbH dynamic software & engineering GmbH www.dynardo.de Genetic Algorithms (GA) versus Evolutionary Algorithms

More information

Genetic Algorithms Presented by: Faramarz Safi (Ph.D.) Faculty of Computer Engineering Islamic Azad University, Najafabad Branch.

Genetic Algorithms Presented by: Faramarz Safi (Ph.D.) Faculty of Computer Engineering Islamic Azad University, Najafabad Branch. Presented by: Faramarz Safi (Ph.D.) Faculty of Computer Engineering Islamic Azad University, Najafabad Branch Chapter 3 1 GA Quick Overview Developed: USA in the 1970 s Early names: J. Holland, K. DeJong,

More information

A motivated definition of exploitation and exploration

A motivated definition of exploitation and exploration A motivated definition of exploitation and exploration Bart Naudts and Adriaan Schippers Technical report 02-99 at the University of Antwerp, Belgium. 1 INTRODUCTION The terms exploration and exploitation

More information

V.Petridis, S. Kazarlis and A. Papaikonomou

V.Petridis, S. Kazarlis and A. Papaikonomou Proceedings of IJCNN 93, p.p. 276-279, Oct. 993, Nagoya, Japan. A GENETIC ALGORITHM FOR TRAINING RECURRENT NEURAL NETWORKS V.Petridis, S. Kazarlis and A. Papaikonomou Dept. of Electrical Eng. Faculty of

More information

Evolutionary Optimization of Filter Parameters for Image Segmentation

Evolutionary Optimization of Filter Parameters for Image Segmentation Evolutionary Optimization of Filter Parameters for Image Segmentation Timothy J. Rupe 30th November 2004 Abstract This paper explores the use of evolutionary strategies (ES) for parameter selection of

More information

NICHING EVOLUTIONARY ALGORITHMS FOR MULTIMODAL AND DYNAMIC OPTIMIZATION

NICHING EVOLUTIONARY ALGORITHMS FOR MULTIMODAL AND DYNAMIC OPTIMIZATION NICHING EVOLUTIONARY ALGORITHMS FOR MULTIMODAL AND DYNAMIC OPTIMIZATION YU LING School of Electrical & Electronic Engineering A thesis submitted to the Nanyang Technological University in partial fulfillment

More information

Homework 2: Search and Optimization

Homework 2: Search and Optimization Scott Chow ROB 537: Learning Based Control October 16, 2017 Homework 2: Search and Optimization 1 Introduction The Traveling Salesman Problem is a well-explored problem that has been shown to be NP-Complete.

More information

CHAPTER 5 ENERGY MANAGEMENT USING FUZZY GENETIC APPROACH IN WSN

CHAPTER 5 ENERGY MANAGEMENT USING FUZZY GENETIC APPROACH IN WSN 97 CHAPTER 5 ENERGY MANAGEMENT USING FUZZY GENETIC APPROACH IN WSN 5.1 INTRODUCTION Fuzzy systems have been applied to the area of routing in ad hoc networks, aiming to obtain more adaptive and flexible

More information

Genetic Programming Prof. Thomas Bäck Nat Evur ol al ut ic o om nar put y Aling go rg it roup hms Genetic Programming 1

Genetic Programming Prof. Thomas Bäck Nat Evur ol al ut ic o om nar put y Aling go rg it roup hms Genetic Programming 1 Genetic Programming Prof. Thomas Bäck Natural Evolutionary Computing Algorithms Group Genetic Programming 1 Genetic programming The idea originated in the 1950s (e.g., Alan Turing) Popularized by J.R.

More information

Introduction to Genetic Algorithms. Genetic Algorithms

Introduction to Genetic Algorithms. Genetic Algorithms Introduction to Genetic Algorithms Genetic Algorithms We ve covered enough material that we can write programs that use genetic algorithms! More advanced example of using arrays Could be better written

More information

Genetic Programming. and its use for learning Concepts in Description Logics

Genetic Programming. and its use for learning Concepts in Description Logics Concepts in Description Artificial Intelligence Institute Computer Science Department Dresden Technical University May 29, 2006 Outline Outline: brief introduction to explanation of the workings of a algorithm

More information

Artificial Intelligence

Artificial Intelligence Artificial Intelligence Informed Search and Exploration Chapter 4 (4.3 4.6) Searching: So Far We ve discussed how to build goal-based and utility-based agents that search to solve problems We ve also presented

More information

JavaEvA A Java based framework for Evolutionary Algorithms - Manual and Documentation - Felix Streichert and Holger Ulmer Tech. Report WSI

JavaEvA A Java based framework for Evolutionary Algorithms - Manual and Documentation - Felix Streichert and Holger Ulmer Tech. Report WSI JavaEvA A Java based framework for Evolutionary Algorithms - Manual and Documentation - Felix Streichert and Holger Ulmer Tech. Report WSI-2005-06 ISSN 0946-3852 Centre for Bioinformatics Tübingen (ZBIT)

More information

Review: Final Exam CPSC Artificial Intelligence Michael M. Richter

Review: Final Exam CPSC Artificial Intelligence Michael M. Richter Review: Final Exam Model for a Learning Step Learner initially Environm ent Teacher Compare s pe c ia l Information Control Correct Learning criteria Feedback changed Learner after Learning Learning by

More information

March 19, Heuristics for Optimization. Outline. Problem formulation. Genetic algorithms

March 19, Heuristics for Optimization. Outline. Problem formulation. Genetic algorithms Olga Galinina olga.galinina@tut.fi ELT-53656 Network Analysis and Dimensioning II Department of Electronics and Communications Engineering Tampere University of Technology, Tampere, Finland March 19, 2014

More information

Meta- Heuristic based Optimization Algorithms: A Comparative Study of Genetic Algorithm and Particle Swarm Optimization

Meta- Heuristic based Optimization Algorithms: A Comparative Study of Genetic Algorithm and Particle Swarm Optimization 2017 2 nd International Electrical Engineering Conference (IEEC 2017) May. 19 th -20 th, 2017 at IEP Centre, Karachi, Pakistan Meta- Heuristic based Optimization Algorithms: A Comparative Study of Genetic

More information

CHAPTER 3.4 AND 3.5. Sara Gestrelius

CHAPTER 3.4 AND 3.5. Sara Gestrelius CHAPTER 3.4 AND 3.5 Sara Gestrelius 3.4 OTHER EVOLUTIONARY ALGORITHMS Estimation of Distribution algorithms Differential Evolution Coevolutionary algorithms Cultural algorithms LAST TIME: EVOLUTIONARY

More information

Artificial Intelligence

Artificial Intelligence Artificial Intelligence Lesson 4 Local Search Local improvement, no paths Look around at states in the local neighborhood and choose the one with the best value Pros: Quick (usually linear) Sometimes enough

More information

The k-means Algorithm and Genetic Algorithm

The k-means Algorithm and Genetic Algorithm The k-means Algorithm and Genetic Algorithm k-means algorithm Genetic algorithm Rough set approach Fuzzy set approaches Chapter 8 2 The K-Means Algorithm The K-Means algorithm is a simple yet effective

More information

Time Complexity Analysis of the Genetic Algorithm Clustering Method

Time Complexity Analysis of the Genetic Algorithm Clustering Method Time Complexity Analysis of the Genetic Algorithm Clustering Method Z. M. NOPIAH, M. I. KHAIRIR, S. ABDULLAH, M. N. BAHARIN, and A. ARIFIN Department of Mechanical and Materials Engineering Universiti

More information

AI Programming CS S-08 Local Search / Genetic Algorithms

AI Programming CS S-08 Local Search / Genetic Algorithms AI Programming CS662-2013S-08 Local Search / Genetic Algorithms David Galles Department of Computer Science University of San Francisco 08-0: Overview Local Search Hill-Climbing Search Simulated Annealing

More information

Topological Machining Fixture Layout Synthesis Using Genetic Algorithms

Topological Machining Fixture Layout Synthesis Using Genetic Algorithms Topological Machining Fixture Layout Synthesis Using Genetic Algorithms Necmettin Kaya Uludag University, Mechanical Eng. Department, Bursa, Turkey Ferruh Öztürk Uludag University, Mechanical Eng. Department,

More information

Applied Cloning Techniques for a Genetic Algorithm Used in Evolvable Hardware Design

Applied Cloning Techniques for a Genetic Algorithm Used in Evolvable Hardware Design Applied Cloning Techniques for a Genetic Algorithm Used in Evolvable Hardware Design Viet C. Trinh vtrinh@isl.ucf.edu Gregory A. Holifield greg.holifield@us.army.mil School of Electrical Engineering and

More information

Evolving SQL Queries for Data Mining

Evolving SQL Queries for Data Mining Evolving SQL Queries for Data Mining Majid Salim and Xin Yao School of Computer Science, The University of Birmingham Edgbaston, Birmingham B15 2TT, UK {msc30mms,x.yao}@cs.bham.ac.uk Abstract. This paper

More information

DERIVATIVE-FREE OPTIMIZATION

DERIVATIVE-FREE OPTIMIZATION DERIVATIVE-FREE OPTIMIZATION Main bibliography J.-S. Jang, C.-T. Sun and E. Mizutani. Neuro-Fuzzy and Soft Computing: A Computational Approach to Learning and Machine Intelligence. Prentice Hall, New Jersey,

More information

Constrained Functions of N Variables: Non-Gradient Based Methods

Constrained Functions of N Variables: Non-Gradient Based Methods onstrained Functions of N Variables: Non-Gradient Based Methods Gerhard Venter Stellenbosch University Outline Outline onstrained Optimization Non-gradient based methods Genetic Algorithms (GA) Particle

More information

Evolutionary Algorithms Encoding, Fitness, Selection

Evolutionary Algorithms Encoding, Fitness, Selection Evolutionary Algorithms Encoding, Fitness, Selection Prof. Dr. Rudolf Kruse Pascal Held {kruse,pheld}@iws.cs.uni-magdeburg.de Otto-von-Guericke-Universität Magdeburg Fakultät für Informatik Institut für

More information

An Evolutionary Algorithm for the Multi-objective Shortest Path Problem

An Evolutionary Algorithm for the Multi-objective Shortest Path Problem An Evolutionary Algorithm for the Multi-objective Shortest Path Problem Fangguo He Huan Qi Qiong Fan Institute of Systems Engineering, Huazhong University of Science & Technology, Wuhan 430074, P. R. China

More information

Evolutionary Algorithms. CS Evolutionary Algorithms 1

Evolutionary Algorithms. CS Evolutionary Algorithms 1 Evolutionary Algorithms CS 478 - Evolutionary Algorithms 1 Evolutionary Computation/Algorithms Genetic Algorithms l Simulate natural evolution of structures via selection and reproduction, based on performance

More information

A New Selection Operator - CSM in Genetic Algorithms for Solving the TSP

A New Selection Operator - CSM in Genetic Algorithms for Solving the TSP A New Selection Operator - CSM in Genetic Algorithms for Solving the TSP Wael Raef Alkhayri Fahed Al duwairi High School Aljabereyah, Kuwait Suhail Sami Owais Applied Science Private University Amman,

More information

The aims of this tutorial

The aims of this tutorial A.E. Eiben Free University Amsterdam (google: eiben) The aims of this tutorial Creating awareness of the tuning issue Providing guidelines for tuning EAs Presenting a vision for future development CEC

More information

A Web-Based Evolutionary Algorithm Demonstration using the Traveling Salesman Problem

A Web-Based Evolutionary Algorithm Demonstration using the Traveling Salesman Problem A Web-Based Evolutionary Algorithm Demonstration using the Traveling Salesman Problem Richard E. Mowe Department of Statistics St. Cloud State University mowe@stcloudstate.edu Bryant A. Julstrom Department

More information

EVOLUTIONARY OPTIMIZATION OF A FLOW LINE USED ExtendSim BUILT-IN OPTIMIZER

EVOLUTIONARY OPTIMIZATION OF A FLOW LINE USED ExtendSim BUILT-IN OPTIMIZER The 13 th International Conference RELIABILITY and STATISTICS in TRANSPORTATION and COMMUNICATION - 2013 Proceedings of the 13 th International Conference Reliability and Statistics in Transportation and

More information

Dynamic Representations and Escaping Local Optima: Improving Genetic Algorithms and Local Search

Dynamic Representations and Escaping Local Optima: Improving Genetic Algorithms and Local Search Dynamic Representations and Escaping Local Optima: Improving Genetic Algorithms and Local Search Laura Barbulescu, Jean-Paul Watson, and L. Darrell Whitley Computer Science Department Colorado State University

More information

Ant Colony Optimization (ACO) [Dorigo 1992] Population Based Search. Core Pseudo-Code for Each Ant. ACO Parameters

Ant Colony Optimization (ACO) [Dorigo 1992] Population Based Search. Core Pseudo-Code for Each Ant. ACO Parameters Population Based Search Ant Colony Optimization Evolutionary Algorithms Evolutionary Strategies Genetic Algorithms Genetic Programming Ant Colony Optimization (ACO) [Dorigo 1992] constructive meta-heuristic

More information

Path Planning Optimization Using Genetic Algorithm A Literature Review

Path Planning Optimization Using Genetic Algorithm A Literature Review International Journal of Computational Engineering Research Vol, 03 Issue, 4 Path Planning Optimization Using Genetic Algorithm A Literature Review 1, Er. Waghoo Parvez, 2, Er. Sonal Dhar 1, (Department

More information

Hill Climbing. Assume a heuristic value for each assignment of values to all variables. Maintain an assignment of a value to each variable.

Hill Climbing. Assume a heuristic value for each assignment of values to all variables. Maintain an assignment of a value to each variable. Hill Climbing Many search spaces are too big for systematic search. A useful method in practice for some consistency and optimization problems is hill climbing: Assume a heuristic value for each assignment

More information

Lab 4: Evolutionary Computation and Swarm Intelligence

Lab 4: Evolutionary Computation and Swarm Intelligence Lab 4: Evolutionary Computation and Swarm Intelligence Introduction Goals The goal of this assignment is to learn about two evolutionary computing methods: genetic algorithms, and particle swarm optimization.

More information

Hardware Neuronale Netzwerke - Lernen durch künstliche Evolution (?)

Hardware Neuronale Netzwerke - Lernen durch künstliche Evolution (?) SKIP - May 2004 Hardware Neuronale Netzwerke - Lernen durch künstliche Evolution (?) S. G. Hohmann, Electronic Vision(s), Kirchhoff Institut für Physik, Universität Heidelberg Hardware Neuronale Netzwerke

More information

THE Multiconstrained 0 1 Knapsack Problem (MKP) is

THE Multiconstrained 0 1 Knapsack Problem (MKP) is An Improved Genetic Algorithm for the Multiconstrained 0 1 Knapsack Problem Günther R. Raidl Abstract This paper presents an improved hybrid Genetic Algorithm (GA) for solving the Multiconstrained 0 1

More information

Genetic Algorithms: Setting Parmeters and Incorporating Constraints OUTLINE OF TOPICS: 1. Setting GA parameters. 2. Constraint Handling (two methods)

Genetic Algorithms: Setting Parmeters and Incorporating Constraints OUTLINE OF TOPICS: 1. Setting GA parameters. 2. Constraint Handling (two methods) Genetic Algorithms: Setting Parmeters and Incorporating Constraints OUTLINE OF TOPICS: 1. Setting GA parameters general guidelines for binary coded GA (some can be extended to real valued GA) estimating

More information

Incorporation of Scalarizing Fitness Functions into Evolutionary Multiobjective Optimization Algorithms

Incorporation of Scalarizing Fitness Functions into Evolutionary Multiobjective Optimization Algorithms H. Ishibuchi, T. Doi, and Y. Nojima, Incorporation of scalarizing fitness functions into evolutionary multiobjective optimization algorithms, Lecture Notes in Computer Science 4193: Parallel Problem Solving

More information

Adaptive Crossover in Genetic Algorithms Using Statistics Mechanism

Adaptive Crossover in Genetic Algorithms Using Statistics Mechanism in Artificial Life VIII, Standish, Abbass, Bedau (eds)(mit Press) 2002. pp 182 185 1 Adaptive Crossover in Genetic Algorithms Using Statistics Mechanism Shengxiang Yang Department of Mathematics and Computer

More information

Multi-objective Optimization

Multi-objective Optimization Jugal K. Kalita Single vs. Single vs. Single Objective Optimization: When an optimization problem involves only one objective function, the task of finding the optimal solution is called single-objective

More information

Genetic Programming. Charles Chilaka. Department of Computational Science Memorial University of Newfoundland

Genetic Programming. Charles Chilaka. Department of Computational Science Memorial University of Newfoundland Genetic Programming Charles Chilaka Department of Computational Science Memorial University of Newfoundland Class Project for Bio 4241 March 27, 2014 Charles Chilaka (MUN) Genetic algorithms and programming

More information

Introduction to Design Optimization: Search Methods

Introduction to Design Optimization: Search Methods Introduction to Design Optimization: Search Methods 1-D Optimization The Search We don t know the curve. Given α, we can calculate f(α). By inspecting some points, we try to find the approximated shape

More information

Measuring Mobility and the Performance of Global Search Algorithms

Measuring Mobility and the Performance of Global Search Algorithms easuring obility and the Performance of Global Search Algorithms onte unacek lunacek@cs.colostate.edu Darrell Whitley whitley@cs.colostate.edu Department of omputer Science olorado State University Fort

More information