# Evolutionary Algorithms. CS Evolutionary Algorithms 1

Save this PDF as:

Size: px
Start display at page:

## Transcription

1 Evolutionary Algorithms CS Evolutionary Algorithms 1

2 Evolutionary Computation/Algorithms Genetic Algorithms l Simulate natural evolution of structures via selection and reproduction, based on performance (fitness) l Type of heuristic search to optimize any set of parameters- Discovery, not inductive learning in isolation l Create "genomes" which represent a current potential solution with a fitness (quality) score l Values in genome represent parameters to optimize MLP weights, TSP path, knapsack, potential clusterings, etc. l Discover new genomes (solutions) using genetic operators Recombination (crossover) and mutation are most common CS Evolutionary Algorithms 2

3 Evolutionary Computation/Algorithms Genetic Algorithms l Populate our search space with initial random solutions l Use genetic operators to search the space l Do local search near the possible solutions with mutation l Do exploratory search with recombination (crossover) (Fitness = 60) (Fitness = 72) (Fitness = 55) (Fitness = 88) CS 312 Approximation 3

4 Evolutionary Algorithms l Start with initialized population P(t) - random, domainknowledge, etc. l Typically have fixed population size (type of beam search), large enough to maintain diversity l Selection Parent_Selection P(t) - Promising Parents more likely to be chosen based on fitness to create new children using genetic operators Survive P(t) - Pruning of less promising candidates, Evaluate P(t) - Calculate fitness of population members. Could be simple metrics to complex simulations. l Survival of the fittest - Find and keep best while also maintaining diversity CS Evolutionary Algorithms 4

5 Evolutionary Algorithm Procedure EA t = 0; Initialize Population P(t); Evaluate P(t); Until Done{ /*Sufficiently good individuals discovered or many iterations passed with no improvement, etc.*/ t = t + 1; Parent_Selection P(t); Recombine P(t); Mutate P(t); Evaluate P(t); Survive P(t);} CS 312 Approximation 5

6 EA Example l Goal: Discover a new automotive engine to maximize performance, reliability, and mileage while minimizing emissions l Features: CID (Cubic inch displacement), fuel system, # of valves, # of cylinders, presence of turbo-charging l Assume - Test unit which tests possible engines and returns integer measure of goodness l Start with population of random engines CS Evolutionary Algorithms 6

7 CS Evolutionary Algorithms 7

8 CS Evolutionary Algorithms 8

9 Data Representation (Genome) l Individuals are represented so that they can be manipulated by genetic operators l Simplest representation is a bit string, where each bit or group of bits could represent a feature/parameter l Assume the following represents a set of parameters p 1 p 2 p 3 p 4 p 5 p 6 p l Could do crossovers anywhere or just at parameter breaks l Can use more complex representations including real numbers, symbolic representations (e.g. programs for genetic programming), etc. CS Evolutionary Algorithms 9

10 Genetic Operators l Crossover variations - multi-point, uniform, averaging, etc. l Mutation - Random changes in features, adaptive, different for each feature, etc. l Others - many schemes mimicking natural genetics: dominance, selective mating, inversion, reordering, speciation, knowledge-based, etc. CS Evolutionary Algorithms 10

11 CS Evolutionary Algorithms 11

12 Fitness Function Evaluation l Each individual in the population should have a fitness based on the fitness function l Fitness function will depend on the application Learning system will usually use accuracy on a validation set for fitness (note that no training set needed, just validation and test) Solution finding (path, plan, etc.) - Length or cost of solution Program - Does it work and how efficient is it l Cost of evaluating function can be an issue. When expensive can approximate or use rankings, etc. which could be easier. l Stopping Criteria - A common one is when best candidates in population are no longer improving over time CS Evolutionary Algorithms 12

13 Parent Selection l In general want the fittest parents to be involved in creating the next generation l However, also need to maintain diversity and avoid crowding so that the entire space gets explored (local minima vs global minima) l Most common approach is Fitness Proportionate Selection (aka roulette wheel selection) Pr(h i ) = Fitness(h i ) population Fitness(h j ) l Everyone has a chance but the fittest are more likely j=1 CS Evolutionary Algorithms 13

14 Parent Selection l l l l There are other methods which lead to more diversity Rank selection Rank order all candidates Do random selection weighted towards highest rank Keeps actual fitness value from dominating Tournament selection Randomly select two candidates The one with highest fitness is chosen with probability p, else the lesser is chosen p is a user defined parameter,.5 < p < 1 Even more diversity Fitness scaling - Scale down fitness values during early generations. Scale back up with time. Equivalently could scale selection probability function over time. CS Evolutionary Algorithms 14

15 Tournament Selection with p = 1 Biagio D Antonio, b. 1446, Florence, Italy - Saint Michael Weighing Souls

16 Survival - New Generation l Population size - Larger gives more diversity but with diminishing gain, small sizes of ~100 are common l How many new offspring will be created at each generation (what % of current generation will not survive) l l Keep selecting parents without replacement until quota filled New candidates replace old candidates to maintain the population constant Many variations Randomly keep best candidates weighted by fitness No old candidates kept Always keep a fixed percentage of old vs new candidates Could keep highest candidate seen so far in separate memory since it may be deleted during normal evolution CS Evolutionary Algorithms 16

17 CS Evolutionary Algorithms 17

18 Evolutionary Algorithms l There exist mathematical proofs that evolutionary techniques are efficient search strategies l There are a number of different Evolutionary algorithm approaches Genetic Algorithms Evolutionary Programming Evolution Strategies Genetic Programming l Strategies differ in representations, selection, operators, evaluation, survival, etc. l Some independently discovered, initially function optimization (EP, ES) l Strategies continue to evolve CS Evolutionary Algorithms 18

19 Genetic Algorithms l Representation based typically on a list of discrete tokens, often bits (Genome) - can be extended to graphs, lists, realvalued vectors, etc. l Select m parents probabilistically based on fitness l Create m (or 2m) new children using genetic operators (emphasis on crossover) and assign them a fitness - singlepoint, multi-point, and uniform crossover l Replace m weakest candidates in the population with the new children (or can always delete parents) CS Evolutionary Algorithms 19

20 Evolutionary Programming l Representation that best fits problem domain l All n parents mutated (no crossover) to create n new children - total of 2n candidates l Only n most fit candidates are kept l Mutation schemes fit representation, varies for each variable, amount of mutation (typically higher probability for smaller mutation), and can be adaptive (i.e. can decrease amount of mutation for candidates with higher fitness and based on time - form of simulated annealing) CS Evolutionary Algorithms 20

21 Evolution Strategies l Similar to Evolutionary Programming - initially used for optimization of complex real systems - fluid dynamics, etc. - usually real vectors l Uses both crossover and mutation. Crossover first. Also averaging crossover (real values), and multi-parent. l Randomly selects set of parents and modifies them to create > n children l Two survival schemes Keep best n of combined parents and children Keep best n of only children CS Evolutionary Algorithms 21

22 Genetic Programming l Evolves more complex structures - programs, Lisp code, neural networks l Start with random programs of functions and terminals (data structures) l Execute programs and give each a fitness measure l Use crossover to create new programs, no mutation l Keep best programs l For example, place lisp code in a tree structure, functions at internal nodes, terminals at leaves, and do crossover at sub-trees - always legal in Lisp CS Evolutionary Algorithms 22

23 CS Evolutionary Algorithms 23

24 Genetic Algorithm Example l Use a Genetic Algorithm to learn the weights of an MLP. Used to be a lab. CS Evolutionary Algorithms 24

25 Genetic Algorithm Example l Use a Genetic Algorithm to learn the weights of an MLP. Used to be a lab. l You could represent each weight with m (e.g. 10) bits (Binary or Gray encoding), remember the bias weights l Could also represent Neural Network Weights as real values - In this case use Gaussian style mutation l Walk through an example comparing both representations Assume wanted to train MLP to solve Iris data set Assume fixed number of hidden nodes, though GAs can be used to discover that also CS Evolutionary Algorithms 25

26 Evolutionary Computation Comments l l l l l l Much current work and extensions Numerous application attempts. Can plug into many algorithms requiring search. Has built-in heuristic. Could augment with domain heuristics. If no better way, can always try evolutionary algorithms, with pretty good results ("Lazy man s solution" to any problem) Many different options and combinations of approaches, parameters, etc. Swarm Intelligence Particle Swarm Optimization, Ant colonies, Artificial bees, Robot flocking, etc. More work needed regarding adaptivity of population size selection mechanisms operators representation CS Evolutionary Algorithms 26

27 Classifier Systems l Reinforcement Learning - sparse payoff l Contains rules which can be executed and given a fitness (Credit Assignment) - Booker uses bucket brigade scheme l GA used to discover improved rules l Classifier made up of input side (conjunction of features allowing don t cares), and an output message (includes internal state message and output information) l Simple representation aids in more flexible adaptation schemes CS Evolutionary Algorithms 27

28 Bucket Brigade Credit Assignment l Each classifier has an associated strength. When matched the strength is used to competitively bid to be able to put message on list during next time step. Highest bidders put messages. l Keeps a message list with values from both input and previously matched rules - matched rules set outputs and put messages on list - allows internal chaining of rules - all messages changed each time step. l Output message conflict resolved through competition (i.e. strengths of classifiers proposing a particular output are summed, highest used) CS Evolutionary Algorithms 28

29 Bucket Brigade (Continued) l Each classifier bids for use at time t. Bid used as a probability (non-linear) of being a winner - assures lower bids get some chances B(C,t) = br(c)s(c,t) where b is a constant << 1 (to insure prob<1), R(C) is specificity (# of asserted features), s(c,t) is strength l Economic analogy - Previously winning rules (t-1) suppliers (made you matchable), following winning rules (t+1) consumers (you made them matchable - actually might have made) CS Evolutionary Algorithms 29

30 Bucket Brigade (Continued) l s(c,t+1) = s(c,t) -B(C,t) - Loss of Strength for each consumer (price paid to be used, prediction of how good it will pay off) l {C'} = {suppliers} - Each of the suppliers shares an equal portion of strength increase proportional to the amount of the Bid of each of the consumers in the next time step s(c',t+1) = s(c',t) + B(C i,t)/ C' l You pay suppliers amount of bid, receive bid amounts from consumers. If consumers profitable (higher bids than you bid) your strength increases. Final rules in chain receive actual payoffs and these eventually propagate iteratively. Consistently winning rules give good payoffs which increases strength of rule chain, while low payoffs do opposite. CS Evolutionary Algorithms 30

### Suppose you have a problem You don t know how to solve it What can you do? Can you use a computer to somehow find a solution for you?

Gurjit Randhawa Suppose you have a problem You don t know how to solve it What can you do? Can you use a computer to somehow find a solution for you? This would be nice! Can it be done? A blind generate

### ARTIFICIAL INTELLIGENCE (CSCU9YE ) LECTURE 5: EVOLUTIONARY ALGORITHMS

ARTIFICIAL INTELLIGENCE (CSCU9YE ) LECTURE 5: EVOLUTIONARY ALGORITHMS Gabriela Ochoa http://www.cs.stir.ac.uk/~goc/ OUTLINE Optimisation problems Optimisation & search Two Examples The knapsack problem

### The k-means Algorithm and Genetic Algorithm

The k-means Algorithm and Genetic Algorithm k-means algorithm Genetic algorithm Rough set approach Fuzzy set approaches Chapter 8 2 The K-Means Algorithm The K-Means algorithm is a simple yet effective

### Artificial Intelligence Application (Genetic Algorithm)

Babylon University College of Information Technology Software Department Artificial Intelligence Application (Genetic Algorithm) By Dr. Asaad Sabah Hadi 2014-2015 EVOLUTIONARY ALGORITHM The main idea about

### A Genetic Algorithm for Graph Matching using Graph Node Characteristics 1 2

Chapter 5 A Genetic Algorithm for Graph Matching using Graph Node Characteristics 1 2 Graph Matching has attracted the exploration of applying new computing paradigms because of the large number of applications

### GENETIC ALGORITHM with Hands-On exercise

GENETIC ALGORITHM with Hands-On exercise Adopted From Lecture by Michael Negnevitsky, Electrical Engineering & Computer Science University of Tasmania 1 Objective To understand the processes ie. GAs Basic

### Escaping Local Optima: Genetic Algorithm

Artificial Intelligence Escaping Local Optima: Genetic Algorithm Dae-Won Kim School of Computer Science & Engineering Chung-Ang University We re trying to escape local optima To achieve this, we have learned

### Genetic Algorithms Variations and Implementation Issues

Genetic Algorithms Variations and Implementation Issues CS 431 Advanced Topics in AI Classic Genetic Algorithms GAs as proposed by Holland had the following properties: Randomly generated population Binary

### Machine Evolution. Machine Evolution. Let s look at. Machine Evolution. Machine Evolution. Machine Evolution. Machine Evolution

Let s look at As you will see later in this course, neural networks can learn, that is, adapt to given constraints. For example, NNs can approximate a given function. In biology, such learning corresponds

### Genetic Algorithms. Kang Zheng Karl Schober

Genetic Algorithms Kang Zheng Karl Schober Genetic algorithm What is Genetic algorithm? A genetic algorithm (or GA) is a search technique used in computing to find true or approximate solutions to optimization

### Genetic Algorithms for Vision and Pattern Recognition

Genetic Algorithms for Vision and Pattern Recognition Faiz Ul Wahab 11/8/2014 1 Objective To solve for optimization of computer vision problems using genetic algorithms 11/8/2014 2 Timeline Problem: Computer

### Kyrre Glette INF3490 Evolvable Hardware Cartesian Genetic Programming

Kyrre Glette kyrrehg@ifi INF3490 Evolvable Hardware Cartesian Genetic Programming Overview Introduction to Evolvable Hardware (EHW) Cartesian Genetic Programming Applications of EHW 3 Evolvable Hardware

### Introduction to Genetic Algorithms

Advanced Topics in Image Analysis and Machine Learning Introduction to Genetic Algorithms Week 3 Faculty of Information Science and Engineering Ritsumeikan University Today s class outline Genetic Algorithms

### CHAPTER 4 GENETIC ALGORITHM

69 CHAPTER 4 GENETIC ALGORITHM 4.1 INTRODUCTION Genetic Algorithms (GAs) were first proposed by John Holland (Holland 1975) whose ideas were applied and expanded on by Goldberg (Goldberg 1989). GAs is

### CHAPTER 2 CONVENTIONAL AND NON-CONVENTIONAL TECHNIQUES TO SOLVE ORPD PROBLEM

20 CHAPTER 2 CONVENTIONAL AND NON-CONVENTIONAL TECHNIQUES TO SOLVE ORPD PROBLEM 2.1 CLASSIFICATION OF CONVENTIONAL TECHNIQUES Classical optimization methods can be classified into two distinct groups:

### DERIVATIVE-FREE OPTIMIZATION

DERIVATIVE-FREE OPTIMIZATION Main bibliography J.-S. Jang, C.-T. Sun and E. Mizutani. Neuro-Fuzzy and Soft Computing: A Computational Approach to Learning and Machine Intelligence. Prentice Hall, New Jersey,

### Outline. Motivation. Introduction of GAs. Genetic Algorithm 9/7/2017. Motivation Genetic algorithms An illustrative example Hypothesis space search

Outline Genetic Algorithm Motivation Genetic algorithms An illustrative example Hypothesis space search Motivation Evolution is known to be a successful, robust method for adaptation within biological

### Genetic Algorithms. PHY 604: Computational Methods in Physics and Astrophysics II

Genetic Algorithms Genetic Algorithms Iterative method for doing optimization Inspiration from biology General idea (see Pang or Wikipedia for more details): Create a collection of organisms/individuals

### Evolutionary Computation. Chao Lan

Evolutionary Computation Chao Lan Outline Introduction Genetic Algorithm Evolutionary Strategy Genetic Programming Introduction Evolutionary strategy can jointly optimize multiple variables. - e.g., max

Advanced Search Genetic algorithm Yingyu Liang yliang@cs.wisc.edu Computer Sciences Department University of Wisconsin, Madison [Based on slides from Jerry Zhu, Andrew Moore http://www.cs.cmu.edu/~awm/tutorials

### Information Fusion Dr. B. K. Panigrahi

Information Fusion By Dr. B. K. Panigrahi Asst. Professor Department of Electrical Engineering IIT Delhi, New Delhi-110016 01/12/2007 1 Introduction Classification OUTLINE K-fold cross Validation Feature

### CHAPTER 5 ENERGY MANAGEMENT USING FUZZY GENETIC APPROACH IN WSN

97 CHAPTER 5 ENERGY MANAGEMENT USING FUZZY GENETIC APPROACH IN WSN 5.1 INTRODUCTION Fuzzy systems have been applied to the area of routing in ad hoc networks, aiming to obtain more adaptive and flexible

### Heuristic Optimisation

Heuristic Optimisation Part 10: Genetic Algorithm Basics Sándor Zoltán Németh http://web.mat.bham.ac.uk/s.z.nemeth s.nemeth@bham.ac.uk University of Birmingham S Z Németh (s.nemeth@bham.ac.uk) Heuristic

### Genetic Algorithms. Chapter 3

Chapter 3 1 Contents of this Chapter 2 Introductory example. Representation of individuals: Binary, integer, real-valued, and permutation. Mutation operator. Mutation for binary, integer, real-valued,

### Local Search (Greedy Descent): Maintain an assignment of a value to each variable. Repeat:

Local Search Local Search (Greedy Descent): Maintain an assignment of a value to each variable. Repeat: Select a variable to change Select a new value for that variable Until a satisfying assignment is

### CHAPTER 6 REAL-VALUED GENETIC ALGORITHMS

CHAPTER 6 REAL-VALUED GENETIC ALGORITHMS 6.1 Introduction Gradient-based algorithms have some weaknesses relative to engineering optimization. Specifically, it is difficult to use gradient-based algorithms

### March 19, Heuristics for Optimization. Outline. Problem formulation. Genetic algorithms

Olga Galinina olga.galinina@tut.fi ELT-53656 Network Analysis and Dimensioning II Department of Electronics and Communications Engineering Tampere University of Technology, Tampere, Finland March 19, 2014

### Genetic Programming. and its use for learning Concepts in Description Logics

Concepts in Description Artificial Intelligence Institute Computer Science Department Dresden Technical University May 29, 2006 Outline Outline: brief introduction to explanation of the workings of a algorithm

### Using Genetic Algorithms to optimize ACS-TSP

Using Genetic Algorithms to optimize ACS-TSP Marcin L. Pilat and Tony White School of Computer Science, Carleton University, 1125 Colonel By Drive, Ottawa, ON, K1S 5B6, Canada {mpilat,arpwhite}@scs.carleton.ca

### Local Search. CS 486/686: Introduction to Artificial Intelligence Winter 2016

Local Search CS 486/686: Introduction to Artificial Intelligence Winter 2016 1 Overview Uninformed Search Very general: assumes no knowledge about the problem BFS, DFS, IDS Informed Search Heuristics A*

### Introduction to Genetic Algorithms. Based on Chapter 10 of Marsland Chapter 9 of Mitchell

Introduction to Genetic Algorithms Based on Chapter 10 of Marsland Chapter 9 of Mitchell Genetic Algorithms - History Pioneered by John Holland in the 1970s Became popular in the late 1980s Based on ideas

### 4/22/2014. Genetic Algorithms. Diwakar Yagyasen Department of Computer Science BBDNITM. Introduction

4/22/24 s Diwakar Yagyasen Department of Computer Science BBDNITM Visit dylycknow.weebly.com for detail 2 The basic purpose of a genetic algorithm () is to mimic Nature s evolutionary approach The algorithm

### Automated Test Data Generation and Optimization Scheme Using Genetic Algorithm

2011 International Conference on Software and Computer Applications IPCSIT vol.9 (2011) (2011) IACSIT Press, Singapore Automated Test Data Generation and Optimization Scheme Using Genetic Algorithm Roshni

### Lecture 6: Genetic Algorithm. An Introduction to Meta-Heuristics, Produced by Qiangfu Zhao (Since 2012), All rights reserved

Lecture 6: Genetic Algorithm An Introduction to Meta-Heuristics, Produced by Qiangfu Zhao (Since 2012), All rights reserved Lec06/1 Search and optimization again Given a problem, the set of all possible

### Hill Climbing. Assume a heuristic value for each assignment of values to all variables. Maintain an assignment of a value to each variable.

Hill Climbing Many search spaces are too big for systematic search. A useful method in practice for some consistency and optimization problems is hill climbing: Assume a heuristic value for each assignment

### CONCEPT FORMATION AND DECISION TREE INDUCTION USING THE GENETIC PROGRAMMING PARADIGM

1 CONCEPT FORMATION AND DECISION TREE INDUCTION USING THE GENETIC PROGRAMMING PARADIGM John R. Koza Computer Science Department Stanford University Stanford, California 94305 USA E-MAIL: Koza@Sunburn.Stanford.Edu

### Multi-objective Optimization

Jugal K. Kalita Single vs. Single vs. Single Objective Optimization: When an optimization problem involves only one objective function, the task of finding the optimal solution is called single-objective

### Time Complexity Analysis of the Genetic Algorithm Clustering Method

Time Complexity Analysis of the Genetic Algorithm Clustering Method Z. M. NOPIAH, M. I. KHAIRIR, S. ABDULLAH, M. N. BAHARIN, and A. ARIFIN Department of Mechanical and Materials Engineering Universiti

### Hardware Neuronale Netzwerke - Lernen durch künstliche Evolution (?)

SKIP - May 2004 Hardware Neuronale Netzwerke - Lernen durch künstliche Evolution (?) S. G. Hohmann, Electronic Vision(s), Kirchhoff Institut für Physik, Universität Heidelberg Hardware Neuronale Netzwerke

### Introduction to Scientific Modeling CS 365, Fall Semester, 2007 Genetic Algorithms

Introduction to Scientific Modeling CS 365, Fall Semester, 2007 Genetic Algorithms Stephanie Forrest FEC 355E http://cs.unm.edu/~forrest/cas-class-06.html forrest@cs.unm.edu 505-277-7104 Genetic Algorithms

### The Binary Genetic Algorithm. Universidad de los Andes-CODENSA

The Binary Genetic Algorithm Universidad de los Andes-CODENSA 1. Genetic Algorithms: Natural Selection on a Computer Figure 1 shows the analogy between biological i l evolution and a binary GA. Both start

### CS:4420 Artificial Intelligence

CS:4420 Artificial Intelligence Spring 2018 Beyond Classical Search Cesare Tinelli The University of Iowa Copyright 2004 18, Cesare Tinelli and Stuart Russell a a These notes were originally developed

### METAHEURISTIC. Jacques A. Ferland Department of Informatique and Recherche Opérationnelle Université de Montréal.

METAHEURISTIC Jacques A. Ferland Department of Informatique and Recherche Opérationnelle Université de Montréal ferland@iro.umontreal.ca March 2015 Overview Heuristic Constructive Techniques: Generate

### Introduction to Optimization

Introduction to Optimization Approximation Algorithms and Heuristics November 21, 2016 École Centrale Paris, Châtenay-Malabry, France Dimo Brockhoff Inria Saclay Ile-de-France 2 Exercise: The Knapsack

### Search Algorithms for Regression Test Suite Minimisation

School of Physical Sciences and Engineering King s College London MSc in Advanced Software Engineering Search Algorithms for Regression Test Suite Minimisation By Benjamin Cook Supervised by Prof. Mark

### Review: Final Exam CPSC Artificial Intelligence Michael M. Richter

Review: Final Exam Model for a Learning Step Learner initially Environm ent Teacher Compare s pe c ia l Information Control Correct Learning criteria Feedback changed Learner after Learning Learning by

### Genetic Algorithms. Genetic Algorithms

A biological analogy for optimization problems Bit encoding, models as strings Reproduction and mutation -> natural selection Pseudo-code for a simple genetic algorithm The goal of genetic algorithms (GA):

### GENETIC ALGORITHM VERSUS PARTICLE SWARM OPTIMIZATION IN N-QUEEN PROBLEM

Journal of Al-Nahrain University Vol.10(2), December, 2007, pp.172-177 Science GENETIC ALGORITHM VERSUS PARTICLE SWARM OPTIMIZATION IN N-QUEEN PROBLEM * Azhar W. Hammad, ** Dr. Ban N. Thannoon Al-Nahrain

### Preprocessing of Stream Data using Attribute Selection based on Survival of the Fittest

Preprocessing of Stream Data using Attribute Selection based on Survival of the Fittest Bhakti V. Gavali 1, Prof. Vivekanand Reddy 2 1 Department of Computer Science and Engineering, Visvesvaraya Technological

### Genetic.io. Genetic Algorithms in all their shapes and forms! Genetic.io Make something of your big data

Genetic Algorithms in all their shapes and forms! Julien Sebrien Self-taught, passion for development. Java, Cassandra, Spark, JPPF. @jsebrien, julien.sebrien@genetic.io Distribution of IT solutions (SaaS,

### Pseudo-code for typical EA

Extra Slides for lectures 1-3: Introduction to Evolutionary algorithms etc. The things in slides were more or less presented during the lectures, combined by TM from: A.E. Eiben and J.E. Smith, Introduction

### METAHEURISTICS. Introduction. Introduction. Nature of metaheuristics. Local improvement procedure. Example: objective function

Introduction METAHEURISTICS Some problems are so complicated that are not possible to solve for an optimal solution. In these problems, it is still important to find a good feasible solution close to the

### [Premalatha, 4(5): May, 2015] ISSN: (I2OR), Publication Impact Factor: (ISRA), Journal Impact Factor: 2.114

IJESRT INTERNATIONAL JOURNAL OF ENGINEERING SCIENCES & RESEARCH TECHNOLOGY GENETIC ALGORITHM FOR OPTIMIZATION PROBLEMS C. Premalatha Assistant Professor, Department of Information Technology Sri Ramakrishna

### Introduction to Optimization

Introduction to Optimization Approximation Algorithms and Heuristics November 6, 2015 École Centrale Paris, Châtenay-Malabry, France Dimo Brockhoff INRIA Lille Nord Europe 2 Exercise: The Knapsack Problem

### ATI Material Do Not Duplicate ATI Material. www. ATIcourses.com. www. ATIcourses.com

ATI Material Material Do Not Duplicate ATI Material Boost Your Skills with On-Site Courses Tailored to Your Needs www.aticourses.com The Applied Technology Institute specializes in training programs for

### The Parallel Software Design Process. Parallel Software Design

Parallel Software Design The Parallel Software Design Process Deborah Stacey, Chair Dept. of Comp. & Info Sci., University of Guelph dastacey@uoguelph.ca Why Parallel? Why NOT Parallel? Why Talk about

### Chapter 9: Genetic Algorithms

Computational Intelligence: Second Edition Contents Compact Overview First proposed by Fraser in 1957 Later by Bremermann in 1962 and Reed et al in 1967 Popularized by Holland in 1975 Genetic algorithms

### A New Selection Operator - CSM in Genetic Algorithms for Solving the TSP

A New Selection Operator - CSM in Genetic Algorithms for Solving the TSP Wael Raef Alkhayri Fahed Al duwairi High School Aljabereyah, Kuwait Suhail Sami Owais Applied Science Private University Amman,

### Chapter 14 Global Search Algorithms

Chapter 14 Global Search Algorithms An Introduction to Optimization Spring, 2015 Wei-Ta Chu 1 Introduction We discuss various search methods that attempts to search throughout the entire feasible set.

### Multi-label classification using rule-based classifier systems

Multi-label classification using rule-based classifier systems Shabnam Nazmi (PhD candidate) Department of electrical and computer engineering North Carolina A&T state university Advisor: Dr. A. Homaifar

### Local Search. CS 486/686: Introduction to Artificial Intelligence

Local Search CS 486/686: Introduction to Artificial Intelligence 1 Overview Uninformed Search Very general: assumes no knowledge about the problem BFS, DFS, IDS Informed Search Heuristics A* search and

### Computational Intelligence

Computational Intelligence Module 6 Evolutionary Computation Ajith Abraham Ph.D. Q What is the most powerful problem solver in the Universe? ΑThe (human) brain that created the wheel, New York, wars and

### 1 Lab + Hwk 5: Particle Swarm Optimization

1 Lab + Hwk 5: Particle Swarm Optimization This laboratory requires the following equipment: C programming tools (gcc, make), already installed in GR B001 Webots simulation software Webots User Guide Webots

### What is GOSET? GOSET stands for Genetic Optimization System Engineering Tool

Lecture 5: GOSET 1 What is GOSET? GOSET stands for Genetic Optimization System Engineering Tool GOSET is a MATLAB based genetic algorithm toolbox for solving optimization problems 2 GOSET Features Wide

### CHAPTER 1 INTRODUCTION

1 CHAPTER 1 INTRODUCTION 1.1 OPTIMIZATION OF MACHINING PROCESS AND MACHINING ECONOMICS In a manufacturing industry, machining process is to shape the metal parts by removing unwanted material. During the

### An Introduction to Evolutionary Algorithms

An Introduction to Evolutionary Algorithms Karthik Sindhya, PhD Postdoctoral Researcher Industrial Optimization Group Department of Mathematical Information Technology Karthik.sindhya@jyu.fi http://users.jyu.fi/~kasindhy/

### CHAPTER 4 FEATURE SELECTION USING GENETIC ALGORITHM

CHAPTER 4 FEATURE SELECTION USING GENETIC ALGORITHM In this research work, Genetic Algorithm method is used for feature selection. The following section explains how Genetic Algorithm is used for feature

### Using Genetic Algorithms in Integer Programming for Decision Support

Doi:10.5901/ajis.2014.v3n6p11 Abstract Using Genetic Algorithms in Integer Programming for Decision Support Dr. Youcef Souar Omar Mouffok Taher Moulay University Saida, Algeria Email:Syoucef12@yahoo.fr

### Optimization Technique for Maximization Problem in Evolutionary Programming of Genetic Algorithm in Data Mining

Optimization Technique for Maximization Problem in Evolutionary Programming of Genetic Algorithm in Data Mining R. Karthick Assistant Professor, Dept. of MCA Karpagam Institute of Technology karthick2885@yahoo.com

### Genetic Programming of Autonomous Agents. Functional Requirements List and Performance Specifi cations. Scott O'Dell

Genetic Programming of Autonomous Agents Functional Requirements List and Performance Specifi cations Scott O'Dell Advisors: Dr. Joel Schipper and Dr. Arnold Patton November 23, 2010 GPAA 1 Project Goals

### 1 Lab 5: Particle Swarm Optimization

1 Lab 5: Particle Swarm Optimization This laboratory requires the following: (The development tools are installed in GR B0 01 already): C development tools (gcc, make, etc.) Webots simulation software

### Genetic Algorithm Performance with Different Selection Methods in Solving Multi-Objective Network Design Problem

etic Algorithm Performance with Different Selection Methods in Solving Multi-Objective Network Design Problem R. O. Oladele Department of Computer Science University of Ilorin P.M.B. 1515, Ilorin, NIGERIA

### Outline. CS 6776 Evolutionary Computation. Numerical Optimization. Fitness Function. ,x 2. ) = x 2 1. , x , 5.0 x 1.

Outline CS 6776 Evolutionary Computation January 21, 2014 Problem modeling includes representation design and Fitness Function definition. Fitness function: Unconstrained optimization/modeling Constrained

### Active contour: a parallel genetic algorithm approach

id-1 Active contour: a parallel genetic algorithm approach Florence Kussener 1 1 MathWorks, 2 rue de Paris 92196 Meudon Cedex, France Florence.Kussener@mathworks.fr Abstract This paper presents an algorithm

### Generation of Ultra Side lobe levels in Circular Array Antennas using Evolutionary Algorithms

Generation of Ultra Side lobe levels in Circular Array Antennas using Evolutionary Algorithms D. Prabhakar Associate Professor, Dept of ECE DVR & Dr. HS MIC College of Technology Kanchikacherla, AP, India.

### Reducing Graphic Conflict In Scale Reduced Maps Using A Genetic Algorithm

Reducing Graphic Conflict In Scale Reduced Maps Using A Genetic Algorithm Dr. Ian D. Wilson School of Technology, University of Glamorgan, Pontypridd CF37 1DL, UK Dr. J. Mark Ware School of Computing,

### International Journal of Digital Application & Contemporary research Website: (Volume 1, Issue 7, February 2013)

Performance Analysis of GA and PSO over Economic Load Dispatch Problem Sakshi Rajpoot sakshirajpoot1988@gmail.com Dr. Sandeep Bhongade sandeepbhongade@rediffmail.com Abstract Economic Load dispatch problem

### A NOVEL APPROACH FOR PRIORTIZATION OF OPTIMIZED TEST CASES

A NOVEL APPROACH FOR PRIORTIZATION OF OPTIMIZED TEST CASES Abhishek Singhal Amity School of Engineering and Technology Amity University Noida, India asinghal1@amity.edu Swati Chandna Amity School of Engineering

### Evolutionary Computation Algorithms for Cryptanalysis: A Study

Evolutionary Computation Algorithms for Cryptanalysis: A Study Poonam Garg Information Technology and Management Dept. Institute of Management Technology Ghaziabad, India pgarg@imt.edu Abstract The cryptanalysis

### MINIMAL EDGE-ORDERED SPANNING TREES USING A SELF-ADAPTING GENETIC ALGORITHM WITH MULTIPLE GENOMIC REPRESENTATIONS

Proceedings of Student/Faculty Research Day, CSIS, Pace University, May 5 th, 2006 MINIMAL EDGE-ORDERED SPANNING TREES USING A SELF-ADAPTING GENETIC ALGORITHM WITH MULTIPLE GENOMIC REPRESENTATIONS Richard

### Midterm Examination CS540-2: Introduction to Artificial Intelligence

Midterm Examination CS540-2: Introduction to Artificial Intelligence March 15, 2018 LAST NAME: FIRST NAME: Problem Score Max Score 1 12 2 13 3 9 4 11 5 8 6 13 7 9 8 16 9 9 Total 100 Question 1. [12] Search

### Design Space Exploration

Design Space Exploration SS 2012 Jun.-Prof. Dr. Christian Plessl Custom Computing University of Paderborn Version 1.1.0 2012-06-15 Overview motivation for design space exploration design space exploration

### A Genetic Algorithm for Multiprocessor Task Scheduling

A Genetic Algorithm for Multiprocessor Task Scheduling Tashniba Kaiser, Olawale Jegede, Ken Ferens, Douglas Buchanan Dept. of Electrical and Computer Engineering, University of Manitoba, Winnipeg, MB,

### International Journal of Scientific & Engineering Research Volume 8, Issue 10, October-2017 ISSN

194 Prime Number Generation Using Genetic Algorithm Arpit Goel 1, Anuradha Brijwal 2, Sakshi Gautam 3 1 Dept. Of Computer Science & Engineering, Himalayan School of Engineering & Technology, Swami Rama

### Neural Network Weight Selection Using Genetic Algorithms

Neural Network Weight Selection Using Genetic Algorithms David Montana presented by: Carl Fink, Hongyi Chen, Jack Cheng, Xinglong Li, Bruce Lin, Chongjie Zhang April 12, 2005 1 Neural Networks Neural networks

### GA is the most popular population based heuristic algorithm since it was developed by Holland in 1975 [1]. This algorithm runs faster and requires les

Chaotic Crossover Operator on Genetic Algorithm Hüseyin Demirci Computer Engineering, Sakarya University, Sakarya, 54187, Turkey Ahmet Turan Özcerit Computer Engineering, Sakarya University, Sakarya, 54187,

### CS5401 FS2015 Exam 1 Key

CS5401 FS2015 Exam 1 Key This is a closed-book, closed-notes exam. The only items you are allowed to use are writing implements. Mark each sheet of paper you use with your name and the string cs5401fs2015

### Evolving SQL Queries for Data Mining

Evolving SQL Queries for Data Mining Majid Salim and Xin Yao School of Computer Science, The University of Birmingham Edgbaston, Birmingham B15 2TT, UK {msc30mms,x.yao}@cs.bham.ac.uk Abstract. This paper

### Midterm Examination CS 540-2: Introduction to Artificial Intelligence

Midterm Examination CS 54-2: Introduction to Artificial Intelligence March 9, 217 LAST NAME: FIRST NAME: Problem Score Max Score 1 15 2 17 3 12 4 6 5 12 6 14 7 15 8 9 Total 1 1 of 1 Question 1. [15] State

### Genetic Algorithms Presented by: Faramarz Safi (Ph.D.) Faculty of Computer Engineering Islamic Azad University, Najafabad Branch.

Presented by: Faramarz Safi (Ph.D.) Faculty of Computer Engineering Islamic Azad University, Najafabad Branch Chapter 3 1 GA Quick Overview Developed: USA in the 1970 s Early names: J. Holland, K. DeJong,

### Meta- Heuristic based Optimization Algorithms: A Comparative Study of Genetic Algorithm and Particle Swarm Optimization

2017 2 nd International Electrical Engineering Conference (IEEC 2017) May. 19 th -20 th, 2017 at IEP Centre, Karachi, Pakistan Meta- Heuristic based Optimization Algorithms: A Comparative Study of Genetic

### A Memetic Genetic Program for Knowledge Discovery

A Memetic Genetic Program for Knowledge Discovery by Gert Nel Submitted in partial fulfilment of the requirements for the degree Master of Science in the Faculty of Engineering, Built Environment and Information

### Automatic Programming with Ant Colony Optimization

Automatic Programming with Ant Colony Optimization Jennifer Green University of Kent jg9@kent.ac.uk Jacqueline L. Whalley University of Kent J.L.Whalley@kent.ac.uk Colin G. Johnson University of Kent C.G.Johnson@kent.ac.uk

### Multi-Objective Optimization Using Genetic Algorithms

Multi-Objective Optimization Using Genetic Algorithms Mikhail Gaerlan Computational Physics PH 4433 December 8, 2015 1 Optimization Optimization is a general term for a type of numerical problem that involves

### Genetic Programming for Multiclass Object Classification

Genetic Programming for Multiclass Object Classification by William Richmond Smart A thesis submitted to the Victoria University of Wellington in fulfilment of the requirements for the degree of Master

### The Genetic Algorithm for finding the maxima of single-variable functions

Research Inventy: International Journal Of Engineering And Science Vol.4, Issue 3(March 2014), PP 46-54 Issn (e): 2278-4721, Issn (p):2319-6483, www.researchinventy.com The Genetic Algorithm for finding

### 1. Introduction. 2. Motivation and Problem Definition. Volume 8 Issue 2, February Susmita Mohapatra

Pattern Recall Analysis of the Hopfield Neural Network with a Genetic Algorithm Susmita Mohapatra Department of Computer Science, Utkal University, India Abstract: This paper is focused on the implementation

### A genetic algorithms approach to optimization parameter space of Geant-V prototype

A genetic algorithms approach to optimization parameter space of Geant-V prototype Oksana Shadura CERN, PH-SFT & National Technical Univ. of Ukraine Kyiv Polytechnic Institute Geant-V parameter space [1/2]