Biology in Computation: Evolving Intelligent Controllers
|
|
- Melissa Sutton
- 5 years ago
- Views:
Transcription
1 Biology in Computation: Evolving Intelligent Controllers Combining Genetic Algorithms with Neural Networks: Implementation & Application Dimitrios N. Terzopoulos 18/1/2017
2 Contents Intelligent Control vs. other strategies Development of Intelligence in Nature Artificial Neural Networks & Implementation Genetic Algorithms & Implementation Neuroevolution & Simulation 2
3 Intelligent Control vs. Other Strategies 3
4 System Modelling 4
5 System Modelling 5
6 Mathematical Model x ( t) = A( t) x( t) + B( t) u( t) y( t) = C( t) x( t) + D( t) u( t) Observability Stability Controllability 6
7 Control u =? 7
8 Complex Systems Thermoregulation 8
9 Complex Systems Blood Pressure Regulation 9
10 Complex Systems Economy 10
11 Complex System Modelling System dynamics cannot be modelled easily. Little information about the behavior of the system. Incomplete knowledge of state variables. Too few output variables. Few input variables. 11
12 Intelligent Modelling Complex Systems contain Knowledge. Knowledge Informal Modelling. Analyze and understand behavior of Systems. What is knowledge? Whatever means something (in a sense): 12
13 Knowledge Knowledge about the terrain of an area Topographic Relief Representation How? 13
14 Knowledge can be contained in a Contour Map. Model & Principles 14
15 Knowledge Knowledge about the normal cardiac function Cardiac Function Representation Aortic Stenosis (and/or, maybe ) Mitral Regurgitation Electrocardiogram & Phonocardiogram 15
16 Knowledge can be contained in a Phonocardiogram. Model & Principles 16
17 Knowledge Intelligent Controllers use Knowledge to their Advantage. Knowledge is represented internally. Sometimes, it is not very clear HOW or WHY! Examples: Rules Fuzzy Logic, Inductive Logic Programming, Structures Neural Networks. Machine Learning Support Vector Machines (SVM), 17
18 Development of Intelligence in Nature 18
19 Biological Controller Neural Network: Nature s great biological controller 19
20 Biological Controller Neural Network: Nature s great biological controller Sensors Vision, Audition, Magnetoception, Somatosensation Inputs 20
21 Biological Controller Neural Network: Nature s great biological controller Sensors Vision, Audition, Magnetoception, Somatosensation Inputs Processor Hidden Layers 21
22 Biological Controller Neural Network: Nature s great biological controller Sensors Vision, Audition, Magnetoception, Somatosensation Inputs Processor Hidden Layers Decision Outputs 22
23 Biological Controller Neural Network: Nature s great biological controller. Sensors Vision, Audition, Magnetoception, Somatosensation Inputs Processor Hidden Layers Decision Outputs Action 23
24 Natural Intelligence Learning vs. Evolution (...both, in real life ) 24
25 Natural Intelligence Learning Neural Network is recalibrated through outside interaction. Evolution Neural Network changes structure across generations. 25
26 Natural Intelligence Learning Neural Network is recalibrated through outside interaction. 26
27 Natural Intelligence Evolution Neural Network changes structure across generations. 27
28 Artificial Neural Networks 28
29 Artificial Neuron Simplest Model (Weighted Sum Element) 29
30 Artificial Neuron Simplest Model (Weighted Sum Element) Soma 30
31 Artificial Neuron Simplest Model (Weighted Sum Element) Soma (characteristics) 31
32 Artificial Neuron Simplest Model (Weighted Sum Element) Dendrites 32
33 Artificial Neuron Simplest Model (Weighted Sum Element) Axon & Synapses 33
34 Artificial Neural Network Multilayer Feedforward Artificial Neural Network: Acyclic. Organization in Layers. Distinct Input Output Layers. 34
35 Implementation General Object Oriented Design Classes Constructor Properties Functionality (operators, delegates, etc.) Graphical User Interface 35
36 Implementation Class Neuron ReceiveInputs(inputs) ProcessSignalQueue() TryFire(neuron, weight) (Enter Inputs in Input Queue) (Sum Activation from Signals) (Send Signals to some neuron) Class Layer (inherited by InputLayer, OutputLayer) PrepareNeurons() ProcessInputs() TryFire(layer) GetOutputs() (Input Layer Only) (Process Neuron Queues) (Send signals to next Layer Neurons) (Output Layer Only) 36
37 Implementation Class NeuralNetwork ProcessData(inputs) RandomNetwork() (Pass data through network) (Create Network with random values) w 11 w 21 37
38 Implementation Class NeuralNetwork ProcessData(inputs) RandomNetwork() (Pass data through network) (Create Network with random values) x 1 w 11 w 21 x 2 38
39 Implementation Class NeuralNetwork ProcessData(inputs) RandomNetwork() (Pass data through network) (Create Network with random values) w 11 w 21 x 1 w 1,o x 2 39
40 Implementation Class NeuralNetwork ProcessData(inputs) RandomNetwork() w 11 w 21 (Pass data through network) (Create Network with random values) y f wx f wx wx ( ) 1 = 2 i1 i = i = y 1 x 1 w 1,o x 2 40
41 Implementation Class NeuralNetwork ProcessData(inputs) RandomNetwork() w 11 w 21 (Pass data through network) (Create Network with random values) y f wx f wx wx ( ) 1 = 2 i1 i = i = y 1 x 1 w 1,o x 2 2x = = + ( ) tanh ( x) f x 1 e 1 e 41 2x
42 Implementation Class NeuralNetwork ProcessData(inputs) RandomNetwork() w 11 w 21 (Pass data through network) (Create Network with random values) y f wx f wx wx ( ) 1 = 2 i1 i = i = y 1 x 1 w 1,o o = w y + 1 1, o 1 x 2 2x = = + ( ) tanh ( x) f x 1 e 1 e 42 2x
43 Implementation Neurons queue the input signals. Each queue is processed when a layer is activated. When activation > threshold Neuron fires! Fire Signal is enqueued in target neuron s queue. Threshold, bias, activation function Design choices. 43
44 Implementation In this application: Multilayer Feedforward Neural Networks Many Hidden Layers containing up to 30 Artificial Neurons each. 4 Artificial Neurons for Input & Output Layer. Hyperbolic Tangent Activation Function. No Threshold for Activation. Random connection weights 0<w<1. 44
45 Genetic Algorithms 45
46 Genetic Algorithms A form of engineered evolution. Mimic principles of evolution to achieve polymorphism. In short Chromosomes mate to create other chromosomes. 46
47 Genetic Algorithms Encoding: Convert objects to Chromosomes. Each Chromosome represents one solution. 47
48 Genetic Algorithms Encoding: Convert objects to Chromosomes. Binary Encoding (A long binary DNA string) 48
49 Genetic Algorithms Encoding: Convert objects to Chromosomes. Binary Encoding (A long binary DNA string) Solution Parameterization 2 variables P = 1, 2 x x { } 49
50 Genetic Algorithms Encoding: Convert objects to Chromosomes. Binary Encoding (A long binary DNA string) Solution Parameterization 2 variables P = 1, 2 x x { } C = a a { } 1 0,1 n n x = a am x = a a ( ) ( ) 2 m+ 1 n 2 Chromosome 50
51 Genetic Algorithms Encoding: Convert objects to Chromosomes. Value Encoding (The parameterization itself) Solution Parameterization 2 variables P = 1, 2 x x { } 51
52 Genetic Algorithms Encoding: Convert objects to Chromosomes. Value Encoding (The parameterization itself) Solution Parameterization 2 variables P = 1, 2 x x { } C = 1, 2 { x x } Chromosome 52
53 Genetic Algorithms Encoding: Convert objects to Chromosomes. Syntax Encoding (Any valid syntactic representation, e.g. a syntax tree) Solution Parameterization A Program 53
54 Genetic Algorithms Encoding: Convert objects to Chromosomes. Syntax Encoding (Any valid syntactic representation, e.g. a syntax tree) Solution Parameterization A Program C = 54
55 Genetic Algorithms Encoding: Convert objects to Chromosomes. Syntax Encoding (Any valid syntactic representation, e.g. a syntax tree) Solution Parameterization A Program C = 55
56 Genetic Algorithms Genetic Operators 56
57 Genetic Algorithms Genetic Operators Crossover Mutation 57
58 Genetic Algorithms Genetic Operators Crossover Mutation 58
59 Genetic Algorithms Genetic Operators Crossover Mutation { } { } 59
60 Genetic Algorithms Random initial population is created. Each chromosome is assessed at a task (e.g. solution). Chromosomes are assigned fitness values. 60
61 Genetic Algorithms One generation cycle consists of: Elimination of some of the least fit. Survival of some of the fittest (Elitism). Some mate to produce offspring (Crossover). Some are randomly altered (Mutation). 61
62 Genetic Algorithms Many ideas can be transferred from Biology to GAs. Artificial Embryogeny (indirect encoding techniques). Sex Chromosomes (sex-linked gene assignment). etc 62
63 Implementation Class Chromosome Constructor() Transcribe() (Creates Chromosome DNA from ANN) (Converts Chromosome DNA to ANN) Class NeuralGeneticRecombiner Constructor() (Creates Random ANN Population) Crossover(mom, dad) (Performs crossover between Chromosomes) EvolveGeneration() (Performs steps to progress generation) 63
64 Implementation In this application: Genetic Algorithm: Randomization instead of Mutation (was destructive). Elimination %: 70% Randomization %: 40% of the surviving (i.e. ~ 28%) Population of 12 Chromosomes Chromosomes have 1 RNG Seed for random #s. After crossover, extra weights might be needed 64
65 Implementation In this application: Evolution: Chromosomes sorted in decreasing order of fitness. Elimination takes place (8 chromosomes eliminated 4 best stay) Randomization takes place (0.4 * 4 = new created) Rest 6 chromosomes from crossover between 4 fittest. 65
66 Neuroevolution 66
67 Neuroevolution Using genetic algorithms to evolve Neural Networks! 67
68 Population of Generation i Neuroevolution Elimination Mutation Population of Generation i Survival (Elitism) Crossover
69 Application Bots in a Maze. 69
70 Application Bots in a Maze. Geometric aspects of Motion 70
71 Application The Maze with the bots. 71
72 Application The Maze (Toroidal bots cross through edges). 72
73 Application Bots are allowed to explore the Maze. They only feel what s in their Field-of-View. They are controlled by Neural Networks. The Simulation-Evolution Algorithm 73
74 74
75 Application How do bots react when a wall is sighted? 75
76 Application How do bots react when a wall is sighted? 76
77 Application How do bots react when a wall is sighted? x = P y = P x + 2x + x 4 y + 2y + y 4 L C R L C R 77
78 Application Four inputs are created (x 1 depends on direction) (x 4 depends on distance) ω x1 = 1 x = 2 2 ap S x3 = x4 = 1 dp 78
79 Application Neural network pilot processes the data x 1 x 2 x 3 x 4 79
80 Application Neural network pilot processes the data x 1 x 2 x 3 x 4 80
81 Application and retrieves the outputs. x 1 x 2 x 3 x 4 y 1 y 2 y 3 y 4 81
82 Application and retrieves the outputs. x 1 x 2 x 3 x 4 y 1 y 2 y 3 y 4 to guide the bot 82
83 Application x 1 x 2 x 3 x 4 and retrieves the outputs. y 1 y 2 y 3 y 4 to guide the bot (appropriately) y1 0.5 y1 > y4 y4 dar = y1 0.5 y1 < y4 y4 y3 0.1 y3 > y2 y2 daz = y y3 < y2 y2 83
84 Application Bots are rewarded with respect to area covered They get points for hitting milestones. (Where? How much?) 84
85 Application They get points for hitting milestones. (Where? How much?) 85
86 Application What does the end result look like? 86
87 Application 87
88 Application Bots gather points, they crash (often), and their neural network pilots evolve. Test experiment for few generations. 88
89 Application 1.8 Evolution of Average Fitness over 8 Generations 1.6 Average Fitness Test Run 1 Test Run 2 Test Run 3 Test Run 4 Test Run 5 Test Run Generation 89
90 Conclusions Any preliminary conclusions? 90
91 Conclusions Any preliminary conclusions? Elitism Improves accuracy across generations. 91
92 Conclusions Any preliminary conclusions? Elitism Improves accuracy across generations. 8 generations Too few! Initial outcomes depend on the starting conditions 92
93 Conclusions Any preliminary conclusions? Elitism Improves accuracy across generations. 8 generations Too few! Initial outcomes depend on the starting conditions Networks with many layers (>8) appear with time. (Not always better). 93
94 Conclusions Any preliminary conclusions? Number of inputs and outputs is related to number of intermediate hidden layers in terms of efficiency. 94
95 Conclusions Any preliminary conclusions? Number of inputs and outputs is related to number of intermediate hidden layers in terms of efficiency. Crossover locates optimal region. Mutation locates optimal solution within optimal region. 95
96 Conclusions Any preliminary conclusions? Number of inputs and outputs is related to number of intermediate hidden layers in terms of efficiency. Crossover locates optimal region. Mutation locates optimal solution within optimal region. Evolution with Learning may prove to be even better! 96
97 Conclusions Any general conclusions? 97
98 Conclusions Any general conclusions? Fitness function evaluation is extremely important. It guides the evolution process (e.g. fitness landscape). If not carefully designed, problem is misrepresented. 98
99 Conclusions Any general conclusions? Fitness function evaluation is extremely important. It guides the evolution process (e.g. fitness landscape). If not carefully designed, problem is misrepresented. Artificial Embryogenesis Very strong improvement. Compaction of genotype. Better scan of solution space. Evolving architecture for ANNs. 99
100 Thank you all for your attention! 100
Genetic Algorithm for Finding Shortest Path in a Network
Intern. J. Fuzzy Mathematical Archive Vol. 2, 2013, 43-48 ISSN: 2320 3242 (P), 2320 3250 (online) Published on 26 August 2013 www.researchmathsci.org International Journal of Genetic Algorithm for Finding
More informationIntroduction to Genetic Algorithms. Based on Chapter 10 of Marsland Chapter 9 of Mitchell
Introduction to Genetic Algorithms Based on Chapter 10 of Marsland Chapter 9 of Mitchell Genetic Algorithms - History Pioneered by John Holland in the 1970s Became popular in the late 1980s Based on ideas
More informationGenetic Algorithms Variations and Implementation Issues
Genetic Algorithms Variations and Implementation Issues CS 431 Advanced Topics in AI Classic Genetic Algorithms GAs as proposed by Holland had the following properties: Randomly generated population Binary
More informationHardware Neuronale Netzwerke - Lernen durch künstliche Evolution (?)
SKIP - May 2004 Hardware Neuronale Netzwerke - Lernen durch künstliche Evolution (?) S. G. Hohmann, Electronic Vision(s), Kirchhoff Institut für Physik, Universität Heidelberg Hardware Neuronale Netzwerke
More informationMachine Evolution. Machine Evolution. Let s look at. Machine Evolution. Machine Evolution. Machine Evolution. Machine Evolution
Let s look at As you will see later in this course, neural networks can learn, that is, adapt to given constraints. For example, NNs can approximate a given function. In biology, such learning corresponds
More informationEvolutionary origins of modularity
Evolutionary origins of modularity Jeff Clune, Jean-Baptiste Mouret and Hod Lipson Proceedings of the Royal Society B 2013 Presented by Raghav Partha Evolvability Evolvability capacity to rapidly adapt
More informationOutline. Motivation. Introduction of GAs. Genetic Algorithm 9/7/2017. Motivation Genetic algorithms An illustrative example Hypothesis space search
Outline Genetic Algorithm Motivation Genetic algorithms An illustrative example Hypothesis space search Motivation Evolution is known to be a successful, robust method for adaptation within biological
More informationGrid-Based Genetic Algorithm Approach to Colour Image Segmentation
Grid-Based Genetic Algorithm Approach to Colour Image Segmentation Marco Gallotta Keri Woods Supervised by Audrey Mbogho Image Segmentation Identifying and extracting distinct, homogeneous regions from
More informationA genetic algorithms approach to optimization parameter space of Geant-V prototype
A genetic algorithms approach to optimization parameter space of Geant-V prototype Oksana Shadura CERN, PH-SFT & National Technical Univ. of Ukraine Kyiv Polytechnic Institute Geant-V parameter space [1/2]
More informationA Genetic Algorithm for Graph Matching using Graph Node Characteristics 1 2
Chapter 5 A Genetic Algorithm for Graph Matching using Graph Node Characteristics 1 2 Graph Matching has attracted the exploration of applying new computing paradigms because of the large number of applications
More informationThe k-means Algorithm and Genetic Algorithm
The k-means Algorithm and Genetic Algorithm k-means algorithm Genetic algorithm Rough set approach Fuzzy set approaches Chapter 8 2 The K-Means Algorithm The K-Means algorithm is a simple yet effective
More information4/22/2014. Genetic Algorithms. Diwakar Yagyasen Department of Computer Science BBDNITM. Introduction
4/22/24 s Diwakar Yagyasen Department of Computer Science BBDNITM Visit dylycknow.weebly.com for detail 2 The basic purpose of a genetic algorithm () is to mimic Nature s evolutionary approach The algorithm
More informationWhat is GOSET? GOSET stands for Genetic Optimization System Engineering Tool
Lecture 5: GOSET 1 What is GOSET? GOSET stands for Genetic Optimization System Engineering Tool GOSET is a MATLAB based genetic algorithm toolbox for solving optimization problems 2 GOSET Features Wide
More informationGenetic Algorithms. Genetic Algorithms
A biological analogy for optimization problems Bit encoding, models as strings Reproduction and mutation -> natural selection Pseudo-code for a simple genetic algorithm The goal of genetic algorithms (GA):
More informationGenetic Algorithms. Kang Zheng Karl Schober
Genetic Algorithms Kang Zheng Karl Schober Genetic algorithm What is Genetic algorithm? A genetic algorithm (or GA) is a search technique used in computing to find true or approximate solutions to optimization
More informationEvolutionary Computation. Chao Lan
Evolutionary Computation Chao Lan Outline Introduction Genetic Algorithm Evolutionary Strategy Genetic Programming Introduction Evolutionary strategy can jointly optimize multiple variables. - e.g., max
More information1. Introduction. 2. Motivation and Problem Definition. Volume 8 Issue 2, February Susmita Mohapatra
Pattern Recall Analysis of the Hopfield Neural Network with a Genetic Algorithm Susmita Mohapatra Department of Computer Science, Utkal University, India Abstract: This paper is focused on the implementation
More informationThe Genetic Algorithm for finding the maxima of single-variable functions
Research Inventy: International Journal Of Engineering And Science Vol.4, Issue 3(March 2014), PP 46-54 Issn (e): 2278-4721, Issn (p):2319-6483, www.researchinventy.com The Genetic Algorithm for finding
More informationGenetic Algorithms. PHY 604: Computational Methods in Physics and Astrophysics II
Genetic Algorithms Genetic Algorithms Iterative method for doing optimization Inspiration from biology General idea (see Pang or Wikipedia for more details): Create a collection of organisms/individuals
More informationIntroduction (7.1) Genetic Algorithms (GA) (7.2) Simulated Annealing (SA) (7.3) Random Search (7.4) Downhill Simplex Search (DSS) (7.
Chapter 7: Derivative-Free Optimization Introduction (7.1) Genetic Algorithms (GA) (7.2) Simulated Annealing (SA) (7.3) Random Search (7.4) Downhill Simplex Search (DSS) (7.5) Jyh-Shing Roger Jang et al.,
More informationNeural Network Weight Selection Using Genetic Algorithms
Neural Network Weight Selection Using Genetic Algorithms David Montana presented by: Carl Fink, Hongyi Chen, Jack Cheng, Xinglong Li, Bruce Lin, Chongjie Zhang April 12, 2005 1 Neural Networks Neural networks
More informationGenetic Algorithms for Vision and Pattern Recognition
Genetic Algorithms for Vision and Pattern Recognition Faiz Ul Wahab 11/8/2014 1 Objective To solve for optimization of computer vision problems using genetic algorithms 11/8/2014 2 Timeline Problem: Computer
More informationArtificial Neural Network based Curve Prediction
Artificial Neural Network based Curve Prediction LECTURE COURSE: AUSGEWÄHLTE OPTIMIERUNGSVERFAHREN FÜR INGENIEURE SUPERVISOR: PROF. CHRISTIAN HAFNER STUDENTS: ANTHONY HSIAO, MICHAEL BOESCH Abstract We
More informationSuppose you have a problem You don t know how to solve it What can you do? Can you use a computer to somehow find a solution for you?
Gurjit Randhawa Suppose you have a problem You don t know how to solve it What can you do? Can you use a computer to somehow find a solution for you? This would be nice! Can it be done? A blind generate
More informationTopological Machining Fixture Layout Synthesis Using Genetic Algorithms
Topological Machining Fixture Layout Synthesis Using Genetic Algorithms Necmettin Kaya Uludag University, Mechanical Eng. Department, Bursa, Turkey Ferruh Öztürk Uludag University, Mechanical Eng. Department,
More informationLecture 6: Genetic Algorithm. An Introduction to Meta-Heuristics, Produced by Qiangfu Zhao (Since 2012), All rights reserved
Lecture 6: Genetic Algorithm An Introduction to Meta-Heuristics, Produced by Qiangfu Zhao (Since 2012), All rights reserved Lec06/1 Search and optimization again Given a problem, the set of all possible
More information11/14/2010 Intelligent Systems and Soft Computing 1
Lecture 7 Artificial neural networks: Supervised learning Introduction, or how the brain works The neuron as a simple computing element The perceptron Multilayer neural networks Accelerated learning in
More informationThe Binary Genetic Algorithm. Universidad de los Andes-CODENSA
The Binary Genetic Algorithm Universidad de los Andes-CODENSA 1. Genetic Algorithms: Natural Selection on a Computer Figure 1 shows the analogy between biological i l evolution and a binary GA. Both start
More informationComputational Intelligence
Computational Intelligence Module 6 Evolutionary Computation Ajith Abraham Ph.D. Q What is the most powerful problem solver in the Universe? ΑThe (human) brain that created the wheel, New York, wars and
More informationInternational Journal of Scientific & Engineering Research, Volume 8, Issue 1, January ISSN
International Journal of Scientific & Engineering Research, Volume 8, Issue 1, January-2017 550 Using Neuro Fuzzy and Genetic Algorithm for Image Denoising Shaymaa Rashid Saleh Raidah S. Khaudeyer Abstract
More informationIntroduction to Genetic Algorithms
Advanced Topics in Image Analysis and Machine Learning Introduction to Genetic Algorithms Week 3 Faculty of Information Science and Engineering Ritsumeikan University Today s class outline Genetic Algorithms
More informationChapter 14 The Genetic Algorithm
Chapter 14 The Genetic Algorithm Chapter Contents 14.1 Biological Evolution............................. 615 14.2 Representing the Population of Individuals............... 616 14.2.1 Strings, Chromosomes,
More informationV.Petridis, S. Kazarlis and A. Papaikonomou
Proceedings of IJCNN 93, p.p. 276-279, Oct. 993, Nagoya, Japan. A GENETIC ALGORITHM FOR TRAINING RECURRENT NEURAL NETWORKS V.Petridis, S. Kazarlis and A. Papaikonomou Dept. of Electrical Eng. Faculty of
More informationCS 4510/9010 Applied Machine Learning. Neural Nets. Paula Matuszek Fall copyright Paula Matuszek 2016
CS 4510/9010 Applied Machine Learning 1 Neural Nets Paula Matuszek Fall 2016 Neural Nets, the very short version 2 A neural net consists of layers of nodes, or neurons, each of which has an activation
More informationApplying genetic algorithm on power system stabilizer for stabilization of power system
Applying genetic algorithm on power system stabilizer for stabilization of power system 1,3 Arnawan Hasibuan and 2,3 Syafrudin 1 Engineering Department of Malikussaleh University, Lhokseumawe, Indonesia;
More informationCHAPTER 5 ENERGY MANAGEMENT USING FUZZY GENETIC APPROACH IN WSN
97 CHAPTER 5 ENERGY MANAGEMENT USING FUZZY GENETIC APPROACH IN WSN 5.1 INTRODUCTION Fuzzy systems have been applied to the area of routing in ad hoc networks, aiming to obtain more adaptive and flexible
More information2. Neural network basics
2. Neural network basics Next commonalities among different neural networks are discussed in order to get started and show which structural parts or concepts appear in almost all networks. It is presented
More informationEvolutionary Algorithms. CS Evolutionary Algorithms 1
Evolutionary Algorithms CS 478 - Evolutionary Algorithms 1 Evolutionary Computation/Algorithms Genetic Algorithms l Simulate natural evolution of structures via selection and reproduction, based on performance
More informationAkaike information criterion).
An Excel Tool The application has three main tabs visible to the User and 8 hidden tabs. The first tab, User Notes, is a guide for the User to help in using the application. Here the User will find all
More informationComparative Analysis of Genetic Algorithm Implementations
Comparative Analysis of Genetic Algorithm Implementations Robert Soricone Dr. Melvin Neville Department of Computer Science Northern Arizona University Flagstaff, Arizona SIGAda 24 Outline Introduction
More informationCHAPTER 6 REAL-VALUED GENETIC ALGORITHMS
CHAPTER 6 REAL-VALUED GENETIC ALGORITHMS 6.1 Introduction Gradient-based algorithms have some weaknesses relative to engineering optimization. Specifically, it is difficult to use gradient-based algorithms
More informationIntroduction to Design Optimization: Search Methods
Introduction to Design Optimization: Search Methods 1-D Optimization The Search We don t know the curve. Given α, we can calculate f(α). By inspecting some points, we try to find the approximated shape
More informationA Modified Genetic Algorithm for Process Scheduling in Distributed System
A Modified Genetic Algorithm for Process Scheduling in Distributed System Vinay Harsora B.V.M. Engineering College Charatar Vidya Mandal Vallabh Vidyanagar, India Dr.Apurva Shah G.H.Patel College of Engineering
More informationFOREST PLANNING USING PSO WITH A PRIORITY REPRESENTATION
FOREST PLANNING USING PSO WITH A PRIORITY REPRESENTATION P.W. Brooks and W.D. Potter Institute for Artificial Intelligence, University of Georgia, USA Overview Background: (NIO Project 1 ) PSO -- GA --
More informationAero-engine PID parameters Optimization based on Adaptive Genetic Algorithm. Yinling Wang, Huacong Li
International Conference on Applied Science and Engineering Innovation (ASEI 215) Aero-engine PID parameters Optimization based on Adaptive Genetic Algorithm Yinling Wang, Huacong Li School of Power and
More informationThe Continuous Genetic Algorithm. Universidad de los Andes-CODENSA
The Continuous Genetic Algorithm Universidad de los Andes-CODENSA 1. Components of a Continuous Genetic Algorithm The flowchart in figure1 provides a big picture overview of a continuous GA.. Figure 1.
More informationInformation Fusion Dr. B. K. Panigrahi
Information Fusion By Dr. B. K. Panigrahi Asst. Professor Department of Electrical Engineering IIT Delhi, New Delhi-110016 01/12/2007 1 Introduction Classification OUTLINE K-fold cross Validation Feature
More informationHeuristic Optimisation
Heuristic Optimisation Part 10: Genetic Algorithm Basics Sándor Zoltán Németh http://web.mat.bham.ac.uk/s.z.nemeth s.nemeth@bham.ac.uk University of Birmingham S Z Németh (s.nemeth@bham.ac.uk) Heuristic
More informationReification of Boolean Logic
Chapter Reification of Boolean Logic Exercises. (a) Design a feedforward network to divide the black dots from other corners with fewest neurons and layers. Please specify the values of weights and thresholds.
More informationEvolving SQL Queries for Data Mining
Evolving SQL Queries for Data Mining Majid Salim and Xin Yao School of Computer Science, The University of Birmingham Edgbaston, Birmingham B15 2TT, UK {msc30mms,x.yao}@cs.bham.ac.uk Abstract. This paper
More informationCONCEPT FORMATION AND DECISION TREE INDUCTION USING THE GENETIC PROGRAMMING PARADIGM
1 CONCEPT FORMATION AND DECISION TREE INDUCTION USING THE GENETIC PROGRAMMING PARADIGM John R. Koza Computer Science Department Stanford University Stanford, California 94305 USA E-MAIL: Koza@Sunburn.Stanford.Edu
More informationGenetic Programming. and its use for learning Concepts in Description Logics
Concepts in Description Artificial Intelligence Institute Computer Science Department Dresden Technical University May 29, 2006 Outline Outline: brief introduction to explanation of the workings of a algorithm
More informationIntroduction to Evolutionary Computation
Introduction to Evolutionary Computation The Brought to you by (insert your name) The EvoNet Training Committee Some of the Slides for this lecture were taken from the Found at: www.cs.uh.edu/~ceick/ai/ec.ppt
More information[Premalatha, 4(5): May, 2015] ISSN: (I2OR), Publication Impact Factor: (ISRA), Journal Impact Factor: 2.114
IJESRT INTERNATIONAL JOURNAL OF ENGINEERING SCIENCES & RESEARCH TECHNOLOGY GENETIC ALGORITHM FOR OPTIMIZATION PROBLEMS C. Premalatha Assistant Professor, Department of Information Technology Sri Ramakrishna
More informationA Population-Based Learning Algorithm Which Learns Both. Architectures and Weights of Neural Networks y. Yong Liu and Xin Yao
A Population-Based Learning Algorithm Which Learns Both Architectures and Weights of Neural Networks y Yong Liu and Xin Yao Computational Intelligence Group Department of Computer Science University College,
More informationGENETIC ALGORITHM with Hands-On exercise
GENETIC ALGORITHM with Hands-On exercise Adopted From Lecture by Michael Negnevitsky, Electrical Engineering & Computer Science University of Tasmania 1 Objective To understand the processes ie. GAs Basic
More informationReview: Final Exam CPSC Artificial Intelligence Michael M. Richter
Review: Final Exam Model for a Learning Step Learner initially Environm ent Teacher Compare s pe c ia l Information Control Correct Learning criteria Feedback changed Learner after Learning Learning by
More informationAppendix E. This appendix contains a description of the software used in the project in implementing the evolutionary ANN.
Appendix E This appendix contains a description of the software used in the project in implementing the evolutionary ANN. The software allows modules of neurons and input sensors to be added or deleted
More informationUsing Genetic Algorithms in Integer Programming for Decision Support
Doi:10.5901/ajis.2014.v3n6p11 Abstract Using Genetic Algorithms in Integer Programming for Decision Support Dr. Youcef Souar Omar Mouffok Taher Moulay University Saida, Algeria Email:Syoucef12@yahoo.fr
More informationIntroduction to Genetic Algorithms. Genetic Algorithms
Introduction to Genetic Algorithms Genetic Algorithms We ve covered enough material that we can write programs that use genetic algorithms! More advanced example of using arrays Could be better written
More informationArtificial Intelligence Application (Genetic Algorithm)
Babylon University College of Information Technology Software Department Artificial Intelligence Application (Genetic Algorithm) By Dr. Asaad Sabah Hadi 2014-2015 EVOLUTIONARY ALGORITHM The main idea about
More informationChapter 9: Genetic Algorithms
Computational Intelligence: Second Edition Contents Compact Overview First proposed by Fraser in 1957 Later by Bremermann in 1962 and Reed et al in 1967 Popularized by Holland in 1975 Genetic algorithms
More informationThe Application of Genetic Neural Network in Network Intrusion Detection
JOURNAL OF COMPUTERS, VOL. 4, NO. 12, DECEMBER 2009 1223 The Application of Genetic Neural Network in Network Intrusion Detection Hua Jiang School of Economics and Management, Hebei University of Engineering,
More informationYuki Osada Andrew Cannon
Yuki Osada Andrew Cannon 1 Humans are an intelligent species One feature is the ability to learn The ability to learn comes down to the brain The brain learns from experience Research shows that the brain
More informationA GENETIC ALGORITHM FOR CLUSTERING ON VERY LARGE DATA SETS
A GENETIC ALGORITHM FOR CLUSTERING ON VERY LARGE DATA SETS Jim Gasvoda and Qin Ding Department of Computer Science, Pennsylvania State University at Harrisburg, Middletown, PA 17057, USA {jmg289, qding}@psu.edu
More informationThe Parallel Software Design Process. Parallel Software Design
Parallel Software Design The Parallel Software Design Process Deborah Stacey, Chair Dept. of Comp. & Info Sci., University of Guelph dastacey@uoguelph.ca Why Parallel? Why NOT Parallel? Why Talk about
More informationCHAPTER 4 FEATURE SELECTION USING GENETIC ALGORITHM
CHAPTER 4 FEATURE SELECTION USING GENETIC ALGORITHM In this research work, Genetic Algorithm method is used for feature selection. The following section explains how Genetic Algorithm is used for feature
More informationJEvolution: Evolutionary Algorithms in Java
Computational Intelligence, Simulation, and Mathematical Models Group CISMM-21-2002 May 19, 2015 JEvolution: Evolutionary Algorithms in Java Technical Report JEvolution V0.98 Helmut A. Mayer helmut@cosy.sbg.ac.at
More informationMachine Learning in Biology
Università degli studi di Padova Machine Learning in Biology Luca Silvestrin (Dottorando, XXIII ciclo) Supervised learning Contents Class-conditional probability density Linear and quadratic discriminant
More informationAdvanced Search Genetic algorithm
Advanced Search Genetic algorithm Yingyu Liang yliang@cs.wisc.edu Computer Sciences Department University of Wisconsin, Madison [Based on slides from Jerry Zhu, Andrew Moore http://www.cs.cmu.edu/~awm/tutorials
More informationParticle swarm optimization of artificial neural networks for autonomous robots. Mahmood Rahmani
Thesis for the degree of Master of Science in Complex Adaptive Systems Particle swarm optimization of artificial neural networks for autonomous robots Mahmood Rahmani Department of Applied Physics Chalmers
More informationGenetic Algorithm. Dr. Rajesh Kumar
Genetic Algorithm Dr. Rajesh Kumar PhD, PDF (NUS, Singapore) SMIEEE, FIETE, MIE (I),LMCSI, SMIACSIT, LMISTE, MIAENG Associate Professor, Department of Electrical Engineering Adjunct Associate Professor,
More informationDETERMINING MAXIMUM/MINIMUM VALUES FOR TWO- DIMENTIONAL MATHMATICLE FUNCTIONS USING RANDOM CREOSSOVER TECHNIQUES
DETERMINING MAXIMUM/MINIMUM VALUES FOR TWO- DIMENTIONAL MATHMATICLE FUNCTIONS USING RANDOM CREOSSOVER TECHNIQUES SHIHADEH ALQRAINY. Department of Software Engineering, Albalqa Applied University. E-mail:
More informationGenetic Programming. Charles Chilaka. Department of Computational Science Memorial University of Newfoundland
Genetic Programming Charles Chilaka Department of Computational Science Memorial University of Newfoundland Class Project for Bio 4241 March 27, 2014 Charles Chilaka (MUN) Genetic algorithms and programming
More informationGenetic Fourier Descriptor for the Detection of Rotational Symmetry
1 Genetic Fourier Descriptor for the Detection of Rotational Symmetry Raymond K. K. Yip Department of Information and Applied Technology, Hong Kong Institute of Education 10 Lo Ping Road, Tai Po, New Territories,
More informationResearch Article Path Planning Using a Hybrid Evolutionary Algorithm Based on Tree Structure Encoding
e Scientific World Journal, Article ID 746260, 8 pages http://dx.doi.org/10.1155/2014/746260 Research Article Path Planning Using a Hybrid Evolutionary Algorithm Based on Tree Structure Encoding Ming-Yi
More informationChapter 5 Components for Evolution of Modular Artificial Neural Networks
Chapter 5 Components for Evolution of Modular Artificial Neural Networks 5.1 Introduction In this chapter, the methods and components used for modular evolution of Artificial Neural Networks (ANNs) are
More informationGenetic Algorithm for Dynamic Capacitated Minimum Spanning Tree
28 Genetic Algorithm for Dynamic Capacitated Minimum Spanning Tree 1 Tanu Gupta, 2 Anil Kumar 1 Research Scholar, IFTM, University, Moradabad, India. 2 Sr. Lecturer, KIMT, Moradabad, India. Abstract Many
More informationDerivative-Free Optimization
Derivative-Free Optimization Chapter 7 from Jang Outline Simulated Annealing (SA) Downhill simplex search Random search Genetic algorithms (GA) 2 The Big Picture Model space Adaptive networks Neural networks
More informationEvolutionary Computation Part 2
Evolutionary Computation Part 2 CS454, Autumn 2017 Shin Yoo (with some slides borrowed from Seongmin Lee @ COINSE) Crossover Operators Offsprings inherit genes from their parents, but not in identical
More informationEvolutionary Art with Cartesian Genetic Programming
Evolutionary Art with Cartesian Genetic Programming Laurence Ashmore 1, and Julian Francis Miller 2 1 Department of Informatics, University of Sussex, Falmer, BN1 9QH, UK emoai@hotmail.com http://www.gaga.demon.co.uk/
More informationParameter optimization model in electrical discharge machining process *
14 Journal of Zhejiang University SCIENCE A ISSN 1673-565X (Print); ISSN 1862-1775 (Online) www.zju.edu.cn/jzus; www.springerlink.com E-mail: jzus@zju.edu.cn Parameter optimization model in electrical
More informationMutations for Permutations
Mutations for Permutations Insert mutation: Pick two allele values at random Move the second to follow the first, shifting the rest along to accommodate Note: this preserves most of the order and adjacency
More informationA TSK-Type Recurrent Fuzzy Network for Dynamic Systems Processing by Neural Network and Genetic Algorithms
IEEE TRANSACTIONS ON FUZZY SYSTEMS, VOL. 10, NO. 2, APRIL 2002 155 A TSK-Type Recurrent Fuzzy Network for Dynamic Systems Processing by Neural Network and Genetic Algorithms Chia-Feng Juang, Member, IEEE
More informationGenetic Algorithm for Dynamic Capacitated Minimum Spanning Tree
Genetic Algorithm for Dynamic Capacitated Minimum Spanning Tree Rahul Mathur M.Tech (Purs.) BU, AJMER IMRAN KHAN Assistant Professor AIT, Ajmer VIKAS CHOUDHARY Assistant Professor AIT, Ajmer ABSTRACT:-Many
More informationSoft Computing and Artificial Intelligence Techniques for Intrusion Detection System
Soft Computing and Artificial Intelligence Techniques for Intrusion Detection System V. Bapuji 1* R. Naveen Kumar 2 Dr. A. Govardhan 3 Prof. S.S.V.N. Sarma 4 1. Department of Informatics, Kakatiya University,
More informationInducing Parameters of a Decision Tree for Expert System Shell McESE by Genetic Algorithm
Inducing Parameters of a Decision Tree for Expert System Shell McESE by Genetic Algorithm I. Bruha and F. Franek Dept of Computing & Software, McMaster University Hamilton, Ont., Canada, L8S4K1 Email:
More informationInitial Classification Through Back Propagation In a Neural Network Following Optimization Through GA to Evaluate the Fitness of an Algorithm
Initial Classification Through Back Propagation In a Neural Network Following Optimization Through GA to Evaluate the Fitness of an Algorithm Amit Ganatra 1, Y P Kosta 2, Gaurang Panchal 3, Chintan Gajjar
More informationNuclear Research Reactors Accidents Diagnosis Using Genetic Algorithm/Artificial Neural Networks
Nuclear Research Reactors Accidents Diagnosis Using Genetic Algorithm/Artificial Neural Networks Abdelfattah A. Ahmed**, Nwal A. Alfishawy*, Mohamed A. Albrdini* and Imbaby I. Mahmoud** * Dept of Comp.
More informationRole of Genetic Algorithm in Routing for Large Network
Role of Genetic Algorithm in Routing for Large Network *Mr. Kuldeep Kumar, Computer Programmer, Krishi Vigyan Kendra, CCS Haryana Agriculture University, Hisar. Haryana, India verma1.kuldeep@gmail.com
More informationNeuroevolution of Agents Capable of Reactive and Deliberative Behaviours in Novel and Dynamic Environments
Neuroevolution of Agents Capable of Reactive and Deliberative Behaviours in Novel and Dynamic Environments Edward Robinson, Timothy Ellis and Alastair Channon School of Computer Science, University of
More informationA Generalized Feedforward Neural Network Architecture and Its Training Using Two Stochastic Search Methods
A Generalized Feedforward Neural Network Architecture and Its Training Using Two tochastic earch Methods Abdesselam Bouzerdoum 1 and Rainer Mueller 2 1 chool of Engineering and Mathematics Edith Cowan
More informationLogical Rhythm - Class 3. August 27, 2018
Logical Rhythm - Class 3 August 27, 2018 In this Class Neural Networks (Intro To Deep Learning) Decision Trees Ensemble Methods(Random Forest) Hyperparameter Optimisation and Bias Variance Tradeoff Biological
More informationSolving Traveling Salesman Problem for Large Spaces using Modified Meta- Optimization Genetic Algorithm
Solving Traveling Salesman Problem for Large Spaces using Modified Meta- Optimization Genetic Algorithm Maad M. Mijwel Computer science, college of science, Baghdad University Baghdad, Iraq maadalnaimiy@yahoo.com
More informationKyrre Glette INF3490 Evolvable Hardware Cartesian Genetic Programming
Kyrre Glette kyrrehg@ifi INF3490 Evolvable Hardware Cartesian Genetic Programming Overview Introduction to Evolvable Hardware (EHW) Cartesian Genetic Programming Applications of EHW 3 Evolvable Hardware
More informationPreprocessing of Stream Data using Attribute Selection based on Survival of the Fittest
Preprocessing of Stream Data using Attribute Selection based on Survival of the Fittest Bhakti V. Gavali 1, Prof. Vivekanand Reddy 2 1 Department of Computer Science and Engineering, Visvesvaraya Technological
More informationTransactions on Information and Communications Technologies vol 15, 1997 WIT Press, ISSN
Optimizing the structure of neural networks using evolution techniques S. D. Likothanassis**, E. Georgopoulos* & D. Fotakis** "Department of Computer Engineering and Informatics, Un/vg^/Yy q/^f 6zrmj,
More informationArtificial Neural Networks Lecture Notes Part 5. Stephen Lucci, PhD. Part 5
Artificial Neural Networks Lecture Notes Part 5 About this file: If you have trouble reading the contents of this file, or in case of transcription errors, email gi0062@bcmail.brooklyn.cuny.edu Acknowledgments:
More informationAdaptive Crossover in Genetic Algorithms Using Statistics Mechanism
in Artificial Life VIII, Standish, Abbass, Bedau (eds)(mit Press) 2002. pp 182 185 1 Adaptive Crossover in Genetic Algorithms Using Statistics Mechanism Shengxiang Yang Department of Mathematics and Computer
More informationPoint Grouping Using a Genetic Algorithm
Point Grouping Using a Genetic Algorithm Kriangsiri Malasri Senior, School of Aerospace Engineering Georgia Institute of Technology, 34054 Georgia Tech Station, Atlanta, GA 30332 Siripong Malasri Professor
More information