THE DEVELOPMENT OF THE POTENTIAL AND ACADMIC PROGRAMMES OF WROCLAW UNIVERISTY OF TECHNOLOGY METAHEURISTICS


 Marcus Gilmore
 9 months ago
 Views:
Transcription
1 METAHEURISTICS 1. Objectives The goals of the laboratory workshop are as follows: to learn basic properties of evolutionary computation techniques and other metaheuristics for solving various global optimization problems, to study the selected evolutionary strategies, genetic algorithms, and some metaheuristics such as ACO, PSO, and IWO. to train the skills in coding global optimization algorithms in Matlab and using the Matlab s Genetic Algorithm and Direct Search Optimization Toolbox. The workshop is scheduled for 3 academic hours.. Introduction In computer science, metaheuristic designates a computational method that optimizes a problem by trying to improve iteratively a candidate solution with regard to a given measure of quality. Metaheuristics make few or no assumptions about the problem being optimized and can search very large spaces of candidate solutions. However, metaheuristics do not guarantee an optimal solution is ever found. Other terms having a similar meaning as metaheuristic are: derivativefree, direct search, blackbox, or just heuristic optimizer. Many metaheuristics implement some form of stochastic optimization. Metaheuristics are used for combinatorial optimization in which an optimal solution is sought over a discrete searchspace. Metaheuristics are also used for problems over realvalued searchspaces, where the classic way of optimization is to derive the gradient of the function to be optimized and then employ gradient descent or a quasinewton method. Metaheuristics do not use the gradient or Hessian matrix so their advantage is that the function to be optimized need not be continuous or differentiable and it can also have constraints. 3. Preparation. The expected time needed for the preparation to this workshop is 9 hours Reading [1]. T. Back, Evolutionary Algorithms in Theory and Practice, New York, Oxford University Press, 1996, []. The Handbook of Evolutionary Computation, Editors: T. Back, D. B. Fogel, Z. Michalewicz, New York, Oxford University Press, 1996, Project cofinanced by European Union within European Social Fund 1
2 [3]. T. Weise, Global Optimization Algorithms Theory and Application, ebook, 009, [4]. A. R. Mehrabian, C. Lucas, A Novel Numerical Optimization Algorithm Inspired from Weed Colonization, Ecological Informatics, Vol. 1, No. 4, 006, pp , [5]. J. Arabas, Wykłady z algorytmów ewolucyjnych, WNT, Problems At the beginning of the laboratory workshop each student should know the answers to the following questions: What is a NPhard problem? What is a fitness function? What are fundamental groups of evolutionary strategies? What is a chromosome or genotype? What is a phenotype? What are the basic genetic operators? What are the roulettewheel and tournament selections? What is the elitist strategy? What are typical crossover techniques? How to apply the evolutionary algorithms to constrained optimization problems? What is a fundamental strategy in the Simulated Annealing (SA) algorithm? What is a fundamental strategy in the TabuSearch (TS) algorithm? What is a fundamental strategy in the Ant Colony Optimization (ACO) algorithm? What is a fundamental strategy in the Particle Swarm Optimization (PSO) algorithm? What is a fundamental strategy in the Invasive Weed Optimization (IWO) algorithm? 3.3. Detailed preparation Each group of students ( 3 persons) is expected to accomplish the following tasks: 1. formulate LP problems in the matrix form for some typical engineering problems (listed below),. code the selected global optimization algorithms in Matlab, 3. compare the results (convergence rate, elapsed time, etc.) obtained with the coded algorithms and with the functions ga(.), gamultiobj(.), and simulannealbnd(.) in Matlab, 4. draw the conclusions. Project cofinanced by European Union within European Social Fund
3 Problems to be modeled The following problems should be solved with the selected global optimization algorithms. Problem 1: Find the global minimum of the Griewank function for n =, 3, : n n 1 xi f ( x) = xi cos i= 1 i= 1 i +. Illustrate this function graphically on a D contour plot and a 3D surface plot. Show its fitness versus evolutionary process. Problem : Find the global minimum of the Rastrigin function for n =, 3, : n i= 1 ( i 10 cos i 10) f ( x) = x ( π x ) +. Illustrate this function graphically on a D contour plot and a 3D surface plot. Show its fitness versus evolutionary process. Problem 3: Find the global minimum of the function: f ( x) x exp for x 0 = 0 exp{ 1} + ( x 0)( x ) for x > 0 for x [ 15 4]. Illustrate this function graphically, and show its fitness versus evolutionary process. Problem 4: Find the global minimum of the Rosenbrock's function: ( ) = ( ) + ( ) f x 100 x x 1 x, 1 1 s.t. xx 1 + x1 x , 10 xx 0, 1 0 x 1, 1 0 x 13, Illustrate this function graphically on a D contour plot and a 3D surface plot. Show its fitness versus evolutionary process. Problem 5: Find the global minima of the following function: Project cofinanced by European Union within European Social Fund 3
4 4 x ( ) 1 f x = 4.1x1 + x1 + x1x + ( 4x 4) x, 3 for 3 x1 3 and x. Illustrate this function graphically on a D contour plot and a 3D surface plot. Show its fitness versus evolutionary process. Problem 6: Find the global minimum of the Easom function: { } ( ) cos( ) cos( ) exp ( π) ( π) f x = x x x x, 1 1 for 100 x i 100, i = 1,. Illustrate this function graphically on a D contour plot and a 3D surface plot. Show its fitness versus evolutionary process. Problem 7: Find the global minimum of the modified Sombrero function: n cos xi i= 1 f ( x) =, n 4 xi + 1 i= 1 for 10 x i 10, i = 1,. Illustrate this function graphically on a D contour plot and a 3D surface plot. Show its fitness versus evolutionary process. Algorithms to be coded Students are expected to code the following algorithms and apply them to the abovementioned global optimization problems. Algorithm 1: The evolutionary strategy (1+1), [1], Chapter, Section.1.7, pp , Algorithm 5, Algorithm : The evolutionary strategy ( μ, λ ), [1], Chapter, Section.1.6, pp , Algorithm 4, Algorithm 3: The evolutionary strategy ( μ + λ ), [1], Chapter, Section.1.6, pp , Algorithm 4, Algorithm 4: The genetic algorithm (general form), [1], Chapter, Section.3.6, pp , Algorithm 8. Test various options: encoding: binary or gray; selection: roulettewheel, linear ranking, stochastic universal sampling or tournament; crossover: onepoint, twopoint, multipoint, uniform; mutation: with or without binary mask; elitism or pure succession, using different values of the parameters (e.g. probability of mutations, size of the base population, etc.). Algorithm 5: The PSO algorithm: [3], Chapter 9, pp. 49 5, Algorithm 9.1, Project cofinanced by European Union within European Social Fund 4
5 Algorithm 6: The SA algorithm: [3], Chapter 1, pp , Algorithm 1.1, Algorithm 7: The TS algorithm: [3], Chapter 14, pp , Algorithm 14.1, Algorithm 8: The IWO algorithm: [4], pp Content of report The report should contain: introductory page, detailed mathematical description of the analyzed problems, a basic description of the coded algorithms, the Matlab code (together with the detailed endline comments) of the analyzed algorithm, the results obtained with the coded algorithms, the results obtained with the Matlab functions included in the selected Matlab toolboxes, conclusions The section Results should present the final solutions (for a D case the final solution marked on the feasible set), the convergence behavior (e.g. error norm between the approximate solution and the exact one or residuals), the elapsed time, and the comparison to the results obtained with the functions included in the selected Matlab s toolboxes. 5. Appendix: The Appendix contains the syntax of the ga function. Syntax GA attempts to solve problems of the form: min F(X) subject to: A*X <= B, Aeq*X = Beq (linear constraints) X C(X) <= 0, Ceq(X) = 0 (nonlinear constraints) LB <= X <= ub X = GA(FITNESSFCN,NVARS) finds a local unconstrained minimum X to the FITNESSFCN using GA. NVARS is the dimension (number of design variables) of the FITNESSFCN. FITNESSFCN accepts a vector X of size 1byNVARS, and returns a scalar evaluated at X. X = GA(FITNESSFCN,NVARS,A,b) finds a local minimum X to the function FITNESSFCN, subject to the linear inequalities A*X <= B. Linear constraints are not satisfied when the PopulationType option is set to 'bitstring' or 'custom'. See the documentation for details. Project cofinanced by European Union within European Social Fund 5
6 X = GA(FITNESSFCN,NVARS,A,b,Aeq,beq) finds a local minimum X to the function FITNESSFCN, subject to the linear equalities Aeq*X = beq as well as A*X <= B. (Set A=[] and B=[] if no inequalities exist.) Linear constraints are not satisfied when the PopulationType option is set to 'bitstring' or 'custom'. See the documentation for details. X = GA(FITNESSFCN,NVARS,A,b,Aeq,beq,lb,ub) defines a set of lower and upper bounds on the design variables, X, so that a solution is found in the range lb <= X <= ub. Use empty matrices for lb and ub if no bounds exist. Set lb(i) = Inf if X(i) is unbounded below; set ub(i) = Inf if X(i) is unbounded above. Linear constraints are not satisfied when the PopulationType option is set to 'bitstring' or 'custom'. See the documentation for details. X = GA(FITNESSFCN,NVARS,A,b,Aeq,beq,lb,ub,NONLCON) subjects the minimization to the constraints defined in NONLCON. The function NONLCON accepts X and returns the vectors C and Ceq, representing the nonlinear inequalities and equalities respectively. GA minimizes FITNESSFCN such that C(X)<=0 and Ceq(X)=0. (Set lb=[] and/or ub=[] if no bounds exist.) Nonlinear constraints are not satisfied when the PopulationType option is set to 'bitstring' or 'custom'. See the documentation for details. X = GA(FITNESSFCN,NVARS,A,b,Aeq,beq,lb,ub,NONLCON,options) minimizes with the default optimization parameters replaced by values in the structure OPTIONS. OPTIONS can be created with the GAOPTIMSET function. X = GA(PROBLEM) finds the minimum for PROBLEM. PROBLEM is a structure that has the following fields: fitnessfcn: <Fitness function> nvars: <Number of design variables> Aineq: <A matrix for inequality constraints> bineq: <b vector for inequality constraints> Aeq: <Aeq matrix for equality constraints> beq: <beq vector for equality constraints> lb: <Lower bound on X> ub: <Upper bound on X> nonlcon: <nonlinear constraint function> options: <Options structure created with GAOPTIMSET> randstate: <State of the uniform random number generator> randnstate: <State of the normal random number generator> [X,FVAL] = GA(FITNESSFCN,...) returns FVAL, the value of the fitness function FITNESSFCN at the solution X. [X,FVAL,EXITFLAG] = GA(FITNESSFCN,...) returns EXITFLAG which describes the exit condition of GA. Possible values of EXITFLAG and the corresponding exit conditions are 1 Average change in value of the fitness function over options.stallgenlimit generations less than options.tolfun and constraint violation less than options.tolcon. Project cofinanced by European Union within European Social Fund 6
7 3 The value of the fitness function did not change in options.stallgenlimit generations and constraint violation less than options.tolcon. 4 Magnitude of step smaller than machine precision and constraint violation less than options.tolcon. This exit condition applies only to nonlinear constraints. 5 Fitness limit reached and constraint violation less than options.tolcon. 0 Maximum number of generations exceeded. 1 Optimization terminated by the output or plot function.  No feasible point found. 4 Stall time limit exceeded. 5 Time limit exceeded. [X,FVAL,EXITFLAG,OUTPUT] = GA(FITNESSFCN,...) returns a structure OUTPUT with the following information: randstate: <State of the function RAND used before GA started> randnstate: <State of the function RANDN used before GA started> generations: <Total generations, excluding HybridFcn iterations> funccount: <Total function evaluations> maxconstraint: <Maximum constraint violation>, if any message: <GA termination message> [X,FVAL,EXITFLAG,OUTPUT,POPULATION] = GA(FITNESSFCN,...) returns the final POPULATION at termination. [X,FVAL,EXITFLAG,OUTPUT,POPULATION,SCORES] = GA(FITNESSFCN,...) returns the SCORES of the final POPULATION. Example: Unconstrained minimization of 'rastriginsfcn' fitness function of numberofvariables = x = Display plotting functions while GA minimizes options = gaoptimset('plotfcns',... [x,fval,exitflag,output] = An example with inequality constraints and lower bounds A = [1 1; 1 ; 1]; b = [; ; 3]; lb = zeros(,1); % Use mutation function which can handle constraints options = [x,fval,exitflag] = FITNESSFCN can also be an anonymous function: x = 3*sin(x(1))+exp(x()),) If FITNESSFCN or NONLCON are parameterized, you can use anonymous functions to capture the problemdependent parameters. Suppose you want to minimize the fitness given in the function myfit, subject to the nonlinear constraint myconstr, where these two functions are parameterized by their second argument a1 and a, respectively. Here myfit and myconstr are Mfile functions such as Project cofinanced by European Union within European Social Fund 7
8 and function f = myfit(x,a1) f = exp(x(1))*(4*x(1)^ + *x()^ + 4*x(1)*x() + *x() + a1); function [c,ceq] = myconstr(x,a) c = [1.5 + x(1)*x()  x(1)  x(); x(1)*x()  a]; % No nonlinear equality constraints: ceq = []; To optimize for specific values of a1 and a, first assign the values to these two parameters. Then create two oneargument anonymous functions that capture the values of a1 and a, and call myfit and myconstr with two arguments. Finally, pass these anonymous functions to GA: a1 = 1; a = 10; % define parameters first % Mutation function for constrained minimization options = x = Project cofinanced by European Union within European Social Fund 8
Laboratorio di Algoritmi Genetici
Laboratorio di Algoritmi Genetici Ruggero Donida Labati Dipartimento di Tecnologie dell Informazione via Bramante 65, 26013 Crema (CR), Italy ruggero.donida@unimi.it Why? You can apply the genetic algorithm
More informationGenetic Algorithm and Direct Search Toolbox 2 User s Guide
Genetic Algorithm and Direct Search Toolbox 2 User s Guide How to Contact The MathWorks www.mathworks.com Web comp.softsys.matlab Newsgroup www.mathworks.com/contact_ts.html Technical Support suggest@mathworks.com
More informationGenetic Algorithm and Direct Search Toolbox For Use with MATLAB
Genetic Algorithm and Direct Search Toolbox For Use with MATLAB Computation Visualization Programming User s Guide Version 2 How to Contact The MathWorks www.mathworks.com Web comp.softsys.matlab Newsgroup
More informationCT79 SOFT COMPUTING ALCCSFEB 2014
Q.1 a. Define Union, Intersection and complement operations of Fuzzy sets. For fuzzy sets A and B Figure Fuzzy sets A & B The union of two fuzzy sets A and B is a fuzzy set C, written as C=AUB or C=A OR
More informationGenetic Algorithm and Direct Search Toolbox
Genetic Algorithm and Direct Search Toolbox For Use with MATLAB User s Guide Version 1 How to Contact The MathWorks: www.mathworks.com comp.softsys.matlab support@mathworks.com suggest@mathworks.com bugs@mathworks.com
More informationAppendix A MATLAB s Optimization Toolbox Algorithms
Appendix A MATLAB s Optimization Toolbox Algorithms Abstract MATLAB s Optimization Toolbox (version 7:2) includes a family of algorithms for solving optimization problems. The toolbox provides functions
More informationA SteadyState Genetic Algorithm for Traveling Salesman Problem with Pickup and Delivery
A SteadyState Genetic Algorithm for Traveling Salesman Problem with Pickup and Delivery Monika Sharma 1, Deepak Sharma 2 1 Research Scholar Department of Computer Science and Engineering, NNSS SGI Samalkha,
More informationGA is the most popular population based heuristic algorithm since it was developed by Holland in 1975 [1]. This algorithm runs faster and requires les
Chaotic Crossover Operator on Genetic Algorithm Hüseyin Demirci Computer Engineering, Sakarya University, Sakarya, 54187, Turkey Ahmet Turan Özcerit Computer Engineering, Sakarya University, Sakarya, 54187,
More informationAn Evolutionary Algorithm for the Multiobjective Shortest Path Problem
An Evolutionary Algorithm for the Multiobjective Shortest Path Problem Fangguo He Huan Qi Qiong Fan Institute of Systems Engineering, Huazhong University of Science & Technology, Wuhan 430074, P. R. China
More informationOptimization of Benchmark Functions Using Genetic Algorithm
Optimization of Benchmark s Using Genetic Algorithm Vinod Goyal GJUS&T, Hisar Sakshi Dhingra GJUS&T, Hisar Jyoti Goyat GJUS&T, Hisar Dr Sanjay Singla IET Bhaddal Technical Campus, Ropar, Punjab Abstrat
More informationAn Introduction to Evolutionary Algorithms
An Introduction to Evolutionary Algorithms Karthik Sindhya, PhD Postdoctoral Researcher Industrial Optimization Group Department of Mathematical Information Technology Karthik.sindhya@jyu.fi http://users.jyu.fi/~kasindhy/
More informationLecture 4. Convexity Robust cost functions Optimizing nonconvex functions. 3B1B Optimization Michaelmas 2017 A. Zisserman
Lecture 4 3B1B Optimization Michaelmas 2017 A. Zisserman Convexity Robust cost functions Optimizing nonconvex functions grid search branch and bound simulated annealing evolutionary optimization The Optimization
More informationPROJECT REPORT. Parallel Optimization in Matlab. Joakim Agnarsson, Mikael Sunde, Inna Ermilova Project in Computational Science: Report January 2013
Parallel Optimization in Matlab Joakim Agnarsson, Mikael Sunde, Inna Ermilova Project in Computational Science: Report January 2013 PROJECT REPORT Department of Information Technology Contents 1 Introduction
More informationConstrained Functions of N Variables: NonGradient Based Methods
onstrained Functions of N Variables: NonGradient Based Methods Gerhard Venter Stellenbosch University Outline Outline onstrained Optimization Nongradient based methods Genetic Algorithms (GA) Particle
More informationThe Modified IWO Algorithm for Optimization of Numerical Functions
The Modified IWO Algorithm for Optimization of Numerical Functions Daniel Kostrzewa and Henryk Josiński Silesian University of Technology, Akademicka 16 PL44100 Gliwice, Poland {Daniel.Kostrzewa,Henryk.Josinski}@polsl.pl
More informationIntroduction to Design Optimization: Search Methods
Introduction to Design Optimization: Search Methods 1D Optimization The Search We don t know the curve. Given α, we can calculate f(α). By inspecting some points, we try to find the approximated shape
More informationCHAPTER 4 GENETIC ALGORITHM
69 CHAPTER 4 GENETIC ALGORITHM 4.1 INTRODUCTION Genetic Algorithms (GAs) were first proposed by John Holland (Holland 1975) whose ideas were applied and expanded on by Goldberg (Goldberg 1989). GAs is
More informationA Genetic Algorithm for Graph Matching using Graph Node Characteristics 1 2
Chapter 5 A Genetic Algorithm for Graph Matching using Graph Node Characteristics 1 2 Graph Matching has attracted the exploration of applying new computing paradigms because of the large number of applications
More informationBinary Differential Evolution Strategies
Binary Differential Evolution Strategies A.P. Engelbrecht, Member, IEEE G. Pampará Abstract Differential evolution has shown to be a very powerful, yet simple, populationbased optimization approach. The
More informationPrerequisite Material for Course Heuristics and Approximation Algorithms
Prerequisite Material for Course Heuristics and Approximation Algorithms This document contains an overview of the basic concepts that are needed in preparation to participate in the course. In addition,
More informationCS5401 FS2015 Exam 1 Key
CS5401 FS2015 Exam 1 Key This is a closedbook, closednotes exam. The only items you are allowed to use are writing implements. Mark each sheet of paper you use with your name and the string cs5401fs2015
More informationAvailable online at ScienceDirect. Razvan Cazacu*, Lucian Grama
Available online at www.sciencedirect.com ScienceDirect Procedia Technology 12 ( 2014 ) 339 346 The 7 th International Conference Interdisciplinarity in Engineering (INTERENG 2013) Steel truss optimization
More informationMATLAB Solution of Linear Programming Problems
MATLAB Solution of Linear Programming Problems The simplex method is included in MATLAB using linprog function. All is needed is to have the problem expressed in the terms of MATLAB definitions. Appendix
More informationIntroduction to Genetic Algorithms. Based on Chapter 10 of Marsland Chapter 9 of Mitchell
Introduction to Genetic Algorithms Based on Chapter 10 of Marsland Chapter 9 of Mitchell Genetic Algorithms  History Pioneered by John Holland in the 1970s Became popular in the late 1980s Based on ideas
More informationAvailable online at ScienceDirect. Procedia CIRP 44 (2016 )
Available online at www.sciencedirect.com ScienceDirect Procedia CIRP 44 (2016 ) 102 107 6th CIRP Conference on Assembly Technologies and Systems (CATS) Worker skills and equipment optimization in assembly
More informationNumerical Optimization: Introduction and gradientbased methods
Numerical Optimization: Introduction and gradientbased methods Master 2 Recherche LRI Apprentissage Statistique et Optimisation Anne Auger Inria SaclayIledeFrance November 2011 http://tao.lri.fr/tikiindex.php?page=courses
More informationTime Complexity Analysis of the Genetic Algorithm Clustering Method
Time Complexity Analysis of the Genetic Algorithm Clustering Method Z. M. NOPIAH, M. I. KHAIRIR, S. ABDULLAH, M. N. BAHARIN, and A. ARIFIN Department of Mechanical and Materials Engineering Universiti
More informationModule 1 Lecture Notes 2. Optimization Problem and Model Formulation
Optimization Methods: Introduction and Basic concepts 1 Module 1 Lecture Notes 2 Optimization Problem and Model Formulation Introduction In the previous lecture we studied the evolution of optimization
More informationOptimizing Flow Shop Sequencing Through Simulation Optimization Using Evolutionary Methods
Optimizing Flow Shop Sequencing Through Simulation Optimization Using Evolutionary Methods Sucharith Vanguri 1, Travis W. Hill 2, Allen G. Greenwood 1 1 Department of Industrial Engineering 260 McCain
More informationAutomata Construct with Genetic Algorithm
Automata Construct with Genetic Algorithm Vít Fábera Department of Informatics and Telecommunication, Faculty of Transportation Sciences, Czech Technical University, Konviktská 2, Praha, Czech Republic,
More informationGENETIC ALGORITHM VERSUS PARTICLE SWARM OPTIMIZATION IN NQUEEN PROBLEM
Journal of AlNahrain University Vol.10(2), December, 2007, pp.172177 Science GENETIC ALGORITHM VERSUS PARTICLE SWARM OPTIMIZATION IN NQUEEN PROBLEM * Azhar W. Hammad, ** Dr. Ban N. Thannoon AlNahrain
More informationTrading Rule Optimization. By Yichi Zhang, Xinyan Hu
Trading Rule Optimization By Yichi Zhang, Xinyan Hu Overview The idea of the project Description of the market strategy and market data Genetic algorithm, PSO algorithm and adjusted PSO algorithm Genetic
More informationGeneration of Ultra Side lobe levels in Circular Array Antennas using Evolutionary Algorithms
Generation of Ultra Side lobe levels in Circular Array Antennas using Evolutionary Algorithms D. Prabhakar Associate Professor, Dept of ECE DVR & Dr. HS MIC College of Technology Kanchikacherla, AP, India.
More informationModel Parameter Estimation
Model Parameter Estimation Shan He School for Computational Science University of Birmingham Module 0623836: Computational Modelling with MATLAB Outline Outline of Topics Concepts about model parameter
More informationMATLAB Based Optimization Techniques and Parallel Computing
MATLAB Based Optimization Techniques and Parallel Computing Bratislava June 4, 2009 2009 The MathWorks, Inc. JörgM. Sautter Application Engineer The MathWorks Agenda Introduction Local and Smooth Optimization
More informationSparse Matrices Reordering using Evolutionary Algorithms: A Seeded Approach
1 Sparse Matrices Reordering using Evolutionary Algorithms: A Seeded Approach David Greiner, Gustavo Montero, Gabriel Winter Institute of Intelligent Systems and Numerical Applications in Engineering (IUSIANI)
More informationFast oriented bounding box optimization on the rotation group SO(3, R)
Fast oriented bounding box optimization on the rotation group SO(3, R) ChiaTche Chang 1, Bastien Gorissen 2,3 and Samuel Melchior 1,2 chiatche.chang@uclouvain.be bastien.gorissen@cenaero.be samuel.melchior@uclouvain.be
More informationGENETIC ALGORITHM with HandsOn exercise
GENETIC ALGORITHM with HandsOn exercise Adopted From Lecture by Michael Negnevitsky, Electrical Engineering & Computer Science University of Tasmania 1 Objective To understand the processes ie. GAs Basic
More informationPRIMALDUAL INTERIOR POINT METHOD FOR LINEAR PROGRAMMING. 1. Introduction
PRIMALDUAL INTERIOR POINT METHOD FOR LINEAR PROGRAMMING KELLER VANDEBOGERT AND CHARLES LANNING 1. Introduction Interior point methods are, put simply, a technique of optimization where, given a problem
More informationBenchmark Functions for the CEC 2008 Special Session and Competition on Large Scale Global Optimization
Benchmark Functions for the CEC 2008 Special Session and Competition on Large Scale Global Optimization K. Tang 1, X. Yao 1, 2, P. N. Suganthan 3, C. MacNish 4, Y. P. Chen 5, C. M. Chen 5, Z. Yang 1 1
More informationMINIMAL EDGEORDERED SPANNING TREES USING A SELFADAPTING GENETIC ALGORITHM WITH MULTIPLE GENOMIC REPRESENTATIONS
Proceedings of Student/Faculty Research Day, CSIS, Pace University, May 5 th, 2006 MINIMAL EDGEORDERED SPANNING TREES USING A SELFADAPTING GENETIC ALGORITHM WITH MULTIPLE GENOMIC REPRESENTATIONS Richard
More informationParticle Swarm Optimization Methods for Pattern. Recognition and Image Processing
Particle Swarm Optimization Methods for Pattern Recognition and Image Processing by Mahamed G. H. Omran Submitted in partial fulfillment of the requirements for the degree Philosophiae Doctor in the Faculty
More informationGenetic Algorithms. Kang Zheng Karl Schober
Genetic Algorithms Kang Zheng Karl Schober Genetic algorithm What is Genetic algorithm? A genetic algorithm (or GA) is a search technique used in computing to find true or approximate solutions to optimization
More informationEvolutionary Algorithms. CS Evolutionary Algorithms 1
Evolutionary Algorithms CS 478  Evolutionary Algorithms 1 Evolutionary Computation/Algorithms Genetic Algorithms l Simulate natural evolution of structures via selection and reproduction, based on performance
More informationFixture Layout Optimization Using Element Strain Energy and Genetic Algorithm
Fixture Layout Optimization Using Element Strain Energy and Genetic Algorithm Zeshan Ahmad, Matteo Zoppi, Rezia Molfino Abstract The stiffness of the workpiece is very important to reduce the errors in
More informationTheoretical Concepts of Machine Learning
Theoretical Concepts of Machine Learning Part 2 Institute of Bioinformatics Johannes Kepler University, Linz, Austria Outline 1 Introduction 2 Generalization Error 3 Maximum Likelihood 4 Noise Models 5
More informationOptimization Technique for Maximization Problem in Evolutionary Programming of Genetic Algorithm in Data Mining
Optimization Technique for Maximization Problem in Evolutionary Programming of Genetic Algorithm in Data Mining R. Karthick Assistant Professor, Dept. of MCA Karpagam Institute of Technology karthick2885@yahoo.com
More informationA TOOLSET FOR SUPPORTING CONTINUOUS DECISION MAKING CASE: GRADE CHANGE OPTIMIZATION
A TOOLSET FOR SUPPORTING CONTINUOUS DECISION MAKING CASE: GRADE CHANGE OPTIMIZATION Petteri Pulkkinen 1, Toni Ahonen, Risto Ritala Institute of Measurement and Information Technology, Tampere University
More informationEvolutionary Computation Algorithms for Cryptanalysis: A Study
Evolutionary Computation Algorithms for Cryptanalysis: A Study Poonam Garg Information Technology and Management Dept. Institute of Management Technology Ghaziabad, India pgarg@imt.edu Abstract The cryptanalysis
More informationThe exam is closed book, closed notes except your onepage (twosided) cheat sheet.
CS 189 Spring 2015 Introduction to Machine Learning Final You have 2 hours 50 minutes for the exam. The exam is closed book, closed notes except your onepage (twosided) cheat sheet. No calculators or
More informationParticle Swarm Optimization
Dario Schor, M.Sc., EIT schor@ieee.org Space Systems Department Magellan Aerospace Winnipeg Winnipeg, Manitoba 1 of 34 Optimization Techniques Motivation Optimization: Where, min x F(x), subject to g(x)
More informationA THREAD BUILDING BLOCKS BASED PARALLEL GENETIC ALGORITHM
www.arpapress.com/volumes/vol31issue1/ijrras_31_1_01.pdf A THREAD BUILDING BLOCKS BASED PARALLEL GENETIC ALGORITHM Erkan Bostanci *, Yilmaz Ar & Sevgi YigitSert SAAT Laboratory, Computer Engineering Department,
More informationAnt Colony Based Load Flow Optimisation Using Matlab
Ant Colony Based Load Flow Optimisation Using Matlab 1 Kapil Upamanyu, 2 Keshav Bansal, 3 Miteshwar Singh Department of Electrical Engineering Delhi Technological University, Shahbad Daulatpur, Main Bawana
More informationParticle Swarm Optimization in Scilab ver 0.17
Particle Swarm Optimization in Scilab ver 0.17 S. SALMON, Research engineer and PhD. student at M3M  UTBM Abstract This document introduces the Particle Swarm Optimization (PSO) in Scilab. The PSO is
More informationAutomatic differentiation based for particle swarm optimization steepest descent direction
International Journal of Advances in Intelligent Informatics ISSN: 24426571 Vol 1, No 2, July 2015, pp. 9097 90 Automatic differentiation based for particle swarm optimization steepest descent direction
More informationA NOVEL BINARY SOCIAL SPIDER ALGORITHM FOR 01 KNAPSACK PROBLEM
International Journal of Innovative Computing, Information and Control ICIC International c 2017 ISSN 13494198 Volume 13, Number 6, December 2017 pp. 2039 2049 A NOVEL BINARY SOCIAL SPIDER ALGORITHM FOR
More informationIntroduction (7.1) Genetic Algorithms (GA) (7.2) Simulated Annealing (SA) (7.3) Random Search (7.4) Downhill Simplex Search (DSS) (7.
Chapter 7: DerivativeFree Optimization Introduction (7.1) Genetic Algorithms (GA) (7.2) Simulated Annealing (SA) (7.3) Random Search (7.4) Downhill Simplex Search (DSS) (7.5) JyhShing Roger Jang et al.,
More informationJob Scheduling on Computational Grids Using Fuzzy Particle Swarm Algorithm
Job Scheduling on Computational Grids Using Fuzzy Particle Swarm Algorithm Ajith Abraham 1,3, Hongbo Liu 2, and Weishi Zhang 3 1 School of Computer Science and Engineering, ChungAng University, Seoul,
More informationShort Reminder of Nonlinear Programming
Short Reminder of Nonlinear Programming Kaisa Miettinen Dept. of Math. Inf. Tech. Email: kaisa.miettinen@jyu.fi Homepage: http://www.mit.jyu.fi/miettine Contents Background General overview briefly theory
More informationIntroduction to Optimization Problems and Methods
Introduction to Optimization Problems and Methods wjch@umich.edu December 10, 2009 Outline 1 Linear Optimization Problem Simplex Method 2 3 Cutting Plane Method 4 Discrete Dynamic Programming Problem Simplex
More informationArtificial Intelligence
Artificial Intelligence CS482, CS682, MW 1 2:15, SEM 201, MS 227 Prerequisites: 302, 365 Instructor: Sushil Louis, sushil@cse.unr.edu, http://www.cse.unr.edu/~sushil Informed Search Best First Search A*
More informationAn evolutionary annealingsimplex algorithm for global optimisation of water resource systems
FIFTH INTERNATIONAL CONFERENCE ON HYDROINFORMATICS 15 July 2002, Cardiff, UK C05  Evolutionary algorithms in hydroinformatics An evolutionary annealingsimplex algorithm for global optimisation of water
More informationModule 4 : Solving Linear Algebraic Equations Section 11 Appendix C: Steepest Descent / Gradient Search Method
Module 4 : Solving Linear Algebraic Equations Section 11 Appendix C: Steepest Descent / Gradient Search Method 11 Appendix C: Steepest Descent / Gradient Search Method In the module on Problem Discretization
More informationDiscussion of Various Techniques for Solving Economic Load Dispatch
International Journal of Enhanced Research in Science, Technology & Engineering ISSN: 23197463, Vol. 4 Issue 7, July2015 Discussion of Various Techniques for Solving Economic Load Dispatch Veerpal Kaur
More informationA NEW SEQUENTIAL CUTTING PLANE ALGORITHM FOR SOLVING MIXED INTEGER NONLINEAR PROGRAMMING PROBLEMS
EVOLUTIONARY METHODS FOR DESIGN, OPTIMIZATION AND CONTROL P. Neittaanmäki, J. Périaux and T. Tuovinen (Eds.) c CIMNE, Barcelona, Spain 2007 A NEW SEQUENTIAL CUTTING PLANE ALGORITHM FOR SOLVING MIXED INTEGER
More informationSide Lobe Reduction of Phased Array Antenna using Genetic Algorithm and Particle Swarm Optimization
211 Side Lobe Reduction of Phased Array Antenna using Genetic Algorithm and Particle Swarm Optimization Pampa Nandi* and Jibendu Sekhar Roy School of Electronics Engineering, KIIT University, Bhubaneswar751024,
More informationINTEGRATION OF INVENTORY CONTROL AND SCHEDULING USING BINARY PARTICLE SWARM OPTIMIZATION ALGORITHM
INTEGRATION OF INVENTORY CONTROL AND SCHEDULING USING BINARY PARTICLE SWARM OPTIMIZATION ALGORITHM Manash Dey Assistant Professor, Mechanical Engineering Department, JIMS EMTC Greater Noida (India) ABSTRACT
More informationComputational Methods. Constrained Optimization
Computational Methods Constrained Optimization Manfred Huber 2010 1 Constrained Optimization Unconstrained Optimization finds a minimum of a function under the assumption that the parameters can take on
More informationEvolutionary Nonlinear Great Deluge for University Course Timetabling
Evolutionary Nonlinear Great Deluge for University Course Timetabling Dario LandaSilva and Joe Henry Obit Automated Scheduling, Optimisation and Planning Research Group School of Computer Science, The
More informationIntroduction to Genetic Algorithms
Advanced Topics in Image Analysis and Machine Learning Introduction to Genetic Algorithms Week 3 Faculty of Information Science and Engineering Ritsumeikan University Today s class outline Genetic Algorithms
More informationIBM ILOG CPLEX Optimization Studio Getting Started with CPLEX for MATLAB. Version 12 Release 6
IBM ILOG CPLEX Optimization Studio Getting Started with CPLEX for MATLAB Version 12 Release 6 Copyright notice Describes general use restrictions and trademarks related to this document and the software
More informationEvolutionary operators in global optimization with dynamic search trajectories
Numerical Algorithms 34: 393 403, 2003. 2003 Kluwer Academic Publishers. Printed in the Netherlands. Evolutionary operators in global optimization with dynamic search trajectories E.C. Laskari, K.E. Parsopoulos
More informationRecent Developments in Modelbased Derivativefree Optimization
Recent Developments in Modelbased Derivativefree Optimization Seppo Pulkkinen April 23, 2010 Introduction Problem definition The problem we are considering is a nonlinear optimization problem with constraints:
More informationOptimization of Constrained Function Using Genetic Algorithm
Optimization of Constrained Function Using Genetic Algorithm Afaq Alam Khan 1* Roohie Naaz Mir 2 1. Department of Information Technology, Central University of Kashmir 2. Department of Computer Science
More informationAnt Colony Optimization
Ant Colony Optimization CompSci 760 Patricia J Riddle 1 Natural Inspiration The name Ant Colony Optimization was chosen to reflect its original inspiration: the foraging behavior of some ant species. It
More informationUsing Proposed Hybrid Algorithm for Solving the Multi Objective Traveling Salesman Problem
Global Journal of Pure and Applied Mathematics. ISSN 09731768 Volume 12, Number 1 (2016), pp. 711722 Research India Publications http://www.ripublication.com Using Proposed Hybrid Algorithm for Solving
More informationDesign of a Route Guidance System with Shortest Driving Time Based on Genetic Algorithm
Design of a Route Guidance System with Shortest Driving Time Based on Genetic Algorithm UMIT ATILA 1, ISMAIL RAKIP KARAS 2, CEVDET GOLOGLU 3, BEYZA YAMAN 2, ILHAMI MUHARREM ORAK 2 1 Directorate of Computer
More informationWhat is GOSET? GOSET stands for Genetic Optimization System Engineering Tool
Lecture 5: GOSET 1 What is GOSET? GOSET stands for Genetic Optimization System Engineering Tool GOSET is a MATLAB based genetic algorithm toolbox for solving optimization problems 2 GOSET Features Wide
More informationParticle swarm algorithms for multilocal optimization A. Ismael F. Vaz 1, Edite M.G.P. Fernandes 1
I Congresso de Estatística e Investigação Operacional da Galiza e Norte de Portugal VII Congreso Galego de Estatística e Investigación de Operacións Guimarães 26, 27 e 28 de Outubro de 2005 Particle swarm
More informationInnovative Systems Design and Engineering ISSN (Paper) ISSN (Online) Vol.5, No.1, 2014
Abstract Tool Path Optimization of Drilling Sequence in CNC Machine Using Genetic Algorithm Prof. Dr. Nabeel Kadim Abid AlSahib 1, Hasan Fahad Abdulrazzaq 2* 1. ThiQar University, AlJadriya, Baghdad,
More informationLOW AND HIGH LEVEL HYBRIDIZATION OF ANT COLONY SYSTEM AND GENETIC ALGORITHM FOR JOB SCHEDULING IN GRID COMPUTING
LOW AND HIGH LEVEL HYBRIDIZATION OF ANT COLONY SYSTEM AND GENETIC ALGORITHM FOR JOB SCHEDULING IN GRID COMPUTING Mustafa Muwafak Alobaedy 1, and Ku Ruhana KuMahamud 2 2 Universiti Utara Malaysia), Malaysia,
More informationIntroduction to ANSYS DesignXplorer
Lecture 5 Goal Driven Optimization 14. 5 Release Introduction to ANSYS DesignXplorer 1 2013 ANSYS, Inc. September 27, 2013 Goal Driven Optimization (GDO) Goal Driven Optimization (GDO) is a multi objective
More informationCHAPTER 4 FEATURE SELECTION USING GENETIC ALGORITHM
CHAPTER 4 FEATURE SELECTION USING GENETIC ALGORITHM In this research work, Genetic Algorithm method is used for feature selection. The following section explains how Genetic Algorithm is used for feature
More informationMulticriterial Optimization Using Genetic Algorithm
Multicriterial Optimization Using Genetic Algorithm 180 175 170 165 Fitness 160 155 150 145 140 Best Fitness Mean Fitness 135 130 0 Page 1 100 200 300 Generations 400 500 600 Contents Optimization, Local
More informationGenetic Algorithms: Setting Parmeters and Incorporating Constraints OUTLINE OF TOPICS: 1. Setting GA parameters. 2. Constraint Handling (two methods)
Genetic Algorithms: Setting Parmeters and Incorporating Constraints OUTLINE OF TOPICS: 1. Setting GA parameters general guidelines for binary coded GA (some can be extended to real valued GA) estimating
More informationDerating NichePSO. Clive Naicker
Derating NichePSO by Clive Naicker Submitted in partial fulfillment of the requirements for the degree Magister Scientiae (Computer Science) in the Faculty of Engineering, Built Environment and Information
More informationDerivativeFree Optimization
DerivativeFree Optimization Chapter 7 from Jang Outline Simulated Annealing (SA) Downhill simplex search Random search Genetic algorithms (GA) 2 The Big Picture Model space Adaptive networks Neural networks
More informationAlgorithm for Classification
Comparison of Hybrid PSOSA Algorithm and Genetic Algorithm for Classification S. G. Sanjeevi 1* A. Naga Nikhila 2 Thaseem Khan 3 G. Sumathi 4 1. Associate Professor, Dept. of Comp. Science & Engg., National
More informationA new minimax, constrained optimization method for solving worst case problems
Carnegie Mellon University Research Showcase @ CMU Department of Electrical and Computer Engineering Carnegie Institute of Technology 1979 A new minimax, constrained optimization method for solving worst
More informationUsing IBM CPLEX Optimization Studio with MathWorks MATLAB
IBM Software Group Using IBM CPLEX Optimization Studio with MathWorks MATLAB Adrian Curic (curica@us.ibm.com) Technical Support Engineer, Level 2 23 October 2014 Agenda IBM Software Group Explain the architecture
More informationOptimization of Complex Systems with OptQuest
Optimization of Complex Systems with OptQuest MANUEL LAGUNA Graduate School of Business Administration University of Colorado, Boulder, CO 803090419 Manuel.Laguna@Colorado.EDU Latest revision: April 8,
More informationA COMPARATIVE STUDY OF EVOLUTIONARY ALGORITHMS FOR SCHOOL SCHEDULING PROBLEM
A COMPARATIVE STUDY OF EVOLUTIONARY ALGORITHMS FOR SCHOOL SCHEDULING PROBLEM 1 DANIEL NUGRAHA, 2 RAYMOND KOSALA 1 School of Computer Science, Bina Nusantara University, Jakarta, Indonesia 2 School of Computer
More informationIMPROVING A GREEDY DNA MOTIF SEARCH USING A MULTIPLE GENOMIC SELFADAPTATING GENETIC ALGORITHM
Proceedings of Student/Faculty Research Day, CSIS, Pace University, May 4th, 2007 IMPROVING A GREEDY DNA MOTIF SEARCH USING A MULTIPLE GENOMIC SELFADAPTATING GENETIC ALGORITHM Michael L. Gargano, mgargano@pace.edu
More informationGenetic.io. Genetic Algorithms in all their shapes and forms! Genetic.io Make something of your big data
Genetic Algorithms in all their shapes and forms! Julien Sebrien Selftaught, passion for development. Java, Cassandra, Spark, JPPF. @jsebrien, julien.sebrien@genetic.io Distribution of IT solutions (SaaS,
More informationIntroduction to optimization methods and line search
Introduction to optimization methods and line search Jussi Hakanen Postdoctoral researcher jussi.hakanen@jyu.fi How to find optimal solutions? Trial and error widely used in practice, not efficient and
More informationABSTRACT I. INTRODUCTION. J Kanimozhi *, R Subramanian Department of Computer Science, Pondicherry University, Puducherry, Tamil Nadu, India
ABSTRACT 2018 IJSRSET Volume 4 Issue 4 Print ISSN: 23951990 Online ISSN : 23944099 Themed Section : Engineering and Technology Travelling Salesman Problem Solved using Genetic Algorithm Combined Data
More informationLecture 25 Nonlinear Programming. November 9, 2009
Nonlinear Programming November 9, 2009 Outline Nonlinear Programming Another example of NLP problem What makes these problems complex Scalar Function Unconstrained Problem Local and global optima: definition,
More informationPRACTICAL GENETIC ALGORITHMS
PRACTICAL GENETIC ALGORITHMS PRACTICAL GENETIC ALGORITHMS SECOND EDITION Randy L. Haupt Sue Ellen Haupt A JOHN WILEY & SONS, INC., PUBLICATION The book is printed on acidfree paper. Copyright 2004 by
More informationGENETIC LOCAL SEARCH ALGORITHMS FOR SINGLE MACHINE SCHEDULING PROBLEMS WITH RELEASE TIME
GENETIC LOCAL SEARCH ALGORITHMS FOR SINGLE MACHINE SCHEDULING PROBLEMS WITH RELEASE TIME Jihchang Hsieh^, Peichann Chang^, Shihhsin Chen^ Department of Industrial Management, Vanung University, ChungLi
More information1 Standard definitions and algorithm description
NonElitist Genetic Algorithm as a Local Search Method Anton V. Eremeev Omsk Branch of Sobolev Institute of Mathematics SB RAS 13, Pevstov str., 644099, Omsk, Russia email: eremeev@ofim.oscsbras.ru Abstract.
More information