Solving Optimization Problems with MATLAB Loren Shure
|
|
- Charlotte Miles
- 5 years ago
- Views:
Transcription
1 Solving Optimization Problems with MATLAB Loren Shure 6 The MathWorks, Inc.
2 Topics Introduction Least-squares minimization Nonlinear optimization Mied-integer programming Global optimization
3 Optimization Problems Maimize Fuel Efficiency Minimize Risk Maimize Profits
4 Design Process Modify Design Variables No Initial Design Variables System Objectives met? Yes Optimal Design 4
5 Why use Optimization? Manually (trial-and-error or iteratively) Initial Guess 5
6 Why use Optimization? Automatically (using optimization techniques) Initial Guess 6
7 Why use Optimization? Finding better (optimal) designs and decisions Faster design and decision evaluations Automate routine decisions Useful for trade-off analysis Antenna Design Using Genetic Algorithm Non-intuitive designs may be found 7
8 Topics Introduction Least-squares minimization Nonlinear optimization Mied-integer programming Global optimization 8
9 Curve Fitting Demo Given some data: t = [ ]; y = [ ]; Fit a curve of the form: y( t) c c e t 9
10 How to solve? Ec c c e y e c c t y t t ) ( As a linear system of equations: min y Ec Ec y c Can t solve this eactly (6 eqns, unknowns) An optimization problem! c c e e e e e e
11 Topics Introduction Least-squares minimization Nonlinear optimization Mied-integer programming Global optimization
12 Nonlinear Optimization min log
13 Nonlinear Optimization - Modeling Gantry Crane Determine acceleration profile that minimizes payload swing Constraints : t f t s t s t 4s t p p p f t p s s 5s
14 Symbolic Math Toolbo Functions for analytical computations Integration Solving equations Simplification Differentiation Transforms Conveniently manage & document symbolic computations in Live Editor Math notation, embedded tet, graphics Share work as pdf or html Integrate with numeric computing MATLAB, Simulink and Simscape language Perform Variable-precision arithmetic Perform eact computations using familiar MATLAB synta in MATLAB 4
15 Topics Introduction Least-squares minimization Nonlinear optimization Mied-integer programming Global optimization 5
16 Mied-Integer Programming Many things eist in discrete amounts: Shares of stock Number of cars a factory produces Number of cows on a farm Often have binary decisions: On/off Buy/don t buy Mied-integer linear programming: Solve optimization problem while enforcing that certain variables need to be integer 6
17 Mied-Integer Linear Programming Continuous and integer variables, {,,,4,5} Linear objective and constraints such that min = 7
18 Traveling Salesman Problem Problem How to find the shortest path through a series of points? Solution Calculate distances between all combinations of points Solve an optimization problem where variables correspond to trips between two points 8
19 Topics Introduction Least-squares minimization Nonlinear optimization Mied-integer programming Global optimization 9
20 Eample Global Optimization Problems Why does fmincon have a hard time finding the function minimum? Starting at Starting at Starting at sin() + cos( ) sin() + cos( ) Starting at Starting at Starting at
21 Eample Global Optimization Problems Why didn t fminunc find the maimum efficiency? Initial Guess
22 Eample Global Optimization Problems Why didn t nonlinear regression find a good fit?.8 c=b e -b 4 t +b e -b 5 t +b e -b 6 t c t
23 Global Optimization Goal: Want to find the lowest/largest value of the nonlinear function that has many local minima/maima Global Minimum at [ ] Problem: Traditional solvers often return one of the local minima (not the global) Solution: A solver that locates globally optimal solutions Rastrigin s Function
24 Global Optimization Solvers Covered Today Multi Start Global Search Simulated Annealing Pattern Search Particle Swarm Genetic Algorithm 4
25 MultiStart Demo Nonlinear Regression lsqcurvefit solution MultiStart solution 5
26 MULTISTART 6
27 What is MultiStart? Run a local solver from each set of start points Option to filter starting points based on feasibility Supports parallel computing 7
28 MultiStart Demo Peaks Function 8
29 GLOBAL SEARCH 9
30 What is GlobalSearch? Multistart heuristic algorithm Calls fmincon from multiple start points to try and find a global minimum Filters/removes non-promising start points
31 GlobalSearch Overview Schematic Problem Peaks function Three minima Green, z = -.65 Red, z= -.5 Blue, z = y
32 GlobalSearch Overview Stage Run from specified y
33 GlobalSearch Overview Stage 4 6 y
34 GlobalSearch Overview Stage 4 6 y
35 GlobalSearch Overview Stage y
36 GlobalSearch Overview Stage y
37 GlobalSearch Overview Stage y
38 GlobalSearch Overview Stage y
39 GlobalSearch Overview Stage y
40 GlobalSearch Overview Stage 6 Current penalty threshold value : 4 y
41 GlobalSearch Overview Stage y
42 GlobalSearch Overview Stage Current penalty threshold value : 4 y
43 GlobalSearch Overview Stage Epand basin of attraction if minimum already found Current penalty threshold value : y Basins can overlap
44 GlobalSearch Demo Peaks Function 44
45 SIMULATED ANNEALING 45
46 What is Simulated Annealing? A probabilistic metaheuristic approach based upon the physical process of annealing in metallurgy. Controlled cooling of a metal allows atoms to realign from a random higher energy state to an ordered crystalline (globally) lower energy state 46
47 Simulated Annealing Overview Iteration Run from specified y
48 Simulated Annealing Overview Iteration Temperature = y.9 - Possible New Points: Standard Normal N(,) * Temperature
49 Simulated Annealing Overview Iteration Temperature = P e accept (.9)/ T. y
50 Simulated Annealing Overview Iteration Temperature = y
51 Simulated Annealing Overview Iteration Temperature = y
52 Simulated Annealing Overview Iteration Temperature = y
53 Simulated Annealing Overview Iteration Temperature =.75 y
54 Simulated Annealing Overview Iteration N- Temperature =. - y
55 Simulated Annealing Overview Iteration N Reannealing Temperature = y
56 Simulated Annealing Overview Iteration N Reannealing Temperature = y.9 -. Paccept ( )) / T e - -. (
57 Simulated Annealing Overview Iteration N Reannealing Temperature = y
58 Simulated Annealing Overview Iteration N+ Temperature =.75 y
59 Simulated Annealing Overview Iteration N+ Temperature =.75 y
60 Simulated Annealing Overview Iteration Temperature =.75 y
61 Simulated Annealing Peaks Function 6
62 PATTERN SEARCH (DIRECT SEARCH) 6
63 What is Pattern Search? An approach that uses a pattern of search directions around the eisting points Epands/contracts around the current point when a solution is not found Does not rely on gradients: works on smooth and nonsmooth problems 6
64 Pattern Search Overview Iteration Run from specified y
65 Pattern Search Overview Iteration Apply pattern vector, poll new points for improvement Mesh size = Pattern vectors = [,], [,], [-,], [,-] First poll successful 4.6 Pnew mesh _ size* pattern _ vector.8.6 *[,] y.4 - Complete Poll (not default)
66 Pattern Search Overview Iteration Mesh size = Pattern vectors = [,], [,], [-,], [,-] y Complete Poll 66
67 Pattern Search Overview Iteration Mesh size = 4 Pattern vectors = [,], [,], [-,], [,-] y
68 Pattern Search Overview Iteration 4 Mesh size = 4*.5 = Pattern vectors = [,], [,], [-,], [,-] y
69 Pattern Search Overview Iteration N Continue epansion/contraction until convergence y
70 Pattern Search Peaks Function 7
71 Pattern Search Climbs Mount Washington 7
72 PARTICLE SWARM 7
73 What is Particle Swarm Optimization? A collection of particles move throughout the region Particles have velocity and are affected by the other particles in the swarm Does not rely on gradients: works on smooth and nonsmooth problems 7
74 Particle Swarm Overview Iteration Initialize particle locations and velocities, evaluate all locations y
75 Particle Swarm Overview Iteration N Update velocities for each particle Best Location for this Particle y - Previous Velocity Best Location for Neighbor Particles
76 Particle Swarm Overview Iteration N Update velocities for each particle y - New Velocity
77 Particle Swarm Overview Iteration N Move particles based on new velocities y
78 Particle Swarm Overview Iteration N Continue swarming until convergence y
79 Particle Swarm Peaks Function 79
80 GENETIC ALGORITHM 8
81 What is a Genetic Algorithm? Uses concepts from evolutionary biology Start with an initial generation of candidate solutions that are tested against the objective function Subsequent generations evolve from the st through selection, crossover and mutation 8
82 How Evolution Works Binary Case Selection Retain the best performing bit strings from one generation to the net. Favor these for reproduction parent = [ ] parent = [ ] Crossover parent = [ ] parent = [ ] child = [ ] Mutation parent = [ ] child = [ ] 8
83 Genetic Algorithm Iteration Evaluate initial population y
84 Genetic Algorithm Iteration Select a few good solutions for reproduction y
85 Genetic Algorithm Iteration Generate new population and evaluate y
86 Genetic Algorithm Iteration y
87 Genetic Algorithm Iteration y
88 Genetic Algorithm Iteration y
89 Genetic Algorithm Iteration N Continue process until stopping criteria are met y - Solution found
90 Genetic Algorithm Peaks Function 9
91 Genetic Algorithm Integer Constraints Mied Integer Optimization min f ( ) s.t. some are integers Eamples Only certain sizes of components available Can only purchase whole shares of stock 9
92 Application: Circuit Component Selection 6 components to size Only certain sizes available Objective: Match Voltage vs. Temperature curve Thermistor Circuit Ω Ω 6 Ω 8k Ω k Ω k Ω? Thermistors: Resistance varies nonlinearly with temperature R TH = R TH,Nom e βt T Nom T T Nom 9
93 Global Optimization Toolbo Solvers GlobalSearch, MultiStart Well suited for smooth objective and constraints Return the location of local and global minima ga, gamultiobj, simulannealbnd, particleswarm Many function evaluations to sample the search space Work on both smooth and nonsmooth problems patternsearch Fewer function evaluations than ga, simulannealbnd, particlewarm Does not rely on gradient calculation like GlobalSearch and MultiStart Works on both smooth and nonsmooth problems 9
94 Optimization Toolbo Solvers fmincon, fminbnd, fminunc, fgoalattain, fminima Nonlinear constraints and objectives Gradient-based methods for smooth objectives and constraints quadprog, linprog Linear constraints and quadratic or linear objective, respectively intlinprog Linear constraints and objective and integer variables lsqlin, lsqnonneg Constrained linear least squares lsqnonlin, lsqcurvefit Nonlinear least squares fsolve Nonlinear equations 94
95 Speeding-up with Parallel Computing Global Optimization solvers that support Parallel Computing: ga, gamultiobj: Members of population evaluated in parallel at each iteration patternsearch: Poll points evaluated in parallel at each iteration particleswarm: Population evaluated in parallel at each iteration MultiStart: Start points evaluated in parallel Optimization solvers that support Parallel Computing: fmincon: parallel evaluation of objective function for finite differences fminunc, fminima, fgoalattain,fsolve, lsqcurvefit, lsqnonlin: same as fmincon Parallel Computing can also be used in the Objective Function parfor 95
96 Parallel Computing Toolbo for the Desktop Desktop Computer Local Speed up parallel applications Take advantage of GPUs Prototype code for your cluster Simulink, Blocksets, and Other Toolboes MATLAB 96
97 Scale Up to Clusters and Clouds Desktop Computer Computer Cluster Local Cluster Simulink, Blocksets, and Other Toolboes MATLAB Scheduler 97
98 Learn More about Optimization with MATLAB Recorded webinar: Mied Integer Linear Programming in MATLAB MATLAB Digest: Using Symbolic Gradients for Optimization MATLAB Digest: Improving Optimization Performance with Parallel Computing Recorded webinar: Optimization in MATLAB for Financial Applications Cash Flow Matching Eample Recorded webinar: Optimization in MATLAB: An Introduction to Quadratic Programming Optimization Toolbo Web demo: Finding an Optimal Path using MATLAB and Optimization Toolbo 5 # Purchased Bonds 98
99 Key Takeaways Solve a wide variety of optimization problems in MATLAB Linear and Nonlinear Continuous and mied-integer Smooth and Nonsmooth Find better solutions to multiple minima and non-smooth problems using global optimization Use symbolic math for setting up problems and automatically calculating gradients Using parallel computing to speed up optimization problems 99
100 Questions? 6 The MathWorks, Inc.
Optimization in MATLAB Seth DeLand
Optimization in MATLAB Seth DeLand 4 The MathWorks, Inc. Topics Intro Using gradient-based solvers Optimization in Comp. Finance toolboxes Global optimization Speeding up your optimizations Optimization
More informationGlobal Optimization with MATLAB Products
Global Optimization with MATLAB Products Account Manager 이장원차장 Application Engineer 엄준상 The MathWorks, Inc. Agenda Introduction to Global Optimization Peaks Surve of Solvers with Eamples 8 MultiStart 6
More informationOptimieren mit MATLAB jetzt auch gemischt-ganzzahlig Dr. Maka Karalashvili Application Engineer MathWorks
Optimieren mit MATLAB jetzt auch gemischt-ganzzahlig Dr. Maka Karalashvili Application Engineer MathWorks 2014 The MathWorks, Inc. 1 Let s consider the following modeling case study Requirements Item Nuts
More informationMATLAB Based Optimization Techniques and Parallel Computing
MATLAB Based Optimization Techniques and Parallel Computing Bratislava June 4, 2009 2009 The MathWorks, Inc. Jörg-M. Sautter Application Engineer The MathWorks Agenda Introduction Local and Smooth Optimization
More informationPROJECT REPORT. Parallel Optimization in Matlab. Joakim Agnarsson, Mikael Sunde, Inna Ermilova Project in Computational Science: Report January 2013
Parallel Optimization in Matlab Joakim Agnarsson, Mikael Sunde, Inna Ermilova Project in Computational Science: Report January 2013 PROJECT REPORT Department of Information Technology Contents 1 Introduction
More informationChapter 14 Global Search Algorithms
Chapter 14 Global Search Algorithms An Introduction to Optimization Spring, 2015 Wei-Ta Chu 1 Introduction We discuss various search methods that attempts to search throughout the entire feasible set.
More informationDeveloping Optimization Algorithms for Real-World Applications
Developing Optimization Algorithms for Real-World Applications Gautam Ponnappa PC Training Engineer Viju Ravichandran, PhD Education Technical Evangelist 2015 The MathWorks, Inc. 1 2 For a given system,
More informationCHAPTER 2 CONVENTIONAL AND NON-CONVENTIONAL TECHNIQUES TO SOLVE ORPD PROBLEM
20 CHAPTER 2 CONVENTIONAL AND NON-CONVENTIONAL TECHNIQUES TO SOLVE ORPD PROBLEM 2.1 CLASSIFICATION OF CONVENTIONAL TECHNIQUES Classical optimization methods can be classified into two distinct groups:
More informationGlobal Optimization. for practical engineering applications. Harry Lee 4/9/2018 CEE 696
Global Optimization for practical engineering applications Harry Lee 4/9/2018 CEE 696 Table of contents 1. Global Optimization 1 Global Optimization Global optimization Figure 1: Fig 2.2 from Nocedal &
More informationAlgorithms & Complexity
Algorithms & Complexity Nicolas Stroppa - nstroppa@computing.dcu.ie CA313@Dublin City University. 2006-2007. November 21, 2006 Classification of Algorithms O(1): Run time is independent of the size of
More informationOptimization Toolbox Release Notes
Optimization Toolbox Release Notes The Optimization Toolbox 2.2 Release Notes on page 1-1 describe the changes introduced in the latest version of the Optimization Toolbox. The following topics are discussed
More informationActive contour: a parallel genetic algorithm approach
id-1 Active contour: a parallel genetic algorithm approach Florence Kussener 1 1 MathWorks, 2 rue de Paris 92196 Meudon Cedex, France Florence.Kussener@mathworks.fr Abstract This paper presents an algorithm
More informationData Mining Chapter 8: Search and Optimization Methods Fall 2011 Ming Li Department of Computer Science and Technology Nanjing University
Data Mining Chapter 8: Search and Optimization Methods Fall 2011 Ming Li Department of Computer Science and Technology Nanjing University Search & Optimization Search and Optimization method deals with
More informationOptimization with Scilab
Optimization with Scilab June 29 th 2011 Michaël BAUDIN & Vincent COUVERT Scilab Consortium Outline Part 1 - What's new in Scilab 5? Focus on the Nelder-Mead component Part 2 - Part 3 - Part 4 - Optimization
More informationGENETIC ALGORITHM with Hands-On exercise
GENETIC ALGORITHM with Hands-On exercise Adopted From Lecture by Michael Negnevitsky, Electrical Engineering & Computer Science University of Tasmania 1 Objective To understand the processes ie. GAs Basic
More informationSURVEY OF TEN NON-TRADITIONAL OPTIMIZATION TECHNIQUES
International Journal of Civil Engineering and Technology (IJCIET) Volume 9, Issue 8, August 2018, pp. 432 453, Article ID: IJCIET_09_08_042 Available online at http://www.iaeme.com/ijciet/issues.asp?jtype=ijciet&vtype=9&itype=8
More informationMeta- Heuristic based Optimization Algorithms: A Comparative Study of Genetic Algorithm and Particle Swarm Optimization
2017 2 nd International Electrical Engineering Conference (IEEC 2017) May. 19 th -20 th, 2017 at IEP Centre, Karachi, Pakistan Meta- Heuristic based Optimization Algorithms: A Comparative Study of Genetic
More informationModule 1 Lecture Notes 2. Optimization Problem and Model Formulation
Optimization Methods: Introduction and Basic concepts 1 Module 1 Lecture Notes 2 Optimization Problem and Model Formulation Introduction In the previous lecture we studied the evolution of optimization
More informationLecture 4. Convexity Robust cost functions Optimizing non-convex functions. 3B1B Optimization Michaelmas 2017 A. Zisserman
Lecture 4 3B1B Optimization Michaelmas 2017 A. Zisserman Convexity Robust cost functions Optimizing non-convex functions grid search branch and bound simulated annealing evolutionary optimization The Optimization
More informationChapter 3 Path Optimization
Chapter 3 Path Optimization Background information on optimization is discussed in this chapter, along with the inequality constraints that are used for the problem. Additionally, the MATLAB program for
More informationMETAHEURISTICS. Introduction. Introduction. Nature of metaheuristics. Local improvement procedure. Example: objective function
Introduction METAHEURISTICS Some problems are so complicated that are not possible to solve for an optimal solution. In these problems, it is still important to find a good feasible solution close to the
More informationDERIVATIVE-FREE OPTIMIZATION
DERIVATIVE-FREE OPTIMIZATION Main bibliography J.-S. Jang, C.-T. Sun and E. Mizutani. Neuro-Fuzzy and Soft Computing: A Computational Approach to Learning and Machine Intelligence. Prentice Hall, New Jersey,
More informationGenetic Algorithm and Direct Search Toolbox 2 User s Guide
Genetic Algorithm and Direct Search Toolbox 2 User s Guide How to Contact The MathWorks www.mathworks.com Web comp.soft-sys.matlab Newsgroup www.mathworks.com/contact_ts.html Technical Support suggest@mathworks.com
More informationGenetic Algorithm and Direct Search Toolbox
Genetic Algorithm and Direct Search Toolbox For Use with MATLAB User s Guide Version 1 How to Contact The MathWorks: www.mathworks.com comp.soft-sys.matlab support@mathworks.com suggest@mathworks.com bugs@mathworks.com
More informationApplication of Genetic Algorithms to CFD. Cameron McCartney
Application of Genetic Algorithms to CFD Cameron McCartney Introduction define and describe genetic algorithms (GAs) and genetic programming (GP) propose possible applications of GA/GP to CFD Application
More informationIntroduction to Genetic Algorithms
Advanced Topics in Image Analysis and Machine Learning Introduction to Genetic Algorithms Week 3 Faculty of Information Science and Engineering Ritsumeikan University Today s class outline Genetic Algorithms
More informationAlgorithm Design (4) Metaheuristics
Algorithm Design (4) Metaheuristics Takashi Chikayama School of Engineering The University of Tokyo Formalization of Constraint Optimization Minimize (or maximize) the objective function f(x 0,, x n )
More informationMarch 19, Heuristics for Optimization. Outline. Problem formulation. Genetic algorithms
Olga Galinina olga.galinina@tut.fi ELT-53656 Network Analysis and Dimensioning II Department of Electronics and Communications Engineering Tampere University of Technology, Tampere, Finland March 19, 2014
More informationARTIFICIAL INTELLIGENCE (CSCU9YE ) LECTURE 5: EVOLUTIONARY ALGORITHMS
ARTIFICIAL INTELLIGENCE (CSCU9YE ) LECTURE 5: EVOLUTIONARY ALGORITHMS Gabriela Ochoa http://www.cs.stir.ac.uk/~goc/ OUTLINE Optimisation problems Optimisation & search Two Examples The knapsack problem
More informationATI Material Do Not Duplicate ATI Material. www. ATIcourses.com. www. ATIcourses.com
ATI Material Material Do Not Duplicate ATI Material Boost Your Skills with On-Site Courses Tailored to Your Needs www.aticourses.com The Applied Technology Institute specializes in training programs for
More informationIntroduction (7.1) Genetic Algorithms (GA) (7.2) Simulated Annealing (SA) (7.3) Random Search (7.4) Downhill Simplex Search (DSS) (7.
Chapter 7: Derivative-Free Optimization Introduction (7.1) Genetic Algorithms (GA) (7.2) Simulated Annealing (SA) (7.3) Random Search (7.4) Downhill Simplex Search (DSS) (7.5) Jyh-Shing Roger Jang et al.,
More informationLocal Search and Optimization Chapter 4. Mausam (Based on slides of Padhraic Smyth, Stuart Russell, Rao Kambhampati, Raj Rao, Dan Weld )
Local Search and Optimization Chapter 4 Mausam (Based on slides of Padhraic Smyth, Stuart Russell, Rao Kambhampati, Raj Rao, Dan Weld ) 1 Outline Local search techniques and optimization Hill-climbing
More informationOutline. Best-first search. Greedy best-first search A* search Heuristics Local search algorithms
Outline Best-first search Greedy best-first search A* search Heuristics Local search algorithms Hill-climbing search Beam search Simulated annealing search Genetic algorithms Constraint Satisfaction Problems
More informationAn Evolutionary Algorithm for Minimizing Multimodal Functions
An Evolutionary Algorithm for Minimizing Multimodal Functions D.G. Sotiropoulos, V.P. Plagianakos and M.N. Vrahatis University of Patras, Department of Mamatics, Division of Computational Mamatics & Informatics,
More informationAn evolutionary annealing-simplex algorithm for global optimisation of water resource systems
FIFTH INTERNATIONAL CONFERENCE ON HYDROINFORMATICS 1-5 July 2002, Cardiff, UK C05 - Evolutionary algorithms in hydroinformatics An evolutionary annealing-simplex algorithm for global optimisation of water
More informationGenetic.io. Genetic Algorithms in all their shapes and forms! Genetic.io Make something of your big data
Genetic Algorithms in all their shapes and forms! Julien Sebrien Self-taught, passion for development. Java, Cassandra, Spark, JPPF. @jsebrien, julien.sebrien@genetic.io Distribution of IT solutions (SaaS,
More informationLocal Search and Optimization Chapter 4. Mausam (Based on slides of Padhraic Smyth, Stuart Russell, Rao Kambhampati, Raj Rao, Dan Weld )
Local Search and Optimization Chapter 4 Mausam (Based on slides of Padhraic Smyth, Stuart Russell, Rao Kambhampati, Raj Rao, Dan Weld ) 1 2 Outline Local search techniques and optimization Hill-climbing
More informationLocal Search and Optimization Chapter 4. Mausam (Based on slides of Padhraic Smyth, Stuart Russell, Rao Kambhampati, Raj Rao, Dan Weld )
Local Search and Optimization Chapter 4 Mausam (Based on slides of Padhraic Smyth, Stuart Russell, Rao Kambhampati, Raj Rao, Dan Weld ) 1 2 Outline Local search techniques and optimization Hill-climbing
More informationPredicting Diabetes using Neural Networks and Randomized Optimization
Predicting Diabetes using Neural Networks and Randomized Optimization Kunal Sharma GTID: ksharma74 CS 4641 Machine Learning Abstract This paper analysis the following randomized optimization techniques
More informationReducing Graphic Conflict In Scale Reduced Maps Using A Genetic Algorithm
Reducing Graphic Conflict In Scale Reduced Maps Using A Genetic Algorithm Dr. Ian D. Wilson School of Technology, University of Glamorgan, Pontypridd CF37 1DL, UK Dr. J. Mark Ware School of Computing,
More informationResearch Incubator: Combinatorial Optimization. Dr. Lixin Tao December 9, 2003
Research Incubator: Combinatorial Optimization Dr. Lixin Tao December 9, 23 Content General Nature of Research on Combinatorial Optimization Problem Identification and Abstraction Problem Properties and
More informationMetaheuristic Optimization with Evolver, Genocop and OptQuest
Metaheuristic Optimization with Evolver, Genocop and OptQuest MANUEL LAGUNA Graduate School of Business Administration University of Colorado, Boulder, CO 80309-0419 Manuel.Laguna@Colorado.EDU Last revision:
More informationDevelopment of optimization methods for Volvo fuel economy simulation. Master s thesis in Signal and Systems RAFAEL KLÜPPEL SMIJTINK
Development of optimization methods for Volvo fuel economy simulation. Master s thesis in Signal and Systems RAFAEL KLÜPPEL SMIJTINK 1 Development of optimization methods for Volvo fuel economy simulation.
More informationTHE DEVELOPMENT OF THE POTENTIAL AND ACADMIC PROGRAMMES OF WROCLAW UNIVERISTY OF TECHNOLOGY METAHEURISTICS
METAHEURISTICS 1. Objectives The goals of the laboratory workshop are as follows: to learn basic properties of evolutionary computation techniques and other metaheuristics for solving various global optimization
More informationSpeeding up MATLAB Applications The MathWorks, Inc.
Speeding up MATLAB Applications 2009 The MathWorks, Inc. Agenda Leveraging the power of vector & matrix operations Addressing bottlenecks Utilizing additional processing power Summary 2 Example: Block
More informationReflector profile optimisation using Radiance
Reflector profile optimisation using Radiance 1,4 1,2 1, 8 6 4 2 3. 2.5 2. 1.5 1..5 I csf(1) csf(2). 1 2 3 4 5 6 Giulio ANTONUTTO Krzysztof WANDACHOWICZ page 1 The idea Krzysztof WANDACHOWICZ Giulio ANTONUTTO
More informationOPTIMIZATION METHODS. For more information visit: or send an to:
OPTIMIZATION METHODS modefrontier is a registered product of ESTECO srl Copyright ESTECO srl 1999-2007 For more information visit: www.esteco.com or send an e-mail to: modefrontier@esteco.com NEOS Optimization
More informationModel Parameter Estimation
Model Parameter Estimation Shan He School for Computational Science University of Birmingham Module 06-23836: Computational Modelling with MATLAB Outline Outline of Topics Concepts about model parameter
More informationSolving Traveling Salesman Problem Using Parallel Genetic. Algorithm and Simulated Annealing
Solving Traveling Salesman Problem Using Parallel Genetic Algorithm and Simulated Annealing Fan Yang May 18, 2010 Abstract The traveling salesman problem (TSP) is to find a tour of a given number of cities
More informationACO and other (meta)heuristics for CO
ACO and other (meta)heuristics for CO 32 33 Outline Notes on combinatorial optimization and algorithmic complexity Construction and modification metaheuristics: two complementary ways of searching a solution
More informationEvolutionary Algorithms. CS Evolutionary Algorithms 1
Evolutionary Algorithms CS 478 - Evolutionary Algorithms 1 Evolutionary Computation/Algorithms Genetic Algorithms l Simulate natural evolution of structures via selection and reproduction, based on performance
More informationTUTORIAL MATLAB OPTIMIZATION TOOLBOX
TUTORIAL MATLAB OPTIMIZATION TOOLBOX INTRODUCTION MATLAB is a technical computing environment for high performance numeric computation and visualization. MATLAB integrates numerical analysis, matrix computation,
More informationEscaping Local Optima: Genetic Algorithm
Artificial Intelligence Escaping Local Optima: Genetic Algorithm Dae-Won Kim School of Computer Science & Engineering Chung-Ang University We re trying to escape local optima To achieve this, we have learned
More informationOptimal Reactive Power Dispatch Using Hybrid Loop-Genetic Based Algorithm
Optimal Reactive Power Dispatch Using Hybrid Loop-Genetic Based Algorithm Md Sajjad Alam Student Department of Electrical Engineering National Institute of Technology, Patna Patna-800005, Bihar, India
More informationGenetic Algorithm and Direct Search Toolbox For Use with MATLAB
Genetic Algorithm and Direct Search Toolbox For Use with MATLAB Computation Visualization Programming User s Guide Version 2 How to Contact The MathWorks www.mathworks.com Web comp.soft-sys.matlab Newsgroup
More informationInformed search algorithms. (Based on slides by Oren Etzioni, Stuart Russell)
Informed search algorithms (Based on slides by Oren Etzioni, Stuart Russell) The problem # Unique board configurations in search space 8-puzzle 9! = 362880 15-puzzle 16! = 20922789888000 10 13 24-puzzle
More informationArtificial Intelligence
Artificial Intelligence Local Search Vibhav Gogate The University of Texas at Dallas Some material courtesy of Luke Zettlemoyer, Dan Klein, Dan Weld, Alex Ihler, Stuart Russell, Mausam Systematic Search:
More information1 Lab + Hwk 5: Particle Swarm Optimization
1 Lab + Hwk 5: Particle Swarm Optimization This laboratory requires the following equipment: C programming tools (gcc, make). Webots simulation software. Webots User Guide Webots Reference Manual. The
More informationRandom Search Report An objective look at random search performance for 4 problem sets
Random Search Report An objective look at random search performance for 4 problem sets Dudon Wai Georgia Institute of Technology CS 7641: Machine Learning Atlanta, GA dwai3@gatech.edu Abstract: This report
More informationHardware-Software Codesign
Hardware-Software Codesign 4. System Partitioning Lothar Thiele 4-1 System Design specification system synthesis estimation SW-compilation intellectual prop. code instruction set HW-synthesis intellectual
More information3.6.2 Generating admissible heuristics from relaxed problems
3.6.2 Generating admissible heuristics from relaxed problems To come up with heuristic functions one can study relaxed problems from which some restrictions of the original problem have been removed The
More information1 Lab + Hwk 5: Particle Swarm Optimization
1 Lab + Hwk 5: Particle Swarm Optimization This laboratory requires the following equipment: C programming tools (gcc, make), already installed in GR B001 Webots simulation software Webots User Guide Webots
More informationHYBRID GENETIC ALGORITHM WITH GREAT DELUGE TO SOLVE CONSTRAINED OPTIMIZATION PROBLEMS
HYBRID GENETIC ALGORITHM WITH GREAT DELUGE TO SOLVE CONSTRAINED OPTIMIZATION PROBLEMS NABEEL AL-MILLI Financial and Business Administration and Computer Science Department Zarqa University College Al-Balqa'
More informationIntroduction to Design Optimization: Search Methods
Introduction to Design Optimization: Search Methods 1-D Optimization The Search We don t know the curve. Given α, we can calculate f(α). By inspecting some points, we try to find the approximated shape
More informationResearch Article Path Planning Using a Hybrid Evolutionary Algorithm Based on Tree Structure Encoding
e Scientific World Journal, Article ID 746260, 8 pages http://dx.doi.org/10.1155/2014/746260 Research Article Path Planning Using a Hybrid Evolutionary Algorithm Based on Tree Structure Encoding Ming-Yi
More informationInertia Weight. v i = ωv i +φ 1 R(0,1)(p i x i )+φ 2 R(0,1)(p g x i ) The new velocity update equation:
Convergence of PSO The velocity update equation: v i = v i +φ 1 R(0,1)(p i x i )+φ 2 R(0,1)(p g x i ) for some values of φ 1 and φ 2 the velocity grows without bound can bound velocity to range [ V max,v
More informationMulti-objective Optimization
Some introductory figures from : Deb Kalyanmoy, Multi-Objective Optimization using Evolutionary Algorithms, Wiley 2001 Multi-objective Optimization Implementation of Constrained GA Based on NSGA-II Optimization
More informationPARTICLE Swarm Optimization (PSO), an algorithm by
, March 12-14, 2014, Hong Kong Cluster-based Particle Swarm Algorithm for Solving the Mastermind Problem Dan Partynski Abstract In this paper we present a metaheuristic algorithm that is inspired by Particle
More informationUsing Genetic Algorithms to optimize ACS-TSP
Using Genetic Algorithms to optimize ACS-TSP Marcin L. Pilat and Tony White School of Computer Science, Carleton University, 1125 Colonel By Drive, Ottawa, ON, K1S 5B6, Canada {mpilat,arpwhite}@scs.carleton.ca
More informationLecture
Lecture.. 7 Constrained problems & optimization Brief introduction differential evolution Brief eample of hybridization of EAs Multiobjective problems & optimization Pareto optimization This slides mainly
More informationHEEDS/ DARS-Basic Global Mechanism Optimization. Megan Karalus, PhD Application Engineer CD-adapco
HEEDS/ DARS-Basic Global Mechanism Optimization Megan Karalus, PhD Application Engineer CD-adapco November 2014 Why do I need a global mechanism? Simple Chemistry Global Mechanism STAR-CCM+ Predict CO
More informationMATLAB Simulink Modeling and Simulation of Recurrent Neural Network for Solving Linear Programming Problems
International Conference on Mathematical Computer Engineering - ICMCE - 8 MALAB Simulink Modeling and Simulation of Recurrent Neural Network for Solving Linear Programming Problems Raja Das a a School
More informationGenetic Algorithms Variations and Implementation Issues
Genetic Algorithms Variations and Implementation Issues CS 431 Advanced Topics in AI Classic Genetic Algorithms GAs as proposed by Holland had the following properties: Randomly generated population Binary
More information1.2 Graph Drawing Techniques
1.2 Graph Drawing Techniques Graph drawing is the automated layout of graphs We shall overview a number of graph drawing techniques For general graphs: Force Directed Spring Embedder Barycentre based Multicriteria
More informationScheduling of Independent Tasks in Cloud Computing Using Modified Genetic Algorithm (FUZZY LOGIC)
Available Online at www.ijcsmc.com International Journal of Computer Science and Mobile Computing A Monthly Journal of Computer Science and Information Technology IJCSMC, Vol. 4, Issue. 9, September 2015,
More informationTraffic Signal Control Based On Fuzzy Artificial Neural Networks With Particle Swarm Optimization
Traffic Signal Control Based On Fuzzy Artificial Neural Networks With Particle Swarm Optimization J.Venkatesh 1, B.Chiranjeevulu 2 1 PG Student, Dept. of ECE, Viswanadha Institute of Technology And Management,
More informationDerivative-Free Optimization
Derivative-Free Optimization Chapter 7 from Jang Outline Simulated Annealing (SA) Downhill simplex search Random search Genetic algorithms (GA) 2 The Big Picture Model space Adaptive networks Neural networks
More informationArtificial Intelligence
Artificial Intelligence Informed Search and Exploration Chapter 4 (4.3 4.6) Searching: So Far We ve discussed how to build goal-based and utility-based agents that search to solve problems We ve also presented
More informationExploration vs. Exploitation in Differential Evolution
Exploration vs. Exploitation in Differential Evolution Ângela A. R. Sá 1, Adriano O. Andrade 1, Alcimar B. Soares 1 and Slawomir J. Nasuto 2 Abstract. Differential Evolution (DE) is a tool for efficient
More informationNetwork Routing Protocol using Genetic Algorithms
International Journal of Electrical & Computer Sciences IJECS-IJENS Vol:0 No:02 40 Network Routing Protocol using Genetic Algorithms Gihan Nagib and Wahied G. Ali Abstract This paper aims to develop a
More informationMachine Learning for Software Engineering
Machine Learning for Software Engineering Introduction and Motivation Prof. Dr.-Ing. Norbert Siegmund Intelligent Software Systems 1 2 Organizational Stuff Lectures: Tuesday 11:00 12:30 in room SR015 Cover
More informationAdaptive Simulated Annealing for Global Optimization in LS-OPT
Adaptive Simulated Annealing for Global Optimization in LS-OPT Summary: Tushar Goel, Nielen Stander Livermore Software Technology Corporation, Livermore, CA, USA 94551 The efficient search of global optimal
More informationAI Programming CS S-08 Local Search / Genetic Algorithms
AI Programming CS662-2013S-08 Local Search / Genetic Algorithms David Galles Department of Computer Science University of San Francisco 08-0: Overview Local Search Hill-Climbing Search Simulated Annealing
More informationGA is the most popular population based heuristic algorithm since it was developed by Holland in 1975 [1]. This algorithm runs faster and requires les
Chaotic Crossover Operator on Genetic Algorithm Hüseyin Demirci Computer Engineering, Sakarya University, Sakarya, 54187, Turkey Ahmet Turan Özcerit Computer Engineering, Sakarya University, Sakarya, 54187,
More informationParallel and Distributed Computing with MATLAB The MathWorks, Inc. 1
Parallel and Distributed Computing with MATLAB 2018 The MathWorks, Inc. 1 Practical Application of Parallel Computing Why parallel computing? Need faster insight on more complex problems with larger datasets
More informationQUANTUM BASED PSO TECHNIQUE FOR IMAGE SEGMENTATION
International Journal of Computer Engineering and Applications, Volume VIII, Issue I, Part I, October 14 QUANTUM BASED PSO TECHNIQUE FOR IMAGE SEGMENTATION Shradha Chawla 1, Vivek Panwar 2 1 Department
More informationAppendix A MATLAB s Optimization Toolbox Algorithms
Appendix A MATLAB s Optimization Toolbox Algorithms Abstract MATLAB s Optimization Toolbox (version 7:2) includes a family of algorithms for solving optimization problems. The toolbox provides functions
More informationInternational Journal of Information Technology and Knowledge Management (ISSN: ) July-December 2012, Volume 5, No. 2, pp.
Empirical Evaluation of Metaheuristic Approaches for Symbolic Execution based Automated Test Generation Surender Singh [1], Parvin Kumar [2] [1] CMJ University, Shillong, Meghalya, (INDIA) [2] Meerut Institute
More informationOptimization of a two-link Robotic Manipulator
Optimization of a two-link Robotic Manipulator Zachary Renwick, Yalım Yıldırım April 22, 2016 Abstract Although robots are used in many processes in research and industry, they are generally not customized
More informationA Steady-State Genetic Algorithm for Traveling Salesman Problem with Pickup and Delivery
A Steady-State Genetic Algorithm for Traveling Salesman Problem with Pickup and Delivery Monika Sharma 1, Deepak Sharma 2 1 Research Scholar Department of Computer Science and Engineering, NNSS SGI Samalkha,
More informationDETERMINING MAXIMUM/MINIMUM VALUES FOR TWO- DIMENTIONAL MATHMATICLE FUNCTIONS USING RANDOM CREOSSOVER TECHNIQUES
DETERMINING MAXIMUM/MINIMUM VALUES FOR TWO- DIMENTIONAL MATHMATICLE FUNCTIONS USING RANDOM CREOSSOVER TECHNIQUES SHIHADEH ALQRAINY. Department of Software Engineering, Albalqa Applied University. E-mail:
More informationLocal Search (Ch )
Local Search (Ch. 4-4.1) Local search Before we tried to find a path from the start state to a goal state using a fringe set Now we will look at algorithms that do not care about a fringe, but just neighbors
More informationInternational Journal of Digital Application & Contemporary research Website: (Volume 1, Issue 7, February 2013)
Performance Analysis of GA and PSO over Economic Load Dispatch Problem Sakshi Rajpoot sakshirajpoot1988@gmail.com Dr. Sandeep Bhongade sandeepbhongade@rediffmail.com Abstract Economic Load dispatch problem
More informationA new Optimization Algorithm for the Design of Integrated Circuits
EUROCON 2007 The International Conference on Computer as a Tool Warsaw, September 9-12 A new Optimization Algorithm for the Design of Integrated Circuits Jernej Olenšek, Árpád Bűrmen, Janez Puhan, Tadej
More informationIntroduction to Artificial Intelligence 2 nd semester 2016/2017. Chapter 4: Beyond Classical Search
Introduction to Artificial Intelligence 2 nd semester 2016/2017 Chapter 4: Beyond Classical Search Mohamed B. Abubaker Palestine Technical College Deir El-Balah 1 Outlines local search algorithms and optimization
More informationKyrre Glette INF3490 Evolvable Hardware Cartesian Genetic Programming
Kyrre Glette kyrrehg@ifi INF3490 Evolvable Hardware Cartesian Genetic Programming Overview Introduction to Evolvable Hardware (EHW) Cartesian Genetic Programming Applications of EHW 3 Evolvable Hardware
More informationSpeeding up MATLAB Applications Sean de Wolski Application Engineer
Speeding up MATLAB Applications Sean de Wolski Application Engineer 2014 The MathWorks, Inc. 1 Non-rigid Displacement Vector Fields 2 Agenda Leveraging the power of vector and matrix operations Addressing
More information^ Springer. Computational Intelligence. A Methodological Introduction. Rudolf Kruse Christian Borgelt. Matthias Steinbrecher Pascal Held
Rudolf Kruse Christian Borgelt Frank Klawonn Christian Moewes Matthias Steinbrecher Pascal Held Computational Intelligence A Methodological Introduction ^ Springer Contents 1 Introduction 1 1.1 Intelligent
More informationLecture 6: Genetic Algorithm. An Introduction to Meta-Heuristics, Produced by Qiangfu Zhao (Since 2012), All rights reserved
Lecture 6: Genetic Algorithm An Introduction to Meta-Heuristics, Produced by Qiangfu Zhao (Since 2012), All rights reserved Lec06/1 Search and optimization again Given a problem, the set of all possible
More informationGenetic Algorithms. PHY 604: Computational Methods in Physics and Astrophysics II
Genetic Algorithms Genetic Algorithms Iterative method for doing optimization Inspiration from biology General idea (see Pang or Wikipedia for more details): Create a collection of organisms/individuals
More information