Model Parameter Estimation
|
|
- Bruce Spencer
- 6 years ago
- Views:
Transcription
1 Model Parameter Estimation Shan He School for Computational Science University of Birmingham Module : Computational Modelling with MATLAB
2 Outline Outline of Topics Concepts about model parameter estimation Parameter estimation using Nelder-Mead Simplex Method Parameter estimation using Particle Swarm Optimiser Parameter estimation for Agent-based models Assignments
3 Concepts about model parameter estimation What is model parameter estimation? After building the model, we need to determine the model parameters. Usually only a fraction parameters can be measured by experiments. Many parameters are hard, expensive, time consuming, or even impossible to measure. Model parameter estimation: to indirectly determine unknown parameters from measurements of experimental data. Challenging because: Experimental data is noisy and sparse, e.g., only a few number of time points. Many models are not mathmatically well defined, e.g., Agent-based models
4 Concepts about model parameter estimation Methods for parameter estimation For equation-based models, we have: Derivative approximation methods: essentially approximate derivatives by finite differences, e.g., Euler s method, and then fit the parameters by linear regression. Pros: the computation time is typically very fast Cons: derivative approximations lead to inaccurate parameters. Bayesian methods: essentially use Bayesian methods to infer parameters from data Pros: can handle noisy or uncertain data; can also infer the whole probability distributions of the parameters rather than a point estimate. Cons: Computational time is very slow because of the need to solve high-dimensional integration problems Markov Chain Monte Carlo Optimisation methods.
5 Concepts about model parameter estimation Parameters estimation as an optimisation problem Suppose we have a system of ODE: dy dt = f (t, y; p), y Rn, f R n, where p R m is the vector of parameters, and a collection of k measurements of experimental data: (t 1, y 1 ), (t 2, y 2 ),..., (t k, y k ). We aim to minimise the following objective function, which is the mean square error between the model output and experimental data: obj(p) = k y(t j ; p) y j 2, j=1 where denotes standard Euclidean vector norm.
6 Concepts about model parameter estimation Optimisation algorithms To solve the above optimisation problem, a variety optimisation algorithms can be chosen: Gradient-based, e.g., Levenberg-Marquardt. Requirements: Mathematically well defined Smooth and differentiable Derivative-free optimisation algorithms: Direct search algorithms, e.g., pattern search, Nelder-Mead method Metaheuristic algorithms, e.g., Evolutionary Computation and Particle Swarm Optimiser
7 Concepts about model parameter estimation Example 1: A simple model Observation: data1 data Suppose we have constructed a simple ODE model: { dx dt = ay + x + t2 + 6t + b dy dt = bx + ay (a + b)(1 t2 ) Task: Estimate parameters a and b from observation
8 Parameter estimation using Nelder-Mead Simplex Method Nelder-Mead Simplex Method A well-established direct search algorithm A heuristic search method, no guarantee to find optimal solutions Based on the concept of a simplex, which is a special polytope of N + 1 vertices in N dimensions Derivative-free: does not use numerical or analytic gradients Implemented in MATLAB as a function: [x,fval] = fminsearch(fun,x0), where fun is the objective function to be minimised and x0 is the starting point
9 Parameter estimation using Nelder-Mead Simplex Method Pros and Cons of Nelder-Mead Simplex Method Pros: Very fast Cons: only suitable for low dimensional and unimodal cases. Performance sensitive to starting point x0
10 Parameter estimation using Nelder-Mead Simplex Method Example 2: Parameter estimation of LV model The fur data was collected by Hudson Bay Company more than 100 years ago Theoretical model for predator-prey interaction: Lotka-Volterra (LV) Model
11 Parameter estimation using Nelder-Mead Simplex Method Example: Lotka-Volterra model { dx dt dy dt = x(α βy) = y(γ δx) α: prey population growth rate β: prey population decline rate γ: predator population decline rate δ: predator population growth rate
12 Parameter estimation using Nelder-Mead Simplex Method Example: Parameter estimation of LV model Objective: to estimate parameters of LV model from the Hudson Bay Company fur data We select the period between We estimate parameters by metaheuristic algorithms
13 Parameter estimation using Particle Swarm Optimiser Evolutionary Computation (EC) Umbrella term for algorithms inspired by evolutionary systems Algorithms are known as evolutionary algorithms (EAs): Genetic Algorithms (GAs), Evolutionary Programming (EP) and Evolution Strategy (ES), etc. Also includes closely related nature-inspired approaches: Particle Swarm Optimiser (PSO) and Ant Colony Optimiser (ACO)
14 Parameter estimation using Particle Swarm Optimiser Evolution is amazing! Walking leaf insect Walking Stick insect Spiny Rainforest Katydid Sand grasshopper
15 Parameter estimation using Particle Swarm Optimiser Evolutionary Computation (EC) Two main properties: Algorithms are usually population based: maintain a set of potential solutions at any one time; Algorithms are stochastic (non-deterministic): random elements help obtain good solutions.
16 Parameter estimation using Particle Swarm Optimiser General design In order to apply an EC to a problem, you need: A suitable representation of solutions to the problem; A way to evaluate solutions; A way to explore the space of solutions (variation operators); A way to select better solution to guide the search (exploit).
17 Parameter estimation using Particle Swarm Optimiser EC terminology Population: set of solutions Individual: a member in the population: Parents: reproducing individuals: Fitness function: a function to summarise how close an individual (solution) is to achieving the set aims
18 Parameter estimation using Particle Swarm Optimiser Standard EC procedure Generate the initial population P(0) at random, and set t = 1 repeat Evaluate the fitness of each individual in P(t). Select parents from P(t) based on their fitness. Obtain population P(t + 1) by applying variation operators to parents Set t = t + 1. until termination criterion satisfied
19 Parameter estimation using Particle Swarm Optimiser Particle Swarm Optimiser (PSO) Invented by Kennedy and Eberhart 1995 Inspired by bird flocking and fish schooling, more precisely, BIOD Simple rules for searching global optima Primarily for real-valued optimisation problems Simpler but sometimes better than GAs
20 Parameter estimation using Particle Swarm Optimiser PSO: detailed algorithm Can be seen as a swarm of particles flying in the search space to find the optimal solution. The variation operator consists of only two equations: V k+1 i = ωv k i + c 1 r 1 (P k i X k i ) + c 2 r 1 (P k g X k i ) X k+1 i = X k i + V k+1 i where Xi k and Vi k are current position and velocity of the i th particle, respectively; P i is the best previous position of the i th particle; P g is the global best position of the swarm; ω is inertia weigh, typically in the range of (0, 1]; c 1 and c 2 are constants, or so-called learning factors; r 1 and r 2 are random number in the range of (0, 1)
21 Parameter estimation using Particle Swarm Optimiser PSO: algorithm illustration The search direction of PSO is determined by: The autobiographical memory, which remembers the best previous position of each individual P i in the swarm The publicized knowledge, which is the best solution P g currently found by the population
22 Parameter estimation using Particle Swarm Optimiser PSO: practical issues One key problem faced by EC researcher is how to choose the parameter PSO: Plug-and-play optimisation algorithm Only 3 parameters, all not very sensitive ω can be a linearly decreasing value - better local search
23 Parameter estimation using Particle Swarm Optimiser EC: further readings and MATLAB toolboxes My tutorial slides on Evolutionary Computation Evolutionary Computation Online tutorial. MATLAB Global Optimization Toolbox Genetic Algorithm Optimization Toolbox (GAOT)
24 Parameter estimation for Agent-based models Parameter estimation for Agent-based models Estimating parameters by minimising the mean square error of model output and experimental data. obj(p) = k y(t j ; p) y j 2, j=1 where y denotes the agent-based model. Because of the stochastic nature of agent-based model, we need to run the model many times to get the average output: obj(p) = k 1 m j=1 m y(t ij ; p) y j 2, Problem: Computationally very demanding! Solution: parallel computing or GPU to speed up simulation. i=1
25 Parameter estimation for Agent-based models Future direction: automated model construction from data Genetic Programming (GP) is a power tools for machine creativity: Genetic Programming for reinventing patented inventions. GP is useful for constructing model (with parameters) from experiment data Distilling Free-Form Natural Laws from Experimental Data. Automated reverse engineering of nonlinear dynamical systems. Dialogue for Reverse Engineering Assessments and Methods (DREAM).
26 Assignments Assignments Download my MATLAB code and data here, please: 1. use GAOT toolbox to estimate parameters of LV model using the the Hudson Bay Company fur data from year 1860 to 1880; 2. try PSO to find the starting point for Nelder-Mead Simplex Method.
Kyrre Glette INF3490 Evolvable Hardware Cartesian Genetic Programming
Kyrre Glette kyrrehg@ifi INF3490 Evolvable Hardware Cartesian Genetic Programming Overview Introduction to Evolvable Hardware (EHW) Cartesian Genetic Programming Applications of EHW 3 Evolvable Hardware
More informationARTIFICIAL INTELLIGENCE (CSCU9YE ) LECTURE 5: EVOLUTIONARY ALGORITHMS
ARTIFICIAL INTELLIGENCE (CSCU9YE ) LECTURE 5: EVOLUTIONARY ALGORITHMS Gabriela Ochoa http://www.cs.stir.ac.uk/~goc/ OUTLINE Optimisation problems Optimisation & search Two Examples The knapsack problem
More informationComparison of Some Evolutionary Algorithms for Approximate Solutions of Optimal Control Problems
Australian Journal of Basic and Applied Sciences, 4(8): 3366-3382, 21 ISSN 1991-8178 Comparison of Some Evolutionary Algorithms for Approximate Solutions of Optimal Control Problems Akbar H. Borzabadi,
More informationCHAPTER 2 CONVENTIONAL AND NON-CONVENTIONAL TECHNIQUES TO SOLVE ORPD PROBLEM
20 CHAPTER 2 CONVENTIONAL AND NON-CONVENTIONAL TECHNIQUES TO SOLVE ORPD PROBLEM 2.1 CLASSIFICATION OF CONVENTIONAL TECHNIQUES Classical optimization methods can be classified into two distinct groups:
More informationTraffic Signal Control Based On Fuzzy Artificial Neural Networks With Particle Swarm Optimization
Traffic Signal Control Based On Fuzzy Artificial Neural Networks With Particle Swarm Optimization J.Venkatesh 1, B.Chiranjeevulu 2 1 PG Student, Dept. of ECE, Viswanadha Institute of Technology And Management,
More informationPARTICLE SWARM OPTIMIZATION (PSO)
PARTICLE SWARM OPTIMIZATION (PSO) J. Kennedy and R. Eberhart, Particle Swarm Optimization. Proceedings of the Fourth IEEE Int. Conference on Neural Networks, 1995. A population based optimization technique
More informationParticle Swarm Optimization Approach for Scheduling of Flexible Job Shops
Particle Swarm Optimization Approach for Scheduling of Flexible Job Shops 1 Srinivas P. S., 2 Ramachandra Raju V., 3 C.S.P Rao. 1 Associate Professor, V. R. Sdhartha Engineering College, Vijayawada 2 Professor,
More informationInternational Journal of Digital Application & Contemporary research Website: (Volume 1, Issue 7, February 2013)
Performance Analysis of GA and PSO over Economic Load Dispatch Problem Sakshi Rajpoot sakshirajpoot1988@gmail.com Dr. Sandeep Bhongade sandeepbhongade@rediffmail.com Abstract Economic Load dispatch problem
More informationA *69>H>N6 #DJGC6A DG C<>C::G>C<,8>:C8:H /DA 'D 2:6G, ()-"&"3 -"(' ( +-" " " % '.+ % ' -0(+$,
The structure is a very important aspect in neural network design, it is not only impossible to determine an optimal structure for a given problem, it is even impossible to prove that a given structure
More informationAn Island Based Hybrid Evolutionary Algorithm for Optimization
An Island Based Hybrid Evolutionary Algorithm for Optimization Changhe Li and Shengxiang Yang Department of Computer Science, University of Leicester University Road, Leicester LE1 7RH, UK {cl160,s.yang}@mcs.le.ac.uk
More informationParticle Swarm Optimization Artificial Bee Colony Chain (PSOABCC): A Hybrid Meteahuristic Algorithm
Particle Swarm Optimization Artificial Bee Colony Chain (PSOABCC): A Hybrid Meteahuristic Algorithm Oğuz Altun Department of Computer Engineering Yildiz Technical University Istanbul, Turkey oaltun@yildiz.edu.tr
More informationIMPROVING THE PARTICLE SWARM OPTIMIZATION ALGORITHM USING THE SIMPLEX METHOD AT LATE STAGE
IMPROVING THE PARTICLE SWARM OPTIMIZATION ALGORITHM USING THE SIMPLEX METHOD AT LATE STAGE Fang Wang, and Yuhui Qiu Intelligent Software and Software Engineering Laboratory, Southwest-China Normal University,
More informationThe movement of the dimmer firefly i towards the brighter firefly j in terms of the dimmer one s updated location is determined by the following equat
An Improved Firefly Algorithm for Optimization Problems Amarita Ritthipakdee 1, Arit Thammano, Nol Premasathian 3, and Bunyarit Uyyanonvara 4 Abstract Optimization problem is one of the most difficult
More information1 Lab 5: Particle Swarm Optimization
1 Lab 5: Particle Swarm Optimization This laboratory requires the following: (The development tools are installed in GR B0 01 already): C development tools (gcc, make, etc.) Webots simulation software
More informationATI Material Do Not Duplicate ATI Material. www. ATIcourses.com. www. ATIcourses.com
ATI Material Material Do Not Duplicate ATI Material Boost Your Skills with On-Site Courses Tailored to Your Needs www.aticourses.com The Applied Technology Institute specializes in training programs for
More informationHandling Multi Objectives of with Multi Objective Dynamic Particle Swarm Optimization
Handling Multi Objectives of with Multi Objective Dynamic Particle Swarm Optimization Richa Agnihotri #1, Dr. Shikha Agrawal #1, Dr. Rajeev Pandey #1 # Department of Computer Science Engineering, UIT,
More informationA Comparative Study of Genetic Algorithm and Particle Swarm Optimization
IOSR Journal of Computer Engineering (IOSR-JCE) e-issn: 2278-0661,p-ISSN: 2278-8727 PP 18-22 www.iosrjournals.org A Comparative Study of Genetic Algorithm and Particle Swarm Optimization Mrs.D.Shona 1,
More informationArgha Roy* Dept. of CSE Netaji Subhash Engg. College West Bengal, India.
Volume 3, Issue 3, March 2013 ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: www.ijarcsse.com Training Artificial
More informationEE 553 Term Project Report Particle Swarm Optimization (PSO) and PSO with Cross-over
EE Term Project Report Particle Swarm Optimization (PSO) and PSO with Cross-over Emre Uğur February, 00 Abstract In this work, Particle Swarm Optimization (PSO) method is implemented and applied to various
More informationLECTURE 16: SWARM INTELLIGENCE 2 / PARTICLE SWARM OPTIMIZATION 2
15-382 COLLECTIVE INTELLIGENCE - S18 LECTURE 16: SWARM INTELLIGENCE 2 / PARTICLE SWARM OPTIMIZATION 2 INSTRUCTOR: GIANNI A. DI CARO BACKGROUND: REYNOLDS BOIDS Reynolds created a model of coordinated animal
More informationInitializing the Particle Swarm Optimizer Using the Nonlinear Simplex Method
Initializing the Particle Swarm Optimizer Using the Nonlinear Simplex Method K.E. PARSOPOULOS, M.N. VRAHATIS Department of Mathematics University of Patras University of Patras Artificial Intelligence
More informationQUANTUM BASED PSO TECHNIQUE FOR IMAGE SEGMENTATION
International Journal of Computer Engineering and Applications, Volume VIII, Issue I, Part I, October 14 QUANTUM BASED PSO TECHNIQUE FOR IMAGE SEGMENTATION Shradha Chawla 1, Vivek Panwar 2 1 Department
More informationGENETIC ALGORITHM VERSUS PARTICLE SWARM OPTIMIZATION IN N-QUEEN PROBLEM
Journal of Al-Nahrain University Vol.10(2), December, 2007, pp.172-177 Science GENETIC ALGORITHM VERSUS PARTICLE SWARM OPTIMIZATION IN N-QUEEN PROBLEM * Azhar W. Hammad, ** Dr. Ban N. Thannoon Al-Nahrain
More informationSwarm Intelligence Particle Swarm Optimization. Erick Luerken 13.Feb.2006 CS 790R, University of Nevada, Reno
Swarm Intelligence Particle Swarm Optimization Erick Luerken 13.Feb.2006 CS 790R, University of Nevada, Reno Motivation Discuss assigned literature in terms of complexity leading to actual applications
More informationACONM: A hybrid of Ant Colony Optimization and Nelder-Mead Simplex Search
ACONM: A hybrid of Ant Colony Optimization and Nelder-Mead Simplex Search N. Arun & V.Ravi* Assistant Professor Institute for Development and Research in Banking Technology (IDRBT), Castle Hills Road #1,
More informationARMA MODEL SELECTION USING PARTICLE SWARM OPTIMIZATION AND AIC CRITERIA. Mark S. Voss a b. and Xin Feng.
Copyright 2002 IFAC 5th Triennial World Congress, Barcelona, Spain ARMA MODEL SELECTION USING PARTICLE SWARM OPTIMIZATION AND AIC CRITERIA Mark S. Voss a b and Xin Feng a Department of Civil and Environmental
More informationApplication of Improved Discrete Particle Swarm Optimization in Logistics Distribution Routing Problem
Available online at www.sciencedirect.com Procedia Engineering 15 (2011) 3673 3677 Advanced in Control Engineeringand Information Science Application of Improved Discrete Particle Swarm Optimization in
More informationParticle Swarm Optimization
Dario Schor, M.Sc., EIT schor@ieee.org Space Systems Department Magellan Aerospace Winnipeg Winnipeg, Manitoba 1 of 34 Optimization Techniques Motivation Optimization: Where, min x F(x), subject to g(x)
More information1 Lab + Hwk 5: Particle Swarm Optimization
1 Lab + Hwk 5: Particle Swarm Optimization This laboratory requires the following equipment: C programming tools (gcc, make), already installed in GR B001 Webots simulation software Webots User Guide Webots
More informationOPTIMIZATION METHODS. For more information visit: or send an to:
OPTIMIZATION METHODS modefrontier is a registered product of ESTECO srl Copyright ESTECO srl 1999-2007 For more information visit: www.esteco.com or send an e-mail to: modefrontier@esteco.com NEOS Optimization
More informationOptimal Power Flow Using Particle Swarm Optimization
Optimal Power Flow Using Particle Swarm Optimization M.Chiranjivi, (Ph.D) Lecturer Department of ECE Bule Hora University, Bulehora, Ethiopia. Abstract: The Optimal Power Flow (OPF) is an important criterion
More informationMATH 209, Lab 5. Richard M. Slevinsky
MATH 209, Lab 5 Richard M. Slevinsky Problems 1. Say the temperature T at any point (x, y, z) in space is given by T = 4 x y z 2. Find the hottest point on the sphere F = x 2 + y 2 + z 2 100 = 0; We equate
More informationTheoretical Concepts of Machine Learning
Theoretical Concepts of Machine Learning Part 2 Institute of Bioinformatics Johannes Kepler University, Linz, Austria Outline 1 Introduction 2 Generalization Error 3 Maximum Likelihood 4 Noise Models 5
More informationSurrogate-assisted Self-accelerated Particle Swarm Optimization
Surrogate-assisted Self-accelerated Particle Swarm Optimization Kambiz Haji Hajikolaei 1, Amir Safari, G. Gary Wang ±, Hirpa G. Lemu, ± School of Mechatronic Systems Engineering, Simon Fraser University,
More informationJednociljna i višeciljna optimizacija korištenjem HUMANT algoritma
Seminar doktoranada i poslijedoktoranada 2015. Dani FESB-a 2015., Split, 25. - 31. svibnja 2015. Jednociljna i višeciljna optimizacija korištenjem HUMANT algoritma (Single-Objective and Multi-Objective
More informationIntroduction to unconstrained optimization - derivative-free methods
Introduction to unconstrained optimization - derivative-free methods Jussi Hakanen Post-doctoral researcher Office: AgC426.3 jussi.hakanen@jyu.fi Learning outcomes To understand the basic principles of
More informationModified Particle Swarm Optimization
Modified Particle Swarm Optimization Swati Agrawal 1, R.P. Shimpi 2 1 Aerospace Engineering Department, IIT Bombay, Mumbai, India, swati.agrawal@iitb.ac.in 2 Aerospace Engineering Department, IIT Bombay,
More informationHybrid Particle Swarm-Based-Simulated Annealing Optimization Techniques
Hybrid Particle Swarm-Based-Simulated Annealing Optimization Techniques Nasser Sadati Abstract Particle Swarm Optimization (PSO) algorithms recently invented as intelligent optimizers with several highly
More informationSwarmOps for Matlab. Numeric & Heuristic Optimization Source-Code Library for Matlab The Manual Revision 1.0
Numeric & Heuristic Optimization Source-Code Library for Matlab The Manual Revision 1.0 By Magnus Erik Hvass Pedersen November 2010 Copyright 2009-2010, all rights reserved by the author. Please see page
More informationThe Pennsylvania State University. The Graduate School. Department of Electrical Engineering COMPARISON OF CAT SWARM OPTIMIZATION WITH PARTICLE SWARM
The Pennsylvania State University The Graduate School Department of Electrical Engineering COMPARISON OF CAT SWARM OPTIMIZATION WITH PARTICLE SWARM OPTIMIZATION FOR IIR SYSTEM IDENTIFICATION A Thesis in
More informationTracking Algorithms. Lecture16: Visual Tracking I. Probabilistic Tracking. Joint Probability and Graphical Model. Deterministic methods
Tracking Algorithms CSED441:Introduction to Computer Vision (2017F) Lecture16: Visual Tracking I Bohyung Han CSE, POSTECH bhhan@postech.ac.kr Deterministic methods Given input video and current state,
More informationAn Introduction to Evolutionary Algorithms
An Introduction to Evolutionary Algorithms Karthik Sindhya, PhD Postdoctoral Researcher Industrial Optimization Group Department of Mathematical Information Technology Karthik.sindhya@jyu.fi http://users.jyu.fi/~kasindhy/
More informationA Particle Swarm Optimization Algorithm for Solving Flexible Job-Shop Scheduling Problem
2011, TextRoad Publication ISSN 2090-4304 Journal of Basic and Applied Scientific Research www.textroad.com A Particle Swarm Optimization Algorithm for Solving Flexible Job-Shop Scheduling Problem Mohammad
More informationCHAPTER 1 INTRODUCTION
1 CHAPTER 1 INTRODUCTION 1.1 OPTIMIZATION OF MACHINING PROCESS AND MACHINING ECONOMICS In a manufacturing industry, machining process is to shape the metal parts by removing unwanted material. During the
More informationA hybrid constrained optimization approach coupling PSO and adaptive constraint-handling technique
A hybrid constrained optimization approach coupling PSO and adaptive constraint-handling technique WEN LONG, SHAOHONG CAI, JIANJUN JIAO, WENZHUAN ZHANG Guizhou Key Laboratory of Economics System Simulation
More informationMeta- Heuristic based Optimization Algorithms: A Comparative Study of Genetic Algorithm and Particle Swarm Optimization
2017 2 nd International Electrical Engineering Conference (IEEC 2017) May. 19 th -20 th, 2017 at IEP Centre, Karachi, Pakistan Meta- Heuristic based Optimization Algorithms: A Comparative Study of Genetic
More informationLECTURE 20: SWARM INTELLIGENCE 6 / ANT COLONY OPTIMIZATION 2
15-382 COLLECTIVE INTELLIGENCE - S18 LECTURE 20: SWARM INTELLIGENCE 6 / ANT COLONY OPTIMIZATION 2 INSTRUCTOR: GIANNI A. DI CARO ANT-ROUTING TABLE: COMBINING PHEROMONE AND HEURISTIC 2 STATE-TRANSITION:
More informationIntroduction to Optimization Using Metaheuristics. Thomas J. K. Stidsen
Introduction to Optimization Using Metaheuristics Thomas J. K. Stidsen Outline General course information Motivation, modelling and solving Hill climbers Simulated Annealing 1 Large-Scale Optimization
More informationx n+1 = x n f(x n) f (x n ), (1)
1 Optimization The field of optimization is large and vastly important, with a deep history in computer science (among other places). Generally, an optimization problem is defined by having a score function
More informationAnt Colony Optimization
Ant Colony Optimization CompSci 760 Patricia J Riddle 1 Natural Inspiration The name Ant Colony Optimization was chosen to reflect its original inspiration: the foraging behavior of some ant species. It
More informationAdaptive Radiation Pattern Optimization for Antenna Arrays by Phase Perturbations using Particle Swarm Optimization
2010 NASA/ESA Conference on Adaptive Hardware and Systems Adaptive Radiation Pattern Optimization for Antenna Arrays by Phase Perturbations using Particle Swarm Optimization Virgilio Zuniga, Ahmet T. Erdogan,
More informationArtificial Bee Colony (ABC) Optimization Algorithm for Solving Constrained Optimization Problems
Artificial Bee Colony (ABC) Optimization Algorithm for Solving Constrained Optimization Problems Dervis Karaboga and Bahriye Basturk Erciyes University, Engineering Faculty, The Department of Computer
More informationCenter-Based Sampling for Population-Based Algorithms
Center-Based Sampling for Population-Based Algorithms Shahryar Rahnamayan, Member, IEEE, G.GaryWang Abstract Population-based algorithms, such as Differential Evolution (DE), Particle Swarm Optimization
More informationModern Methods of Data Analysis - WS 07/08
Modern Methods of Data Analysis Lecture XV (04.02.08) Contents: Function Minimization (see E. Lohrmann & V. Blobel) Optimization Problem Set of n independent variables Sometimes in addition some constraints
More informationParticle Swarm Optimization
Particle Swarm Optimization Gonçalo Pereira INESC-ID and Instituto Superior Técnico Porto Salvo, Portugal gpereira@gaips.inesc-id.pt April 15, 2011 1 What is it? Particle Swarm Optimization is an algorithm
More informationConstraints in Particle Swarm Optimization of Hidden Markov Models
Constraints in Particle Swarm Optimization of Hidden Markov Models Martin Macaš, Daniel Novák, and Lenka Lhotská Czech Technical University, Faculty of Electrical Engineering, Dep. of Cybernetics, Prague,
More informationStep Size Optimization of LMS Algorithm Using Particle Swarm Optimization Algorithm in System Identification
IJCSNS International Journal of Computer Science and Network Security, VOL.13 No.6, June 2013 125 Step Size Optimization of LMS Algorithm Using Particle Swarm Optimization Algorithm in System Identification
More informationLuo, W., and Li, Y. (2016) Benchmarking Heuristic Search and Optimisation Algorithms in Matlab. In: 22nd International Conference on Automation and Computing (ICAC), 2016, University of Essex, Colchester,
More informationSimplicial Global Optimization
Simplicial Global Optimization Julius Žilinskas Vilnius University, Lithuania September, 7 http://web.vu.lt/mii/j.zilinskas Global optimization Find f = min x A f (x) and x A, f (x ) = f, where A R n.
More informationShort-Cut MCMC: An Alternative to Adaptation
Short-Cut MCMC: An Alternative to Adaptation Radford M. Neal Dept. of Statistics and Dept. of Computer Science University of Toronto http://www.cs.utoronto.ca/ radford/ Third Workshop on Monte Carlo Methods,
More informationA Multiobjective Memetic Algorithm Based on Particle Swarm Optimization
A Multiobjective Memetic Algorithm Based on Particle Swarm Optimization Dr. Liu Dasheng James Cook University, Singapore / 48 Outline of Talk. Particle Swam Optimization 2. Multiobjective Particle Swarm
More informationMobile Robot Path Planning in Static Environments using Particle Swarm Optimization
Mobile Robot Path Planning in Static Environments using Particle Swarm Optimization M. Shahab Alam, M. Usman Rafique, and M. Umer Khan Abstract Motion planning is a key element of robotics since it empowers
More information1 Lab + Hwk 5: Particle Swarm Optimization
1 Lab + Hwk 5: Particle Swarm Optimization This laboratory requires the following equipment: C programming tools (gcc, make). Webots simulation software. Webots User Guide Webots Reference Manual. The
More informationA NEW APPROACH TO SOLVE ECONOMIC LOAD DISPATCH USING PARTICLE SWARM OPTIMIZATION
A NEW APPROACH TO SOLVE ECONOMIC LOAD DISPATCH USING PARTICLE SWARM OPTIMIZATION Manjeet Singh 1, Divesh Thareja 2 1 Department of Electrical and Electronics Engineering, Assistant Professor, HCTM Technical
More information10-701/15-781, Fall 2006, Final
-7/-78, Fall 6, Final Dec, :pm-8:pm There are 9 questions in this exam ( pages including this cover sheet). If you need more room to work out your answer to a question, use the back of the page and clearly
More informationA Native Approach to Cell to Switch Assignment Using Firefly Algorithm
International Journal of Engineering Inventions ISSN: 2278-7461, www.ijeijournal.com Volume 1, Issue 2(September 2012) PP: 17-22 A Native Approach to Cell to Switch Assignment Using Firefly Algorithm Apoorva
More informationCell-to-switch assignment in. cellular networks. barebones particle swarm optimization
Cell-to-switch assignment in cellular networks using barebones particle swarm optimization Sotirios K. Goudos a), Konstantinos B. Baltzis, Christos Bachtsevanidis, and John N. Sahalos RadioCommunications
More informationAn evolutionary annealing-simplex algorithm for global optimisation of water resource systems
FIFTH INTERNATIONAL CONFERENCE ON HYDROINFORMATICS 1-5 July 2002, Cardiff, UK C05 - Evolutionary algorithms in hydroinformatics An evolutionary annealing-simplex algorithm for global optimisation of water
More informationPre-requisite Material for Course Heuristics and Approximation Algorithms
Pre-requisite Material for Course Heuristics and Approximation Algorithms This document contains an overview of the basic concepts that are needed in preparation to participate in the course. In addition,
More informationPARTICLE Swarm Optimization (PSO), an algorithm by
, March 12-14, 2014, Hong Kong Cluster-based Particle Swarm Algorithm for Solving the Mastermind Problem Dan Partynski Abstract In this paper we present a metaheuristic algorithm that is inspired by Particle
More information10703 Deep Reinforcement Learning and Control
10703 Deep Reinforcement Learning and Control Russ Salakhutdinov Machine Learning Department rsalakhu@cs.cmu.edu Policy Gradient I Used Materials Disclaimer: Much of the material and slides for this lecture
More informationModified Particle Swarm Optimization with Novel Modulated Inertia for Velocity Update
Modified Particle Swarm Optimization with Novel Modulated Inertia for Velocity Update Abdul Hadi Hamdan #1, Fazida Hanim Hashim #2, Abdullah Zawawi Mohamed *3, W. M. Diyana W. Zaki #4, Aini Hussain #5
More informationSIMULTANEOUS COMPUTATION OF MODEL ORDER AND PARAMETER ESTIMATION FOR ARX MODEL BASED ON MULTI- SWARM PARTICLE SWARM OPTIMIZATION
SIMULTANEOUS COMPUTATION OF MODEL ORDER AND PARAMETER ESTIMATION FOR ARX MODEL BASED ON MULTI- SWARM PARTICLE SWARM OPTIMIZATION Kamil Zakwan Mohd Azmi, Zuwairie Ibrahim and Dwi Pebrianti Faculty of Electrical
More informationA Polar Coordinate Particle Swarm Optimiser
A Polar Coordinate Particle Swarm Optimiser Wiehann Matthysen and Andries P. Engelbrecht Department of Computer Science, University of Pretoria, South Africa engel@cs.up.ac.za Abstract The Particle Swarm
More informationCost Functions in Machine Learning
Cost Functions in Machine Learning Kevin Swingler Motivation Given some data that reflects measurements from the environment We want to build a model that reflects certain statistics about that data Something
More informationLocal Selection for Heuristic Algorithms as a Factor in Accelerating Optimum Search
Local Selection for Heuristic Algorithms as a Factor in Accelerating Optimum Search Danuta Jama Institute of Mathematics Silesian University of Technology Kaszubska 23, 44-100 Gliwice, Poland Email: Danuta.Jama@polsl.pl
More informationParticle Swarm Optimization applied to Pattern Recognition
Particle Swarm Optimization applied to Pattern Recognition by Abel Mengistu Advisor: Dr. Raheel Ahmad CS Senior Research 2011 Manchester College May, 2011-1 - Table of Contents Introduction... - 3 - Objectives...
More informationFuzzy finite element model updating using metaheuristic optimization algorithms
Fuzzy finite element model updating using metaheuristic optimization algorithms I. Boulkaibet a, T. Marwala a, M.I. Friswell b, H. Haddad Khodaparast b and S. Adhikari b a Electrical and Electronic Engineering
More informationIntroduction to Optimization Using Metaheuristics. The Lecturer: Thomas Stidsen. Outline. Name: Thomas Stidsen: Nationality: Danish.
The Lecturer: Thomas Stidsen Name: Thomas Stidsen: tks@imm.dtu.dk Outline Nationality: Danish. General course information Languages: Danish and English. Motivation, modelling and solving Education: Ph.D.
More informationAn Approach to Polygonal Approximation of Digital CurvesBasedonDiscreteParticleSwarmAlgorithm
Journal of Universal Computer Science, vol. 13, no. 10 (2007), 1449-1461 submitted: 12/6/06, accepted: 24/10/06, appeared: 28/10/07 J.UCS An Approach to Polygonal Approximation of Digital CurvesBasedonDiscreteParticleSwarmAlgorithm
More informationComparative Study of Meta-heuristics Optimization Algorithm using Benchmark Function
International Journal of Electrical and Computer Engineering (IJECE) Vol. 7, No. 3, June 2017, pp. 1643~1650 ISSN: 2088-8708, DOI: 10.11591/ijece.v7i3.pp1643-1650 1643 Comparative Study of Meta-heuristics
More informationOpportunistic Self Organizing Migrating Algorithm for Real-Time Dynamic Traveling Salesman Problem
Opportunistic Self Organizing Migrating Algorithm for Real-Time Dynamic Traveling Salesman Problem arxiv:1709.03793v1 [cs.ne] 12 Sep 2017 Shubham Dokania, Sunyam Bagga, and Rohit Sharma shubham.k.dokania@gmail.com,
More informationPerformance Comparison of Genetic Algorithm, Particle Swarm Optimization and Simulated Annealing Applied to TSP
Performance Comparison of Genetic Algorithm, Particle Swarm Optimization and Simulated Annealing Applied to TSP Madhumita Panda Assistant Professor, Computer Science SUIIT, Sambalpur University. Odisha,
More informationParticle Swarm Optimization Based Approach for Location Area Planning in Cellular Networks
International Journal of Intelligent Systems and Applications in Engineering Advanced Technology and Science ISSN:2147-67992147-6799 www.atscience.org/ijisae Original Research Paper Particle Swarm Optimization
More informationAnt Colony Optimization: A New Stochastic Solver for Modeling Vapor-Liquid Equilibrium Data
Ant Colony Optimization: A New Stochastic Solver for Modeling Vapor-Liquid Equilibrium Data Jorge Adan Fernández-Vargas 1, Adrián Bonilla-Petriciolet *, Juan Gabriel Segovia- Hernández 1 and Salvador Hernández
More informationDerating NichePSO. Clive Naicker
Derating NichePSO by Clive Naicker Submitted in partial fulfillment of the requirements for the degree Magister Scientiae (Computer Science) in the Faculty of Engineering, Built Environment and Information
More informationAnt Colony Optimization
DM841 DISCRETE OPTIMIZATION Part 2 Heuristics Marco Chiarandini Department of Mathematics & Computer Science University of Southern Denmark Outline 1. earch 2. Context Inspiration from Nature 3. 4. 5.
More informationEvolutionary Methods for State-based Testing
Evolutionary Methods for State-based Testing PhD Student Raluca Lefticaru Supervised by Florentin Ipate University of Piteşti, Romania Department of Computer Science Outline Motivation Search-based software
More informationA Study on Optimization Algorithms for Clustering Gene Expression Data
A Study on Optimization Algorithms for Clustering Gene Expression Data Athul Jose 1, Chandrasekar P 2 PG scholor Dept of CSE, Bannari Amman Institute of technology, Sathyamangalam, Tamilnadu, India 1,
More informationA Combinatorial Algorithm for The Cardinality Constrained Portfolio Optimization Problem
0 IEEE Congress on Evolutionary Computation (CEC) July -, 0, Beijing, China A Combinatorial Algorithm for The Cardinality Constrained Portfolio Optimization Problem Tianxiang Cui, Shi Cheng, and Ruibin
More informationThe Design and Implementation of a Modeling Package
The Design and Implementation of a Modeling Package p.1/20 The Design and Implementation of a Modeling Package Hossein ZivariPiran hzp@cs.toronto.edu Department of Computer Science University of Toronto
More informationFinding Optimal Trajectory Points for TDOA/FDOA Geo-Location Sensors
Finding Optimal Trajectory Points for TDOA/FDOA Geo-Location Sensors Ran Ren, Mark L. Fowler and N. Eva Wu Department of Electrical and Computer Engineering State University of New York at Binghamton Binghamton,
More informationGA is the most popular population based heuristic algorithm since it was developed by Holland in 1975 [1]. This algorithm runs faster and requires les
Chaotic Crossover Operator on Genetic Algorithm Hüseyin Demirci Computer Engineering, Sakarya University, Sakarya, 54187, Turkey Ahmet Turan Özcerit Computer Engineering, Sakarya University, Sakarya, 54187,
More informationSolving Optimization Problems with MATLAB Loren Shure
Solving Optimization Problems with MATLAB Loren Shure 6 The MathWorks, Inc. Topics Introduction Least-squares minimization Nonlinear optimization Mied-integer programming Global optimization Optimization
More informationImplementation and Comparison between PSO and BAT Algorithms for Path Planning with Unknown Environment
Implementation and Comparison between PSO and BAT Algorithms for Path Planning with Unknown Environment Dr. Mukesh Nandanwar 1, Anuj Nandanwar 2 1 Assistance Professor (CSE), Chhattisgarh Engineering College,
More informationEvolutionary Algorithms. CS Evolutionary Algorithms 1
Evolutionary Algorithms CS 478 - Evolutionary Algorithms 1 Evolutionary Computation/Algorithms Genetic Algorithms l Simulate natural evolution of structures via selection and reproduction, based on performance
More informationCHAPTER 6 ORTHOGONAL PARTICLE SWARM OPTIMIZATION
131 CHAPTER 6 ORTHOGONAL PARTICLE SWARM OPTIMIZATION 6.1 INTRODUCTION The Orthogonal arrays are helpful in guiding the heuristic algorithms to obtain a good solution when applied to NP-hard problems. This
More informationParameter Estimation of DC Motor using Adaptive Transfer Function based on Nelder-Mead Optimisation
Indonesian Journal of Electrical Engineering and Computer Science Vol. 9, No. 3, March 2018, pp. 696~702 ISSN: 2502-4752, DOI: 10.11591/ijeecs.v9.i3.pp696-702 696 Parameter Estimation of DC Motor using
More informationGSO: A New Solution for Solving Unconstrained Optimization Tasks Using Garter Snake s Behavior
GSO: A New Solution for Solving Unconstrained Optimization Tasks Using Garter Snake s Behavior Maryam Naghdiani, Mohsen Jahanshahi, Senior member, IEEE Department of Computer Engineering Central Tehran
More informationNon-deterministic Search techniques. Emma Hart
Non-deterministic Search techniques Emma Hart Why do local search? Many real problems are too hard to solve with exact (deterministic) techniques Modern, non-deterministic techniques offer ways of getting
More information