Comparison between Neighbourhood and Genetic Algorithms on two Analytic Objective Functions and on a 2.5D Synthetic Seismic Inverse Problems

Size: px
Start display at page:

Download "Comparison between Neighbourhood and Genetic Algorithms on two Analytic Objective Functions and on a 2.5D Synthetic Seismic Inverse Problems"

Transcription

1 Comparison between Neighbourhood and Genetic Algorithms on two Analytic Objective Functions and on a 2.5D Synthetic Seismic Inverse Problems A. Sajeva*, M. Aleardi*, A. Mazzotti* and E. Stucchi** * Università di Pisa ** Università di Milano

2 Agenda Stochastic Methods Neighbourhood Algorithm Genetic Algorithm Comparison on Convex Analytic Function Multi-minima Analytic Function 2.5D Seismic Inverse Problem Conclusion

3 Agenda Stochastic Methods Neighbourhood Algorithm Genetic Algorithm Comparison on Convex Analytic Function Multi-minima Analytic Function 2.5D Seismic Inverse Problem Conclusion

4 Stochastic Methods In probability theory, a purely stochastic system is one whose state is non-deterministic so that the subsequent state of the system is determined probabilistically. [M. Kac & J. Logan, in Fluctuation Phenomena, eds. E.W. Montroll & J.L. Lebowitz, North-Holland, Amsterdam, 1976] A geophysical inverse problem consists in obtaining the earth model for which the predicted data best fit the observed ones (Tarantola, 1986). The problem is often non-linear and can be solved using a local linearization method (such as Gauss-Newton, steepest descent or conjugate gradient) or using a Stochastic method such as Simulated Annealing, Genetic Algorithms, and Neighborhood Algorithm.

5 Neighbourhood Algorithm (1) Generate an initial set of ns models uniformly (or otherwise) in model space of dimension nd; (2) Calculate the misfit function for the most recently generated set of ns models and determine the nr models with the lowest misfit of all models generated so far; (3) Generate ns new models by performing a uniform random walk in the Voronoi cell of each of the nr chosen models (i.e. ns/nr samples in each cell); (4) Go to step 2. (Sambridge, 1998,1999a,1999b)

6 Genetic Algorithm Genetic Algorithms (Holland,1975) are based on the mechanics of natural selection and evolution to search through model space of dimension nd. A population of strings (called chromosomes) is evolved toward better solutions during the evolution process. In each generation, the fitness (the error associated to each possible solution) of every individual is evaluated, then multiple individuals are stochastically selected from the current population on the basis of their fitness. model model model Then they are modified (using crossover and mutation operators) to form a new population which is used in the next iteration. The algorithm terminates when either a maximum number of generations has been reached, or the fitness level for the current population is satisfactory. model model

7 Agenda Stochastic Methods Neighbourhood Algorithm Genetic Algorithm Comparison on Convex Analytic Function Multi-minima Analytic Function 2D Seismic Inverse Problem Conclusion

8 Convex function: De Jong m2 m1 m2 m1

9 Inversion Parameters Dim. of model space (nd) [ 2, 5, 10, 15, 20 ] Model ranges ±10 Num. of inversions 10 Convergence Hardware (mtrue-m) < Ɛ esa-core Intel(R) Xeon(R) CPU 48 GB RAM NA num. of models comp. x iter. (ns) 10*nd num. of chosen models (nr) 1 GA num. of individuals x population (num pop) 10*nd SELECTION sel rate 80% sel type stochastic universal sampling pressure sel 2, linear MUTATION mute range 0.2*(model range) mute rate 10%

10 Inversion Results: NA vs GA m2 m1 (nd) (nd)

11 Multi-minima function: Egg-Box m2 m1 m2 m1

12 Inversion Parameters Model ranges ±10 Num. of inversions 5 Convergence (mtrue-m) < Ɛ Hardware esa-core Intel(R) Xeon(R) CPU 48 GB RAM NA dim. of model space (nd) [ 1, 2, 3, 4, 5] num. of initial models ~ 2 ns num. of models comp. x iter (ns) ~ 6 nd num. of chosen models (nr) 1/3 ns GA dim. of model space (nd) [ 2, 5, 10, 15, 20 ] num. pop 200 SELECTION sel rate 80% sel type roulette wheel pressure sel non linear MUTATION mute range 0.2*(model range) mute rate 10%

13 Inversion Results: NA vs GA m2 m1 (nd) (nd)

14 Agenda Stochastic Methods Neighbourhood Algorithm Genetic Algorithm Comparison on Convex Analytic Function Multi-minima Analytic Function 2D Seismic Inverse Problem Conclusion

15 FW-global- True model Inversion 2.5 D Range : 400 m/s Misfit function : L2 Forward Operator : Finite Differences Dimensions of Model Space : 64 Max. Frequency : 1 Hz Cell Dimensions : 288 x 288 m CONVERGENCE CRITERIUM Num. of evaluated models : ~33900 Marmousi ACQUISITION GEOMETRY num. of geophones : 60 (inline ) x 15 (crossline) : 72 m distance btw geophones num. of sources : 15 distance btw sources : 288 m

16 FW-global-Inversion 2.5 D Final model: differences with the true model NA Inversion Parameters num. of models comp. x iter. (ns) 128 num. of chosen models (nr) 32 num. of iterations 264 Data Misfit Evolution

17 FW-global-Inversion 2.5 D Final model: differences with the true model GA Inversion Parameters num. pop 300 num. of generations 140 SELECTION sel rate 80% sel type stochastic universal sampling pressure sel 2 (linear ranking) Data Misfit Evolution MUTATION mute range 0.2*(model range) mute rate 10%

18 Conclusions We compare two different stochastic optimization methods: a Genetic Algorithm and the Neighborhood Algorithm. The tests on the analytic functions (both the convex one and the multiminima one) highlight a better performance of GA with respect to NA in case of high-dimension model spaces. In case of the multi-minima function the inversion parameters for NA must be carefully chosen in order to avoid trapping in a local minimum. The high computational cost of NA for high dimensions is likely due to the computation of the Voronoi cells, whose time is proportional to the square of the number of evaluated models. The synthetic seismic inversion, performed with a 64 dimensions model space, confirms the results obtained with the analytic functions, that is, the better performance of GA for high dimension model spaces (nd >15-20).

19 Aknowledgements These results were obtained within a research project with ENI. We thank ENI for the permission to publish these results.

20 Thank you for your attention. Any questions?

U043 3D Prestack Time Domain Full Waveform Inversion

U043 3D Prestack Time Domain Full Waveform Inversion U043 3D Prestack Time Domain Full Waveform Inversion D.V. Vigh* (WesternGeco), W.E.S. Starr (WesternGeco) & K.D. Kenneth Dingwall (WesternGeco) SUMMARY Despite the relatively high computational demand,

More information

Escaping Local Optima: Genetic Algorithm

Escaping Local Optima: Genetic Algorithm Artificial Intelligence Escaping Local Optima: Genetic Algorithm Dae-Won Kim School of Computer Science & Engineering Chung-Ang University We re trying to escape local optima To achieve this, we have learned

More information

Optimization in Brachytherapy. Gary A. Ezzell, Ph.D. Mayo Clinic Scottsdale

Optimization in Brachytherapy. Gary A. Ezzell, Ph.D. Mayo Clinic Scottsdale Optimization in Brachytherapy Gary A. Ezzell, Ph.D. Mayo Clinic Scottsdale Outline General concepts of optimization Classes of optimization techniques Concepts underlying some commonly available methods

More information

Global Optimization. for practical engineering applications. Harry Lee 4/9/2018 CEE 696

Global Optimization. for practical engineering applications. Harry Lee 4/9/2018 CEE 696 Global Optimization for practical engineering applications Harry Lee 4/9/2018 CEE 696 Table of contents 1. Global Optimization 1 Global Optimization Global optimization Figure 1: Fig 2.2 from Nocedal &

More information

Beyond Classical Search: Local Search. CMPSCI 383 September 23, 2011

Beyond Classical Search: Local Search. CMPSCI 383 September 23, 2011 Beyond Classical Search: Local Search CMPSCI 383 September 23, 2011 1 Today s lecture Local Search Hill-climbing Simulated annealing Local beam search Genetic algorithms Genetic programming Local search

More information

Improvements in time domain FWI and its applications Kwangjin Yoon*, Sang Suh, James Cai and Bin Wang, TGS

Improvements in time domain FWI and its applications Kwangjin Yoon*, Sang Suh, James Cai and Bin Wang, TGS Downloaded 0/7/13 to 05.196.179.38. Redistribution subject to SEG license or copyright; see Terms of Use at http://library.seg.org/ Improvements in time domain FWI and its applications Kwangjin Yoon*,

More information

Model parametrization strategies for Newton-based acoustic full waveform

Model parametrization strategies for Newton-based acoustic full waveform Model parametrization strategies for Newton-based acoustic full waveform inversion Amsalu Y. Anagaw, University of Alberta, Edmonton, Canada, aanagaw@ualberta.ca Summary This paper studies the effects

More information

Suppose you have a problem You don t know how to solve it What can you do? Can you use a computer to somehow find a solution for you?

Suppose you have a problem You don t know how to solve it What can you do? Can you use a computer to somehow find a solution for you? Gurjit Randhawa Suppose you have a problem You don t know how to solve it What can you do? Can you use a computer to somehow find a solution for you? This would be nice! Can it be done? A blind generate

More information

Accelerating the Hessian-free Gauss-Newton Full-waveform Inversion via Preconditioned Conjugate Gradient Method

Accelerating the Hessian-free Gauss-Newton Full-waveform Inversion via Preconditioned Conjugate Gradient Method Accelerating the Hessian-free Gauss-Newton Full-waveform Inversion via Preconditioned Conjugate Gradient Method Wenyong Pan 1, Kris Innanen 1 and Wenyuan Liao 2 1. CREWES Project, Department of Geoscience,

More information

An evolutionary annealing-simplex algorithm for global optimisation of water resource systems

An evolutionary annealing-simplex algorithm for global optimisation of water resource systems FIFTH INTERNATIONAL CONFERENCE ON HYDROINFORMATICS 1-5 July 2002, Cardiff, UK C05 - Evolutionary algorithms in hydroinformatics An evolutionary annealing-simplex algorithm for global optimisation of water

More information

Seismic Full Waveform Inversion and Modeling

Seismic Full Waveform Inversion and Modeling P - 387 Seismic Full Waveform Inversion and Modeling Richa Rastogi¹, Abhishek Srivastava¹, Kalpita Shirodkar¹* (kalpitas@cdac.in), S.K Das², Ajith C² PK Choudhury² 1. Centre for Development of Advanced

More information

Graphical Approach to Solve the Transcendental Equations Salim Akhtar 1 Ms. Manisha Dawra 2

Graphical Approach to Solve the Transcendental Equations Salim Akhtar 1 Ms. Manisha Dawra 2 Graphical Approach to Solve the Transcendental Equations Salim Akhtar 1 Ms. Manisha Dawra 2 1 M.Tech. Scholar 2 Assistant Professor 1,2 Department of Computer Science & Engineering, 1,2 Al-Falah School

More information

Using Genetic Algorithms to optimize ACS-TSP

Using Genetic Algorithms to optimize ACS-TSP Using Genetic Algorithms to optimize ACS-TSP Marcin L. Pilat and Tony White School of Computer Science, Carleton University, 1125 Colonel By Drive, Ottawa, ON, K1S 5B6, Canada {mpilat,arpwhite}@scs.carleton.ca

More information

Genetic Algorithms Variations and Implementation Issues

Genetic Algorithms Variations and Implementation Issues Genetic Algorithms Variations and Implementation Issues CS 431 Advanced Topics in AI Classic Genetic Algorithms GAs as proposed by Holland had the following properties: Randomly generated population Binary

More information

Genetic Algorithms: Setting Parmeters and Incorporating Constraints OUTLINE OF TOPICS: 1. Setting GA parameters. 2. Constraint Handling (two methods)

Genetic Algorithms: Setting Parmeters and Incorporating Constraints OUTLINE OF TOPICS: 1. Setting GA parameters. 2. Constraint Handling (two methods) Genetic Algorithms: Setting Parmeters and Incorporating Constraints OUTLINE OF TOPICS: 1. Setting GA parameters general guidelines for binary coded GA (some can be extended to real valued GA) estimating

More information

The Binary Genetic Algorithm. Universidad de los Andes-CODENSA

The Binary Genetic Algorithm. Universidad de los Andes-CODENSA The Binary Genetic Algorithm Universidad de los Andes-CODENSA 1. Genetic Algorithms: Natural Selection on a Computer Figure 1 shows the analogy between biological i l evolution and a binary GA. Both start

More information

Stochastic (Monte Carlo) optimization methods like the

Stochastic (Monte Carlo) optimization methods like the Seismic SPECIAL SECTION: inversion Sei smic inversion for reservoir for reservoir properties Full-waveform inversion of seismic data with the Neighborhood Algorithm MORITZ M. FLIEDNER, SVEN TREITEL, and

More information

Genetic Algorithms. Genetic Algorithms

Genetic Algorithms. Genetic Algorithms A biological analogy for optimization problems Bit encoding, models as strings Reproduction and mutation -> natural selection Pseudo-code for a simple genetic algorithm The goal of genetic algorithms (GA):

More information

Stochastic conjugate gradient method for least-square seismic inversion problems Wei Huang*, Hua-Wei Zhou, University of Houston

Stochastic conjugate gradient method for least-square seismic inversion problems Wei Huang*, Hua-Wei Zhou, University of Houston Stochastic conjugate gradient method for least-square seismic inversion problems Wei Huang*, Hua-Wei Zhou, University of Houston Summary With the development of computational power, there has been an increased

More information

Prediction under Uncertainty in Reservoir Modeling

Prediction under Uncertainty in Reservoir Modeling 1 Prediction under Uncertainty in Reservoir Modeling Mike Christie 1, Sam Subbey 1, Malcolm Sambridge 1 Institute of Petroleum Engineering, Heriot-Watt University, Edinburgh, EH14 4AS, UK Institute of

More information

CHAPTER 4 GENETIC ALGORITHM

CHAPTER 4 GENETIC ALGORITHM 69 CHAPTER 4 GENETIC ALGORITHM 4.1 INTRODUCTION Genetic Algorithms (GAs) were first proposed by John Holland (Holland 1975) whose ideas were applied and expanded on by Goldberg (Goldberg 1989). GAs is

More information

Constrained Functions of N Variables: Non-Gradient Based Methods

Constrained Functions of N Variables: Non-Gradient Based Methods onstrained Functions of N Variables: Non-Gradient Based Methods Gerhard Venter Stellenbosch University Outline Outline onstrained Optimization Non-gradient based methods Genetic Algorithms (GA) Particle

More information

Neural Network Weight Selection Using Genetic Algorithms

Neural Network Weight Selection Using Genetic Algorithms Neural Network Weight Selection Using Genetic Algorithms David Montana presented by: Carl Fink, Hongyi Chen, Jack Cheng, Xinglong Li, Bruce Lin, Chongjie Zhang April 12, 2005 1 Neural Networks Neural networks

More information

GENETIC ALGORITHM with Hands-On exercise

GENETIC ALGORITHM with Hands-On exercise GENETIC ALGORITHM with Hands-On exercise Adopted From Lecture by Michael Negnevitsky, Electrical Engineering & Computer Science University of Tasmania 1 Objective To understand the processes ie. GAs Basic

More information

Lecture 4. Convexity Robust cost functions Optimizing non-convex functions. 3B1B Optimization Michaelmas 2017 A. Zisserman

Lecture 4. Convexity Robust cost functions Optimizing non-convex functions. 3B1B Optimization Michaelmas 2017 A. Zisserman Lecture 4 3B1B Optimization Michaelmas 2017 A. Zisserman Convexity Robust cost functions Optimizing non-convex functions grid search branch and bound simulated annealing evolutionary optimization The Optimization

More information

A New Selection Operator - CSM in Genetic Algorithms for Solving the TSP

A New Selection Operator - CSM in Genetic Algorithms for Solving the TSP A New Selection Operator - CSM in Genetic Algorithms for Solving the TSP Wael Raef Alkhayri Fahed Al duwairi High School Aljabereyah, Kuwait Suhail Sami Owais Applied Science Private University Amman,

More information

The Genetic Algorithm for finding the maxima of single-variable functions

The Genetic Algorithm for finding the maxima of single-variable functions Research Inventy: International Journal Of Engineering And Science Vol.4, Issue 3(March 2014), PP 46-54 Issn (e): 2278-4721, Issn (p):2319-6483, www.researchinventy.com The Genetic Algorithm for finding

More information

Genetic Algorithms for Vision and Pattern Recognition

Genetic Algorithms for Vision and Pattern Recognition Genetic Algorithms for Vision and Pattern Recognition Faiz Ul Wahab 11/8/2014 1 Objective To solve for optimization of computer vision problems using genetic algorithms 11/8/2014 2 Timeline Problem: Computer

More information

[Premalatha, 4(5): May, 2015] ISSN: (I2OR), Publication Impact Factor: (ISRA), Journal Impact Factor: 2.114

[Premalatha, 4(5): May, 2015] ISSN: (I2OR), Publication Impact Factor: (ISRA), Journal Impact Factor: 2.114 IJESRT INTERNATIONAL JOURNAL OF ENGINEERING SCIENCES & RESEARCH TECHNOLOGY GENETIC ALGORITHM FOR OPTIMIZATION PROBLEMS C. Premalatha Assistant Professor, Department of Information Technology Sri Ramakrishna

More information

Chapter 14 Global Search Algorithms

Chapter 14 Global Search Algorithms Chapter 14 Global Search Algorithms An Introduction to Optimization Spring, 2015 Wei-Ta Chu 1 Introduction We discuss various search methods that attempts to search throughout the entire feasible set.

More information

Application of Genetic Algorithms to CFD. Cameron McCartney

Application of Genetic Algorithms to CFD. Cameron McCartney Application of Genetic Algorithms to CFD Cameron McCartney Introduction define and describe genetic algorithms (GAs) and genetic programming (GP) propose possible applications of GA/GP to CFD Application

More information

DERIVATIVE-FREE OPTIMIZATION

DERIVATIVE-FREE OPTIMIZATION DERIVATIVE-FREE OPTIMIZATION Main bibliography J.-S. Jang, C.-T. Sun and E. Mizutani. Neuro-Fuzzy and Soft Computing: A Computational Approach to Learning and Machine Intelligence. Prentice Hall, New Jersey,

More information

Selection Intensity in Asynchronous Cellular Evolutionary Algorithms

Selection Intensity in Asynchronous Cellular Evolutionary Algorithms Selection Intensity in A Cellular Evolutionary Algorithms Mario Giacobini, Enrique Alba 2, and Marco Tomassini Computer Science Institute, University of Lausanne, Lausanne, Switzerland 2 Department of

More information

Submit: Your group source code to mooshak

Submit: Your group source code to mooshak Tutorial 2 (Optional) Genetic Algorithms This is an optional tutorial. Should you decide to answer it please Submit: Your group source code to mooshak http://mooshak.deei.fct.ualg.pt/ up to May 28, 2018.

More information

Data Mining Chapter 8: Search and Optimization Methods Fall 2011 Ming Li Department of Computer Science and Technology Nanjing University

Data Mining Chapter 8: Search and Optimization Methods Fall 2011 Ming Li Department of Computer Science and Technology Nanjing University Data Mining Chapter 8: Search and Optimization Methods Fall 2011 Ming Li Department of Computer Science and Technology Nanjing University Search & Optimization Search and Optimization method deals with

More information

Introduction to Design Optimization: Search Methods

Introduction to Design Optimization: Search Methods Introduction to Design Optimization: Search Methods 1-D Optimization The Search We don t know the curve. Given α, we can calculate f(α). By inspecting some points, we try to find the approximated shape

More information

Refraction Full-waveform Inversion in a Shallow Water Environment

Refraction Full-waveform Inversion in a Shallow Water Environment Refraction Full-waveform Inversion in a Shallow Water Environment Z. Zou* (PGS), J. Ramos-Martínez (PGS), S. Kelly (PGS), G. Ronholt (PGS), L.T. Langlo (PGS), A. Valenciano Mavilio (PGS), N. Chemingui

More information

March 19, Heuristics for Optimization. Outline. Problem formulation. Genetic algorithms

March 19, Heuristics for Optimization. Outline. Problem formulation. Genetic algorithms Olga Galinina olga.galinina@tut.fi ELT-53656 Network Analysis and Dimensioning II Department of Electronics and Communications Engineering Tampere University of Technology, Tampere, Finland March 19, 2014

More information

Summary. GEMTIP model of a three-phase medium with ellipsoidal inclusions

Summary. GEMTIP model of a three-phase medium with ellipsoidal inclusions GEMTIP inversion of complex resistivity data using a hybrid method based on a genetic algorithm with simulated annealing and regularized conjugate gradient method Wei Lin *, Michael S. Zhdanov, Vladimir

More information

Full waveform inversion by deconvolution gradient method

Full waveform inversion by deconvolution gradient method Full waveform inversion by deconvolution gradient method Fuchun Gao*, Paul Williamson, Henri Houllevigue, Total), 2012 Lei Fu Rice University November 14, 2012 Outline Introduction Method Implementation

More information

Introduction to Genetic Algorithms

Introduction to Genetic Algorithms Advanced Topics in Image Analysis and Machine Learning Introduction to Genetic Algorithms Week 3 Faculty of Information Science and Engineering Ritsumeikan University Today s class outline Genetic Algorithms

More information

Solving Optimization and Inverse Problems in Remote Sensing by using Evolutionary Algorithms

Solving Optimization and Inverse Problems in Remote Sensing by using Evolutionary Algorithms Technical University Munich Faculty for civil engineering and land surveying Remote Sensing Technology Prof. Dr.-Ing. Richard Bamler Solving Optimization and Inverse Problems in Remote Sensing by using

More information

LECTURE NOTES Non-Linear Programming

LECTURE NOTES Non-Linear Programming CEE 6110 David Rosenberg p. 1 Learning Objectives LECTURE NOTES Non-Linear Programming 1. Write out the non-linear model formulation 2. Describe the difficulties of solving a non-linear programming model

More information

A Genetic Algorithm for Graph Matching using Graph Node Characteristics 1 2

A Genetic Algorithm for Graph Matching using Graph Node Characteristics 1 2 Chapter 5 A Genetic Algorithm for Graph Matching using Graph Node Characteristics 1 2 Graph Matching has attracted the exploration of applying new computing paradigms because of the large number of applications

More information

Image Processing algorithm for matching horizons across faults in seismic data

Image Processing algorithm for matching horizons across faults in seismic data Image Processing algorithm for matching horizons across faults in seismic data Melanie Aurnhammer and Klaus Tönnies Computer Vision Group, Otto-von-Guericke University, Postfach 410, 39016 Magdeburg, Germany

More information

ARTIFICIAL INTELLIGENCE (CSCU9YE ) LECTURE 5: EVOLUTIONARY ALGORITHMS

ARTIFICIAL INTELLIGENCE (CSCU9YE ) LECTURE 5: EVOLUTIONARY ALGORITHMS ARTIFICIAL INTELLIGENCE (CSCU9YE ) LECTURE 5: EVOLUTIONARY ALGORITHMS Gabriela Ochoa http://www.cs.stir.ac.uk/~goc/ OUTLINE Optimisation problems Optimisation & search Two Examples The knapsack problem

More information

A projected Hessian matrix for full waveform inversion Yong Ma and Dave Hale, Center for Wave Phenomena, Colorado School of Mines

A projected Hessian matrix for full waveform inversion Yong Ma and Dave Hale, Center for Wave Phenomena, Colorado School of Mines A projected Hessian matrix for full waveform inversion Yong Ma and Dave Hale, Center for Wave Phenomena, Colorado School of Mines SUMMARY A Hessian matrix in full waveform inversion (FWI) is difficult

More information

Experimental Comparison of Different Techniques to Generate Adaptive Sequences

Experimental Comparison of Different Techniques to Generate Adaptive Sequences Experimental Comparison of Different Techniques to Generate Adaptive Sequences Carlos Molinero 1, Manuel Núñez 1 and Robert M. Hierons 2 1 Departamento de Sistemas Informáticos y Computación, Universidad

More information

Artificial Intelligence

Artificial Intelligence Artificial Intelligence Informed Search and Exploration Chapter 4 (4.3 4.6) Searching: So Far We ve discussed how to build goal-based and utility-based agents that search to solve problems We ve also presented

More information

AN IMPROVED ITERATIVE METHOD FOR SOLVING GENERAL SYSTEM OF EQUATIONS VIA GENETIC ALGORITHMS

AN IMPROVED ITERATIVE METHOD FOR SOLVING GENERAL SYSTEM OF EQUATIONS VIA GENETIC ALGORITHMS AN IMPROVED ITERATIVE METHOD FOR SOLVING GENERAL SYSTEM OF EQUATIONS VIA GENETIC ALGORITHMS Seyed Abolfazl Shahzadehfazeli 1, Zainab Haji Abootorabi,3 1 Parallel Processing Laboratory, Yazd University,

More information

Electromagnetic migration of marine CSEM data in areas with rough bathymetry Michael S. Zhdanov and Martin Čuma*, University of Utah

Electromagnetic migration of marine CSEM data in areas with rough bathymetry Michael S. Zhdanov and Martin Čuma*, University of Utah Electromagnetic migration of marine CSEM data in areas with rough bathymetry Michael S. Zhdanov and Martin Čuma*, University of Utah Summary In this paper we present a new approach to the interpretation

More information

Classical Gradient Methods

Classical Gradient Methods Classical Gradient Methods Note simultaneous course at AMSI (math) summer school: Nonlin. Optimization Methods (see http://wwwmaths.anu.edu.au/events/amsiss05/) Recommended textbook (Springer Verlag, 1999):

More information

Thèse de Doctorat de l Université Paris-Sud. Carlos Kavka. pour obtenir le grade de Docteur de l Université Paris-Sud

Thèse de Doctorat de l Université Paris-Sud. Carlos Kavka. pour obtenir le grade de Docteur de l Université Paris-Sud Thèse de Doctorat de l Université Paris-Sud Specialité: Informatique Présentée per Carlos Kavka pour obtenir le grade de Docteur de l Université Paris-Sud EVOLUTIONARY DESIGN OF GEOMETRIC-BASED FUZZY SYSTEMS

More information

Segmentation of Noisy Binary Images Containing Circular and Elliptical Objects using Genetic Algorithms

Segmentation of Noisy Binary Images Containing Circular and Elliptical Objects using Genetic Algorithms Segmentation of Noisy Binary Images Containing Circular and Elliptical Objects using Genetic Algorithms B. D. Phulpagar Computer Engg. Dept. P. E. S. M. C. O. E., Pune, India. R. S. Bichkar Prof. ( Dept.

More information

Evolutionary Algorithms. CS Evolutionary Algorithms 1

Evolutionary Algorithms. CS Evolutionary Algorithms 1 Evolutionary Algorithms CS 478 - Evolutionary Algorithms 1 Evolutionary Computation/Algorithms Genetic Algorithms l Simulate natural evolution of structures via selection and reproduction, based on performance

More information

Local Search (Greedy Descent): Maintain an assignment of a value to each variable. Repeat:

Local Search (Greedy Descent): Maintain an assignment of a value to each variable. Repeat: Local Search Local Search (Greedy Descent): Maintain an assignment of a value to each variable. Repeat: Select a variable to change Select a new value for that variable Until a satisfying assignment is

More information

Sparse Matrices Reordering using Evolutionary Algorithms: A Seeded Approach

Sparse Matrices Reordering using Evolutionary Algorithms: A Seeded Approach 1 Sparse Matrices Reordering using Evolutionary Algorithms: A Seeded Approach David Greiner, Gustavo Montero, Gabriel Winter Institute of Intelligent Systems and Numerical Applications in Engineering (IUSIANI)

More information

G012 Scattered Ground-roll Attenuation for 2D Land Data Using Seismic Interferometry

G012 Scattered Ground-roll Attenuation for 2D Land Data Using Seismic Interferometry G012 Scattered Ground-roll Attenuation for 2D Land Data Using Seismic Interferometry D.F. Halliday* (Schlumberger Cambridge Research), P.J. Bilsby (WesternGeco), J. Quigley (WesternGeco) & E. Kragh (Schlumberger

More information

Th C 02 Model-Based Surface Wave Analysis and Attenuation

Th C 02 Model-Based Surface Wave Analysis and Attenuation Th C 02 Model-Based Surface Wave Analysis and Attenuation J. Bai* (Paradigm Geophysical), O. Yilmaz (Paradigm Geophysical) Summary Surface waves can significantly degrade overall data quality in seismic

More information

Local Search (Ch )

Local Search (Ch ) Local Search (Ch. 4-4.1) Local search Before we tried to find a path from the start state to a goal state using a fringe set Now we will look at algorithms that do not care about a fringe, but just neighbors

More information

Genetic Algorithms. Kang Zheng Karl Schober

Genetic Algorithms. Kang Zheng Karl Schober Genetic Algorithms Kang Zheng Karl Schober Genetic algorithm What is Genetic algorithm? A genetic algorithm (or GA) is a search technique used in computing to find true or approximate solutions to optimization

More information

Genetic algorithms and finite element coupling for mechanical optimization

Genetic algorithms and finite element coupling for mechanical optimization Computer Aided Optimum Design in Engineering X 87 Genetic algorithms and finite element coupling for mechanical optimization G. Corriveau, R. Guilbault & A. Tahan Department of Mechanical Engineering,

More information

Local Search and Optimization Chapter 4. Mausam (Based on slides of Padhraic Smyth, Stuart Russell, Rao Kambhampati, Raj Rao, Dan Weld )

Local Search and Optimization Chapter 4. Mausam (Based on slides of Padhraic Smyth, Stuart Russell, Rao Kambhampati, Raj Rao, Dan Weld ) Local Search and Optimization Chapter 4 Mausam (Based on slides of Padhraic Smyth, Stuart Russell, Rao Kambhampati, Raj Rao, Dan Weld ) 1 Outline Local search techniques and optimization Hill-climbing

More information

COMPARISON OF ALGORITHMS FOR NONLINEAR REGRESSION ESTIMATES

COMPARISON OF ALGORITHMS FOR NONLINEAR REGRESSION ESTIMATES COMPSTAT 2004 Symposium c Physica-Verlag/Springer 2004 COMPARISON OF ALGORITHMS FOR NONLINEAR REGRESSION ESTIMATES Tvrdík J. and Křivý I. Key words: Global optimization, evolutionary algorithms, heuristics,

More information

Theoretical Concepts of Machine Learning

Theoretical Concepts of Machine Learning Theoretical Concepts of Machine Learning Part 2 Institute of Bioinformatics Johannes Kepler University, Linz, Austria Outline 1 Introduction 2 Generalization Error 3 Maximum Likelihood 4 Noise Models 5

More information

Learning Adaptive Parameters with Restricted Genetic Optimization Method

Learning Adaptive Parameters with Restricted Genetic Optimization Method Learning Adaptive Parameters with Restricted Genetic Optimization Method Santiago Garrido and Luis Moreno Universidad Carlos III de Madrid, Leganés 28911, Madrid (Spain) Abstract. Mechanisms for adapting

More information

GRASP. Greedy Randomized Adaptive. Search Procedure

GRASP. Greedy Randomized Adaptive. Search Procedure GRASP Greedy Randomized Adaptive Search Procedure Type of problems Combinatorial optimization problem: Finite ensemble E = {1,2,... n } Subset of feasible solutions F 2 Objective function f : 2 Minimisation

More information

Offspring Generation Method using Delaunay Triangulation for Real-Coded Genetic Algorithms

Offspring Generation Method using Delaunay Triangulation for Real-Coded Genetic Algorithms Offspring Generation Method using Delaunay Triangulation for Real-Coded Genetic Algorithms Hisashi Shimosaka 1, Tomoyuki Hiroyasu 2, and Mitsunori Miki 2 1 Graduate School of Engineering, Doshisha University,

More information

CS5401 FS2015 Exam 1 Key

CS5401 FS2015 Exam 1 Key CS5401 FS2015 Exam 1 Key This is a closed-book, closed-notes exam. The only items you are allowed to use are writing implements. Mark each sheet of paper you use with your name and the string cs5401fs2015

More information

Global optimisation techniques in water resources management

Global optimisation techniques in water resources management XXVI General Assembly of European Geophysical Society Nice, France, 6-30 March 001 HSC/ Water Resources Engineering: Hydroinformatics Global optimisation techniques in water resources management Andreas

More information

Convex Optimization CMU-10725

Convex Optimization CMU-10725 Convex Optimization CMU-10725 Conjugate Direction Methods Barnabás Póczos & Ryan Tibshirani Conjugate Direction Methods 2 Books to Read David G. Luenberger, Yinyu Ye: Linear and Nonlinear Programming Nesterov:

More information

1. Introduction. 2. Motivation and Problem Definition. Volume 8 Issue 2, February Susmita Mohapatra

1. Introduction. 2. Motivation and Problem Definition. Volume 8 Issue 2, February Susmita Mohapatra Pattern Recall Analysis of the Hopfield Neural Network with a Genetic Algorithm Susmita Mohapatra Department of Computer Science, Utkal University, India Abstract: This paper is focused on the implementation

More information

Optimization in MATLAB Seth DeLand

Optimization in MATLAB Seth DeLand Optimization in MATLAB Seth DeLand 4 The MathWorks, Inc. Topics Intro Using gradient-based solvers Optimization in Comp. Finance toolboxes Global optimization Speeding up your optimizations Optimization

More information

A short introduction to embedded optimization

A short introduction to embedded optimization A short introduction to embedded optimization Tecnomatix Plant Simulation Worldwide User Conference June 22nd, 2016 Realize innovation. A short introduction to embedded optimization Table of content 1.

More information

Local Search and Optimization Chapter 4. Mausam (Based on slides of Padhraic Smyth, Stuart Russell, Rao Kambhampati, Raj Rao, Dan Weld )

Local Search and Optimization Chapter 4. Mausam (Based on slides of Padhraic Smyth, Stuart Russell, Rao Kambhampati, Raj Rao, Dan Weld ) Local Search and Optimization Chapter 4 Mausam (Based on slides of Padhraic Smyth, Stuart Russell, Rao Kambhampati, Raj Rao, Dan Weld ) 1 2 Outline Local search techniques and optimization Hill-climbing

More information

Local Search and Optimization Chapter 4. Mausam (Based on slides of Padhraic Smyth, Stuart Russell, Rao Kambhampati, Raj Rao, Dan Weld )

Local Search and Optimization Chapter 4. Mausam (Based on slides of Padhraic Smyth, Stuart Russell, Rao Kambhampati, Raj Rao, Dan Weld ) Local Search and Optimization Chapter 4 Mausam (Based on slides of Padhraic Smyth, Stuart Russell, Rao Kambhampati, Raj Rao, Dan Weld ) 1 2 Outline Local search techniques and optimization Hill-climbing

More information

Genetic Algorithm Based Template Optimization for a Vision System: Obstacle Detection

Genetic Algorithm Based Template Optimization for a Vision System: Obstacle Detection ISTET'09 Umair Ali Khan, Alireza Fasih, Kyandoghere Kyamakya, Jean Chamberlain Chedjou Transportation Informatics Group, Alpen Adria University, Klagenfurt, Austria. Genetic Algorithm Based Template Optimization

More information

METAHEURISTIC. Jacques A. Ferland Department of Informatique and Recherche Opérationnelle Université de Montréal.

METAHEURISTIC. Jacques A. Ferland Department of Informatique and Recherche Opérationnelle Université de Montréal. METAHEURISTIC Jacques A. Ferland Department of Informatique and Recherche Opérationnelle Université de Montréal ferland@iro.umontreal.ca March 2015 Overview Heuristic Constructive Techniques: Generate

More information

Topological Machining Fixture Layout Synthesis Using Genetic Algorithms

Topological Machining Fixture Layout Synthesis Using Genetic Algorithms Topological Machining Fixture Layout Synthesis Using Genetic Algorithms Necmettin Kaya Uludag University, Mechanical Eng. Department, Bursa, Turkey Ferruh Öztürk Uludag University, Mechanical Eng. Department,

More information

Information Fusion Dr. B. K. Panigrahi

Information Fusion Dr. B. K. Panigrahi Information Fusion By Dr. B. K. Panigrahi Asst. Professor Department of Electrical Engineering IIT Delhi, New Delhi-110016 01/12/2007 1 Introduction Classification OUTLINE K-fold cross Validation Feature

More information

Reduction of Side Lobe Levels of Sum Patterns from Discrete Arrays Using Genetic Algorithm

Reduction of Side Lobe Levels of Sum Patterns from Discrete Arrays Using Genetic Algorithm Reduction of Side Lobe Levels of Sum Patterns from Discrete Arrays Using Genetic Algorithm Dr. R. Ramana Reddy 1, S.M. Vali 2, P.Divakara Varma 3 Department of ECE, MVGR College of Engineering, Vizianagaram-535005

More information

P063 ADAPTIVE TRAVEL-TIME AND RAY- PARAMETER INVERSION OF DENSELY SAMPLED 2-D SEISMIC DATA

P063 ADAPTIVE TRAVEL-TIME AND RAY- PARAMETER INVERSION OF DENSELY SAMPLED 2-D SEISMIC DATA 1 P063 ADAPTIVE TRAVEL-TIME AND RAY- PARAMETER INVERSION OF DENSELY SAMPLED 2-D SEISMIC DATA I. TRINKS 1, S. SINGH 2, C. CHAPMAN 3, P. BARTON 1, M. BOSCH 4, A. CHERRETT 5 Addresses 1 Bullard Laboratories,

More information

AN OPTIMIZATION GENETIC ALGORITHM FOR IMAGE DATABASES IN AGRICULTURE

AN OPTIMIZATION GENETIC ALGORITHM FOR IMAGE DATABASES IN AGRICULTURE AN OPTIMIZATION GENETIC ALGORITHM FOR IMAGE DATABASES IN AGRICULTURE Changwu Zhu 1, Guanxiang Yan 2, Zhi Liu 3, Li Gao 1,* 1 Department of Computer Science, Hua Zhong Normal University, Wuhan 430079, China

More information

Time Complexity Analysis of the Genetic Algorithm Clustering Method

Time Complexity Analysis of the Genetic Algorithm Clustering Method Time Complexity Analysis of the Genetic Algorithm Clustering Method Z. M. NOPIAH, M. I. KHAIRIR, S. ABDULLAH, M. N. BAHARIN, and A. ARIFIN Department of Mechanical and Materials Engineering Universiti

More information

Genetic Algorithm using Theory of Chaos

Genetic Algorithm using Theory of Chaos Procedia Computer Science Volume 51, 2015, Pages 316 325 ICCS 2015 International Conference On Computational Science Genetic Algorithm using Theory of Chaos Petra Snaselova and Frantisek Zboril Faculty

More information

Meta- Heuristic based Optimization Algorithms: A Comparative Study of Genetic Algorithm and Particle Swarm Optimization

Meta- Heuristic based Optimization Algorithms: A Comparative Study of Genetic Algorithm and Particle Swarm Optimization 2017 2 nd International Electrical Engineering Conference (IEEC 2017) May. 19 th -20 th, 2017 at IEP Centre, Karachi, Pakistan Meta- Heuristic based Optimization Algorithms: A Comparative Study of Genetic

More information

A Hybrid Genetic Algorithms and Tabu Search for Solving an Irregular Shape Strip Packing Problem

A Hybrid Genetic Algorithms and Tabu Search for Solving an Irregular Shape Strip Packing Problem A Hybrid Genetic Algorithms and Tabu Search for Solving an Irregular Shape Strip Packing Problem Kittipong Ekkachai 1 and Pradondet Nilagupta 2 ABSTRACT This paper presents a packing algorithm to solve

More information

Global Optimization with MATLAB Products

Global Optimization with MATLAB Products Global Optimization with MATLAB Products Account Manager 이장원차장 Application Engineer 엄준상 The MathWorks, Inc. Agenda Introduction to Global Optimization Peaks Surve of Solvers with Eamples 8 MultiStart 6

More information

A Framework for Online Inversion-Based 3D Site Characterization

A Framework for Online Inversion-Based 3D Site Characterization A Framework for Online Inversion-Based 3D Site Characterization Volkan Akcelik, Jacobo Bielak, Ioannis Epanomeritakis,, Omar Ghattas Carnegie Mellon University George Biros University of Pennsylvania Loukas

More information

Evolutionary design for the behaviour of cellular automaton-based complex systems

Evolutionary design for the behaviour of cellular automaton-based complex systems Evolutionary design for the behaviour of cellular automaton-based complex systems School of Computer Science & IT University of Nottingham Adaptive Computing in Design and Manufacture Bristol Motivation

More information

Lecture 5: Optimization of accelerators in simulation and experiments. X. Huang USPAS, Jan 2015

Lecture 5: Optimization of accelerators in simulation and experiments. X. Huang USPAS, Jan 2015 Lecture 5: Optimization of accelerators in simulation and experiments X. Huang USPAS, Jan 2015 1 Optimization in simulation General considerations Optimization algorithms Applications of MOGA Applications

More information

Progress Report on: Interferometric Interpolation of 3D SSP Data

Progress Report on: Interferometric Interpolation of 3D SSP Data Progress Report on: Interferometric Interpolation of 3D SSP Data Sherif M. Hanafy ABSTRACT We present the theory and numerical results for interferometrically interpolating and extrapolating 3D marine

More information

An Evolutionary Algorithm for Minimizing Multimodal Functions

An Evolutionary Algorithm for Minimizing Multimodal Functions An Evolutionary Algorithm for Minimizing Multimodal Functions D.G. Sotiropoulos, V.P. Plagianakos and M.N. Vrahatis University of Patras, Department of Mamatics, Division of Computational Mamatics & Informatics,

More information

REAL-CODED GENETIC ALGORITHMS CONSTRAINED OPTIMIZATION. Nedim TUTKUN

REAL-CODED GENETIC ALGORITHMS CONSTRAINED OPTIMIZATION. Nedim TUTKUN REAL-CODED GENETIC ALGORITHMS CONSTRAINED OPTIMIZATION Nedim TUTKUN nedimtutkun@gmail.com Outlines Unconstrained Optimization Ackley s Function GA Approach for Ackley s Function Nonlinear Programming Penalty

More information

Multi-source Least-squares Migration of Gulf of Mexico Data

Multi-source Least-squares Migration of Gulf of Mexico Data Multi-source Least-squares Migration of Gulf of Mexico Data Xin Wang. King Abdullah University of Science and Technology, Thuwal 955-69, Kingdom of Saudi Arabia Corresponding author is Xin Wang. E-mail

More information

ISSN: [Keswani* et al., 7(1): January, 2018] Impact Factor: 4.116

ISSN: [Keswani* et al., 7(1): January, 2018] Impact Factor: 4.116 IJESRT INTERNATIONAL JOURNAL OF ENGINEERING SCIENCES & RESEARCH TECHNOLOGY AUTOMATIC TEST CASE GENERATION FOR PERFORMANCE ENHANCEMENT OF SOFTWARE THROUGH GENETIC ALGORITHM AND RANDOM TESTING Bright Keswani,

More information

Automatic Programming with Ant Colony Optimization

Automatic Programming with Ant Colony Optimization Automatic Programming with Ant Colony Optimization Jennifer Green University of Kent jg9@kent.ac.uk Jacqueline L. Whalley University of Kent J.L.Whalley@kent.ac.uk Colin G. Johnson University of Kent C.G.Johnson@kent.ac.uk

More information

v : erosion h : erosion H : dilation V : dilation s : erosion r : erosion R : dilation S : dilation

v : erosion h : erosion H : dilation V : dilation s : erosion r : erosion R : dilation S : dilation AUTOMATIC GENERATION OF DIRECTIONAL EROSION AND DILATION SEQUENCE BY GENETIC ALGORITHMS Ikushi Yoda Image Understanding Section Machine Understanding Division Electrotechnical Laboratory 1-1-4 Umezono,

More information

3D inversion of marine CSEM data: A feasibility study from the Shtokman gas field in the Barents Sea

3D inversion of marine CSEM data: A feasibility study from the Shtokman gas field in the Barents Sea 3D inversion of marine CSEM data: A feasibility study from the Shtokman gas field in the Barents Sea M. S. Zhdanov 1,2, M. Čuma 1,2, A. Gribenko 1,2, G. Wilson 2 and N. Black 2 1 The University of Utah,

More information

Introduction to Genetic Algorithms. Based on Chapter 10 of Marsland Chapter 9 of Mitchell

Introduction to Genetic Algorithms. Based on Chapter 10 of Marsland Chapter 9 of Mitchell Introduction to Genetic Algorithms Based on Chapter 10 of Marsland Chapter 9 of Mitchell Genetic Algorithms - History Pioneered by John Holland in the 1970s Became popular in the late 1980s Based on ideas

More information