STRUCTURAL & MULTIDISCIPLINARY OPTIMIZATION

Size: px
Start display at page:

Download "STRUCTURAL & MULTIDISCIPLINARY OPTIMIZATION"

Transcription

1 STRUCTURAL & MULTIDISCIPLINARY OPTIMIZATION Pierre DUYSINX Patricia TOSSINGS Department of Aerospace and Mechanical Engineering Academic year

2 Course objectives To become familiar with the introduction of optimization concepts in design and engineering processes. To be able to formulate your design problem as an optimization problem To present a systematic and critical overview of various numerical methods available to solve optimization problems. The basic concepts are illustrated throughout the course by solving simple optimization problems. (Generally structural problems but also multidisciplinary problems) To be able to read, implement and exploit scientific papers 2

3 Course objectives Several examples of application to real-life design problems are offered to demonstrate the high level of efficiency attained in modern numerical optimization methods. Remark: Although most examples are taken in the field of structural optimization, using finite element modeling and analysis, the same principles and methods can be easily applied to other design problems and simulation methods arising in various engineering disciplines. Electromagnetics Fluid flows Mechanical Engineering Chemical Engineering 3

4 Outline INTRODUCTION Optimization in Engineering Design Assumptions and definitions Problem statement Iterative optimization Process INTRODUCTION TO MATHEMATICAL PROGRAMMING Optimality conditions of single variable and multiple variable functions (KKT conditions) Convex functions, convex sets PRIMAL AND DUAL PROBLEM STATEMENT Lagrange function Lagrangian problem 4

5 Outline UNCONSTRAINED OPTIMIZATION Descent methods for minimization The method of steepest descent Quasi unconstrained problem: optimality conditions Line search techniques Newton type methods Conjugate direction methods Quasi Newton methods 5

6 Outline GENERAL NON LINEAR PROGRAMMING METHODS Pure dual methods Lagrange function KKT conditions Introduction to duality Weak duality Strong duality Properties of dual function in Strong duality Application to quadratic problems st linear constraints Treatment of side constraints Dual solutions of MMA subproblems 6

7 Outline SENSITIVITY ANALYSIS Linear static problems Natural vibrations Linear stability STRUCTURAL APPROXIMATIONS OC criteria as a first order expansion of displacements Linear approximation Reciprocal approximations Convex Linearization (CONLIN) Method of Moving asymptotes (MMA) Generalized Method of Moving Asymptotes The MMA family schemes Second order approximations Diagonal SQP, GMMA 7

8 Outline SOLVING SEQUENTIAL CONVEX PROGRAMMING Transformation methods: Barrier functions, Penalty function, Augmented Lagrangian methods Direct (primal) methods Gradient projection methods Method of feasible directions Linearization methods Sequential Linear Programming SLP Recursive Quadratic programming Sequential Quadratic Programming SQP Dual solvers With convex and separable approximation CONLIN and MMA Subproblem formulation Dual solvers for MMA and CONLIN 8

9 Outline TOPOLOGY optimization: Introduction Optimal material distribution problem formulation Microstructures and homogenization Sensitivity analysis Compliance design Strength design Examples TOPOLOGY OPTIMIZATION: advanced topics Geometrical restrictions: min/ max size, perimeter, etc. Stress constraints in topology optimization Multiple material topology optimization Topology optimization and additive manufacturing 9

10 Outline SHAPE OPTIMIZATION Representation of geometries Parametric curves and surfaces Constructive geometry Level set description Parametric approach of CAD systems Sensitivity analysis wrt to boundary variables Material derivatives Velocity field concept Velocity field calculation Extension to XFEM and Level set description Finite element error control Industrial software tools Examples 10

11 Outline COMPOSITE STRUCTURE OPTIMIZATION Parameterization of composites Problem formulation Sensitivity analysis Solution aspects META HEURISTIC ALGORITHMS Introduction to meta heuristic optimization algorithms Genetic Algorithms Simulated Annealing Particle Swarm Optimization 11

12 Computer work 1: Unconstrained Minimization Solve optimization unconstrained minimization problems using computer and MATLAB to experiment the optimization methods presented during the lectures Group of two students Build up your MATLAB code to solve: Unconstrained minimization of quadratic and non quadratic functions Evaluation: Report and Power Point presentation (max 20 pages) MATLAB code Deadline: November 6, 2018 (12:00 AM) 12

13 Computer work 2: Basics of Topology Optimization Building up your own topology optimization solver to experiment with the method Group of two students Goal: solve efficiently your topology optimization problem Write your MATLAB code Ref: A 99 line topology optimization code written in Matlab. O. Sigmund. Struct Multidisc Optim 21, Available at Evaluation: Report & Power Point presentation (max 20 pages) Program MATLAB code Deadline: December 22, 2018 (12:00 AM) 13

14 Computer work 3: Solve an industrial problem using topology optimization Introduction to an industrial topology optimization tool (NX TOPOL) Group of two students Getting starting with TOPOL Goal: getting starting to and being able to solve industrial applications Getting started with TOPOL Understand the TOPOL parameter settings Solve an industrial benchmark Evaluation: Report and Power Point Presentation (max 20 pages) Deadline January 7, 2019 (12:00 AM) 14

15 Exams and assessment Oral exam: theory Two questions of theory Two questions about computer projects In January Computer works & projects Reports & Program Oral presentation 15

16 Lecture notes Copy of the slides Lecture slides by Pierre Duysinx & Patricia Tossings Web site: > cours > MECA0027 References (recommended but not mandatory!) Programmation mathématique : théorie et algorithmes (Tome 1). M.Minoux. Dunod, Paris, Foundations of Structural Optimization: A Unified Approach. A.J. Morris. John Wiley & Sons Ltd, 1982 Haftka, R.T. and Gürdal, Z., Elements of Structural Optimization, 3rd edition, Springer, 1992 Topology Optimization, Theory, Methods, and Applications. M.P. Bendsoe and O. Sigmund, Springer Verlag, Berlin,

17 Agenda Date Hour Lecture 18/09 14h Fundamentals of Math Programming including KKT conditions (P. Tossings) 25/09 14h Introduction to Engineering Design using Structural Optimization (P. Duysinx) Optimality Criteria approach of structural optimization (P. Duysinx) 02/10 14h Unconstrained Optimization I - Gradient Methods (P. Tossings) Computer Work 1: Unconstrained minimization 09/10 14h Unconstrained Optimization II - Gradient Methods & Line Search (P. Tossings) Computer Work 2: Unconstrained Minimization 17

18 Agenda Date Hour Lecture 16/10 14h Unconstrained Optimization III Newton & Quasi Newton (P. Tossings) Computer Work 3: Unconstrained minimization 23/10 14h Topology optimization. Introduction (P. Duysinx) 30/10 HOLLIDAY Computer Work 4: Topology Optimization using MATLAB 07/11 12h Deadline Project 1 Unconstrained minimization 07/11 14h Sensitivity analysis of linear structural systems (P. Duysinx) Computer Work 5: Topology Optimization using MATLAB 18

19 Agenda Date Hour Lecture 13/11 14h General nonlinear programming : Duality (P. Tossings) Computer Work 6: Topology Optimization (MATLAB) 20/11 14h Structural approximations and dual solvers: CONLIN, MMA (P. Duysinx) Computer Work 7: Topology Optimization (MATLAB) 27/11 14h Solving Sequential Convex Problems: Transformation methods (Barrier, Penalty, Augmented Lagrangian) (P. Tossings) Computer Work 8: Topology optimization using NX TOPOL 04/12 14h Solving Sequential Convex Problems: Transformation methods, SLP, SQP, Dual solvers (P. Duysinx) Computer Work 9: Topology optimization (NX TOPOL) 19

20 Agenda Date Hour Lecture 11/12 14h Shape optimization (P. Duysinx) Computer Work 10: Topology Optimization (NX TOPOL) 18/12 Topology optimization and additive manufacturing (P. Duysinx, E. Fernandez) Computer Work 11: Topology Optimization (NX TOPOL) 22/12 12h Deadline project 2 Topology optimization using MATLAB 07/01 12h Deadline project 3 Topology optimization using NX TOPOL 20

21 Contacts Pierre Duysinx LTAS-Automotive Engineering Institute de Mécanique B52 0/514 Tel Patricia TOSSINGS Mathématiques Générales B37 0/57 Institut de Mathématique Tél:

22 Contacts Assistants : Pablo ALARCON LTAS-Automotive Engineering Institute de Mécanique B52 0/512 Tel palarcon@uliege.be Eduardo FERNANDEZ SANCHEZ LTAS-Automotive Engineering Institute de Mécanique B52 0/512 Tel efsanchez@uliege.be 22

CONLIN & MMA solvers. Pierre DUYSINX LTAS Automotive Engineering Academic year

CONLIN & MMA solvers. Pierre DUYSINX LTAS Automotive Engineering Academic year CONLIN & MMA solvers Pierre DUYSINX LTAS Automotive Engineering Academic year 2018-2019 1 CONLIN METHOD 2 LAY-OUT CONLIN SUBPROBLEMS DUAL METHOD APPROACH FOR CONLIN SUBPROBLEMS SEQUENTIAL QUADRATIC PROGRAMMING

More information

TOPOLOGY OPTIMIZATION: AN INTRODUCTION. Pierre DUYSINX LTAS Automotive Engineering Academic year

TOPOLOGY OPTIMIZATION: AN INTRODUCTION. Pierre DUYSINX LTAS Automotive Engineering Academic year TOPOLOGY OPTIMIZATION: AN INTRODUCTION Pierre DUYSINX LTAS Automotive Engineering Academic year 2017-2018 1 LAY-OUT Introduction Topology problem formulation Problem statement Compliance minimization Homogenization

More information

APPLIED OPTIMIZATION WITH MATLAB PROGRAMMING

APPLIED OPTIMIZATION WITH MATLAB PROGRAMMING APPLIED OPTIMIZATION WITH MATLAB PROGRAMMING Second Edition P. Venkataraman Rochester Institute of Technology WILEY JOHN WILEY & SONS, INC. CONTENTS PREFACE xiii 1 Introduction 1 1.1. Optimization Fundamentals

More information

Contents. I Basics 1. Copyright by SIAM. Unauthorized reproduction of this article is prohibited.

Contents. I Basics 1. Copyright by SIAM. Unauthorized reproduction of this article is prohibited. page v Preface xiii I Basics 1 1 Optimization Models 3 1.1 Introduction... 3 1.2 Optimization: An Informal Introduction... 4 1.3 Linear Equations... 7 1.4 Linear Optimization... 10 Exercises... 12 1.5

More information

Module 1 Lecture Notes 2. Optimization Problem and Model Formulation

Module 1 Lecture Notes 2. Optimization Problem and Model Formulation Optimization Methods: Introduction and Basic concepts 1 Module 1 Lecture Notes 2 Optimization Problem and Model Formulation Introduction In the previous lecture we studied the evolution of optimization

More information

David G. Luenberger Yinyu Ye. Linear and Nonlinear. Programming. Fourth Edition. ö Springer

David G. Luenberger Yinyu Ye. Linear and Nonlinear. Programming. Fourth Edition. ö Springer David G. Luenberger Yinyu Ye Linear and Nonlinear Programming Fourth Edition ö Springer Contents 1 Introduction 1 1.1 Optimization 1 1.2 Types of Problems 2 1.3 Size of Problems 5 1.4 Iterative Algorithms

More information

Nonlinear Programming

Nonlinear Programming Nonlinear Programming SECOND EDITION Dimitri P. Bertsekas Massachusetts Institute of Technology WWW site for book Information and Orders http://world.std.com/~athenasc/index.html Athena Scientific, Belmont,

More information

An Introduction to Structural Optimization

An Introduction to Structural Optimization An Introduction to Structural Optimization SOLID MECHANICS AND ITS APPLICATIONS Volume 153 Series Editor: G.M.L. GLADWELL Department of Civil Engineering University of Waterloo Waterloo, Ontario, Canada

More information

TOPOLOGY OPTIMIZATION OF ELASTOMER DAMPING DEVICES FOR STRUCTURAL VIBRATION REDUCTION

TOPOLOGY OPTIMIZATION OF ELASTOMER DAMPING DEVICES FOR STRUCTURAL VIBRATION REDUCTION 6th European Conference on Computational Mechanics (ECCM 6) 7th European Conference on Computational Fluid Dynamics (ECFD 7) 1115 June 2018, Glasgow, UK TOPOLOGY OPTIMIZATION OF ELASTOMER DAMPING DEVICES

More information

Constrained optimization

Constrained optimization Constrained optimization A general constrained optimization problem has the form where The Lagrangian function is given by Primal and dual optimization problems Primal: Dual: Weak duality: Strong duality:

More information

Introduction to Optimization

Introduction to Optimization Introduction to Optimization Second Order Optimization Methods Marc Toussaint U Stuttgart Planned Outline Gradient-based optimization (1st order methods) plain grad., steepest descent, conjugate grad.,

More information

LECTURE 13: SOLUTION METHODS FOR CONSTRAINED OPTIMIZATION. 1. Primal approach 2. Penalty and barrier methods 3. Dual approach 4. Primal-dual approach

LECTURE 13: SOLUTION METHODS FOR CONSTRAINED OPTIMIZATION. 1. Primal approach 2. Penalty and barrier methods 3. Dual approach 4. Primal-dual approach LECTURE 13: SOLUTION METHODS FOR CONSTRAINED OPTIMIZATION 1. Primal approach 2. Penalty and barrier methods 3. Dual approach 4. Primal-dual approach Basic approaches I. Primal Approach - Feasible Direction

More information

COMS 4771 Support Vector Machines. Nakul Verma

COMS 4771 Support Vector Machines. Nakul Verma COMS 4771 Support Vector Machines Nakul Verma Last time Decision boundaries for classification Linear decision boundary (linear classification) The Perceptron algorithm Mistake bound for the perceptron

More information

Support Vector Machines. James McInerney Adapted from slides by Nakul Verma

Support Vector Machines. James McInerney Adapted from slides by Nakul Verma Support Vector Machines James McInerney Adapted from slides by Nakul Verma Last time Decision boundaries for classification Linear decision boundary (linear classification) The Perceptron algorithm Mistake

More information

Programming, numerics and optimization

Programming, numerics and optimization Programming, numerics and optimization Lecture C-4: Constrained optimization Łukasz Jankowski ljank@ippt.pan.pl Institute of Fundamental Technological Research Room 4.32, Phone +22.8261281 ext. 428 June

More information

LAYOUT OPTIMIZATION : A MATHEMATICAL PROGRAMMING APPROACH

LAYOUT OPTIMIZATION : A MATHEMATICAL PROGRAMMING APPROACH Aerospace Structures rue Ernest Solvay, 21 - B-4000 Liège (BELGIUM) UNIVERSITY OF LIEGE Report OA-41 LAYOUT OPTIMIZATION : A MATHEMATICAL PROGRAMMING APPROACH by Pierre DUYSINX Aerospace Laboratory, Institute

More information

Introduction to Design Optimization

Introduction to Design Optimization Introduction to Design Optimization First Edition Krishnan Suresh i Dedicated to my family. They mean the world to me. ii Origins of this Text Preface Like many other textbooks, this text has evolved from

More information

INTRODUCTION TO LINEAR AND NONLINEAR PROGRAMMING

INTRODUCTION TO LINEAR AND NONLINEAR PROGRAMMING INTRODUCTION TO LINEAR AND NONLINEAR PROGRAMMING DAVID G. LUENBERGER Stanford University TT ADDISON-WESLEY PUBLISHING COMPANY Reading, Massachusetts Menlo Park, California London Don Mills, Ontario CONTENTS

More information

Comparative Study of Topological Optimization of Beam and Ring Type Structures under static Loading Condition

Comparative Study of Topological Optimization of Beam and Ring Type Structures under static Loading Condition Comparative Study of Topological Optimization of Beam and Ring Type Structures under static Loading Condition Vani Taklikar 1, Anadi Misra 2 P.G. Student, Department of Mechanical Engineering, G.B.P.U.A.T,

More information

Introduction to Optimization Problems and Methods

Introduction to Optimization Problems and Methods Introduction to Optimization Problems and Methods wjch@umich.edu December 10, 2009 Outline 1 Linear Optimization Problem Simplex Method 2 3 Cutting Plane Method 4 Discrete Dynamic Programming Problem Simplex

More information

Convex Optimization. Lijun Zhang Modification of

Convex Optimization. Lijun Zhang   Modification of Convex Optimization Lijun Zhang zlj@nju.edu.cn http://cs.nju.edu.cn/zlj Modification of http://stanford.edu/~boyd/cvxbook/bv_cvxslides.pdf Outline Introduction Convex Sets & Functions Convex Optimization

More information

Introduction to Constrained Optimization

Introduction to Constrained Optimization Introduction to Constrained Optimization Duality and KKT Conditions Pratik Shah {pratik.shah [at] lnmiit.ac.in} The LNM Institute of Information Technology www.lnmiit.ac.in February 13, 2013 LNMIIT MLPR

More information

Theoretical Concepts of Machine Learning

Theoretical Concepts of Machine Learning Theoretical Concepts of Machine Learning Part 2 Institute of Bioinformatics Johannes Kepler University, Linz, Austria Outline 1 Introduction 2 Generalization Error 3 Maximum Likelihood 4 Noise Models 5

More information

Preface. and Its Applications 81, ISBN , doi: / , Springer Science+Business Media New York, 2013.

Preface. and Its Applications 81, ISBN , doi: / , Springer Science+Business Media New York, 2013. Preface This book is for all those interested in using the GAMS technology for modeling and solving complex, large-scale, continuous nonlinear optimization problems or applications. Mainly, it is a continuation

More information

DETERMINISTIC OPERATIONS RESEARCH

DETERMINISTIC OPERATIONS RESEARCH DETERMINISTIC OPERATIONS RESEARCH Models and Methods in Optimization Linear DAVID J. RADER, JR. Rose-Hulman Institute of Technology Department of Mathematics Terre Haute, IN WILEY A JOHN WILEY & SONS,

More information

Surrogate Gradient Algorithm for Lagrangian Relaxation 1,2

Surrogate Gradient Algorithm for Lagrangian Relaxation 1,2 Surrogate Gradient Algorithm for Lagrangian Relaxation 1,2 X. Zhao 3, P. B. Luh 4, and J. Wang 5 Communicated by W.B. Gong and D. D. Yao 1 This paper is dedicated to Professor Yu-Chi Ho for his 65th birthday.

More information

INTERIOR POINT METHOD BASED CONTACT ALGORITHM FOR STRUCTURAL ANALYSIS OF ELECTRONIC DEVICE MODELS

INTERIOR POINT METHOD BASED CONTACT ALGORITHM FOR STRUCTURAL ANALYSIS OF ELECTRONIC DEVICE MODELS 11th World Congress on Computational Mechanics (WCCM XI) 5th European Conference on Computational Mechanics (ECCM V) 6th European Conference on Computational Fluid Dynamics (ECFD VI) E. Oñate, J. Oliver

More information

Topology Optimization of Two Linear Elastic Bodies in Unilateral Contact

Topology Optimization of Two Linear Elastic Bodies in Unilateral Contact 2 nd International Conference on Engineering Optimization September 6-9, 2010, Lisbon, Portugal Topology Optimization of Two Linear Elastic Bodies in Unilateral Contact Niclas Strömberg Department of Mechanical

More information

arxiv: v2 [math.oc] 12 Feb 2019

arxiv: v2 [math.oc] 12 Feb 2019 A CENTRAL PATH FOLLOWING METHOD USING THE NORMALIZED GRADIENTS Long Chen 1, Wenyi Chen 2, and Kai-Uwe Bletzinger 1 arxiv:1902.04040v2 [math.oc] 12 Feb 2019 1 Chair of Structural Analysis, Technical University

More information

Lecture 4 Duality and Decomposition Techniques

Lecture 4 Duality and Decomposition Techniques Lecture 4 Duality and Decomposition Techniques Jie Lu (jielu@kth.se) Richard Combes Alexandre Proutiere Automatic Control, KTH September 19, 2013 Consider the primal problem Lagrange Duality Lagrangian

More information

NON-PARAMETRIC SHAPE OPTIMIZATION IN INDUSTRIAL CONTEXT

NON-PARAMETRIC SHAPE OPTIMIZATION IN INDUSTRIAL CONTEXT NON-PARAMETRIC SHAPE OPTIMIZATION IN INDUSTRIAL CONTEXT Michael Böhm, Peter Clausen FE-DESIGN GmbH, Paris, April 3rd, 2012 Overview Introduction / FE-Design Optimization in Industry and Requirements Shape

More information

LECTURE NOTES Non-Linear Programming

LECTURE NOTES Non-Linear Programming CEE 6110 David Rosenberg p. 1 Learning Objectives LECTURE NOTES Non-Linear Programming 1. Write out the non-linear model formulation 2. Describe the difficulties of solving a non-linear programming model

More information

Outline. Level Set Methods. For Inverse Obstacle Problems 4. Introduction. Introduction. Martin Burger

Outline. Level Set Methods. For Inverse Obstacle Problems 4. Introduction. Introduction. Martin Burger For Inverse Obstacle Problems Martin Burger Outline Introduction Optimal Geometries Inverse Obstacle Problems & Shape Optimization Sensitivity Analysis based on Gradient Flows Numerical Methods University

More information

Characterizing Improving Directions Unconstrained Optimization

Characterizing Improving Directions Unconstrained Optimization Final Review IE417 In the Beginning... In the beginning, Weierstrass's theorem said that a continuous function achieves a minimum on a compact set. Using this, we showed that for a convex set S and y not

More information

Unstructured Mesh Generation for Implicit Moving Geometries and Level Set Applications

Unstructured Mesh Generation for Implicit Moving Geometries and Level Set Applications Unstructured Mesh Generation for Implicit Moving Geometries and Level Set Applications Per-Olof Persson (persson@mit.edu) Department of Mathematics Massachusetts Institute of Technology http://www.mit.edu/

More information

PRIMAL-DUAL INTERIOR POINT METHOD FOR LINEAR PROGRAMMING. 1. Introduction

PRIMAL-DUAL INTERIOR POINT METHOD FOR LINEAR PROGRAMMING. 1. Introduction PRIMAL-DUAL INTERIOR POINT METHOD FOR LINEAR PROGRAMMING KELLER VANDEBOGERT AND CHARLES LANNING 1. Introduction Interior point methods are, put simply, a technique of optimization where, given a problem

More information

Applied Lagrange Duality for Constrained Optimization

Applied Lagrange Duality for Constrained Optimization Applied Lagrange Duality for Constrained Optimization Robert M. Freund February 10, 2004 c 2004 Massachusetts Institute of Technology. 1 1 Overview The Practical Importance of Duality Review of Convexity

More information

Critical study of design parameterization in topology optimization; The influence of design parameterization on local minima

Critical study of design parameterization in topology optimization; The influence of design parameterization on local minima 2 nd International Conference on Engineering Optimization September 6-9, 21, Lisbon, Portugal Critical study of design parameterization in topology optimization; The influence of design parameterization

More information

Introduction to optimization methods and line search

Introduction to optimization methods and line search Introduction to optimization methods and line search Jussi Hakanen Post-doctoral researcher jussi.hakanen@jyu.fi How to find optimal solutions? Trial and error widely used in practice, not efficient and

More information

Solution Methods Numerical Algorithms

Solution Methods Numerical Algorithms Solution Methods Numerical Algorithms Evelien van der Hurk DTU Managment Engineering Class Exercises From Last Time 2 DTU Management Engineering 42111: Static and Dynamic Optimization (6) 09/10/2017 Class

More information

Comparison of Interior Point Filter Line Search Strategies for Constrained Optimization by Performance Profiles

Comparison of Interior Point Filter Line Search Strategies for Constrained Optimization by Performance Profiles INTERNATIONAL JOURNAL OF MATHEMATICS MODELS AND METHODS IN APPLIED SCIENCES Comparison of Interior Point Filter Line Search Strategies for Constrained Optimization by Performance Profiles M. Fernanda P.

More information

An explicit feature control approach in structural topology optimization

An explicit feature control approach in structural topology optimization th World Congress on Structural and Multidisciplinary Optimisation 07 th -2 th, June 205, Sydney Australia An explicit feature control approach in structural topology optimization Weisheng Zhang, Xu Guo

More information

Convex Analysis and Minimization Algorithms I

Convex Analysis and Minimization Algorithms I Jean-Baptiste Hiriart-Urruty Claude Lemarechal Convex Analysis and Minimization Algorithms I Fundamentals With 113 Figures Springer-Verlag Berlin Heidelberg New York London Paris Tokyo Hong Kong Barcelona

More information

Classical Gradient Methods

Classical Gradient Methods Classical Gradient Methods Note simultaneous course at AMSI (math) summer school: Nonlin. Optimization Methods (see http://wwwmaths.anu.edu.au/events/amsiss05/) Recommended textbook (Springer Verlag, 1999):

More information

Lecture 7: Support Vector Machine

Lecture 7: Support Vector Machine Lecture 7: Support Vector Machine Hien Van Nguyen University of Houston 9/28/2017 Separating hyperplane Red and green dots can be separated by a separating hyperplane Two classes are separable, i.e., each

More information

Lec13p1, ORF363/COS323

Lec13p1, ORF363/COS323 Lec13 Page 1 Lec13p1, ORF363/COS323 This lecture: Semidefinite programming (SDP) Definition and basic properties Review of positive semidefinite matrices SDP duality SDP relaxations for nonconvex optimization

More information

Topology Optimization and JuMP

Topology Optimization and JuMP Immense Potential and Challenges School of Engineering and Information Technology UNSW Canberra June 28, 2018 Introduction About Me First year PhD student at UNSW Canberra Multidisciplinary design optimization

More information

DISCRETE CONVEX ANALYSIS

DISCRETE CONVEX ANALYSIS DISCRETE CONVEX ANALYSIS o KAZUO MUROTA University of Tokyo; PRESTO, JST Tokyo, Japan Society for Industrial and Applied Mathematics Philadelphia List of Figures Notation Preface xi xiii xxi 1 Introduction

More information

Optimal Design of a Parallel Beam System with Elastic Supports to Minimize Flexural Response to Harmonic Loading

Optimal Design of a Parallel Beam System with Elastic Supports to Minimize Flexural Response to Harmonic Loading 11 th World Congress on Structural and Multidisciplinary Optimisation 07 th -12 th, June 2015, Sydney Australia Optimal Design of a Parallel Beam System with Elastic Supports to Minimize Flexural Response

More information

Convex Optimization and Machine Learning

Convex Optimization and Machine Learning Convex Optimization and Machine Learning Mengliu Zhao Machine Learning Reading Group School of Computing Science Simon Fraser University March 12, 2014 Mengliu Zhao SFU-MLRG March 12, 2014 1 / 25 Introduction

More information

An augmented Lagrangian method for equality constrained optimization with fast infeasibility detection

An augmented Lagrangian method for equality constrained optimization with fast infeasibility detection An augmented Lagrangian method for equality constrained optimization with fast infeasibility detection Paul Armand 1 Ngoc Nguyen Tran 2 Institut de Recherche XLIM Université de Limoges Journées annuelles

More information

Design Optimization - Structural Design Optimization -

Design Optimization - Structural Design Optimization - 16.810 Engineering Design and Rapid Prototyping Lecture 6 Design Optimization - Structural Design Optimization - Instructor(s) Prof. Olivier de Weck January 11, 2005 What Is Design Optimization? Selecting

More information

TOPOLOGY OPTIMIZATION OF STRUCTURES USING GLOBAL STRESS MEASURE

TOPOLOGY OPTIMIZATION OF STRUCTURES USING GLOBAL STRESS MEASURE OPOLOGY OPIMIZAION OF SRUCURES USING GLOBAL SRESS MEASURE By VIJAY KRISHNA YALAMANCHILI A HESIS PRESENED O HE GRADUAE SCHOOL OF HE UNIVERSIY OF FLORIDA IN PARIAL FULFILLMEN OF HE REQUIREMENS FOR HE DEGREE

More information

Constrained Optimization COS 323

Constrained Optimization COS 323 Constrained Optimization COS 323 Last time Introduction to optimization objective function, variables, [constraints] 1-dimensional methods Golden section, discussion of error Newton s method Multi-dimensional

More information

Composite Self-concordant Minimization

Composite Self-concordant Minimization Composite Self-concordant Minimization Volkan Cevher Laboratory for Information and Inference Systems-LIONS Ecole Polytechnique Federale de Lausanne (EPFL) volkan.cevher@epfl.ch Paris 6 Dec 11, 2013 joint

More information

Chapter 8 Visualization and Optimization

Chapter 8 Visualization and Optimization Chapter 8 Visualization and Optimization Recommended reference books: [1] Edited by R. S. Gallagher: Computer Visualization, Graphics Techniques for Scientific and Engineering Analysis by CRC, 1994 [2]

More information

INTERNATIONAL JOURNAL OF CIVIL AND STRUCTURAL ENGINEERING Volume 2, No 1, 2011

INTERNATIONAL JOURNAL OF CIVIL AND STRUCTURAL ENGINEERING Volume 2, No 1, 2011 INTERNATIONAL JOURNAL OF CIVIL AND STRUCTURAL ENGINEERING Volume 2, No 1, 2011 Copyright 2010 All rights reserved Integrated Publishing services Research article ISSN 0976 4399 Topology optimization of

More information

Multi-stage Stochastic Programming, Stochastic Decomposition, and Connections to Dynamic Programming: An Algorithmic Perspective

Multi-stage Stochastic Programming, Stochastic Decomposition, and Connections to Dynamic Programming: An Algorithmic Perspective Multi-stage Stochastic Programming, Stochastic Decomposition, and Connections to Dynamic Programming: An Algorithmic Perspective Suvrajeet Sen Data Driven Decisions Lab, ISE Department Ohio State University

More information

Multidisciplinary System Design Optimization (MSDO) Course Summary

Multidisciplinary System Design Optimization (MSDO) Course Summary Multidisciplinary System Design Optimization (MSDO) Course Summary Lecture 23 Prof. Olivier de Weck Prof. Karen Willcox 1 Outline Summarize course content Present some emerging research directions Interactive

More information

Fast-Lipschitz Optimization

Fast-Lipschitz Optimization Fast-Lipschitz Optimization DREAM Seminar Series University of California at Berkeley September 11, 2012 Carlo Fischione ACCESS Linnaeus Center, Electrical Engineering KTH Royal Institute of Technology

More information

Element energy based method for topology optimization

Element energy based method for topology optimization th World Congress on Structural and Multidisciplinary Optimization May 9-24, 23, Orlando, Florida, USA Element energy based method for topology optimization Vladimir Uskov Central Aerohydrodynamic Institute

More information

The Level Set Method applied to Structural Topology Optimization

The Level Set Method applied to Structural Topology Optimization The Level Set Method applied to Structural Topology Optimization Dr Peter Dunning 22-Jan-2013 Structural Optimization Sizing Optimization Shape Optimization Increasing: No. design variables Opportunity

More information

ISM206 Lecture, April 26, 2005 Optimization of Nonlinear Objectives, with Non-Linear Constraints

ISM206 Lecture, April 26, 2005 Optimization of Nonlinear Objectives, with Non-Linear Constraints ISM206 Lecture, April 26, 2005 Optimization of Nonlinear Objectives, with Non-Linear Constraints Instructor: Kevin Ross Scribe: Pritam Roy May 0, 2005 Outline of topics for the lecture We will discuss

More information

A NURBS-BASED APPROACH FOR SHAPE AND TOPOLOGY OPTIMIZATION OF FLOW DOMAINS

A NURBS-BASED APPROACH FOR SHAPE AND TOPOLOGY OPTIMIZATION OF FLOW DOMAINS 6th European Conference on Computational Mechanics (ECCM 6) 7th European Conference on Computational Fluid Dynamics (ECFD 7) 11 15 June 2018, Glasgow, UK A NURBS-BASED APPROACH FOR SHAPE AND TOPOLOGY OPTIMIZATION

More information

Stochastic Separable Mixed-Integer Nonlinear Programming via Nonconvex Generalized Benders Decomposition

Stochastic Separable Mixed-Integer Nonlinear Programming via Nonconvex Generalized Benders Decomposition Stochastic Separable Mixed-Integer Nonlinear Programming via Nonconvex Generalized Benders Decomposition Xiang Li Process Systems Engineering Laboratory Department of Chemical Engineering Massachusetts

More information

Olivier Brüls. Department of Aerospace and Mechanical Engineering University of Liège

Olivier Brüls. Department of Aerospace and Mechanical Engineering University of Liège Fully coupled simulation of mechatronic and flexible multibody systems: An extended finite element approach Olivier Brüls Department of Aerospace and Mechanical Engineering University of Liège o.bruls@ulg.ac.be

More information

Principles of Wireless Sensor Networks. Fast-Lipschitz Optimization

Principles of Wireless Sensor Networks. Fast-Lipschitz Optimization http://www.ee.kth.se/~carlofi/teaching/pwsn-2011/wsn_course.shtml Lecture 5 Stockholm, October 14, 2011 Fast-Lipschitz Optimization Royal Institute of Technology - KTH Stockholm, Sweden e-mail: carlofi@kth.se

More information

Optimization. Industrial AI Lab.

Optimization. Industrial AI Lab. Optimization Industrial AI Lab. Optimization An important tool in 1) Engineering problem solving and 2) Decision science People optimize Nature optimizes 2 Optimization People optimize (source: http://nautil.us/blog/to-save-drowning-people-ask-yourself-what-would-light-do)

More information

Efficient Tuning of SVM Hyperparameters Using Radius/Margin Bound and Iterative Algorithms

Efficient Tuning of SVM Hyperparameters Using Radius/Margin Bound and Iterative Algorithms IEEE TRANSACTIONS ON NEURAL NETWORKS, VOL. 13, NO. 5, SEPTEMBER 2002 1225 Efficient Tuning of SVM Hyperparameters Using Radius/Margin Bound and Iterative Algorithms S. Sathiya Keerthi Abstract This paper

More information

COMPUTATIONAL DYNAMICS

COMPUTATIONAL DYNAMICS COMPUTATIONAL DYNAMICS THIRD EDITION AHMED A. SHABANA Richard and Loan Hill Professor of Engineering University of Illinois at Chicago A John Wiley and Sons, Ltd., Publication COMPUTATIONAL DYNAMICS COMPUTATIONAL

More information

Combination of Simulation and Optimization in the Design of Electromechanical Systems

Combination of Simulation and Optimization in the Design of Electromechanical Systems Combination of Simulation and Optimization in the Design of Electromechanical Systems Hermann Landes 1, Frank Vogel 2, Wigand Rathmann 2 1 WisSoft, Buckenhof, Germany 2 inutech GmbH, Nuremberg, Germany

More information

Lecture 12: Feasible direction methods

Lecture 12: Feasible direction methods Lecture 12 Lecture 12: Feasible direction methods Kin Cheong Sou December 2, 2013 TMA947 Lecture 12 Lecture 12: Feasible direction methods 1 / 1 Feasible-direction methods, I Intro Consider the problem

More information

PARAMETRIC SHAPE AND TOPOLOGY OPTIMIZATION WITH RADIAL BASIS FUNCTIONS

PARAMETRIC SHAPE AND TOPOLOGY OPTIMIZATION WITH RADIAL BASIS FUNCTIONS PARAMETRIC SHAPE AND TOPOLOGY OPTIMIZATION WITH RADIAL BASIS FUNCTIONS Michael Yu Wang 1 and Shengyin Wang 1 Department of Automation and Computer-Aided Engineering The Chinese University of Hong Kong

More information

Programming, numerics and optimization

Programming, numerics and optimization Programming, numerics and optimization Lecture A-1: Preliminaries, programming basics I Łukasz Jankowski ljank@ippt.pan.pl Smart-Tech Centre Institute of Fundamental Technological Research Room 4.32, Phone

More information

Efficient Use of Iterative Solvers in Nested Topology Optimization

Efficient Use of Iterative Solvers in Nested Topology Optimization Efficient Use of Iterative Solvers in Nested Topology Optimization Oded Amir, Mathias Stolpe and Ole Sigmund Technical University of Denmark Department of Mathematics Department of Mechanical Engineering

More information

A nodal based evolutionary structural optimisation algorithm

A nodal based evolutionary structural optimisation algorithm Computer Aided Optimum Design in Engineering IX 55 A dal based evolutionary structural optimisation algorithm Y.-M. Chen 1, A. J. Keane 2 & C. Hsiao 1 1 ational Space Program Office (SPO), Taiwan 2 Computational

More information

OPTIMIZATION METHODS

OPTIMIZATION METHODS D. Nagesh Kumar Associate Professor Department of Civil Engineering, Indian Institute of Science, Bangalore - 50 0 Email : nagesh@civil.iisc.ernet.in URL: http://www.civil.iisc.ernet.in/~nagesh Brief Contents

More information

HYBRID GENETIC ALGORITHM WITH GREAT DELUGE TO SOLVE CONSTRAINED OPTIMIZATION PROBLEMS

HYBRID GENETIC ALGORITHM WITH GREAT DELUGE TO SOLVE CONSTRAINED OPTIMIZATION PROBLEMS HYBRID GENETIC ALGORITHM WITH GREAT DELUGE TO SOLVE CONSTRAINED OPTIMIZATION PROBLEMS NABEEL AL-MILLI Financial and Business Administration and Computer Science Department Zarqa University College Al-Balqa'

More information

Linear methods for supervised learning

Linear methods for supervised learning Linear methods for supervised learning LDA Logistic regression Naïve Bayes PLA Maximum margin hyperplanes Soft-margin hyperplanes Least squares resgression Ridge regression Nonlinear feature maps Sometimes

More information

STRUCTURAL TOPOLOGY OPTIMIZATION SUBJECTED TO RELAXED STRESS AND DESIGN VARIABLES

STRUCTURAL TOPOLOGY OPTIMIZATION SUBJECTED TO RELAXED STRESS AND DESIGN VARIABLES STRUCTURAL TOPOLOGY OPTIMIZATION SUBJECTED TO RELAXED STRESS AND DESIGN VARIABLES Hailu Shimels Gebremedhen, Dereje Engida Woldemichael and Fakhruldin M. Hashim Mechanical Engineering Department, Universiti

More information

Topology Optimization of Multiple Load Case Structures

Topology Optimization of Multiple Load Case Structures Topology Optimization of Multiple Load Case Structures Rafael Santos Iwamura Exectuive Aviation Engineering Department EMBRAER S.A. rafael.iwamura@embraer.com.br Alfredo Rocha de Faria Department of Mechanical

More information

Data Mining Chapter 8: Search and Optimization Methods Fall 2011 Ming Li Department of Computer Science and Technology Nanjing University

Data Mining Chapter 8: Search and Optimization Methods Fall 2011 Ming Li Department of Computer Science and Technology Nanjing University Data Mining Chapter 8: Search and Optimization Methods Fall 2011 Ming Li Department of Computer Science and Technology Nanjing University Search & Optimization Search and Optimization method deals with

More information

Truss structural configuration optimization using the linear extended interior penalty function method

Truss structural configuration optimization using the linear extended interior penalty function method ANZIAM J. 46 (E) pp.c1311 C1326, 2006 C1311 Truss structural configuration optimization using the linear extended interior penalty function method Wahyu Kuntjoro Jamaluddin Mahmud (Received 25 October

More information

Performance Evaluation of an Interior Point Filter Line Search Method for Constrained Optimization

Performance Evaluation of an Interior Point Filter Line Search Method for Constrained Optimization 6th WSEAS International Conference on SYSTEM SCIENCE and SIMULATION in ENGINEERING, Venice, Italy, November 21-23, 2007 18 Performance Evaluation of an Interior Point Filter Line Search Method for Constrained

More information

EARLY INTERIOR-POINT METHODS

EARLY INTERIOR-POINT METHODS C H A P T E R 3 EARLY INTERIOR-POINT METHODS An interior-point algorithm is one that improves a feasible interior solution point of the linear program by steps through the interior, rather than one that

More information

Introduction to Mathematical Programming IE496. Final Review. Dr. Ted Ralphs

Introduction to Mathematical Programming IE496. Final Review. Dr. Ted Ralphs Introduction to Mathematical Programming IE496 Final Review Dr. Ted Ralphs IE496 Final Review 1 Course Wrap-up: Chapter 2 In the introduction, we discussed the general framework of mathematical modeling

More information

Optimization III: Constrained Optimization

Optimization III: Constrained Optimization Optimization III: Constrained Optimization CS 205A: Mathematical Methods for Robotics, Vision, and Graphics Doug James (and Justin Solomon) CS 205A: Mathematical Methods Optimization III: Constrained Optimization

More information

Algorithms for convex optimization

Algorithms for convex optimization Algorithms for convex optimization Michal Kočvara Institute of Information Theory and Automation Academy of Sciences of the Czech Republic and Czech Technical University kocvara@utia.cas.cz http://www.utia.cas.cz/kocvara

More information

Introduction to Optimization

Introduction to Optimization Introduction to Optimization Constrained Optimization Marc Toussaint U Stuttgart Constrained Optimization General constrained optimization problem: Let R n, f : R n R, g : R n R m, h : R n R l find min

More information

Topology optimization of continuum structures with ɛ-relaxed stress constraints

Topology optimization of continuum structures with ɛ-relaxed stress constraints Topology optimization of continuum structures with ɛ-relaxed stress constraints C.E.M. Guilherme and J.S.O. Fonseca Federal University of Rio Grande do Sul, RS Brazil Abstract Topology optimization of

More information

Convex Programs. COMPSCI 371D Machine Learning. COMPSCI 371D Machine Learning Convex Programs 1 / 21

Convex Programs. COMPSCI 371D Machine Learning. COMPSCI 371D Machine Learning Convex Programs 1 / 21 Convex Programs COMPSCI 371D Machine Learning COMPSCI 371D Machine Learning Convex Programs 1 / 21 Logistic Regression! Support Vector Machines Support Vector Machines (SVMs) and Convex Programs SVMs are

More information

Chapter 3 Numerical Methods

Chapter 3 Numerical Methods Chapter 3 Numerical Methods Part 1 3.1 Linearization and Optimization of Functions of Vectors 1 Problem Notation 2 Outline 3.1.1 Linearization 3.1.2 Optimization of Objective Functions 3.1.3 Constrained

More information

The Role of Geometry in the Multidisciplinary Design of Aerospace Vehicles

The Role of Geometry in the Multidisciplinary Design of Aerospace Vehicles The Role of Geometry in the Multidisciplinary Design of Aerospace Vehicles SIAM Conference on Geometric Design Thomas A. Zang & Jamshid A. Samareh Multidisciplinary Optimization Branch NASA Langley Research

More information

Data Mining: Concepts and Techniques. Chapter 9 Classification: Support Vector Machines. Support Vector Machines (SVMs)

Data Mining: Concepts and Techniques. Chapter 9 Classification: Support Vector Machines. Support Vector Machines (SVMs) Data Mining: Concepts and Techniques Chapter 9 Classification: Support Vector Machines 1 Support Vector Machines (SVMs) SVMs are a set of related supervised learning methods used for classification Based

More information

SmartDO. Smart Computing. Smart Design Optimization. Tel :

SmartDO.   Smart Computing. Smart Design Optimization.     Tel : SmartDO Design Optimization/ System Integration/ Process Automation Email : contact@smartdo.co Tel : 886-37-462-733 SmartDO Optimize Your Product. Make The Most Profit Out Of Your CAE Investment SmartDO

More information

Modified Augmented Lagrangian Coordination and Alternating Direction Method of Multipliers with

Modified Augmented Lagrangian Coordination and Alternating Direction Method of Multipliers with Modified Augmented Lagrangian Coordination and Alternating Direction Method of Multipliers with Parallelization in Non-hierarchical Analytical Target Cascading Yongsu Jung Department of Mechanical Engineering,

More information

A simple Topology Optimization Example. with MD R2 Patran

A simple Topology Optimization Example. with MD R2 Patran A simple Topology Optimization Example with MD R2 Patran by cand. ing. Hanno Niemann Département Mécanique des Structures et Matériaux (DMSM) Institut Supérieur de l'aéronautic et de l'espace (ISAE) Université

More information

Second-order shape optimization of a steel bridge

Second-order shape optimization of a steel bridge Computer Aided Optimum Design of Structures 67 Second-order shape optimization of a steel bridge A.F.M. Azevedo, A. Adao da Fonseca Faculty of Engineering, University of Porto, Porto, Portugal Email: alvaro@fe.up.pt,

More information

INTRODUCTION TO CAD/CAM SYSTEMS IM LECTURE HOURS PER WEEK PRESENTIAL

INTRODUCTION TO CAD/CAM SYSTEMS IM LECTURE HOURS PER WEEK PRESENTIAL COURSE CODE INTENSITY MODALITY CHARACTERISTIC PRE-REQUISITE CO-REQUISITE CREDITS ACTUALIZATION DATE INTRODUCTION TO CAD/CAM SYSTEMS IM0242 3 LECTURE HOURS PER WEEK 48 HOURS CLASSROOM ON 16 WEEKS, 96 HOURS

More information

MVE165/MMG630, Applied Optimization Lecture 8 Integer linear programming algorithms. Ann-Brith Strömberg

MVE165/MMG630, Applied Optimization Lecture 8 Integer linear programming algorithms. Ann-Brith Strömberg MVE165/MMG630, Integer linear programming algorithms Ann-Brith Strömberg 2009 04 15 Methods for ILP: Overview (Ch. 14.1) Enumeration Implicit enumeration: Branch and bound Relaxations Decomposition methods:

More information