OPTIMIZATION METHODS

Similar documents
Introduction to Mathematical Programming IE496. Final Review. Dr. Ted Ralphs

DETERMINISTIC OPERATIONS RESEARCH

Dynamic Programming. Other Topics

Module 1 Lecture Notes 2. Optimization Problem and Model Formulation

LECTURE 13: SOLUTION METHODS FOR CONSTRAINED OPTIMIZATION. 1. Primal approach 2. Penalty and barrier methods 3. Dual approach 4. Primal-dual approach

Programming, numerics and optimization

Department of Mathematics Oleg Burdakov of 30 October Consider the following linear programming problem (LP):

INTRODUCTION TO LINEAR AND NONLINEAR PROGRAMMING

MATHEMATICS II: COLLECTION OF EXERCISES AND PROBLEMS

George B. Dantzig Mukund N. Thapa. Linear Programming. 1: Introduction. With 87 Illustrations. Springer

Local and Global Minimum

Contents. I Basics 1. Copyright by SIAM. Unauthorized reproduction of this article is prohibited.

Linear and Integer Programming :Algorithms in the Real World. Related Optimization Problems. How important is optimization?

Unconstrained Optimization Principles of Unconstrained Optimization Search Methods

David G. Luenberger Yinyu Ye. Linear and Nonlinear. Programming. Fourth Edition. ö Springer

Optimization Methods. Final Examination. 1. There are 5 problems each w i t h 20 p o i n ts for a maximum of 100 points.

Kernel Methods & Support Vector Machines

Linear Programming. Linear Programming. Linear Programming. Example: Profit Maximization (1/4) Iris Hui-Ru Jiang Fall Linear programming

Lecture 7: Support Vector Machine

Lecture 25 Nonlinear Programming. November 9, 2009

Simulation. Lecture O1 Optimization: Linear Programming. Saeed Bastani April 2016

Convex Optimization. Lijun Zhang Modification of

Tribhuvan University Institute Of Science and Technology Tribhuvan University Institute of Science and Technology

Solution Methods Numerical Algorithms

APPLIED OPTIMIZATION WITH MATLAB PROGRAMMING

Linear Programming. L.W. Dasanayake Department of Economics University of Kelaniya

Linear Programming. Linear programming provides methods for allocating limited resources among competing activities in an optimal way.

ME 555: Distributed Optimization

Some Advanced Topics in Linear Programming

Unit.9 Integer Programming

COPYRIGHTED MATERIAL. Index

Introduction to Optimization Problems and Methods

OPERATIONS RESEARCH. Dr. Mohd Vaseem Ismail. Assistant Professor. Faculty of Pharmacy Jamia Hamdard New Delhi

LECTURE NOTES Non-Linear Programming

Artificial Intelligence

Solutions for Operations Research Final Exam

Section Notes 5. Review of Linear Programming. Applied Math / Engineering Sciences 121. Week of October 15, 2017

Linear Programming and its Applications

Optimization Methods: Advanced Topics in Optimization - Multi-objective Optimization 1. Module 8 Lecture Notes 2. Multi-objective Optimization

Nonlinear Programming

LARGE SCALE LINEAR AND INTEGER OPTIMIZATION: A UNIFIED APPROACH

Convex Programs. COMPSCI 371D Machine Learning. COMPSCI 371D Machine Learning Convex Programs 1 / 21

Linear Programming Duality and Algorithms

Applications of Linear Programming

Advanced Operations Research Prof. G. Srinivasan Department of Management Studies Indian Institute of Technology, Madras

Advanced Operations Research Prof. G. Srinivasan Department of Management Studies Indian Institute of Technology, Madras

Integer Programming Explained Through Gomory s Cutting Plane Algorithm and Column Generation

Advanced Operations Research Techniques IE316. Quiz 2 Review. Dr. Ted Ralphs

Outline. CS38 Introduction to Algorithms. Linear programming 5/21/2014. Linear programming. Lecture 15 May 20, 2014

Lesson 11: Duality in linear programming

COT 6936: Topics in Algorithms! Giri Narasimhan. ECS 254A / EC 2443; Phone: x3748

LECTURE 6: INTERIOR POINT METHOD. 1. Motivation 2. Basic concepts 3. Primal affine scaling algorithm 4. Dual affine scaling algorithm

Real life Problem. Review

BCN Decision and Risk Analysis. Syed M. Ahmed, Ph.D.

In other words, we want to find the domain points that yield the maximum or minimum values (extrema) of the function.

Linear methods for supervised learning

MVE165/MMG631 Linear and integer optimization with applications Lecture 9 Discrete optimization: theory and algorithms

Interpretation of Dual Model for Piecewise Linear. Programming Problem Robert Hlavatý

Optimization Methods: Optimization using Calculus Kuhn-Tucker Conditions 1. Module - 2 Lecture Notes 5. Kuhn-Tucker Conditions

THEORY OF LINEAR AND INTEGER PROGRAMMING

Applied Lagrange Duality for Constrained Optimization

Introduction to Design Optimization

TMA946/MAN280 APPLIED OPTIMIZATION. Exam instructions

Support Vector Machines. James McInerney Adapted from slides by Nakul Verma

Linear Programming: Introduction

Linear Programming Problems

Chapter II. Linear Programming

CSE 417 Network Flows (pt 4) Min Cost Flows

Fundamentals of Integer Programming

A NEW SEQUENTIAL CUTTING PLANE ALGORITHM FOR SOLVING MIXED INTEGER NONLINEAR PROGRAMMING PROBLEMS

Lagrangian Relaxation: An overview

Introduction. Linear because it requires linear functions. Programming as synonymous of planning.

ISM206 Lecture, April 26, 2005 Optimization of Nonlinear Objectives, with Non-Linear Constraints

Resource Management in Computer Networks -- Mapping from engineering problems to mathematical formulations

5 Day 5: Maxima and minima for n variables.

Classification of Optimization Problems and the Place of Calculus of Variations in it

Optimization. Definition: Terms: Why Optimization is Necessary? 29/10/2016. Factor Levels Response Effects Interaction

Identical text Minor difference Moved in S&W Wrong in S&W Not copied from Wiki 1

Linear Optimization and Extensions: Theory and Algorithms

Lecture 4 Duality and Decomposition Techniques

IE598 Big Data Optimization Summary Nonconvex Optimization

COMS 4771 Support Vector Machines. Nakul Verma

Easter Term OPTIMIZATION

4.1 The original problem and the optimal tableau

22. LECTURE 22. I can define critical points. I know the difference between local and absolute minimums/maximums.

Linear Programming. Course review MS-E2140. v. 1.1

Introduction to Optimization

CONLIN & MMA solvers. Pierre DUYSINX LTAS Automotive Engineering Academic year

MA4254: Discrete Optimization. Defeng Sun. Department of Mathematics National University of Singapore Office: S Telephone:

DM545 Linear and Integer Programming. Lecture 2. The Simplex Method. Marco Chiarandini

Graphs that have the feasible bases of a given linear

Lecture 2 Optimization with equality constraints

A Simplex-Cosine Method for Solving Hard Linear Problems

Machine Learning for Signal Processing Lecture 4: Optimization

Natural Language Processing

Optimal network flow allocation

Theoretical Concepts of Machine Learning

Dynamic modelling and network optimization

Previously Local sensitivity analysis: having found an optimal basis to a problem in standard form,

CHAPTER 2 CONVENTIONAL AND NON-CONVENTIONAL TECHNIQUES TO SOLVE ORPD PROBLEM

Transcription:

D. Nagesh Kumar Associate Professor Department of Civil Engineering, Indian Institute of Science, Bangalore - 50 0 Email : nagesh@civil.iisc.ernet.in URL: http://www.civil.iisc.ernet.in/~nagesh Brief Contents Overview of optimization and classification of optimization problems; Optimization using calculus, Kuhn-Tucker Conditions; Linear - Graphical method, Simplex method, Revised simplex method, Sensitivity analysis, Examples of transportation, assignment, water resources and other applications; Dynamic - Introduction, Sequential optimization, computational procedure, curse of dimensionality, Applications in water resources and structural engineering; Other topics in Optimization - Piecewise linear approximation, Multi objective optimization, Multi level optimization; Direct and indirect search methods; Evolutionary algorithms for optimization and search; Applications in civil engineering.

DETAILED CONTENTS : Introduction and Basic Concepts (05) Historical Development; Engineering applications of Optimization; Art of Modeling; Objective function; Constraints and Constraint surface; Formulation of design problems as mathematical programming problems; Classification of optimization problems based on nature of constraints, structure of the problem, deterministic nature of variables, separability of functions and number of objective functions; Optimization techniques classical and advanced techniques. : Optimization using Calculus (0) Stationary points - maxima, minima and saddle points; Functions of single and two variables; Global Optimum; Convexity and concavity of functions of one and two variables; Optimization of function of one variable and multiple variables; Gradient vectors; Examples; Optimization of function of multiple variables subject to equality constraints; Lagrangian function; Optimization of function of multiple variables subject to equality constraints; Hessian matrix formulation; Eigen values; Kuhn- Tucker Conditions; Examples. 3: Linear (0) Standard form of linear programming (LP) problem; Canonical form of LP problem; Assumptions in LP Models; Elementary operations; Graphical method for two variable optimization problem; Examples; Motivation of simplex method, Simplex algorithm and construction of simplex tableau; Simplex criterion; Minimization versus maximization problems; Revised simplex method; Duality in LP; Primal-dual relations; Dual Simplex method; Sensitivity or post optimality analysis; other algorithms for solving LP problems Karmarkar s projective scaling method. 4: Linear Applications (04) Use of software for solving linear optimization problems using graphical and simplex methods; Examples for transportation, assignment, water resources, structural and other optimization problems. 5: Dynamic (04) Sequential optimization; Representation of multistage decision process; Types of multistage decision problems; Concept of sub optimization and the principle of optimality; Recursive equations Forward and backward recursions; Computational procedure in dynamic programming (DP); Discrete versus continuous dynamic programming; Multiple state variables; curse of dimensionality in DP.

: Dynamic Applications (0) Problem formulation and applications for Design of continuous beam, Optimal geometric layout of a truss, Water allocation as a sequential process, Capacity expansion, Reservoir operation etc. 7: Integer (03) Integer linear programming; Concept of cutting plane method; Mixed integer programming; Solution algorithms; Examples. 8: Further topics in Optimization (0) Piecewise linear approximation of a nonlinear function; Multi objective optimization Weighted and constrained methods; Multi level optimization; Direct and indirect search methods; Evolutionary algorithms for optimization and search; Applications in civil engineering.

Lecture Plan. Introduction and Basic Concepts. Optimization using Calculus 3. Linear 4. Linear Applications Hours for Sub- Sub- Historical Development; Engineering applications of Optimization; Art of Modeling Objective function; Constraints and Constraint surface; Formulation of design problems as mathematical programming problems Classification of optimization problems Optimization techniques classical and advanced techniques. Stationary points; Functions of single and two variables; Global Optimum Convexity and concavity of functions of one and two variables Optimization of function of one variable and multiple variables; Gradient vectors; Examples. Optimization of function of multiple variables subject to equality constraints; Lagrangian function. Optimization of function of multiple variables subject to equality constraints; Hessian matrix formulation; Eigen values. Kuhn-Tucker Conditions; Examples. Standard form of linear programming (LP) problem; Canonical form of LP problem; Assumptions in LP Models; Elementary operations. Graphical method for two variable optimization problem; Examples. Motivation of simplex method, Simplex algorithm and construction of simplex tableau; Simplex criterion; Minimization versus maximization problems. Revised simplex method; Duality in LP; Primal-dual relations; Dual Simplex method; Sensitivity or post optimality analysis. Other algorithms for solving LP problems Karmarkar s projective scaling method. Use of software for solving linear optimization problems using graphical and simplex methods. Examples for transportation, assignment, water resources, structural and other 3 optimization problems. Total Hours 5 4

5. Dynamic. Dynamic Applications 7. Integer 8. Advanced Topics in Optimization Sub- Sequential optimization; Representation of multistage decision process; Types of multistage decision problems; Concept of sub optimization and the principle of optimality. Recursive equations Forward and backward recursions; Computational procedure in dynamic programming (DP). Discrete versus continuous dynamic programming; Multiple state variables; curse of dimensionality in DP. Problem formulation and application in Design of continuous beam and Optimal geometric layout of a truss. Hours for Sub- Water allocation as a sequential process Capacity expansion and Reservoir operation Integer linear programming; Concept of cutting plane method. Mixed integer programming; Solution algorithms; Examples. Piecewise linear approximation of a nonlinear function Multi objective optimization Weighted and constrained methods; Multi level optimization. Direct and indirect search methods. Evolutionary algorithms for optimization and search. Applications in civil engineering. Total Hours 4 3 Total 40