Other Algorithms for Linear Programming Chapter 7

Similar documents
Introduction. Linear because it requires linear functions. Programming as synonymous of planning.

Optimization of Design. Lecturer:Dung-An Wang Lecture 8

Linear Programming Problems

Linear programming II João Carlos Lourenço

Linear Programming. Linear programming provides methods for allocating limited resources among competing activities in an optimal way.

ISE203 Optimization 1 Linear Models. Dr. Arslan Örnek Chapter 4 Solving LP problems: The Simplex Method SIMPLEX

5 The Theory of the Simplex Method

AM 121: Intro to Optimization Models and Methods Fall 2017

Introduction to Operations Research

Read: H&L chapters 1-6

CSE 40/60236 Sam Bailey

Chap5 The Theory of the Simplex Method

LECTURE 6: INTERIOR POINT METHOD. 1. Motivation 2. Basic concepts 3. Primal affine scaling algorithm 4. Dual affine scaling algorithm

5. DUAL LP, SOLUTION INTERPRETATION, AND POST-OPTIMALITY

Civil Engineering Systems Analysis Lecture XV. Instructor: Prof. Naveen Eluru Department of Civil Engineering and Applied Mechanics

Marginal and Sensitivity Analyses

BCN Decision and Risk Analysis. Syed M. Ahmed, Ph.D.

Chapter II. Linear Programming

Primal Simplex Algorithm for the Pure Minimal Cost Flow Problem

Introduction to Mathematical Programming IE496. Final Review. Dr. Ted Ralphs

Advanced Operations Research Techniques IE316. Quiz 2 Review. Dr. Ted Ralphs

CSC 8301 Design & Analysis of Algorithms: Linear Programming

MATHEMATICS II: COLLECTION OF EXERCISES AND PROBLEMS

Linear Programming. Course review MS-E2140. v. 1.1

Controlling Air Pollution. A quick review. Reclaiming Solid Wastes. Chapter 4 The Simplex Method. Solving the Bake Sale problem. How to move?

LECTURE 13: SOLUTION METHODS FOR CONSTRAINED OPTIMIZATION. 1. Primal approach 2. Penalty and barrier methods 3. Dual approach 4. Primal-dual approach

Chapter 3: Towards the Simplex Method for Efficient Solution of Linear Programs

Advanced Operations Research Techniques IE316. Quiz 1 Review. Dr. Ted Ralphs

Introduction to Operations Research Prof. G. Srinivasan Department of Management Studies Indian Institute of Technology, Madras

Section Notes 5. Review of Linear Programming. Applied Math / Engineering Sciences 121. Week of October 15, 2017

Tuesday, April 10. The Network Simplex Method for Solving the Minimum Cost Flow Problem

Some Advanced Topics in Linear Programming

Solutions for Operations Research Final Exam

4.1 The original problem and the optimal tableau

Generalized Network Flow Programming

3 INTEGER LINEAR PROGRAMMING

Part 4. Decomposition Algorithms Dantzig-Wolf Decomposition Algorithm

VARIANTS OF THE SIMPLEX METHOD

Math Models of OR: The Simplex Algorithm: Practical Considerations

SUBSTITUTING GOMORY CUTTING PLANE METHOD TOWARDS BALAS ALGORITHM FOR SOLVING BINARY LINEAR PROGRAMMING

Section Notes 4. Duality, Sensitivity, and the Dual Simplex Algorithm. Applied Math / Engineering Sciences 121. Week of October 8, 2018

Linear Optimization. Andongwisye John. November 17, Linkoping University. Andongwisye John (Linkoping University) November 17, / 25

Math 414 Lecture 30. The greedy algorithm provides the initial transportation matrix.

Graphical Methods in Linear Programming

Simulation. Lecture O1 Optimization: Linear Programming. Saeed Bastani April 2016

SUBSTITUTING GOMORY CUTTING PLANE METHOD TOWARDS BALAS ALGORITHM FOR SOLVING BINARY LINEAR PROGRAMMING

4.1 Graphical solution of a linear program and standard form

CASE STUDY. fourteen. Animating The Simplex Method. case study OVERVIEW. Application Overview and Model Development.

Discuss mainly the standard inequality case: max. Maximize Profit given limited resources. each constraint associated to a resource

Linear Programming Applications. Software for Linear Programming

Ellipsoid Algorithm :Algorithms in the Real World. Ellipsoid Algorithm. Reduction from general case

MATLAB Solution of Linear Programming Problems

16.410/413 Principles of Autonomy and Decision Making

Linear Programming. Linear Programming. Linear Programming. Example: Profit Maximization (1/4) Iris Hui-Ru Jiang Fall Linear programming

UNIT 2 LINEAR PROGRAMMING PROBLEMS

Journal of Business & Economics Research November, 2009 Volume 7, Number 11

New Directions in Linear Programming

Linear programming and duality theory

DM545 Linear and Integer Programming. Lecture 2. The Simplex Method. Marco Chiarandini

COLUMN GENERATION IN LINEAR PROGRAMMING

Chapter 4: The Mechanics of the Simplex Method

Programming, numerics and optimization

Artificial Intelligence

Linear Programming. Revised Simplex Method, Duality of LP problems and Sensitivity analysis

THE simplex algorithm [1] has been popularly used

An example of LP problem: Political Elections

TRANSPORTATION AND ASSIGNMENT PROBLEMS

Department of Mathematics Oleg Burdakov of 30 October Consider the following linear programming problem (LP):

Math Introduction to Operations Research

Lecture 9: Linear Programming

Computational Integer Programming. Lecture 12: Branch and Cut. Dr. Ted Ralphs

The Simplex Algorithm

Unit.9 Integer Programming

SHORTCUT METHODS FOR SIMPLEX- BASED SENSITIVITY ANALYSIS OF LINEAR PROGRAMMING AND RELATED SOFTWARE ISSUES. 1. Introduction 1. Muwafaq M.

The Ascendance of the Dual Simplex Method: A Geometric View

CS675: Convex and Combinatorial Optimization Spring 2018 The Simplex Algorithm. Instructor: Shaddin Dughmi

5.4 Pure Minimal Cost Flow

The Affine Scaling Method

Introduction to Linear Programming. Chapter 3: Hillier and Lieberman Chapter 3: Decision Tools for Agribusiness Dr. Hurley s AGB 328 Course

Copyright 2007 Pearson Addison-Wesley. All rights reserved. A. Levitin Introduction to the Design & Analysis of Algorithms, 2 nd ed., Ch.

Linear Programming has been used to:

Graphs that have the feasible bases of a given linear

What s Linear Programming? Often your try is to maximize or minimize an objective within given constraints

Contents. I Basics 1. Copyright by SIAM. Unauthorized reproduction of this article is prohibited.

Introduction to Linear Programming. Algorithmic and Geometric Foundations of Optimization

Selected Topics in Column Generation

OPERATIONS RESEARCH. Linear Programming Problem

INEN 420 Final Review

Part 1. The Review of Linear Programming The Revised Simplex Method

3 Interior Point Method

Solving Linear Programs Using the Simplex Method (Manual)

Outline. CS38 Introduction to Algorithms. Linear programming 5/21/2014. Linear programming. Lecture 15 May 20, 2014

The Simplex Algorithm. Chapter 5. Decision Procedures. An Algorithmic Point of View. Revision 1.0

Tribhuvan University Institute Of Science and Technology Tribhuvan University Institute of Science and Technology

Lesson 17. Geometry and Algebra of Corner Points

3. The Simplex algorithmn The Simplex algorithmn 3.1 Forms of linear programs

NATCOR Convex Optimization Linear Programming 1

Discrete Optimization. Lecture Notes 2

Lesson 11: Duality in linear programming

Introduction to Operations Research Prof. G. Srinivasan Department of Management Studies Indian Institute of Technology, Madras

Transcription:

Other Algorithms for Linear Programming Chapter 7

Introduction The Simplex method is only a part of the arsenal of algorithms regularly used by LP practitioners. Variants of the simplex method the dual simplex method parametric LP The interiorpoint approach

7. The Dual Simplex Method Based on the duality theory( ch 6) Can be thought of as the mirror image of the simplex method. Useful in special types of situations: If you have to introduce many artificial variables to construct an initial BF solution artificially, it is easier to begin with a dual feasible solution..fewer iterations as well To estimate the optimal value of the objective Sensitivity analysis

7. Parametric LP Used for conducting sensitivity analysis systematically by gradually changing various model parameters simultaneously. Systematic changes in the c parameters Systematic changes in the b parameters

Systematic Changes in the c parameters The objective function of the ordinary linear programming model n Z = j= Is replaced by c j x j n Z ( q ) = ( c j a q ) x j= j Where a j are given input constants representing the relative rates at which the coefficients are to be changed. j

Summary of the Parametric LP procedure for Systematic Changes in the c Parameters. Solve the problem with q=0 by the Simplex method.. Use the sensitivity analysis procedure to introduce the Dc j =a j q changes into Eq. (0).. Increase q until one of the nonbasic variables has its coefficient in Eq. (0) go negative ( or until q has been increased as far as desired). 4. Use this variable as the entering basic variable for an iteration of the simplex method to find the new optimal solution. Return to step.

Example Wyndor Glass Co. a = and a = Z ( q ) = ( q ) x x (5 q )

Beginning with the final simplex tableau q=0 Z / x x5 4 = 6

Step Would first have these changes from the original coefficients added into it on the left hand side Z qx qx / x x = 4 5 6

X and x as basic variables both need to be eliminated from Eq (0) Z qx (0) q times q qx / x Eq.() = 6 4 times Eq.() Z (/ 7 / 6q ) x 4 x 5 ( / q ) x 5 = 6 q Optimality test: the current BF solution will remain Optimal as long as these coefficients of the nonbasic Variables remain nonnegative: / 7 / 6q 0 / q 0 for for 0 allq q 0 9 / 7

Table 7.

Systematic Changes in the b Parameters Max Z( q ) = n j= c j x j subject to n j= and x j a ij x 0 j b i for a q i i =,,... m j =,,..., n

Summary of the Parametric LP Procedure for Systematic Changes in the b Parameters. Solve the problem with q=0 by the Simplex method.. Use the sensitivity analysis procedure to introduce the Db=aq changes to the right side column.. Increase q until one of the basic variables has its value in the right side column go negative ( or until q has been increased as far as desired). 4. Use this variable as the leaving variable for an iteration of the dual simplex method to find the new optimal solution. Return to step.

Example: dual problem for the Wyndor Glass Co. Table 6.; a = and a = functional constraints q q q q 5 5 y y or y y y y or y y

Table 7.

[ ] œ œ œ ß ø Œ Œ Œ º Ø = œ ß ø Œ º Ø œ ß ø Œ º Ø = = = œ ß ø Œ º Ø = = 6 7 5 / / 0 / * * 6 5 6 * * q q q q q q q b S b b y Z The role of the sensitivity analysis

7.4 An InteriorPoint Algorithm Concept : Shoot through the interior of the feasible region toward an optimal solution. Concept : Move in a direction that improves the objective function value at the fastest possible rate. Concept : Transform the feasible region to place the current trial solution near its center, thereby enabling a large improvement when concept is implemented.

Example Max Z = x x subject to x x 8 and x 0 x 0

x (0,8) optimal Z=6=x x (,4) (,) x

The Relevance of the Gradient for Concepts and The algorithm begins with an initial trial solution that lies in the interior of the feasible region i.e. inside the boundary of the feasible region. Arbitrarily chosen (,) to be the initial trial solution.

Using the Projected Gradient to Implement Concepts and The augmented form: C = [,, 0], X = [x, x, x] T, A = [,, ] B = 8 Adding the gradient: (, 4, 4) = (,, 4) (,, 0)

Using the Projected Gradient to Implement Concepts and The constraint fails, the projection of the result to x x x =8 is used: (, 4, 4) > (,, ). OR The projected gradient C p is used: (,, ) = (,, 4) (0,, ), here C p = (0,, ) is the projection of the gradient (,, 0) to x x x =0 P = I A T (A A T ) A C p = P c

A Centering Scheme for Implementing Concept New rescaled variables are introduceed: x = x /, x = x /, x = x x = x = x = / 4 New variables are equidistant from the three constraint boundaries: x = 0, x = 0, x = The new problem: 0 Z = x 4x x x 4x = 8

Summary and Illustration of the Algorithm The algorithm is designed for dealing with big problems. The algorithm tends to require smaller number of iterations (although with more work per iteration)

Conclusions Duality theory and parametric linear programming are especially valuable for postoptimality analysis Interior point method provides a powerful approach for efficiently solving of very large problems