Math Models of OR: The Simplex Algorithm: Practical Considerations
|
|
- Dwight Russell
- 5 years ago
- Views:
Transcription
1 Math Models of OR: The Simplex Algorithm: Practical Considerations John E. Mitchell Department of Mathematical Sciences RPI, Troy, NY USA September 2018 Mitchell Simplex Algorithm: Practical Considerations 1 / 20
2 Initialization and termination Outline 1 Initialization and termination 2 Tolerances 3 Pivoting rules 4 Preprocessing 5 Free variables Mitchell Simplex Algorithm: Practical Considerations 2 / 20
3 Initialization and termination The Phases of the Simplex Algorithm As presented, the simplex algorithm solves a linear optimization problem by Converting it into standard form, Phase I: finding an equivalent canonical form, usually through the method of artificial variables, and Phase II: pivoting from basic feasible solution to neighboring basic feasible solution until reaching either optimal form or unbounded form. When you formulate a problem to feed to a solver, you shouldn t convert it to standard form. Solvers can efficiently exploit simple bounds, free variables, and inequality constraints; see later. Mitchell Simplex Algorithm: Practical Considerations 3 / 20
4 Initialization and termination The Phases of the Simplex Algorithm As presented, the simplex algorithm solves a linear optimization problem by Converting it into standard form, Phase I: finding an equivalent canonical form, usually through the method of artificial variables, and Phase II: pivoting from basic feasible solution to neighboring basic feasible solution until reaching either optimal form or unbounded form. When you formulate a problem to feed to a solver, you shouldn t convert it to standard form. Solvers can efficiently exploit simple bounds, free variables, and inequality constraints; see later. Mitchell Simplex Algorithm: Practical Considerations 3 / 20
5 Initialization and termination The Phases of the Simplex Algorithm As presented, the simplex algorithm solves a linear optimization problem by Converting it into standard form, Phase I: finding an equivalent canonical form, usually through the method of artificial variables, and Phase II: pivoting from basic feasible solution to neighboring basic feasible solution until reaching either optimal form or unbounded form. When you formulate a problem to feed to a solver, you shouldn t convert it to standard form. Solvers can efficiently exploit simple bounds, free variables, and inequality constraints; see later. Mitchell Simplex Algorithm: Practical Considerations 3 / 20
6 Initialization and termination Terminating the algorithm We have seen that the simplex algorithm may cycle between multiple basic sequences that give the same extreme point. Modern LP solvers have built-in mechanisms to help escape such cycling by using perturbation techniques involving the variable bounds. Given an m n constraint matrix A of rank m, any basic feasible solution has m basic variables. So the n number of possible basic feasible solutions is no larger than m Thus, the simplex algorithm converges in a finite number of iterations. Modern solvers routinely solve problems with millions of variables, even on a laptop.. Mitchell Simplex Algorithm: Practical Considerations 4 / 20
7 Tolerances Outline 1 Initialization and termination 2 Tolerances 3 Pivoting rules 4 Preprocessing 5 Free variables Mitchell Simplex Algorithm: Practical Considerations 5 / 20
8 Tolerances Roundoff errors Numbers are represented to a finite precision on a computer. Combining together finite precision representations of numbers may lead to additional roundoff errors. Typically, 10 7 is regarded as machine single precision, while is double precision. A computer cannot readily return solutions that are more accurate than these precision values. Mitchell Simplex Algorithm: Practical Considerations 6 / 20
9 Tolerances Tolerances Modern optimization solvers have several tolerances for declaring that a solution is optimal. The principal tolerances are: feasiblility: Do the variables obey their bounds? Are the constraints satisfied? The default tolerance for CPLEX is Note that the tolerance might be an absolute value, or it might be a relative tolerance. A relative tolerance compares the error scaled by the given bound or value, for example: if require P n j=1 a ijx j = b i : relative tolerance is P n j=1 a ij x j b i max{1, b i } optimality: the reduced costs need to be nonnegative to conclude a solution is optimal. This is relaxed to requiring that all the reduced costs are greater than some tolerance. The default in CPLEX is to require that all reduced costs be no smaller than Mitchell Simplex Algorithm: Practical Considerations 7 / 20
10 Tolerances Tolerances Modern optimization solvers have several tolerances for declaring that a solution is optimal. The principal tolerances are: feasiblility: Do the variables obey their bounds? Are the constraints satisfied? The default tolerance for CPLEX is Note that the tolerance might be an absolute value, or it might be a relative tolerance. A relative tolerance compares the error scaled by the given bound or value, for example: if require P n j=1 a ijx j = b i : relative tolerance is P n j=1 a ij x j b i max{1, b i } optimality: the reduced costs need to be nonnegative to conclude a solution is optimal. This is relaxed to requiring that all the reduced costs are greater than some tolerance. The default in CPLEX is to require that all reduced costs be no smaller than Mitchell Simplex Algorithm: Practical Considerations 7 / 20
11 Tolerances Pivot elements Internally, the algorithm needs to ensure that it does not choose a pivot element that is too close to zero, which would lead to accumulation of roundoff errors. Mitchell Simplex Algorithm: Practical Considerations 8 / 20
12 Pivoting rules Outline 1 Initialization and termination 2 Tolerances 3 Pivoting rules 4 Preprocessing 5 Free variables Mitchell Simplex Algorithm: Practical Considerations 9 / 20
13 Pivoting rules Pivoting rules The original pivot rule for choosing the entering variable is to choose the most negative reduced cost. Other rules that require more work per iteration, but typically reduce the number of iterations include: best improvement: choose the incoming variable that leads to the best improvement in the objective function value. Mitchell Simplex Algorithm: Practical Considerations 10 / 20
14 Pivoting rules Steepest edge steepest edge: choose the incoming variable where the simplex direction makes the most acute angle with the objective function c. x (0, 0) min x2ir 2 3x 1 x 2 3x 1 + 3x 2 = 10 s.t. x 1 3x 2 apple 2 3x 1 + 3x 2 apple 10 x 1, x 2 0 feasible region x 1 3x 2 = 2 c steepest edge x 1 Mitchell Simplex Algorithm: Practical Considerations 11 / 20
15 Pivoting rules Dual simplex dual simplex: Later, we will see the dual simplex algorithm, which can work very well, especially with a steepest edge pivot rule. Mitchell Simplex Algorithm: Practical Considerations 12 / 20
16 Pivoting rules Partial pricing One method to reduce computational cost is partial pricing: instead of examining all the reduced costs, we examine a subset and choose the incoming variable from this subset. If all the reduced costs in the subset are nonnegative then we examine some of the remaining reduced costs. Mitchell Simplex Algorithm: Practical Considerations 13 / 20
17 Preprocessing Outline 1 Initialization and termination 2 Tolerances 3 Pivoting rules 4 Preprocessing 5 Free variables Mitchell Simplex Algorithm: Practical Considerations 14 / 20
18 Preprocessing Preprocessing Commercial solvers preprocess linear optimization problems before solving them, looking for logical implications that allow them to shrink the size of the problem. For example, they look for variables that can be fixed or constraints that are redundant. These steps are especially useful for integer optimization problems. Also useful sometimes is rescaling the problem, so that the numbers in different columns of the constraint matrix are not too widely divergent from one another. For example, if all the numbers in one column are expressed in terms of 10 3 and in another column in terms of 10 4, then the columns can be rescaled. Mitchell Simplex Algorithm: Practical Considerations 15 / 20
19 Free variables Outline 1 Initialization and termination 2 Tolerances 3 Pivoting rules 4 Preprocessing 5 Free variables Mitchell Simplex Algorithm: Practical Considerations 16 / 20
20 Free variables Handling upper bounds We ve previously seen that the simplex algorithm can handle upper bounds on variables without needing to introduce explicit slack variables. Mitchell Simplex Algorithm: Practical Considerations 17 / 20
21 Free variables Free variables Free variables are variables that are unrestricted in sign. Such a variable can be eliminated from a linear optimization problem. the free variable appears in an equality constraint: For example, we have a constraint x 1 + 3x 4 2x 6 = 5, where x 1 is a free variable. The for any values of x 4 and x 6,we can set x 1 = 5 3x 4 + 2x 6 and we don t have to worry about the sign of x 1. So, we can obtain an equivalent linear optimization problem by replacing x 1 by 5 3x 4 + 2x 6 in all the other constraints and the objective function. The original constraint x 1 + 3x 4 2x 6 = 5 can be deleted. Mitchell Simplex Algorithm: Practical Considerations 18 / 20
22 Free variables, part 2 Free variables the free variable appears only in inequality constraints: Assume we write all the inequality constraints as apple constraints, so they all have the form nx a ij x j apple b i. j=1 Assume x 1 is a free variable. There are some situations where we can make dramatic simplifications to the problem: I ai1 0 for all constraints and c 1 = 0: In this case, all the constraints with a nonzero a i1 coefficient are redundant, since these constraints can all be satisfied by taking x 1 sufficiently negative. I ai1 0 for all constraints and c 1 > 0: In this case, the problem has an unbounded optimal value, provided it is feasible: we can drive x 1! 1. I a i1 apple 0 for all constraints and c 1 = 0 or c 1 < 0: similar to the two previous cases, with now x 1!1. Mitchell Simplex Algorithm: Practical Considerations 19 / 20
23 Free variables, part 2 Free variables the free variable appears only in inequality constraints: Assume we write all the inequality constraints as apple constraints, so they all have the form nx a ij x j apple b i. j=1 Assume x 1 is a free variable. There are some situations where we can make dramatic simplifications to the problem: I ai1 0 for all constraints and c 1 = 0: In this case, all the constraints with a nonzero a i1 coefficient are redundant, since these constraints can all be satisfied by taking x 1 sufficiently negative. I ai1 0 for all constraints and c 1 > 0: In this case, the problem has an unbounded optimal value, provided it is feasible: we can drive x 1! 1. I a i1 apple 0 for all constraints and c 1 = 0 or c 1 < 0: similar to the two previous cases, with now x 1!1. Mitchell Simplex Algorithm: Practical Considerations 19 / 20
24 Free variables, part 2 Free variables the free variable appears only in inequality constraints: Assume we write all the inequality constraints as apple constraints, so they all have the form nx a ij x j apple b i. j=1 Assume x 1 is a free variable. There are some situations where we can make dramatic simplifications to the problem: I ai1 0 for all constraints and c 1 = 0: In this case, all the constraints with a nonzero a i1 coefficient are redundant, since these constraints can all be satisfied by taking x 1 sufficiently negative. I ai1 0 for all constraints and c 1 > 0: In this case, the problem has an unbounded optimal value, provided it is feasible: we can drive x 1! 1. I a i1 apple 0 for all constraints and c 1 = 0 or c 1 < 0: similar to the two previous cases, with now x 1!1. Mitchell Simplex Algorithm: Practical Considerations 19 / 20
25 Free variables, part 2 Free variables the free variable appears only in inequality constraints: Assume we write all the inequality constraints as apple constraints, so they all have the form nx a ij x j apple b i. j=1 Assume x 1 is a free variable. There are some situations where we can make dramatic simplifications to the problem: I ai1 0 for all constraints and c 1 = 0: In this case, all the constraints with a nonzero a i1 coefficient are redundant, since these constraints can all be satisfied by taking x 1 sufficiently negative. I ai1 0 for all constraints and c 1 > 0: In this case, the problem has an unbounded optimal value, provided it is feasible: we can drive x 1! 1. I a i1 apple 0 for all constraints and c 1 = 0 or c 1 < 0: similar to the two previous cases, with now x 1!1. Mitchell Simplex Algorithm: Practical Considerations 19 / 20
26 Free variables, part 3 Free variables If we are not in one of these simpler subcases then we may well need to introduce slack variables into the inequality constraints and then eliminate the free variable. Mitchell Simplex Algorithm: Practical Considerations 20 / 20
5. DUAL LP, SOLUTION INTERPRETATION, AND POST-OPTIMALITY
5. DUAL LP, SOLUTION INTERPRETATION, AND POST-OPTIMALITY 5.1 DUALITY Associated with every linear programming problem (the primal) is another linear programming problem called its dual. If the primal involves
More informationOptimization of Design. Lecturer:Dung-An Wang Lecture 8
Optimization of Design Lecturer:Dung-An Wang Lecture 8 Lecture outline Reading: Ch8 of text Today s lecture 2 8.1 LINEAR FUNCTIONS Cost Function Constraints 3 8.2 The standard LP problem Only equality
More informationLinear Programming. Course review MS-E2140. v. 1.1
Linear Programming MS-E2140 Course review v. 1.1 Course structure Modeling techniques Linear programming theory and the Simplex method Duality theory Dual Simplex algorithm and sensitivity analysis Integer
More informationDM545 Linear and Integer Programming. Lecture 2. The Simplex Method. Marco Chiarandini
DM545 Linear and Integer Programming Lecture 2 The Marco Chiarandini Department of Mathematics & Computer Science University of Southern Denmark Outline 1. 2. 3. 4. Standard Form Basic Feasible Solutions
More informationOutline. CS38 Introduction to Algorithms. Linear programming 5/21/2014. Linear programming. Lecture 15 May 20, 2014
5/2/24 Outline CS38 Introduction to Algorithms Lecture 5 May 2, 24 Linear programming simplex algorithm LP duality ellipsoid algorithm * slides from Kevin Wayne May 2, 24 CS38 Lecture 5 May 2, 24 CS38
More informationFinite Math Linear Programming 1 May / 7
Linear Programming Finite Math 1 May 2017 Finite Math Linear Programming 1 May 2017 1 / 7 General Description of Linear Programming Finite Math Linear Programming 1 May 2017 2 / 7 General Description of
More informationBCN Decision and Risk Analysis. Syed M. Ahmed, Ph.D.
Linear Programming Module Outline Introduction The Linear Programming Model Examples of Linear Programming Problems Developing Linear Programming Models Graphical Solution to LP Problems The Simplex Method
More informationLinear Programming Motivation: The Diet Problem
Agenda We ve done Greedy Method Divide and Conquer Dynamic Programming Network Flows & Applications NP-completeness Now Linear Programming and the Simplex Method Hung Q. Ngo (SUNY at Buffalo) CSE 531 1
More informationThe Ascendance of the Dual Simplex Method: A Geometric View
The Ascendance of the Dual Simplex Method: A Geometric View Robert Fourer 4er@ampl.com AMPL Optimization Inc. www.ampl.com +1 773-336-AMPL U.S.-Mexico Workshop on Optimization and Its Applications Huatulco
More informationMathematical and Algorithmic Foundations Linear Programming and Matchings
Adavnced Algorithms Lectures Mathematical and Algorithmic Foundations Linear Programming and Matchings Paul G. Spirakis Department of Computer Science University of Patras and Liverpool Paul G. Spirakis
More informationAdvanced Operations Research Techniques IE316. Quiz 2 Review. Dr. Ted Ralphs
Advanced Operations Research Techniques IE316 Quiz 2 Review Dr. Ted Ralphs IE316 Quiz 2 Review 1 Reading for The Quiz Material covered in detail in lecture Bertsimas 4.1-4.5, 4.8, 5.1-5.5, 6.1-6.3 Material
More informationLinear programming and duality theory
Linear programming and duality theory Complements of Operations Research Giovanni Righini Linear Programming (LP) A linear program is defined by linear constraints, a linear objective function. Its variables
More informationArtificial Intelligence
Artificial Intelligence Combinatorial Optimization G. Guérard Department of Nouvelles Energies Ecole Supérieur d Ingénieurs Léonard de Vinci Lecture 1 GG A.I. 1/34 Outline 1 Motivation 2 Geometric resolution
More informationSection Notes 5. Review of Linear Programming. Applied Math / Engineering Sciences 121. Week of October 15, 2017
Section Notes 5 Review of Linear Programming Applied Math / Engineering Sciences 121 Week of October 15, 2017 The following list of topics is an overview of the material that was covered in the lectures
More informationAn iteration of the simplex method (a pivot )
Recap, and outline of Lecture 13 Previously Developed and justified all the steps in a typical iteration ( pivot ) of the Simplex Method (see next page). Today Simplex Method Initialization Start with
More informationAdvanced Operations Research Techniques IE316. Quiz 1 Review. Dr. Ted Ralphs
Advanced Operations Research Techniques IE316 Quiz 1 Review Dr. Ted Ralphs IE316 Quiz 1 Review 1 Reading for The Quiz Material covered in detail in lecture. 1.1, 1.4, 2.1-2.6, 3.1-3.3, 3.5 Background material
More informationPart 4. Decomposition Algorithms Dantzig-Wolf Decomposition Algorithm
In the name of God Part 4. 4.1. Dantzig-Wolf Decomposition Algorithm Spring 2010 Instructor: Dr. Masoud Yaghini Introduction Introduction Real world linear programs having thousands of rows and columns.
More informationIntroduction to Mathematical Programming IE496. Final Review. Dr. Ted Ralphs
Introduction to Mathematical Programming IE496 Final Review Dr. Ted Ralphs IE496 Final Review 1 Course Wrap-up: Chapter 2 In the introduction, we discussed the general framework of mathematical modeling
More informationSome Advanced Topics in Linear Programming
Some Advanced Topics in Linear Programming Matthew J. Saltzman July 2, 995 Connections with Algebra and Geometry In this section, we will explore how some of the ideas in linear programming, duality theory,
More informationDiscrete Optimization. Lecture Notes 2
Discrete Optimization. Lecture Notes 2 Disjunctive Constraints Defining variables and formulating linear constraints can be straightforward or more sophisticated, depending on the problem structure. The
More informationDEGENERACY AND THE FUNDAMENTAL THEOREM
DEGENERACY AND THE FUNDAMENTAL THEOREM The Standard Simplex Method in Matrix Notation: we start with the standard form of the linear program in matrix notation: (SLP) m n we assume (SLP) is feasible, and
More informationSimulation. Lecture O1 Optimization: Linear Programming. Saeed Bastani April 2016
Simulation Lecture O Optimization: Linear Programming Saeed Bastani April 06 Outline of the course Linear Programming ( lecture) Integer Programming ( lecture) Heuristics and Metaheursitics (3 lectures)
More informationLinear Programming. Linear programming provides methods for allocating limited resources among competing activities in an optimal way.
University of Southern California Viterbi School of Engineering Daniel J. Epstein Department of Industrial and Systems Engineering ISE 330: Introduction to Operations Research - Deterministic Models Fall
More informationSelected Topics in Column Generation
Selected Topics in Column Generation February 1, 2007 Choosing a solver for the Master Solve in the dual space(kelly s method) by applying a cutting plane algorithm In the bundle method(lemarechal), a
More informationLinear Programming. Readings: Read text section 11.6, and sections 1 and 2 of Tom Ferguson s notes (see course homepage).
Linear Programming Learning Goals. Introduce Linear Programming Problems. Widget Example, Graphical Solution. Basic Theory: Feasible Set, Vertices, Existence of Solutions. Equivalent formulations. Outline
More informationLinear Programming. Widget Factory Example. Linear Programming: Standard Form. Widget Factory Example: Continued.
Linear Programming Widget Factory Example Learning Goals. Introduce Linear Programming Problems. Widget Example, Graphical Solution. Basic Theory:, Vertices, Existence of Solutions. Equivalent formulations.
More informationTHE simplex algorithm [1] has been popularly used
Proceedings of the International MultiConference of Engineers and Computer Scientists 207 Vol II, IMECS 207, March 5-7, 207, Hong Kong An Improvement in the Artificial-free Technique along the Objective
More informationAM 121: Intro to Optimization Models and Methods Fall 2017
AM 121: Intro to Optimization Models and Methods Fall 2017 Lecture 10: Dual Simplex Yiling Chen SEAS Lesson Plan Interpret primal simplex in terms of pivots on the corresponding dual tableau Dictionaries
More informationLinear Optimization. Andongwisye John. November 17, Linkoping University. Andongwisye John (Linkoping University) November 17, / 25
Linear Optimization Andongwisye John Linkoping University November 17, 2016 Andongwisye John (Linkoping University) November 17, 2016 1 / 25 Overview 1 Egdes, One-Dimensional Faces, Adjacency of Extreme
More informationSection Notes 4. Duality, Sensitivity, and the Dual Simplex Algorithm. Applied Math / Engineering Sciences 121. Week of October 8, 2018
Section Notes 4 Duality, Sensitivity, and the Dual Simplex Algorithm Applied Math / Engineering Sciences 121 Week of October 8, 2018 Goals for the week understand the relationship between primal and dual
More information3. The Simplex algorithmn The Simplex algorithmn 3.1 Forms of linear programs
11 3.1 Forms of linear programs... 12 3.2 Basic feasible solutions... 13 3.3 The geometry of linear programs... 14 3.4 Local search among basic feasible solutions... 15 3.5 Organization in tableaus...
More informationOutline. Column Generation: Cutting Stock A very applied method. Introduction to Column Generation. Given an LP problem
Column Generation: Cutting Stock A very applied method thst@man.dtu.dk Outline History The Simplex algorithm (re-visited) Column Generation as an extension of the Simplex algorithm A simple example! DTU-Management
More informationColumn Generation: Cutting Stock
Column Generation: Cutting Stock A very applied method thst@man.dtu.dk DTU-Management Technical University of Denmark 1 Outline History The Simplex algorithm (re-visited) Column Generation as an extension
More informationLinear and Integer Programming :Algorithms in the Real World. Related Optimization Problems. How important is optimization?
Linear and Integer Programming 15-853:Algorithms in the Real World Linear and Integer Programming I Introduction Geometric Interpretation Simplex Method Linear or Integer programming maximize z = c T x
More informationInteger and Combinatorial Optimization: Clustering Problems
Integer and Combinatorial Optimization: Clustering Problems John E. Mitchell Department of Mathematical Sciences RPI, Troy, NY 12180 USA February 2019 Mitchell Clustering Problems 1 / 14 Clustering Clustering
More informationVARIANTS OF THE SIMPLEX METHOD
C H A P T E R 6 VARIANTS OF THE SIMPLEX METHOD By a variant of the Simplex Method (in this chapter) we mean an algorithm consisting of a sequence of pivot steps in the primal system using alternative rules
More informationLinear Programming. Linear Programming. Linear Programming. Example: Profit Maximization (1/4) Iris Hui-Ru Jiang Fall Linear programming
Linear Programming 3 describes a broad class of optimization tasks in which both the optimization criterion and the constraints are linear functions. Linear Programming consists of three parts: A set of
More informationLinear programming II João Carlos Lourenço
Decision Support Models Linear programming II João Carlos Lourenço joao.lourenco@ist.utl.pt Academic year 2012/2013 Readings: Hillier, F.S., Lieberman, G.J., 2010. Introduction to Operations Research,
More informationMATHEMATICS II: COLLECTION OF EXERCISES AND PROBLEMS
MATHEMATICS II: COLLECTION OF EXERCISES AND PROBLEMS GRADO EN A.D.E. GRADO EN ECONOMÍA GRADO EN F.Y.C. ACADEMIC YEAR 2011-12 INDEX UNIT 1.- AN INTRODUCCTION TO OPTIMIZATION 2 UNIT 2.- NONLINEAR PROGRAMMING
More informationNotes for Lecture 18
U.C. Berkeley CS17: Intro to CS Theory Handout N18 Professor Luca Trevisan November 6, 21 Notes for Lecture 18 1 Algorithms for Linear Programming Linear programming was first solved by the simplex method
More informationGENERAL ASSIGNMENT PROBLEM via Branch and Price JOHN AND LEI
GENERAL ASSIGNMENT PROBLEM via Branch and Price JOHN AND LEI Outline Review the column generation in Generalized Assignment Problem (GAP) GAP Examples in Branch and Price 2 Assignment Problem The assignment
More informationNOTATION AND TERMINOLOGY
15.053x, Optimization Methods in Business Analytics Fall, 2016 October 4, 2016 A glossary of notation and terms used in 15.053x Weeks 1, 2, 3, 4 and 5. (The most recent week's terms are in blue). NOTATION
More informationFundamentals of Integer Programming
Fundamentals of Integer Programming Di Yuan Department of Information Technology, Uppsala University January 2018 Outline Definition of integer programming Formulating some classical problems with integer
More informationCASE STUDY. fourteen. Animating The Simplex Method. case study OVERVIEW. Application Overview and Model Development.
CASE STUDY fourteen Animating The Simplex Method case study OVERVIEW CS14.1 CS14.2 CS14.3 CS14.4 CS14.5 CS14.6 CS14.7 Application Overview and Model Development Worksheets User Interface Procedures Re-solve
More informationCS 473: Algorithms. Ruta Mehta. Spring University of Illinois, Urbana-Champaign. Ruta (UIUC) CS473 1 Spring / 36
CS 473: Algorithms Ruta Mehta University of Illinois, Urbana-Champaign Spring 2018 Ruta (UIUC) CS473 1 Spring 2018 1 / 36 CS 473: Algorithms, Spring 2018 LP Duality Lecture 20 April 3, 2018 Some of the
More informationNew Directions in Linear Programming
New Directions in Linear Programming Robert Vanderbei November 5, 2001 INFORMS Miami Beach NOTE: This is a talk mostly on pedagogy. There will be some new results. It is not a talk on state-of-the-art
More information3 INTEGER LINEAR PROGRAMMING
3 INTEGER LINEAR PROGRAMMING PROBLEM DEFINITION Integer linear programming problem (ILP) of the decision variables x 1,..,x n : (ILP) subject to minimize c x j j n j= 1 a ij x j x j 0 x j integer n j=
More informationIntroduction to Operations Research Prof. G. Srinivasan Department of Management Studies Indian Institute of Technology, Madras
Introduction to Operations Research Prof. G. Srinivasan Department of Management Studies Indian Institute of Technology, Madras Module 03 Simplex Algorithm Lecture - 03 Tabular form (Minimization) In this
More informationTIM 206 Lecture Notes Integer Programming
TIM 206 Lecture Notes Integer Programming Instructor: Kevin Ross Scribe: Fengji Xu October 25, 2011 1 Defining Integer Programming Problems We will deal with linear constraints. The abbreviation MIP stands
More informationInteger Programming as Projection
Integer Programming as Projection H. P. Williams London School of Economics John Hooker Carnegie Mellon University INFORMS 2015, Philadelphia USA A Different Perspective on IP Projection of an IP onto
More informationIntroduction. Linear because it requires linear functions. Programming as synonymous of planning.
LINEAR PROGRAMMING Introduction Development of linear programming was among the most important scientific advances of mid-20th cent. Most common type of applications: allocate limited resources to competing
More informationMATLAB Solution of Linear Programming Problems
MATLAB Solution of Linear Programming Problems The simplex method is included in MATLAB using linprog function. All is needed is to have the problem expressed in the terms of MATLAB definitions. Appendix
More information16.410/413 Principles of Autonomy and Decision Making
16.410/413 Principles of Autonomy and Decision Making Lecture 17: The Simplex Method Emilio Frazzoli Aeronautics and Astronautics Massachusetts Institute of Technology November 10, 2010 Frazzoli (MIT)
More informationHeuristic Optimization Today: Linear Programming. Tobias Friedrich Chair for Algorithm Engineering Hasso Plattner Institute, Potsdam
Heuristic Optimization Today: Linear Programming Chair for Algorithm Engineering Hasso Plattner Institute, Potsdam Linear programming Let s first define it formally: A linear program is an optimization
More informationLP-Modelling. dr.ir. C.A.J. Hurkens Technische Universiteit Eindhoven. January 30, 2008
LP-Modelling dr.ir. C.A.J. Hurkens Technische Universiteit Eindhoven January 30, 2008 1 Linear and Integer Programming After a brief check with the backgrounds of the participants it seems that the following
More informationInteger Programming Chapter 9
1 Integer Programming Chapter 9 University of Chicago Booth School of Business Kipp Martin October 30, 2017 2 Outline Branch and Bound Theory Branch and Bound Linear Programming Node Selection Strategies
More informationCourse Summary! What have we learned and what are we expected to know?
Course Summary! What have we learned and what are we expected to know? Overview! Introduction Modelling in MiniZinc Finite Domain Constraint Solving Search Linear Programming and Network Flow Mixed Integer
More informationContents. I Basics 1. Copyright by SIAM. Unauthorized reproduction of this article is prohibited.
page v Preface xiii I Basics 1 1 Optimization Models 3 1.1 Introduction... 3 1.2 Optimization: An Informal Introduction... 4 1.3 Linear Equations... 7 1.4 Linear Optimization... 10 Exercises... 12 1.5
More informationCivil Engineering Systems Analysis Lecture XIV. Instructor: Prof. Naveen Eluru Department of Civil Engineering and Applied Mechanics
Civil Engineering Systems Analysis Lecture XIV Instructor: Prof. Naveen Eluru Department of Civil Engineering and Applied Mechanics Today s Learning Objectives Dual 2 Linear Programming Dual Problem 3
More informationTribhuvan University Institute Of Science and Technology Tribhuvan University Institute of Science and Technology
Tribhuvan University Institute Of Science and Technology Tribhuvan University Institute of Science and Technology Course Title: Linear Programming Full Marks: 50 Course No. : Math 403 Pass Mark: 17.5 Level
More informationChapter 7. Linear Programming Models: Graphical and Computer Methods
Chapter 7 Linear Programming Models: Graphical and Computer Methods To accompany Quantitative Analysis for Management, Eleventh Edition, by Render, Stair, and Hanna Power Point slides created by Brian
More informationCSc 545 Lecture topic: The Criss-Cross method of Linear Programming
CSc 545 Lecture topic: The Criss-Cross method of Linear Programming Wanda B. Boyer University of Victoria November 21, 2012 Presentation Outline 1 Outline 2 3 4 Please note: I would be extremely grateful
More informationLinear Programming Problems
Linear Programming Problems Two common formulations of linear programming (LP) problems are: min Subject to: 1,,, 1,2,,;, max Subject to: 1,,, 1,2,,;, Linear Programming Problems The standard LP problem
More information4 LINEAR PROGRAMMING (LP) E. Amaldi Fondamenti di R.O. Politecnico di Milano 1
4 LINEAR PROGRAMMING (LP) E. Amaldi Fondamenti di R.O. Politecnico di Milano 1 Mathematical programming (optimization) problem: min f (x) s.t. x X R n set of feasible solutions with linear objective function
More informationCS 473: Algorithms. Ruta Mehta. Spring University of Illinois, Urbana-Champaign. Ruta (UIUC) CS473 1 Spring / 29
CS 473: Algorithms Ruta Mehta University of Illinois, Urbana-Champaign Spring 2018 Ruta (UIUC) CS473 1 Spring 2018 1 / 29 CS 473: Algorithms, Spring 2018 Simplex and LP Duality Lecture 19 March 29, 2018
More informationSUBSTITUTING GOMORY CUTTING PLANE METHOD TOWARDS BALAS ALGORITHM FOR SOLVING BINARY LINEAR PROGRAMMING
ASIAN JOURNAL OF MATHEMATICS AND APPLICATIONS Volume 2014, Article ID ama0156, 11 pages ISSN 2307-7743 http://scienceasia.asia SUBSTITUTING GOMORY CUTTING PLANE METHOD TOWARDS BALAS ALGORITHM FOR SOLVING
More informationThe Simplex Algorithm
The Simplex Algorithm Uri Feige November 2011 1 The simplex algorithm The simplex algorithm was designed by Danzig in 1947. This write-up presents the main ideas involved. It is a slight update (mostly
More information5.3 Cutting plane methods and Gomory fractional cuts
5.3 Cutting plane methods and Gomory fractional cuts (ILP) min c T x s.t. Ax b x 0integer feasible region X Assumption: a ij, c j and b i integer. Observation: The feasible region of an ILP can be described
More informationMath 5593 Linear Programming Lecture Notes
Math 5593 Linear Programming Lecture Notes Unit II: Theory & Foundations (Convex Analysis) University of Colorado Denver, Fall 2013 Topics 1 Convex Sets 1 1.1 Basic Properties (Luenberger-Ye Appendix B.1).........................
More informationGurobi Guidelines for Numerical Issues February 2017
Gurobi Guidelines for Numerical Issues February 2017 Background Models with numerical issues can lead to undesirable results: slow performance, wrong answers or inconsistent behavior. When solving a model
More informationIntroduction to Operations Research Prof. G. Srinivasan Department of Management Studies Indian Institute of Technology, Madras
Introduction to Operations Research Prof. G. Srinivasan Department of Management Studies Indian Institute of Technology, Madras Module - 05 Lecture - 24 Solving LPs with mixed type of constraints In the
More informationLinear Programming. them such that they
Linear Programming l Another "Sledgehammer" in our toolkit l Many problems fit into the Linear Programming approach l These are optimization tasks where both the constraints and the objective are linear
More informationDepartment of Mathematics Oleg Burdakov of 30 October Consider the following linear programming problem (LP):
Linköping University Optimization TAOP3(0) Department of Mathematics Examination Oleg Burdakov of 30 October 03 Assignment Consider the following linear programming problem (LP): max z = x + x s.t. x x
More informationSolutions for Operations Research Final Exam
Solutions for Operations Research Final Exam. (a) The buffer stock is B = i a i = a + a + a + a + a + a 6 + a 7 = + + + + + + =. And the transportation tableau corresponding to the transshipment problem
More informationOutline. Combinatorial Optimization 2. Finite Systems of Linear Inequalities. Finite Systems of Linear Inequalities. Theorem (Weyl s theorem :)
Outline Combinatorial Optimization 2 Rumen Andonov Irisa/Symbiose and University of Rennes 1 9 novembre 2009 Finite Systems of Linear Inequalities, variants of Farkas Lemma Duality theory in Linear Programming
More informationAgenda. Understanding advanced modeling techniques takes some time and experience No exercises today Ask questions!
Modeling 2 Agenda Understanding advanced modeling techniques takes some time and experience No exercises today Ask questions! Part 1: Overview of selected modeling techniques Background Range constraints
More informationSUBSTITUTING GOMORY CUTTING PLANE METHOD TOWARDS BALAS ALGORITHM FOR SOLVING BINARY LINEAR PROGRAMMING
Bulletin of Mathematics Vol. 06, No. 0 (20), pp.. SUBSTITUTING GOMORY CUTTING PLANE METHOD TOWARDS BALAS ALGORITHM FOR SOLVING BINARY LINEAR PROGRAMMING Eddy Roflin, Sisca Octarina, Putra B. J Bangun,
More informationA Generic Separation Algorithm and Its Application to the Vehicle Routing Problem
A Generic Separation Algorithm and Its Application to the Vehicle Routing Problem Presented by: Ted Ralphs Joint work with: Leo Kopman Les Trotter Bill Pulleyblank 1 Outline of Talk Introduction Description
More informationTuesday, April 10. The Network Simplex Method for Solving the Minimum Cost Flow Problem
. Tuesday, April The Network Simplex Method for Solving the Minimum Cost Flow Problem Quotes of the day I think that I shall never see A poem lovely as a tree. -- Joyce Kilmer Knowing trees, I understand
More information5.4 Pure Minimal Cost Flow
Pure Minimal Cost Flow Problem. Pure Minimal Cost Flow Networks are especially convenient for modeling because of their simple nonmathematical structure that can be easily portrayed with a graph. This
More informationAMATH 383 Lecture Notes Linear Programming
AMATH 8 Lecture Notes Linear Programming Jakob Kotas (jkotas@uw.edu) University of Washington February 4, 014 Based on lecture notes for IND E 51 by Zelda Zabinsky, available from http://courses.washington.edu/inde51/notesindex.htm.
More informationGraphs and Network Flows IE411. Lecture 20. Dr. Ted Ralphs
Graphs and Network Flows IE411 Lecture 20 Dr. Ted Ralphs IE411 Lecture 20 1 Network Simplex Algorithm Input: A network G = (N, A), a vector of capacities u Z A, a vector of costs c Z A, and a vector of
More informationFinancial Optimization ISE 347/447. Lecture 13. Dr. Ted Ralphs
Financial Optimization ISE 347/447 Lecture 13 Dr. Ted Ralphs ISE 347/447 Lecture 13 1 Reading for This Lecture C&T Chapter 11 ISE 347/447 Lecture 13 2 Integer Linear Optimization An integer linear optimization
More informationAn Improved Decomposition Algorithm and Computer Technique for Solving LPs
International Journal of Basic & Applied Sciences IJBAS-IJENS Vol: 11 No: 0 12 An Improved Decomposition Algorithm and Computer Technique for Solving LPs Md. Istiaq Hossain and M Babul Hasan Abstract -
More informationPreviously Local sensitivity analysis: having found an optimal basis to a problem in standard form,
Recap, and outline of Lecture 20 Previously Local sensitivity analysis: having found an optimal basis to a problem in standard form, if the cost vectors is changed, or if the right-hand side vector is
More informationLinear Programming Terminology
Linear Programming Terminology The carpenter problem is an example of a linear program. T and B (the number of tables and bookcases to produce weekly) are decision variables. The profit function is an
More informationINTRODUCTION TO LINEAR AND NONLINEAR PROGRAMMING
INTRODUCTION TO LINEAR AND NONLINEAR PROGRAMMING DAVID G. LUENBERGER Stanford University TT ADDISON-WESLEY PUBLISHING COMPANY Reading, Massachusetts Menlo Park, California London Don Mills, Ontario CONTENTS
More informationConvex Optimization CMU-10725
Convex Optimization CMU-10725 Ellipsoid Methods Barnabás Póczos & Ryan Tibshirani Outline Linear programs Simplex algorithm Running time: Polynomial or Exponential? Cutting planes & Ellipsoid methods for
More informationLinear Programming. Revised Simplex Method, Duality of LP problems and Sensitivity analysis
Linear Programming Revised Simple Method, Dualit of LP problems and Sensitivit analsis Introduction Revised simple method is an improvement over simple method. It is computationall more efficient and accurate.
More informationInteger Programming Theory
Integer Programming Theory Laura Galli October 24, 2016 In the following we assume all functions are linear, hence we often drop the term linear. In discrete optimization, we seek to find a solution x
More informationlpsymphony - Integer Linear Programming in R
lpsymphony - Integer Linear Programming in R Vladislav Kim October 30, 2017 Contents 1 Introduction 2 2 lpsymphony: Quick Start 2 3 Integer Linear Programming 5 31 Equivalent and Dual Formulations 5 32
More informationRead: H&L chapters 1-6
Viterbi School of Engineering Daniel J. Epstein Department of Industrial and Systems Engineering ISE 330: Introduction to Operations Research Fall 2006 (Oct 16): Midterm Review http://www-scf.usc.edu/~ise330
More informationx ji = s i, i N, (1.1)
Dual Ascent Methods. DUAL ASCENT In this chapter we focus on the minimum cost flow problem minimize subject to (i,j) A {j (i,j) A} a ij x ij x ij {j (j,i) A} (MCF) x ji = s i, i N, (.) b ij x ij c ij,
More informationMVE165/MMG630, Applied Optimization Lecture 8 Integer linear programming algorithms. Ann-Brith Strömberg
MVE165/MMG630, Integer linear programming algorithms Ann-Brith Strömberg 2009 04 15 Methods for ILP: Overview (Ch. 14.1) Enumeration Implicit enumeration: Branch and bound Relaxations Decomposition methods:
More informationThe Heuristic (Dark) Side of MIP Solvers. Asja Derviskadic, EPFL Vit Prochazka, NHH Christoph Schaefer, EPFL
The Heuristic (Dark) Side of MIP Solvers Asja Derviskadic, EPFL Vit Prochazka, NHH Christoph Schaefer, EPFL 1 Table of content [Lodi], The Heuristic (Dark) Side of MIP Solvers, Hybrid Metaheuristics, 273-284,
More informationDavid G. Luenberger Yinyu Ye. Linear and Nonlinear. Programming. Fourth Edition. ö Springer
David G. Luenberger Yinyu Ye Linear and Nonlinear Programming Fourth Edition ö Springer Contents 1 Introduction 1 1.1 Optimization 1 1.2 Types of Problems 2 1.3 Size of Problems 5 1.4 Iterative Algorithms
More informationPivot and Gomory Cut. A MIP Feasibility Heuristic NSERC
Pivot and Gomory Cut A MIP Feasibility Heuristic Shubhashis Ghosh Ryan Hayward shubhashis@randomknowledge.net hayward@cs.ualberta.ca NSERC CGGT 2007 Kyoto Jun 11-15 page 1 problem given a MIP, find a feasible
More informationMVE165/MMG631 Linear and integer optimization with applications Lecture 9 Discrete optimization: theory and algorithms
MVE165/MMG631 Linear and integer optimization with applications Lecture 9 Discrete optimization: theory and algorithms Ann-Brith Strömberg 2018 04 24 Lecture 9 Linear and integer optimization with applications
More informationLinear Programming Motivation
Linear Programming Motivation CS 9 Staff September, 00 The slides define a combinatorial optimization problem as: Given a set of variables, each associated with a value domain, and given constraints over
More informationPRIMAL-DUAL INTERIOR POINT METHOD FOR LINEAR PROGRAMMING. 1. Introduction
PRIMAL-DUAL INTERIOR POINT METHOD FOR LINEAR PROGRAMMING KELLER VANDEBOGERT AND CHARLES LANNING 1. Introduction Interior point methods are, put simply, a technique of optimization where, given a problem
More information