Duality. Primal program P: Maximize n. Dual program D: Minimize m. j=1 c jx j subject to n. j=1. i=1 b iy i subject to m. i=1
|
|
- Reynard Griffith
- 5 years ago
- Views:
Transcription
1 Duality Primal program P: Maximize n j=1 c jx j subject to n a ij x j b i, i = 1, 2,..., m j=1 x j 0, j = 1, 2,..., n Dual program D: Minimize m i=1 b iy i subject to m a ij x j c j, j = 1, 2,..., n i=1 y j 0, i = 1, 2,..., m T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
2 The Duality Theorem Weak Duality Theorem If x is a feasible solution to P and y is a feasible solution to D then the value c T x is smaller than the value b T y. T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
3 The Duality Theorem Weak Duality Theorem If x is a feasible solution to P and y is a feasible solution to D then the value c T x is smaller than the value b T y. (Strong) Duality Theorem If P has an optimal solution x then D has an optimal solution y and c T x = b T y. T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
4 Finding Optimal Dual Solution from Primal Dictionary Primal program P: Maximize c T x under Ax b, x 0. Solve P using two phase simplex method, obtaining optimal solution x. T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
5 Finding Optimal Dual Solution from Primal Dictionary Primal program P: Maximize c T x under Ax b, x 0. Solve P using two phase simplex method, obtaining optimal solution x. Last row of last dictionary: n+m z = z + c k x k. k=1 T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
6 Finding Optimal Dual Solution from Primal Dictionary Primal program P: Maximize c T x under Ax b, x 0. Solve P using two phase simplex method, obtaining optimal solution x. Last row of last dictionary: Let y i = c n+i, i = 1, 2.,..., m. Then: n+m z = z + c k x k. k=1 1 y is a feasible solution to D: Minimize b T y under A T y c, y 0. 2 b T y = z. T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
7 Explaining the magic... Primal P: Maximize 5x 1 + 4x 2 + 3x 3 Subject to 2x 1 + 3x 2 + x 3 5 4x 1 + x 2 + 2x x 1 + 4x 2 + 2x 3 8 x 1, x 2, x 3 0 T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
8 Explaining the magic... Primal P: Maximize 5x 1 + 4x 2 + 3x 3 Subject to 2x 1 + 3x 2 + x 3 5 4x 1 + x 2 + 2x x 1 + 4x 2 + 2x 3 8 x 1, x 2, x 3 0 Dual D: Minimize 5y y 2 + 8y 3 Subject to 2y 1 + 4y y 1 + y 2 + 4y 3 4 y 1 + 2y 2 + 2y 3 3 y 1, y 2, y 3 0 T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
9 Pivoting both primal and dual dictionary Primal: x 4 = 5 2x 1 3x 2 x 3 x 5 = 11 4x 1 x 2 2x 3 x 6 = 8 3x 1 4x 2 2x 3 z = 5x 1 + 4x 2 + 3x 3 Dual: (Not feasible!) y 4 = 5 + 2y 1 + 4y 2 + 3y 3 y 5 = 4 + 3y 1 + y 2 + 4y 3 y 6 = 3 + y 1 + 2y 2 + 2y 3 w = 5y y 2 + 8y 3 T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
10 Pivoting x 1 and x 4 (and y 4 and y 1 ) Primal: x 1 = 5/2 1/2x 4 3/2x 2 1/2x 3 x 5 = 1 + 2x 4 + 5x 2 x 6 = 1/2 + 3/2x 4 + 1/2x 2 1/2x 3 z = 25/2 5/2x 4 7/2x 2 + 1/2x 3 Dual: (Still not feasible!) y 1 = 5/2 + 1/2y 4 2y 2 3/2y 3 y 5 = 7/2 + 3/2y 4 5y 2 1/2y 3 y 6 = 1/2 + 1/2y 4 + 1/2y 3 w = 25/2 + 5/2y 4 + y 2 + 1/2y 3 T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
11 Pivoting x 3 and x 6 (and y 6 and y 3 ) Primal: Optimal! x 1 = 2 2x 4 2x 2 + x 6 x 5 = 1 + 2x 4 + 5x 2 x 3 = 1 + 3x 4 + x 2 2x 6 z = 13 x 4 3x 2 x 6 Dual: Feasible! (and optimal) y 1 = 1 + 2y 4 2y 2 3y 6 y 5 = 3 + 2y 4 5y 2 y 6 y 3 = 1 y 4 + 2y 6 w = y 4 + y 2 + y 6 T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
12 Generalized Duality Theorem Primal program P: Maximize c 1 x 1 + c 2 x 2 + c 3 x 3 subject to y 1 : a 11 x 1 + a 12 x 2 + a 13 x 3 b 1 y 2 : a 21 x 1 + a 22 x 2 + a 23 x 3 b 2 y 3 : a 31 x 1 + a 32 x 2 + a 33 x 3 = b 3 x 1 0, x 2 0, x 3 UIS Dual program D: Minimize b 1 y 1 + b 2 y 2 + b 3 y 3 subject to x 1 : a 11 y 1 + a 21 y 2 + a 31 y 3 c 1 x 2 : a 12 y 1 + a 22 y 2 + a 32 y 3 c 2 x 3 : a 13 y 1 + a 23 y 2 + a 33 y 3 = c 3 y 1 0, y 2 0, y 3 UIS T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
13 Rules for Taking the Dual Constraints in primal corresponds to variables in dual (and vice versa) Coefficients of objective function in primal corresponds to constants in constraints in dual (and vice versa) Primal (Maximization) Dual (Minimization) for constraint 0 for variable for constraint 0 for variable = for constraint UIS for variable 0 for variable for constraint 0 for varaible for constraint UIS for variable = for constraint T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
14 Interpreting Duality A diet problem Buy food items in order to satisfy daily intake of energy, protein and calcium, minimizing the cost. Food Serving size Energy Protein Calcium Price Oatmeal Chicken Eggs Whole milk Cherry pie Pork with beans T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
15 Linear Programming Formulation Minimize 3x x x 3 + 9x x x 6 subject to 110x x x x x x x x x 3 + 8x 4 + 4x x x x x x x x x 1 0,..., x 6 0 Take the dual... T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
16 Linear Programming Formulation Minimize 3x x x 3 + 9x x x 6 subject to 110x x x x x x x x x 3 + 8x 4 + 4x x x x x x x x x 1 0,..., x 6 0 Take the dual... Maximize 2000y y y 3 subject to 110y 1 + 4y 2 + 2y y y y y y y y y y y 1 + 4y y y y y 3 19 y 1 0, y 2 0, y 3 0 T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
17 Interpreting the Dual Maximize 2000y y y 3 subject to 110y 1 + 4y 2 + 2y y y y y y y y y y y 1 + 4y y y y y 3 19 y 1 0, y 2 0, y 3 0 How large can we price energy, protein and calcium? (Shadow prices) T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
18 Max Flow - Min Cut Let A be the vertex arc incidence matrix, i.e, 1 if e = (u, v) A u,e = 1 if e = (v, u) 0 otherwise Let d be the vector defined by d s = 1, d t = 1, and d i = 0 otherwise. Then we can express the max flow problem with following linear program. Maximize v subject to Af + dv = 0 f c f 0 T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
19 Max Flow - Min Cut (II) Maximize v subject to Af + dv = 0 f c f 0 Take the dual... T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
20 Max Flow - Min Cut (II) Maximize v subject to Af + dv = 0 f c f 0 Take the dual... Minimize uv E g uvc(u, v) subject to p u p v + g uv 0 uv E p s + p t 1 g uv 0 T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
21 Certifying Optimality Suppose we wish to prove to someone that a solution x to a linear program P is optimal. If we supply both the optimal solution x and an optimal solution y to the dual D, then one may easily verify that the solution x is fact optimal! T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
22 Certifying Optimality Suppose we wish to prove to someone that a solution x to a linear program P is optimal. If we supply both the optimal solution x and an optimal solution y to the dual D, then one may easily verify that the solution x is fact optimal! What if the linear program P is infeasible. How can we easily convince someone this is the case? T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
23 Certifying Optimality Suppose we wish to prove to someone that a solution x to a linear program P is optimal. If we supply both the optimal solution x and an optimal solution y to the dual D, then one may easily verify that the solution x is fact optimal! What if the linear program P is infeasible. How can we easily convince someone this is the case? Farkas Lemma Exactly one of the following is true: There exist x such that Ax b. There exist y 0 such that A T y = 0 but b T y < 0. T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
24 Proof of Farkas Lemma Farkas Lemma Exactly one of the following is true: There exist x such that Ax b. There exist y 0 such that A T y = 0 but b T y < 0. T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
25 Proof of Farkas Lemma Farkas Lemma Exactly one of the following is true: There exist x such that Ax b. There exist y 0 such that A T y = 0 but b T y < 0. Both cannot be true: 0 = 0 T x = (A T y) T x = y T Ax y T b = b T y < 0 T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
26 Proof of Farkas Lemma Farkas Lemma Exactly one of the following is true: There exist x such that Ax b. There exist y 0 such that A T y = 0 but b T y < 0. Both cannot be true: 0 = 0 T x = (A T y) T x = y T Ax y T b = b T y < 0 We must show that both cannot be false. We do that be showing that if (1) is false then (2) is true. T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
27 Proof of Farkas Lemma (II) Consider the program P and it s dual D: P: Maximize 0 subject to Ax b D: Minimize bt y subject to A T y = 0, y 0 T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
28 Proof of Farkas Lemma (II) Consider the program P and it s dual D: P: Maximize 0 subject to Ax b D: Minimize bt y subject to A T y = 0, y 0 If P is infeasible then D is either infeasible or unbounded. T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
29 Proof of Farkas Lemma (II) Consider the program P and it s dual D: P: Maximize 0 subject to Ax b D: Minimize bt y subject to A T y = 0, y 0 If P is infeasible then D is either infeasible or unbounded. D is always feasible. T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
30 Proof of Farkas Lemma (II) Consider the program P and it s dual D: P: Maximize 0 subject to Ax b D: Minimize bt y subject to A T y = 0, y 0 If P is infeasible then D is either infeasible or unbounded. D is always feasible. Hence, if P is infeasible, then D is unbounded. T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
31 Proof of Farkas Lemma (II) Consider the program P and it s dual D: P: Maximize 0 subject to Ax b D: Minimize bt y subject to A T y = 0, y 0 If P is infeasible then D is either infeasible or unbounded. D is always feasible. Hence, if P is infeasible, then D is unbounded. Thus we may find a solution y such that b T y < 0. T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
32 Proof of Farkas Lemma (II) Consider the program P and it s dual D: P: Maximize 0 subject to Ax b D: Minimize bt y subject to A T y = 0, y 0 If P is infeasible then D is either infeasible or unbounded. D is always feasible. Hence, if P is infeasible, then D is unbounded. Thus we may find a solution y such that b T y < 0. Farkas Lemma follows from the Strong Duality Theorem. T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
33 Proof of Farkas Lemma (II) Consider the program P and it s dual D: P: Maximize 0 subject to Ax b D: Minimize bt y subject to A T y = 0, y 0 If P is infeasible then D is either infeasible or unbounded. D is always feasible. Hence, if P is infeasible, then D is unbounded. Thus we may find a solution y such that b T y < 0. Farkas Lemma follows from the Strong Duality Theorem. We can also prove the Strong Duality Theorem from Farkas Lemma! T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
34 Proving Strong Duality from Farkas Lemma P: Maximize ct x subject to Ax b, x 0 (Strong) Duality Theorem D: Minimize bt y subject to A T y c, y 0 If P has an optimal solution x then D has an optimal solution y and c T x = b T y. T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
35 Proving Strong Duality from Farkas Lemma P: Maximize ct x subject to Ax b, x 0 (Strong) Duality Theorem D: Minimize bt y subject to A T y c, y 0 If P has an optimal solution x then D has an optimal solution y and c T x = b T y. By weak duality we just have to provide feasible y such that b T y c T x. If no such y did exist then the following system is infeasible: A T c b T I y c x 0 T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
36 Proving Strong Duality from Farkas Lemma (II) If the following system is infeasible A T c b T I y c x 0 x by Farkas Lemma there exists λ 0 such that s [ A ] x b I λ = 0 s and [ c T c T x 0 ] x λ < 0 s T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
37 Proving Strong Duality from Farkas Lemma (III) Rewriting, and [ ] x A b I λ = 0 s [ c T c T x 0 ] x λ < 0 s we have x 0, λ 0, and s 0 such that Ax + λb Is = 0 and c T x + λc T x < 0. T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
38 Proving Strong Duality from Farkas Lemma (III) Rewriting, and [ ] x A b I λ = 0 s [ c T c T x 0 ] x λ < 0 s we have x 0, λ 0, and s 0 such that Ax + λb Is = 0 and c T x + λc T x < 0. This implies: λc T x < c T x. Ax λb. T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
39 Proving Strong Duality from Farkas Lemma (IV) We have x 0 and λ 0 such that λc T x < c T x. Ax λb. T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
40 Proving Strong Duality from Farkas Lemma (IV) We have x 0 and λ 0 such that λc T x < c T x. Ax λb. Case 1: λ 0. Normalize x by λ. Then x is a better solution than x contradiction. T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
41 Proving Strong Duality from Farkas Lemma (IV) We have x 0 and λ 0 such that λc T x < c T x. Ax λb. Case 1: λ 0. Normalize x by λ. Then x is a better solution than x contradiction. Case 2: λ = 0. Then there exist x 0 such that Ax 0 and c T x > 0. Then we can improve x in the direction of x, and obtain a better solution than x contradiction. T. D. Hansen (Aarhus) Optimization, Lecture 8 February 18, / 21
Mathematical and Algorithmic Foundations Linear Programming and Matchings
Adavnced Algorithms Lectures Mathematical and Algorithmic Foundations Linear Programming and Matchings Paul G. Spirakis Department of Computer Science University of Patras and Liverpool Paul G. Spirakis
More informationCS 473: Algorithms. Ruta Mehta. Spring University of Illinois, Urbana-Champaign. Ruta (UIUC) CS473 1 Spring / 36
CS 473: Algorithms Ruta Mehta University of Illinois, Urbana-Champaign Spring 2018 Ruta (UIUC) CS473 1 Spring 2018 1 / 36 CS 473: Algorithms, Spring 2018 LP Duality Lecture 20 April 3, 2018 Some of the
More informationLinear Programming Motivation: The Diet Problem
Agenda We ve done Greedy Method Divide and Conquer Dynamic Programming Network Flows & Applications NP-completeness Now Linear Programming and the Simplex Method Hung Q. Ngo (SUNY at Buffalo) CSE 531 1
More informationSection Notes 5. Review of Linear Programming. Applied Math / Engineering Sciences 121. Week of October 15, 2017
Section Notes 5 Review of Linear Programming Applied Math / Engineering Sciences 121 Week of October 15, 2017 The following list of topics is an overview of the material that was covered in the lectures
More informationCivil Engineering Systems Analysis Lecture XIV. Instructor: Prof. Naveen Eluru Department of Civil Engineering and Applied Mechanics
Civil Engineering Systems Analysis Lecture XIV Instructor: Prof. Naveen Eluru Department of Civil Engineering and Applied Mechanics Today s Learning Objectives Dual 2 Linear Programming Dual Problem 3
More informationLinear Programming. Larry Blume. Cornell University & The Santa Fe Institute & IHS
Linear Programming Larry Blume Cornell University & The Santa Fe Institute & IHS Linear Programs The general linear program is a constrained optimization problem where objectives and constraints are all
More informationSection Notes 4. Duality, Sensitivity, and the Dual Simplex Algorithm. Applied Math / Engineering Sciences 121. Week of October 8, 2018
Section Notes 4 Duality, Sensitivity, and the Dual Simplex Algorithm Applied Math / Engineering Sciences 121 Week of October 8, 2018 Goals for the week understand the relationship between primal and dual
More informationSolving Linear and Integer Programs
Solving Linear and Integer Programs Robert E. Bixby Gurobi Optimization, Inc. and Rice University Overview Linear Programming: Example and introduction to basic LP, including duality Primal and dual simplex
More informationNotes for Lecture 20
U.C. Berkeley CS170: Intro to CS Theory Handout N20 Professor Luca Trevisan November 13, 2001 Notes for Lecture 20 1 Duality As it turns out, the max-flow min-cut theorem is a special case of a more general
More informationIntroduction to Mathematical Programming IE496. Final Review. Dr. Ted Ralphs
Introduction to Mathematical Programming IE496 Final Review Dr. Ted Ralphs IE496 Final Review 1 Course Wrap-up: Chapter 2 In the introduction, we discussed the general framework of mathematical modeling
More informationAdvanced Operations Research Techniques IE316. Quiz 2 Review. Dr. Ted Ralphs
Advanced Operations Research Techniques IE316 Quiz 2 Review Dr. Ted Ralphs IE316 Quiz 2 Review 1 Reading for The Quiz Material covered in detail in lecture Bertsimas 4.1-4.5, 4.8, 5.1-5.5, 6.1-6.3 Material
More information6.854 Advanced Algorithms. Scribes: Jay Kumar Sundararajan. Duality
6.854 Advanced Algorithms Scribes: Jay Kumar Sundararajan Lecturer: David Karger Duality This lecture covers weak and strong duality, and also explains the rules for finding the dual of a linear program,
More information11 Linear Programming
11 Linear Programming 11.1 Definition and Importance The final topic in this course is Linear Programming. We say that a problem is an instance of linear programming when it can be effectively expressed
More informationAM 121: Intro to Optimization Models and Methods Fall 2017
AM 121: Intro to Optimization Models and Methods Fall 2017 Lecture 10: Dual Simplex Yiling Chen SEAS Lesson Plan Interpret primal simplex in terms of pivots on the corresponding dual tableau Dictionaries
More informationLinear Programming Duality and Algorithms
COMPSCI 330: Design and Analysis of Algorithms 4/5/2016 and 4/7/2016 Linear Programming Duality and Algorithms Lecturer: Debmalya Panigrahi Scribe: Tianqi Song 1 Overview In this lecture, we will cover
More informationLinear Programming. Course review MS-E2140. v. 1.1
Linear Programming MS-E2140 Course review v. 1.1 Course structure Modeling techniques Linear programming theory and the Simplex method Duality theory Dual Simplex algorithm and sensitivity analysis Integer
More informationLinear Programming. Linear programming provides methods for allocating limited resources among competing activities in an optimal way.
University of Southern California Viterbi School of Engineering Daniel J. Epstein Department of Industrial and Systems Engineering ISE 330: Introduction to Operations Research - Deterministic Models Fall
More informationCollege of Computer & Information Science Fall 2007 Northeastern University 14 September 2007
College of Computer & Information Science Fall 2007 Northeastern University 14 September 2007 CS G399: Algorithmic Power Tools I Scribe: Eric Robinson Lecture Outline: Linear Programming: Vertex Definitions
More informationOutline. Combinatorial Optimization 2. Finite Systems of Linear Inequalities. Finite Systems of Linear Inequalities. Theorem (Weyl s theorem :)
Outline Combinatorial Optimization 2 Rumen Andonov Irisa/Symbiose and University of Rennes 1 9 novembre 2009 Finite Systems of Linear Inequalities, variants of Farkas Lemma Duality theory in Linear Programming
More information1. Lecture notes on bipartite matching February 4th,
1. Lecture notes on bipartite matching February 4th, 2015 6 1.1.1 Hall s Theorem Hall s theorem gives a necessary and sufficient condition for a bipartite graph to have a matching which saturates (or matches)
More informationHeuristic Optimization Today: Linear Programming. Tobias Friedrich Chair for Algorithm Engineering Hasso Plattner Institute, Potsdam
Heuristic Optimization Today: Linear Programming Chair for Algorithm Engineering Hasso Plattner Institute, Potsdam Linear programming Let s first define it formally: A linear program is an optimization
More informationRecap, and outline of Lecture 18
Recap, and outline of Lecture 18 Previously Applications of duality: Farkas lemma (example of theorems of alternative) A geometric view of duality Degeneracy and multiple solutions: a duality connection
More informationLecture 5: Duality Theory
Lecture 5: Duality Theory Rajat Mittal IIT Kanpur The objective of this lecture note will be to learn duality theory of linear programming. We are planning to answer following questions. What are hyperplane
More informationCSE 101- Winter 18 Discussion Section Week 8
CSE 101- Winter 18 Discussion Section Week 8 Topics for today Reductions Max Flow and LP Number Puzzle Circulation problem Maximum bipartite matching Bob diet plan and pill salesman USB Problem from PA3
More informationHomework 2: Multi-unit combinatorial auctions (due Nov. 7 before class)
CPS 590.1 - Linear and integer programming Homework 2: Multi-unit combinatorial auctions (due Nov. 7 before class) Please read the rules for assignments on the course web page. Contact Vince (conitzer@cs.duke.edu)
More informationOutline. CS38 Introduction to Algorithms. Linear programming 5/21/2014. Linear programming. Lecture 15 May 20, 2014
5/2/24 Outline CS38 Introduction to Algorithms Lecture 5 May 2, 24 Linear programming simplex algorithm LP duality ellipsoid algorithm * slides from Kevin Wayne May 2, 24 CS38 Lecture 5 May 2, 24 CS38
More information5. DUAL LP, SOLUTION INTERPRETATION, AND POST-OPTIMALITY
5. DUAL LP, SOLUTION INTERPRETATION, AND POST-OPTIMALITY 5.1 DUALITY Associated with every linear programming problem (the primal) is another linear programming problem called its dual. If the primal involves
More informationLecture Notes 2: The Simplex Algorithm
Algorithmic Methods 25/10/2010 Lecture Notes 2: The Simplex Algorithm Professor: Yossi Azar Scribe:Kiril Solovey 1 Introduction In this lecture we will present the Simplex algorithm, finish some unresolved
More informationCS 473: Algorithms. Ruta Mehta. Spring University of Illinois, Urbana-Champaign. Ruta (UIUC) CS473 1 Spring / 29
CS 473: Algorithms Ruta Mehta University of Illinois, Urbana-Champaign Spring 2018 Ruta (UIUC) CS473 1 Spring 2018 1 / 29 CS 473: Algorithms, Spring 2018 Simplex and LP Duality Lecture 19 March 29, 2018
More informationIn this chapter we introduce some of the basic concepts that will be useful for the study of integer programming problems.
2 Basics In this chapter we introduce some of the basic concepts that will be useful for the study of integer programming problems. 2.1 Notation Let A R m n be a matrix with row index set M = {1,...,m}
More informationApproximation Algorithms
Approximation Algorithms Prof. Tapio Elomaa tapio.elomaa@tut.fi Course Basics A 4 credit unit course Part of Theoretical Computer Science courses at the Laboratory of Mathematics There will be 4 hours
More informationSome Advanced Topics in Linear Programming
Some Advanced Topics in Linear Programming Matthew J. Saltzman July 2, 995 Connections with Algebra and Geometry In this section, we will explore how some of the ideas in linear programming, duality theory,
More informationEcon 172A - Slides from Lecture 2
Econ 205 Sobel Econ 172A - Slides from Lecture 2 Joel Sobel September 28, 2010 Announcements 1. Sections this evening (Peterson 110, 8-9 or 9-10). 2. Podcasts available when I remember to use microphone.
More informationLecture 16 October 23, 2014
CS 224: Advanced Algorithms Fall 2014 Prof. Jelani Nelson Lecture 16 October 23, 2014 Scribe: Colin Lu 1 Overview In the last lecture we explored the simplex algorithm for solving linear programs. While
More informationLecture Overview. 2 Shortest s t path. 2.1 The LP. 2.2 The Algorithm. COMPSCI 530: Design and Analysis of Algorithms 11/14/2013
COMPCI 530: Design and Analysis of Algorithms 11/14/2013 Lecturer: Debmalya Panigrahi Lecture 22 cribe: Abhinandan Nath 1 Overview In the last class, the primal-dual method was introduced through the metric
More informationInteger Programming Theory
Integer Programming Theory Laura Galli October 24, 2016 In the following we assume all functions are linear, hence we often drop the term linear. In discrete optimization, we seek to find a solution x
More informationIntroduction to Operations Research
- Introduction to Operations Research Peng Zhang April, 5 School of Computer Science and Technology, Shandong University, Ji nan 5, China. Email: algzhang@sdu.edu.cn. Introduction Overview of the Operations
More informationNotes taken by Mea Wang. February 11, 2005
CSC2411 - Linear Programming and Combinatorial Optimization Lecture 5: Smoothed Analysis, Randomized Combinatorial Algorithms, and Linear Programming Duality Notes taken by Mea Wang February 11, 2005 Summary:
More informationLECTURES 3 and 4: Flows and Matchings
LECTURES 3 and 4: Flows and Matchings 1 Max Flow MAX FLOW (SP). Instance: Directed graph N = (V,A), two nodes s,t V, and capacities on the arcs c : A R +. A flow is a set of numbers on the arcs such that
More informationSolutions for Operations Research Final Exam
Solutions for Operations Research Final Exam. (a) The buffer stock is B = i a i = a + a + a + a + a + a 6 + a 7 = + + + + + + =. And the transportation tableau corresponding to the transshipment problem
More informationLecture 7. s.t. e = (u,v) E x u + x v 1 (2) v V x v 0 (3)
COMPSCI 632: Approximation Algorithms September 18, 2017 Lecturer: Debmalya Panigrahi Lecture 7 Scribe: Xiang Wang 1 Overview In this lecture, we will use Primal-Dual method to design approximation algorithms
More informationMath 5490 Network Flows
Math 590 Network Flows Lecture 7: Preflow Push Algorithm, cont. Stephen Billups University of Colorado at Denver Math 590Network Flows p./6 Preliminaries Optimization Seminar Next Thursday: Speaker: Ariela
More information1. Lecture notes on bipartite matching
Massachusetts Institute of Technology 18.453: Combinatorial Optimization Michel X. Goemans February 5, 2017 1. Lecture notes on bipartite matching Matching problems are among the fundamental problems in
More informationLinear programming and duality theory
Linear programming and duality theory Complements of Operations Research Giovanni Righini Linear Programming (LP) A linear program is defined by linear constraints, a linear objective function. Its variables
More informationAMS : Combinatorial Optimization Homework Problems - Week V
AMS 553.766: Combinatorial Optimization Homework Problems - Week V For the following problems, A R m n will be m n matrices, and b R m. An affine subspace is the set of solutions to a a system of linear
More informationDiscrete Optimization 2010 Lecture 5 Min-Cost Flows & Total Unimodularity
Discrete Optimization 2010 Lecture 5 Min-Cost Flows & Total Unimodularity Marc Uetz University of Twente m.uetz@utwente.nl Lecture 5: sheet 1 / 26 Marc Uetz Discrete Optimization Outline 1 Min-Cost Flows
More informationSubmodularity Reading Group. Matroid Polytopes, Polymatroid. M. Pawan Kumar
Submodularity Reading Group Matroid Polytopes, Polymatroid M. Pawan Kumar http://www.robots.ox.ac.uk/~oval/ Outline Linear Programming Matroid Polytopes Polymatroid Polyhedron Ax b A : m x n matrix b:
More informationLinear Programming Problems
Linear Programming Problems Two common formulations of linear programming (LP) problems are: min Subject to: 1,,, 1,2,,;, max Subject to: 1,,, 1,2,,;, Linear Programming Problems The standard LP problem
More informationEcon 172A - Slides from Lecture 8
1 Econ 172A - Slides from Lecture 8 Joel Sobel October 23, 2012 2 Announcements Important: Midterm seating assignments. Posted tonight. Corrected Answers to Quiz 1 posted. Quiz 2 on Thursday at end of
More informationLinear Programming: Introduction
CSC 373 - Algorithm Design, Analysis, and Complexity Summer 2016 Lalla Mouatadid Linear Programming: Introduction A bit of a historical background about linear programming, that I stole from Jeff Erickson
More informationCOT 6936: Topics in Algorithms! Giri Narasimhan. ECS 254A / EC 2443; Phone: x3748
COT 6936: Topics in Algorithms! Giri Narasimhan ECS 254A / EC 2443; Phone: x3748 giri@cs.fiu.edu http://www.cs.fiu.edu/~giri/teach/cot6936_s12.html https://moodle.cis.fiu.edu/v2.1/course/view.php?id=174
More informationR n a T i x = b i} is a Hyperplane.
Geometry of LPs Consider the following LP : min {c T x a T i x b i The feasible region is i =1,...,m}. X := {x R n a T i x b i i =1,...,m} = m i=1 {x Rn a T i x b i} }{{} X i The set X i is a Half-space.
More informationApproximation Algorithms: The Primal-Dual Method. My T. Thai
Approximation Algorithms: The Primal-Dual Method My T. Thai 1 Overview of the Primal-Dual Method Consider the following primal program, called P: min st n c j x j j=1 n a ij x j b i j=1 x j 0 Then the
More informationLecture 10,11: General Matching Polytope, Maximum Flow. 1 Perfect Matching and Matching Polytope on General Graphs
CMPUT 675: Topics in Algorithms and Combinatorial Optimization (Fall 2009) Lecture 10,11: General Matching Polytope, Maximum Flow Lecturer: Mohammad R Salavatipour Date: Oct 6 and 8, 2009 Scriber: Mohammad
More informationMath 5593 Linear Programming Lecture Notes
Math 5593 Linear Programming Lecture Notes Unit II: Theory & Foundations (Convex Analysis) University of Colorado Denver, Fall 2013 Topics 1 Convex Sets 1 1.1 Basic Properties (Luenberger-Ye Appendix B.1).........................
More informationAdvanced Algorithms Linear Programming
Reading: Advanced Algorithms Linear Programming CLRS, Chapter29 (2 nd ed. onward). Linear Algebra and Its Applications, by Gilbert Strang, chapter 8 Linear Programming, by Vasek Chvatal Introduction to
More informationRepetition: Primal Dual for Set Cover
Repetition: Primal Dual for Set Cover Primal Relaxation: k min i=1 w ix i s.t. u U i:u S i x i 1 i {1,..., k} x i 0 Dual Formulation: max u U y u s.t. i {1,..., k} u:u S i y u w i y u 0 Harald Räcke 428
More informationIntroduction to Mathematical Programming IE406. Lecture 20. Dr. Ted Ralphs
Introduction to Mathematical Programming IE406 Lecture 20 Dr. Ted Ralphs IE406 Lecture 20 1 Reading for This Lecture Bertsimas Sections 10.1, 11.4 IE406 Lecture 20 2 Integer Linear Programming An integer
More informationEaster Term OPTIMIZATION
DPK OPTIMIZATION Easter Term Example Sheet It is recommended that you attempt about the first half of this sheet for your first supervision and the remainder for your second supervision An additional example
More informationArtificial Intelligence
Artificial Intelligence Combinatorial Optimization G. Guérard Department of Nouvelles Energies Ecole Supérieur d Ingénieurs Léonard de Vinci Lecture 1 GG A.I. 1/34 Outline 1 Motivation 2 Geometric resolution
More informationACO Comprehensive Exam October 12 and 13, Computability, Complexity and Algorithms
1. Computability, Complexity and Algorithms Given a simple directed graph G = (V, E), a cycle cover is a set of vertex-disjoint directed cycles that cover all vertices of the graph. 1. Show that there
More informationRead: H&L chapters 1-6
Viterbi School of Engineering Daniel J. Epstein Department of Industrial and Systems Engineering ISE 330: Introduction to Operations Research Fall 2006 (Oct 16): Midterm Review http://www-scf.usc.edu/~ise330
More informationMath 414 Lecture 30. The greedy algorithm provides the initial transportation matrix.
Math Lecture The greedy algorithm provides the initial transportation matrix. matrix P P Demand W ª «2 ª2 «W ª «W ª «ª «ª «Supply The circled x ij s are the initial basic variables. Erase all other values
More information4.1 The original problem and the optimal tableau
Chapter 4 Sensitivity analysis The sensitivity analysis is performed after a given linear problem has been solved, with the aim of studying how changes to the problem affect the optimal solution In particular,
More informationApproximation Algorithms
Approximation Algorithms Prof. Tapio Elomaa tapio.elomaa@tut.fi Course Basics A new 4 credit unit course Part of Theoretical Computer Science courses at the Department of Mathematics There will be 4 hours
More informationMA4254: Discrete Optimization. Defeng Sun. Department of Mathematics National University of Singapore Office: S Telephone:
MA4254: Discrete Optimization Defeng Sun Department of Mathematics National University of Singapore Office: S14-04-25 Telephone: 6516 3343 Aims/Objectives: Discrete optimization deals with problems of
More informationNew Directions in Linear Programming
New Directions in Linear Programming Robert Vanderbei November 5, 2001 INFORMS Miami Beach NOTE: This is a talk mostly on pedagogy. There will be some new results. It is not a talk on state-of-the-art
More informationMVE165/MMG631 Linear and integer optimization with applications Lecture 7 Discrete optimization models and applications; complexity
MVE165/MMG631 Linear and integer optimization with applications Lecture 7 Discrete optimization models and applications; complexity Ann-Brith Strömberg 2019 04 09 Lecture 7 Linear and integer optimization
More informationThe Simplex Algorithm
The Simplex Algorithm Uri Feige November 2011 1 The simplex algorithm The simplex algorithm was designed by Danzig in 1947. This write-up presents the main ideas involved. It is a slight update (mostly
More informationAdvanced Operations Research Techniques IE316. Quiz 1 Review. Dr. Ted Ralphs
Advanced Operations Research Techniques IE316 Quiz 1 Review Dr. Ted Ralphs IE316 Quiz 1 Review 1 Reading for The Quiz Material covered in detail in lecture. 1.1, 1.4, 2.1-2.6, 3.1-3.3, 3.5 Background material
More informationIn this lecture, we ll look at applications of duality to three problems:
Lecture 7 Duality Applications (Part II) In this lecture, we ll look at applications of duality to three problems: 1. Finding maximum spanning trees (MST). We know that Kruskal s algorithm finds this,
More informationThe Simplex Algorithm with a New. Primal and Dual Pivot Rule. Hsin-Der CHEN 3, Panos M. PARDALOS 3 and Michael A. SAUNDERS y. June 14, 1993.
The Simplex Algorithm with a New rimal and Dual ivot Rule Hsin-Der CHEN 3, anos M. ARDALOS 3 and Michael A. SAUNDERS y June 14, 1993 Abstract We present a simplex-type algorithm for linear programming
More informationChapter II. Linear Programming
1 Chapter II Linear Programming 1. Introduction 2. Simplex Method 3. Duality Theory 4. Optimality Conditions 5. Applications (QP & SLP) 6. Sensitivity Analysis 7. Interior Point Methods 1 INTRODUCTION
More informationFinite Math Linear Programming 1 May / 7
Linear Programming Finite Math 1 May 2017 Finite Math Linear Programming 1 May 2017 1 / 7 General Description of Linear Programming Finite Math Linear Programming 1 May 2017 2 / 7 General Description of
More informationPlanarity: dual graphs
: dual graphs Math 104, Graph Theory March 28, 2013 : dual graphs Duality Definition Given a plane graph G, the dual graph G is the plane graph whose vtcs are the faces of G. The correspondence between
More informationMath Introduction to Operations Research
Math 300 Introduction to Operations Research Examination (50 points total) Solutions. (6 pt total) Consider the following linear programming problem: Maximize subject to and x, x, x 3 0. 3x + x + 5x 3
More informationConic Duality. yyye
Conic Linear Optimization and Appl. MS&E314 Lecture Note #02 1 Conic Duality Yinyu Ye Department of Management Science and Engineering Stanford University Stanford, CA 94305, U.S.A. http://www.stanford.edu/
More information3. The Simplex algorithmn The Simplex algorithmn 3.1 Forms of linear programs
11 3.1 Forms of linear programs... 12 3.2 Basic feasible solutions... 13 3.3 The geometry of linear programs... 14 3.4 Local search among basic feasible solutions... 15 3.5 Organization in tableaus...
More informationAlgorithmic Game Theory and Applications. Lecture 6: The Simplex Algorithm
Algorithmic Game Theory and Applications Lecture 6: The Simplex Algorithm Kousha Etessami Recall our example 1 x + y
More informationCombinatorial Optimization
Combinatorial Optimization Frank de Zeeuw EPFL 2012 Today Introduction Graph problems - What combinatorial things will we be optimizing? Algorithms - What kind of solution are we looking for? Linear Programming
More informationLecture 14: Linear Programming II
A Theorist s Toolkit (CMU 18-859T, Fall 013) Lecture 14: Linear Programming II October 3, 013 Lecturer: Ryan O Donnell Scribe: Stylianos Despotakis 1 Introduction At a big conference in Wisconsin in 1948
More informationLecture 6: Faces, Facets
IE 511: Integer Programming, Spring 2019 31 Jan, 2019 Lecturer: Karthik Chandrasekaran Lecture 6: Faces, Facets Scribe: Setareh Taki Disclaimer: These notes have not been subjected to the usual scrutiny
More information4 LINEAR PROGRAMMING (LP) E. Amaldi Fondamenti di R.O. Politecnico di Milano 1
4 LINEAR PROGRAMMING (LP) E. Amaldi Fondamenti di R.O. Politecnico di Milano 1 Mathematical programming (optimization) problem: min f (x) s.t. x X R n set of feasible solutions with linear objective function
More informationDual-fitting analysis of Greedy for Set Cover
Dual-fitting analysis of Greedy for Set Cover We showed earlier that the greedy algorithm for set cover gives a H n approximation We will show that greedy produces a solution of cost at most H n OPT LP
More informationLesson 11: Duality in linear programming
Unit 1 Lesson 11: Duality in linear programming Learning objectives: Introduction to dual programming. Formulation of Dual Problem. Introduction For every LP formulation there exists another unique linear
More informationLecture notes on the simplex method September We will present an algorithm to solve linear programs of the form. maximize.
Cornell University, Fall 2017 CS 6820: Algorithms Lecture notes on the simplex method September 2017 1 The Simplex Method We will present an algorithm to solve linear programs of the form maximize subject
More informationORIE 6300 Mathematical Programming I September 2, Lecture 3
ORIE 6300 Mathematical Programming I September 2, 2014 Lecturer: David P. Williamson Lecture 3 Scribe: Divya Singhvi Last time we discussed how to take dual of an LP in two different ways. Today we will
More informationCS599: Convex and Combinatorial Optimization Fall 2013 Lecture 14: Combinatorial Problems as Linear Programs I. Instructor: Shaddin Dughmi
CS599: Convex and Combinatorial Optimization Fall 2013 Lecture 14: Combinatorial Problems as Linear Programs I Instructor: Shaddin Dughmi Announcements Posted solutions to HW1 Today: Combinatorial problems
More informationDetecting Infeasibility in Infeasible-Interior-Point. Methods for Optimization
FOCM 02 Infeasible Interior Point Methods 1 Detecting Infeasibility in Infeasible-Interior-Point Methods for Optimization Slide 1 Michael J. Todd, School of Operations Research and Industrial Engineering,
More informationCSE 460. Today we will look at" Classes of Optimization Problems" Linear Programming" The Simplex Algorithm"
CSE 460 Linear Programming" Today we will look at" Classes of Optimization Problems" Linear Programming" The Simplex Algorithm" Classes of Optimization Problems" Optimization" unconstrained"..." linear"
More informationORF 307: Lecture 14. Linear Programming: Chapter 14: Network Flows: Algorithms
ORF 307: Lecture 14 Linear Programming: Chapter 14: Network Flows: Algorithms Robert J. Vanderbei April 10, 2018 Slides last edited on April 10, 2018 http://www.princeton.edu/ rvdb Agenda Primal Network
More informationGeorge B. Dantzig Mukund N. Thapa. Linear Programming. 1: Introduction. With 87 Illustrations. Springer
George B. Dantzig Mukund N. Thapa Linear Programming 1: Introduction With 87 Illustrations Springer Contents FOREWORD PREFACE DEFINITION OF SYMBOLS xxi xxxiii xxxvii 1 THE LINEAR PROGRAMMING PROBLEM 1
More informationApplied Lagrange Duality for Constrained Optimization
Applied Lagrange Duality for Constrained Optimization Robert M. Freund February 10, 2004 c 2004 Massachusetts Institute of Technology. 1 1 Overview The Practical Importance of Duality Review of Convexity
More informationImproved Gomory Cuts for Primal Cutting Plane Algorithms
Improved Gomory Cuts for Primal Cutting Plane Algorithms S. Dey J-P. Richard Industrial Engineering Purdue University INFORMS, 2005 Outline 1 Motivation The Basic Idea Set up the Lifting Problem How to
More informationLagrangian Relaxation: An overview
Discrete Math for Bioinformatics WS 11/12:, by A. Bockmayr/K. Reinert, 22. Januar 2013, 13:27 4001 Lagrangian Relaxation: An overview Sources for this lecture: D. Bertsimas and J. Tsitsiklis: Introduction
More informationProblem set 2. Problem 1. Problem 2. Problem 3. CS261, Winter Instructor: Ashish Goel.
CS261, Winter 2017. Instructor: Ashish Goel. Problem set 2 Electronic submission to Gradescope due 11:59pm Thursday 2/16. Form a group of 2-3 students that is, submit one homework with all of your names.
More informationVARIANTS OF THE SIMPLEX METHOD
C H A P T E R 6 VARIANTS OF THE SIMPLEX METHOD By a variant of the Simplex Method (in this chapter) we mean an algorithm consisting of a sequence of pivot steps in the primal system using alternative rules
More informationEcon 172A - Slides from Lecture 9
1 Econ 172A - Slides from Lecture 9 Joel Sobel October 25, 2012 2 Announcements Important: Midterm seating assignments. Posted. Corrected Answers to Quiz 1 posted. Midterm on November 1, 2012. Problems
More informationLinear Programming Algorithms [Read Chapters G and H first.] Status: Half-finished.
Simplicibus itaque verbis gaudet Mathematica Veritas, cum etiam per se simplex sit Veritatis oratio. [And thus Mathematical Truth prefers simple words, because the language of Truth is itself simple.]
More informationPolytopes Course Notes
Polytopes Course Notes Carl W. Lee Department of Mathematics University of Kentucky Lexington, KY 40506 lee@ms.uky.edu Fall 2013 i Contents 1 Polytopes 1 1.1 Convex Combinations and V-Polytopes.....................
More information