Outline. Combinatorial Optimization 2. Finite Systems of Linear Inequalities. Finite Systems of Linear Inequalities. Theorem (Weyl s theorem :)

Size: px
Start display at page:

Download "Outline. Combinatorial Optimization 2. Finite Systems of Linear Inequalities. Finite Systems of Linear Inequalities. Theorem (Weyl s theorem :)"

Transcription

1 Outline Combinatorial Optimization 2 Rumen Andonov Irisa/Symbiose and University of Rennes 1 9 novembre 2009 Finite Systems of Linear Inequalities, variants of Farkas Lemma Duality theory in Linear Programming Application 1 : The shortest path problem (SPP) and its dual The primal simplex algorithm briefly The dual simplex algorithm briefly Application 2 : Max-Flow Min-Cut (MFMC) Total Unimodularity Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33 Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33 Finite Systems of Linear Inequalities Finite Systems of Linear Inequalities We assume : A R m n,b R m 1,c R 1 n,x R n 1,y R 1 m A polytope is conv(x) for some finite set X R n. A polytope can also be described as the solution set of a finite system of linear inequalities, i.e. : (Weyl s theorem :) If P is a polytope, then P = {X R n : for some m Z + and a ij,b i R. n j=1 a ij x j b i,for i = 1,...,m} We assume : A R m n,b R m 1,c R 1 n,x R n 1,y R 1 m A polytope is conv(x) for some finite set X R n. A polytope can also be described as the solution set of a finite system of linear inequalities, i.e. : (Weyl s theorem :) If P is a polytope, then P = {X R n : for some m Z + and a ij,b i R. n j=1 a ij x j b i,for i = 1,...,m} (of the Alternative for Linear Inequalities :) {x R n : Ax b} /0 iff {y R m + : ya = 0, yb < 0} = /0 Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33 Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33

2 Finite Systems of Linear Inequalities (Farkas Lemma ) An equivalent result is the following : given A and b, (Farkas Lemma :) Finite Systems of Linear Inequalities (Farkas Lemma ) An equivalent result is the following : given A and b, (Farkas Lemma :) b) Either {x R n + : Ax = b} /0 or (excl.) { y R m : ya 0, yb < 0} /0 b) Either {x R n + : Ax = b} /0 or (excl.) { y R m : ya 0, yb < 0} /0 Either b cone{a 1,...,A n } (where A i are the columns of A), or a vector y that makes an acute angle with A i and an obtuse angle with b, but not both. A b A b A 1 A y Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33 Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33 Variants of Farkas Lemma Variants of Farkas Lemma : b) Either {x R+ n : Ax = b} /0 or (excl.) { y R m : ya 0, yb < 0} /0 a) Either {x R+ n : Ax b} /0 or (excl.) { y R+ m : ya 0, yb < 0} /0 c) Either {x R n : Ax b} /0 or (excl.) { y R+ m : ya = 0, yb < 0} /0 d) If P = {r R+ n : Ar = 0}, either P\{0} /0, or {y R m : ya > 0} /0 Duality theory in Linear Programming Let A R m n,b R m 1,c R 1 n, a i is the i-th row and A j is the j-th col. of A. To any primal (P) is associated its dual (D) by associating a dual variable to each primal constraint and following the rules : Primal Dual max min variables x constraints constraints variables y objective coefficients c constraint right hand sides c constraint right hand sides b objective coefficients b a i x b i y i 0 a i x b i y i 0 a i x = b i y i unconstrained x j 0 ya j c j x j 0 ya j c j x j unconstrained ya j = c j Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33 Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33

3 Duality theory : Canonical Forms Duality theory : Primal/Dual relationship (Illustration) Let be given a primal (P) in a canonical form (i.e.) A primal problem and its dual Its dual (D) is as follows. (P) z = max{cx Ax b,x R n,x 0} (1) (D) w = min{yb ya c,y R m,y 0} (2) maxz = 6x 1 + x 2 + x 3 4x 1 + 3x 2 2x 3 = 1 6x 1 2x 2 + 9x 3 9 2x 1 + 3x 2 + 8x 3 5 x 1 0,x 2 0,x 3 unrestricted minw = y 1 + 9y 2 + 5y 3 4y 1 + 6y 2 + 2y 3 6 3y 1 2y 2 + 3y 3 1 2y 1 + 9y 2 + 8y 3 = 1 y 1 unrestricted,y 2 0,y 3 0 In general, the following relationships hold : primal/dual constraint dual/primal constraint (3) consistent with canonical form variable 0 (4) reversed from canonical form variable 0 (5) eqaulity constraint variable unrestricted (6) Lemma : It is easy to verify that the dual of the dual is the primal. Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33 Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33 Duality theory in Linear Programming (cont.) Consider the following couple primal-dual (it just just a matter of convenience. (D) is given in the so called standard form to which any LP form can be transformed). (P) z = max{cx Ax b,x R n } (7) (D) w = min{yb ya = c,y 0,y R m } (8) We suppose rank(a) = m n (all redundant equations were removed). Weak Duality : If x is feasible to P and y is feasible to D, then cx yb. Hence 1 if cx = yb, then x and y are optimal 2 if either is unbounded, then the other is infeasible. Proof. Trivial (cx = yax yb). Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33 Duality theory in Linear Programming (cont.) Strong Duality : If P and D have feasible solutions, then they have optimal solutions x,y with cx = yb. If either is infeasible, then the other is either infeasible or unbounded. Proof. Can be proved using one of the variant of Farkas lemma. Here we will discuss its geometrical insight only. Remark : The of the Alternative for Linear Inequalities can be proven from the Strong Duality. Hint : Consider the program (D0) min{yb : ya = 0,y R m +} (9) First argue that either the optimal objective value for D0 is zero or D0 is unbounded. Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33

4 Duality theory in Linear Programming (cont.) Geometrically : Suppose a finite maximum δ (i.e.) δ = cx = max{cx Ax b}. Visualizing Duality c cx*= δ a1 a2 x* a1x*= β P a2x*=β2 Set A = (a 1,a 2 ) t, b = (β 1,β 2 ) and let a 1 x = β 1,a 2 x = β 2. Then λ 1,λ 2 0 s.t. c = λ 1 a 1 + λ 2 a 2. Hence δ = λ 1 β 1 + λ 2 β 2. This implies : Question (How to find the shortest path from S to T?) max{cx Ax b} = δ = λ 1 β 1 + λ 2 β 2 min{yb ya = c,y 0} (10) (since the λ i give a feasible solution for the minimum). On the other hand, from the weak duality we have max{cx Ax b} min{yb ya = c,y 0}. Hence max{cx Ax b} = min{yb ya = c,y 0}. Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33 Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33 Visualizing Duality Visualizing Duality Question (How to find the shortest path from S to T?) Question (How to find the shortest path from S to T?) Answer (Just pull S away from T until the gadget is taut.) Answer (Just pull S away from T until the gadget is taut.) Why does it work? Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33 Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33

5 Visualizing Duality Visualizing Duality Question (How to find the shortest path from S to T?) Question (How to find the shortest path from S to T?) Answer (Just pull S away from T until the gadget is taut.) Answer (Just pull S away from T until the gadget is taut.) Why does it work? Because by pulling S away from T we solve the dual of the shortest-path problem! Why does it work? Because by pulling S away from T we solve the dual of the shortest-path problem! Exercice (Prove the above formally.) Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33 Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33 Application 1 : The shortest path problem and its dual The shortest path problem (SPP) and its dual Finding the shortest path from S to T is equivalent to pulling S away from T as much as possible. We will prove it by writing the primal and the dual problem of the above modeling. Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33 Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33

6 The shortest path problem (SPP) SPP : Primal-Dual LP formulation Given a directed graph G = (V,U) and weights w j 0 associated with each arc u j, find a path from s to t with the minimum total weight. s u1 u2 [1] [2] u3 [2] a b u4 [3] u5 [1] t A = s t a b A weighted directed graph and the corresponding node-arc incidence matrix A. The weights are in squared brackets. A path from s to t can be thought of as a flow φ of unit 1 leaving s and entering t. The primal (P) of (SPP) and its dual (D) where a variable π i is assigned to each node i, are given below. Aφ = (P) min wφ (11) +1 row s 1 row t 0 otherwise φ 0 (12) (D) max π s π t (13) π i π j w ij (ij) U (14) π i unrestricted i V (15) Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33 Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33 Complementary-Slackness in Duality theory Complementary-Slackness in Duality theory : II Let us denote by a i the i-the raw of the matrix A and by A j its j-the column. Points x R n and y R m are complementary, with respect to P and D, if y i (b i a i x) = 0, for i = 1,...m (16) Weak Complementary-Slackness If feasible solutions x and y are complementary, then they are optimal solutions. Proof. 0 = m i=1 y i (b i a i x) = m i=1 y i b i n m j=1 i=1 y i a ij x j = yb cx If x and y are complementary and feasible, then yb = cx and by the Weak Duality they are optimal. Let us denote by a i the i-the raw of the matrix A and by A j its j-the column. Points x R n and y R m are complementary, with respect to P and D, if y i (b i a i x) = 0, for i = 1,...m (17) Strong Complementary-Slackness If feasible solutions x and y are optimal solutions to P and D, respectively, then they are complementary. Note : Similar considerations hold for the other LP duality equation, i.e. x j (c j ya j ) = 0, for j = 1,...n (18) Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33 Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33

7 Complementary-Slackness in Duality theory : III Variant : A pair (x, y) feasible in P and D respectively, is optimal iff. y i (b i a i x) = 0, for i = 1,...m x j (c j ya j ) = 0, for j = 1,...n (19) Geometrically : Suppose δ = max{cx Ax b}. As we saw then λ 1,λ 2 0 s.t. c = λ 1 a 1 + λ 2 a 2, where a 1 x = β 1,a 2 x = β 2. Note that if ax < β for some inequality in Ax b, then the corresponding component in y is zero. cx*= δ a a1x*= β P c x* a2 a2x*=β2 The primal simplex algorithm briefly Given the following linear program in standard form : Definition (P) z = max{cx Ax = b,x 0,x R n } (20) A basis B is a m m non-singular submatrix of A. Then A = (B,N). Let x = (x B,x N ) and Bx B + Nx N = b. x B + B 1 Nx N = B 1 b = b. x B = B 1 b and x N = 0 is called a basic solution of P. If B 1 b 0, then (x B,x N ) is called a basic primal feasible solution and B is called a primal feasible basis. A point x is an extreme point of the set {x Ax = b,x 0} iff it is a basic feasible solution. ( Fundamental theorem of linear programming) If (P) has a finite optimum then it has an optimal basic feasible solution. Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33 Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33 The dual simplex algorithm The following is the dual of problem (P) (D) w = min{yb ya c,y R m } (21) Let c = (c B,c N ) and z = c B x B + c N x N = c B b+(c N c B B 1 N)x N. Set y = c B B 1 R m. y is complementary to (x B,x N ) since ya c = c B B 1 (B,N) (c B,c N ) = (0,c B B 1 N c N ) and x N = 0. Max-Flow Min-Cut (MFMC) Definition If c B B 1 N c N, then B is called a dual feasible basis. If B is primal and dual feasible then x = (x B,x N ) = (B 1 b,0) is an optimal solution to P and y = c B B 1 is an optimal solution to D. Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33 Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33

8 Application 2 : Max-Flow Min-Cut (MFMC) Application 2 : Max-Flow Min-Cut (MFMC) Let N = (s,t,v,e,c) be a flow network with n = V nodes, m = E arcs, and arc-capacity c(i,j). Let the flow in arc i,j be denoted by φ i,j. Flow conservation holds for any node except s,t where e Γ + (s) φ e = e Γ (t) φ e = φ 0 (flow value) (22) Find a flow φ = [φ 1,φ 2,...φ m ] s.t. 0 φ e c e and maximizing φ 0. Let N = (s,t,v,e,c) be a flow network with n = V nodes, m = E arcs, and arc-capacity c(i,j). Let the flow in arc i,j be denoted by φ i,j. Flow conservation holds for any node except s,t where e Γ + (s) φ e = e Γ (t) φ e = φ 0 (flow value) (22) Find a flow φ = [φ 1,φ 2,...φ m ] s.t. 0 φ e c e and maximizing φ 0. Modeling MFMC as a LP problem The node-arc incidence matrix A = [a i,j ] i = 1,2,..., V +1 if arc e j leaves node i and j = 1,2,..., E is defined by a i,j = 1 if arc e j enters node i 0 otherwise Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33 Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33 MFMC : LP formulation MFMC : Primal-Dual LP formulation Let (as usual) a i denote the ith row of A. The flow conservation at a node i (except s,t) is expressed by : The LP formulation of the MFMC is : let d R n be defined by 1 i = s d i = +1 i = t 0 otherwise a i φ = 0 (23) maxφ 0 (24) dφ 0 + Aφ = 0 (25) φ c (26) φ 0 (27) φ 0 0 (28) Assign variables λ i,i V to (30) and variables γ i,j,(i,j) E to (31). Then we obtain : (P) maxφ 0 (29) dφ 0 + Aφ = 0 (30) φ c (31) φ 0 (32) φ 0 0 (33) (D) min γ i,j c i,j (34) (i,j) E λ i λ j + γ i,j 0 (i,j) E (35) λ s + λ t 1 (36) γ i,j 0 (i,j) E (37) Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33 Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33

9 MFMC : Max-Flow Min-Cut Relationships Max-Flow Min-Cut Definition An s t cut is a partition (A,Ā) of V, s.t. s A and t Ā. The capacity of an s t cut is C(A,Ā) = c e. e Γ + (A) Every s t cut determines a feasible solution with cost C(A,Ā) to (D) as follows : { { 0 i A, 1 (i,j) s.t. i A,j Ā λ γ i,j = i = 1 i Ā 0 otherwise The value φ 0 is no greater than the capacity C(A,Ā) of any s t cut. Furthermore, the value of the maximum flow equals the capacity of the minimum cut, and a flow φ and cut C(A,Ā) are jointly optimal iff φ i,j = 0 for (i,j) E such that i Ā and j A (38) φ i,j = c i,j for (i,j) E such that i A and j Ā (39) Proof. Trivial, use the complementary slackness. Proof : Just by checking. Note that (35) is strict inequality iff i Ā and j A. Note also that λ s + λ t = 1. Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33 Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33 Total Unimodularity When solving an LP problem always gives integer solution? Total Unimodularity Definition An integer matrix A is called totally unimodular (TUM) if the determinant of each square submatrix of A equals 0,+1, or -1. P(A) = {x Ax b,x 0,} (40) If A is TUM, then all the vertices of P(A) are integer for any integer vector b. Proof. First prove the case {x Ax = b,x 0,}. Any basic solution x = B 1 b = adj(b)b det(b). Then show that (A I) is TUM. Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33 Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33

10 Total Unimodularity (suite I) An integer matrix A with a ij = 0,+1, 1 is TUM if no more than two nonzero entries appear in any column, and if the rows of A can be partitioned into two sets I 1 and I 2 s.t. : 1 If a column has two entries of the same sign, their rows are in different sets ; 2 If a column has two entries of the different signs, their rows are in the same sets ; Proof. By induction of the size of submatrices. Let C be a submatrix of size k. For k = 1 it is true. Let k > 1. It is obvious when C has a column of all zeros or with one nonzero. Let C has two nonzero entries in every column. Then the conditions of the theorem imply : i I 1 a ij = i I 2 a ij for every column j. i.e. a linear combination of rows is zero, hence det(c) = 0. Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33 Total Unimodularity (suite II) Corollary Any LP in standard or canonical form whose constraint matrix A is either 1 The node-arc incidence matrix of a directed graph, or 2 The node-edge incidence matrix of an undirected bipartite graph, has only integer optimal vertices. This includes the LP formulation of shortest path, max-flow, the transport problem, and weighted bipartite matching. Proof. The matrices in Case 1 satisfy the condition of the theorem with I 2 = /0 ; those in Case 2 with I 1 = V and I 2 = U, where the bipartite graph is G = (V,U,E). Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33 Examen June 2009 Exercice 1 : Optimizing an anti-fire system The port company COSMAR wishes to improve its anti-fire security by buying new anti-fire systems SLIC. The company identifies 7 zones of the port to be specially protected. These zones are denoted by X on the below figure. WEST NORTH A B C D E F 1 X 2 X 3 X 4 X X X 5 6 X FIG.: The 7 zones to be protected by the company COSMAR G Optimizing an anti-fire system COSMAR intends to allocate the SLIC systems on the North and West sides of the port. A SLIC system protects the zones situated on the same row or column. For example, a SLIC installed on D covers zones (1,D) et (6,D). It is required that these anti-fire systems cannot be placed on consecutive columns, that at least one SLIC is allocated on row 1 or on column A, and that at least 60% of the SLIC are placed on the North side. Questions : 1 Formulate the corresponding linear program that allows to minimize the number of the anti-fire systems needed to cover the 7 special zones. 2 Since the cost of one SLIC is 8070 euros, COSMAR wishes to buy at most 3 of them. For the non-protected zones COSMAR plans to take out insurance against fire. This insurance costs 2000 euros for each zone on lines 1, 2, 3 and 3000 euros for the other lines. Modify the previous linear model in order to minimize the total cost. 3 Are you aware of software packages permitting to solve such problems? Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33 Rumen Andonov (Irisa) Combinatorial Optimization 2 9 novembre / 33

Mathematical and Algorithmic Foundations Linear Programming and Matchings

Mathematical and Algorithmic Foundations Linear Programming and Matchings Adavnced Algorithms Lectures Mathematical and Algorithmic Foundations Linear Programming and Matchings Paul G. Spirakis Department of Computer Science University of Patras and Liverpool Paul G. Spirakis

More information

Discrete Optimization 2010 Lecture 5 Min-Cost Flows & Total Unimodularity

Discrete Optimization 2010 Lecture 5 Min-Cost Flows & Total Unimodularity Discrete Optimization 2010 Lecture 5 Min-Cost Flows & Total Unimodularity Marc Uetz University of Twente m.uetz@utwente.nl Lecture 5: sheet 1 / 26 Marc Uetz Discrete Optimization Outline 1 Min-Cost Flows

More information

CS 473: Algorithms. Ruta Mehta. Spring University of Illinois, Urbana-Champaign. Ruta (UIUC) CS473 1 Spring / 36

CS 473: Algorithms. Ruta Mehta. Spring University of Illinois, Urbana-Champaign. Ruta (UIUC) CS473 1 Spring / 36 CS 473: Algorithms Ruta Mehta University of Illinois, Urbana-Champaign Spring 2018 Ruta (UIUC) CS473 1 Spring 2018 1 / 36 CS 473: Algorithms, Spring 2018 LP Duality Lecture 20 April 3, 2018 Some of the

More information

Introduction to Mathematical Programming IE496. Final Review. Dr. Ted Ralphs

Introduction to Mathematical Programming IE496. Final Review. Dr. Ted Ralphs Introduction to Mathematical Programming IE496 Final Review Dr. Ted Ralphs IE496 Final Review 1 Course Wrap-up: Chapter 2 In the introduction, we discussed the general framework of mathematical modeling

More information

4 Integer Linear Programming (ILP)

4 Integer Linear Programming (ILP) TDA6/DIT37 DISCRETE OPTIMIZATION 17 PERIOD 3 WEEK III 4 Integer Linear Programg (ILP) 14 An integer linear program, ILP for short, has the same form as a linear program (LP). The only difference is that

More information

In this chapter we introduce some of the basic concepts that will be useful for the study of integer programming problems.

In this chapter we introduce some of the basic concepts that will be useful for the study of integer programming problems. 2 Basics In this chapter we introduce some of the basic concepts that will be useful for the study of integer programming problems. 2.1 Notation Let A R m n be a matrix with row index set M = {1,...,m}

More information

Linear programming and duality theory

Linear programming and duality theory Linear programming and duality theory Complements of Operations Research Giovanni Righini Linear Programming (LP) A linear program is defined by linear constraints, a linear objective function. Its variables

More information

6.854 Advanced Algorithms. Scribes: Jay Kumar Sundararajan. Duality

6.854 Advanced Algorithms. Scribes: Jay Kumar Sundararajan. Duality 6.854 Advanced Algorithms Scribes: Jay Kumar Sundararajan Lecturer: David Karger Duality This lecture covers weak and strong duality, and also explains the rules for finding the dual of a linear program,

More information

Dual-fitting analysis of Greedy for Set Cover

Dual-fitting analysis of Greedy for Set Cover Dual-fitting analysis of Greedy for Set Cover We showed earlier that the greedy algorithm for set cover gives a H n approximation We will show that greedy produces a solution of cost at most H n OPT LP

More information

DM545 Linear and Integer Programming. Lecture 2. The Simplex Method. Marco Chiarandini

DM545 Linear and Integer Programming. Lecture 2. The Simplex Method. Marco Chiarandini DM545 Linear and Integer Programming Lecture 2 The Marco Chiarandini Department of Mathematics & Computer Science University of Southern Denmark Outline 1. 2. 3. 4. Standard Form Basic Feasible Solutions

More information

Linear Programming. Course review MS-E2140. v. 1.1

Linear Programming. Course review MS-E2140. v. 1.1 Linear Programming MS-E2140 Course review v. 1.1 Course structure Modeling techniques Linear programming theory and the Simplex method Duality theory Dual Simplex algorithm and sensitivity analysis Integer

More information

Integer Programming Theory

Integer Programming Theory Integer Programming Theory Laura Galli October 24, 2016 In the following we assume all functions are linear, hence we often drop the term linear. In discrete optimization, we seek to find a solution x

More information

ACO Comprehensive Exam October 12 and 13, Computability, Complexity and Algorithms

ACO Comprehensive Exam October 12 and 13, Computability, Complexity and Algorithms 1. Computability, Complexity and Algorithms Given a simple directed graph G = (V, E), a cycle cover is a set of vertex-disjoint directed cycles that cover all vertices of the graph. 1. Show that there

More information

Linear Programming. Linear programming provides methods for allocating limited resources among competing activities in an optimal way.

Linear Programming. Linear programming provides methods for allocating limited resources among competing activities in an optimal way. University of Southern California Viterbi School of Engineering Daniel J. Epstein Department of Industrial and Systems Engineering ISE 330: Introduction to Operations Research - Deterministic Models Fall

More information

Lecture 5: Duality Theory

Lecture 5: Duality Theory Lecture 5: Duality Theory Rajat Mittal IIT Kanpur The objective of this lecture note will be to learn duality theory of linear programming. We are planning to answer following questions. What are hyperplane

More information

Duality. Primal program P: Maximize n. Dual program D: Minimize m. j=1 c jx j subject to n. j=1. i=1 b iy i subject to m. i=1

Duality. Primal program P: Maximize n. Dual program D: Minimize m. j=1 c jx j subject to n. j=1. i=1 b iy i subject to m. i=1 Duality Primal program P: Maximize n j=1 c jx j subject to n a ij x j b i, i = 1, 2,..., m j=1 x j 0, j = 1, 2,..., n Dual program D: Minimize m i=1 b iy i subject to m a ij x j c j, j = 1, 2,..., n i=1

More information

LECTURES 3 and 4: Flows and Matchings

LECTURES 3 and 4: Flows and Matchings LECTURES 3 and 4: Flows and Matchings 1 Max Flow MAX FLOW (SP). Instance: Directed graph N = (V,A), two nodes s,t V, and capacities on the arcs c : A R +. A flow is a set of numbers on the arcs such that

More information

Some Advanced Topics in Linear Programming

Some Advanced Topics in Linear Programming Some Advanced Topics in Linear Programming Matthew J. Saltzman July 2, 995 Connections with Algebra and Geometry In this section, we will explore how some of the ideas in linear programming, duality theory,

More information

Math 5593 Linear Programming Lecture Notes

Math 5593 Linear Programming Lecture Notes Math 5593 Linear Programming Lecture Notes Unit II: Theory & Foundations (Convex Analysis) University of Colorado Denver, Fall 2013 Topics 1 Convex Sets 1 1.1 Basic Properties (Luenberger-Ye Appendix B.1).........................

More information

1. Lecture notes on bipartite matching February 4th,

1. Lecture notes on bipartite matching February 4th, 1. Lecture notes on bipartite matching February 4th, 2015 6 1.1.1 Hall s Theorem Hall s theorem gives a necessary and sufficient condition for a bipartite graph to have a matching which saturates (or matches)

More information

6. Lecture notes on matroid intersection

6. Lecture notes on matroid intersection Massachusetts Institute of Technology 18.453: Combinatorial Optimization Michel X. Goemans May 2, 2017 6. Lecture notes on matroid intersection One nice feature about matroids is that a simple greedy algorithm

More information

Advanced Operations Research Techniques IE316. Quiz 2 Review. Dr. Ted Ralphs

Advanced Operations Research Techniques IE316. Quiz 2 Review. Dr. Ted Ralphs Advanced Operations Research Techniques IE316 Quiz 2 Review Dr. Ted Ralphs IE316 Quiz 2 Review 1 Reading for The Quiz Material covered in detail in lecture Bertsimas 4.1-4.5, 4.8, 5.1-5.5, 6.1-6.3 Material

More information

Lecture Notes 2: The Simplex Algorithm

Lecture Notes 2: The Simplex Algorithm Algorithmic Methods 25/10/2010 Lecture Notes 2: The Simplex Algorithm Professor: Yossi Azar Scribe:Kiril Solovey 1 Introduction In this lecture we will present the Simplex algorithm, finish some unresolved

More information

Linear Programming. Larry Blume. Cornell University & The Santa Fe Institute & IHS

Linear Programming. Larry Blume. Cornell University & The Santa Fe Institute & IHS Linear Programming Larry Blume Cornell University & The Santa Fe Institute & IHS Linear Programs The general linear program is a constrained optimization problem where objectives and constraints are all

More information

MA4254: Discrete Optimization. Defeng Sun. Department of Mathematics National University of Singapore Office: S Telephone:

MA4254: Discrete Optimization. Defeng Sun. Department of Mathematics National University of Singapore Office: S Telephone: MA4254: Discrete Optimization Defeng Sun Department of Mathematics National University of Singapore Office: S14-04-25 Telephone: 6516 3343 Aims/Objectives: Discrete optimization deals with problems of

More information

Linear Programming Motivation: The Diet Problem

Linear Programming Motivation: The Diet Problem Agenda We ve done Greedy Method Divide and Conquer Dynamic Programming Network Flows & Applications NP-completeness Now Linear Programming and the Simplex Method Hung Q. Ngo (SUNY at Buffalo) CSE 531 1

More information

AMS : Combinatorial Optimization Homework Problems - Week V

AMS : Combinatorial Optimization Homework Problems - Week V AMS 553.766: Combinatorial Optimization Homework Problems - Week V For the following problems, A R m n will be m n matrices, and b R m. An affine subspace is the set of solutions to a a system of linear

More information

Heuristic Optimization Today: Linear Programming. Tobias Friedrich Chair for Algorithm Engineering Hasso Plattner Institute, Potsdam

Heuristic Optimization Today: Linear Programming. Tobias Friedrich Chair for Algorithm Engineering Hasso Plattner Institute, Potsdam Heuristic Optimization Today: Linear Programming Chair for Algorithm Engineering Hasso Plattner Institute, Potsdam Linear programming Let s first define it formally: A linear program is an optimization

More information

Outline. CS38 Introduction to Algorithms. Linear programming 5/21/2014. Linear programming. Lecture 15 May 20, 2014

Outline. CS38 Introduction to Algorithms. Linear programming 5/21/2014. Linear programming. Lecture 15 May 20, 2014 5/2/24 Outline CS38 Introduction to Algorithms Lecture 5 May 2, 24 Linear programming simplex algorithm LP duality ellipsoid algorithm * slides from Kevin Wayne May 2, 24 CS38 Lecture 5 May 2, 24 CS38

More information

12 Introduction to LP-Duality

12 Introduction to LP-Duality 12 Introduction to LP-Duality A large fraction of the theory of approximation algorithms, as we know it today, is built around linear programming (LP). In Section 12.1 we will review some key concepts

More information

Polytopes Course Notes

Polytopes Course Notes Polytopes Course Notes Carl W. Lee Department of Mathematics University of Kentucky Lexington, KY 40506 lee@ms.uky.edu Fall 2013 i Contents 1 Polytopes 1 1.1 Convex Combinations and V-Polytopes.....................

More information

Section Notes 4. Duality, Sensitivity, and the Dual Simplex Algorithm. Applied Math / Engineering Sciences 121. Week of October 8, 2018

Section Notes 4. Duality, Sensitivity, and the Dual Simplex Algorithm. Applied Math / Engineering Sciences 121. Week of October 8, 2018 Section Notes 4 Duality, Sensitivity, and the Dual Simplex Algorithm Applied Math / Engineering Sciences 121 Week of October 8, 2018 Goals for the week understand the relationship between primal and dual

More information

1 Linear programming relaxation

1 Linear programming relaxation Cornell University, Fall 2010 CS 6820: Algorithms Lecture notes: Primal-dual min-cost bipartite matching August 27 30 1 Linear programming relaxation Recall that in the bipartite minimum-cost perfect matching

More information

Lecture 10,11: General Matching Polytope, Maximum Flow. 1 Perfect Matching and Matching Polytope on General Graphs

Lecture 10,11: General Matching Polytope, Maximum Flow. 1 Perfect Matching and Matching Polytope on General Graphs CMPUT 675: Topics in Algorithms and Combinatorial Optimization (Fall 2009) Lecture 10,11: General Matching Polytope, Maximum Flow Lecturer: Mohammad R Salavatipour Date: Oct 6 and 8, 2009 Scriber: Mohammad

More information

Civil Engineering Systems Analysis Lecture XIV. Instructor: Prof. Naveen Eluru Department of Civil Engineering and Applied Mechanics

Civil Engineering Systems Analysis Lecture XIV. Instructor: Prof. Naveen Eluru Department of Civil Engineering and Applied Mechanics Civil Engineering Systems Analysis Lecture XIV Instructor: Prof. Naveen Eluru Department of Civil Engineering and Applied Mechanics Today s Learning Objectives Dual 2 Linear Programming Dual Problem 3

More information

11 Linear Programming

11 Linear Programming 11 Linear Programming 11.1 Definition and Importance The final topic in this course is Linear Programming. We say that a problem is an instance of linear programming when it can be effectively expressed

More information

Lecture 3: Totally Unimodularity and Network Flows

Lecture 3: Totally Unimodularity and Network Flows Lecture 3: Totally Unimodularity and Network Flows (3 units) Outline Properties of Easy Problems Totally Unimodular Matrix Minimum Cost Network Flows Dijkstra Algorithm for Shortest Path Problem Ford-Fulkerson

More information

Problem set 2. Problem 1. Problem 2. Problem 3. CS261, Winter Instructor: Ashish Goel.

Problem set 2. Problem 1. Problem 2. Problem 3. CS261, Winter Instructor: Ashish Goel. CS261, Winter 2017. Instructor: Ashish Goel. Problem set 2 Electronic submission to Gradescope due 11:59pm Thursday 2/16. Form a group of 2-3 students that is, submit one homework with all of your names.

More information

Section Notes 5. Review of Linear Programming. Applied Math / Engineering Sciences 121. Week of October 15, 2017

Section Notes 5. Review of Linear Programming. Applied Math / Engineering Sciences 121. Week of October 15, 2017 Section Notes 5 Review of Linear Programming Applied Math / Engineering Sciences 121 Week of October 15, 2017 The following list of topics is an overview of the material that was covered in the lectures

More information

Introduction to Mathematical Programming IE406. Lecture 20. Dr. Ted Ralphs

Introduction to Mathematical Programming IE406. Lecture 20. Dr. Ted Ralphs Introduction to Mathematical Programming IE406 Lecture 20 Dr. Ted Ralphs IE406 Lecture 20 1 Reading for This Lecture Bertsimas Sections 10.1, 11.4 IE406 Lecture 20 2 Integer Linear Programming An integer

More information

THEORY OF LINEAR AND INTEGER PROGRAMMING

THEORY OF LINEAR AND INTEGER PROGRAMMING THEORY OF LINEAR AND INTEGER PROGRAMMING ALEXANDER SCHRIJVER Centrum voor Wiskunde en Informatica, Amsterdam A Wiley-Inter science Publication JOHN WILEY & SONS^ Chichester New York Weinheim Brisbane Singapore

More information

Notes for Lecture 20

Notes for Lecture 20 U.C. Berkeley CS170: Intro to CS Theory Handout N20 Professor Luca Trevisan November 13, 2001 Notes for Lecture 20 1 Duality As it turns out, the max-flow min-cut theorem is a special case of a more general

More information

Conic Duality. yyye

Conic Duality.  yyye Conic Linear Optimization and Appl. MS&E314 Lecture Note #02 1 Conic Duality Yinyu Ye Department of Management Science and Engineering Stanford University Stanford, CA 94305, U.S.A. http://www.stanford.edu/

More information

Linear Programming Problems

Linear Programming Problems Linear Programming Problems Two common formulations of linear programming (LP) problems are: min Subject to: 1,,, 1,2,,;, max Subject to: 1,,, 1,2,,;, Linear Programming Problems The standard LP problem

More information

Math 5490 Network Flows

Math 5490 Network Flows Math 590 Network Flows Lecture 7: Preflow Push Algorithm, cont. Stephen Billups University of Colorado at Denver Math 590Network Flows p./6 Preliminaries Optimization Seminar Next Thursday: Speaker: Ariela

More information

COT 6936: Topics in Algorithms! Giri Narasimhan. ECS 254A / EC 2443; Phone: x3748

COT 6936: Topics in Algorithms! Giri Narasimhan. ECS 254A / EC 2443; Phone: x3748 COT 6936: Topics in Algorithms! Giri Narasimhan ECS 254A / EC 2443; Phone: x3748 giri@cs.fiu.edu http://www.cs.fiu.edu/~giri/teach/cot6936_s12.html https://moodle.cis.fiu.edu/v2.1/course/view.php?id=174

More information

1. Lecture notes on bipartite matching

1. Lecture notes on bipartite matching Massachusetts Institute of Technology 18.453: Combinatorial Optimization Michel X. Goemans February 5, 2017 1. Lecture notes on bipartite matching Matching problems are among the fundamental problems in

More information

4 LINEAR PROGRAMMING (LP) E. Amaldi Fondamenti di R.O. Politecnico di Milano 1

4 LINEAR PROGRAMMING (LP) E. Amaldi Fondamenti di R.O. Politecnico di Milano 1 4 LINEAR PROGRAMMING (LP) E. Amaldi Fondamenti di R.O. Politecnico di Milano 1 Mathematical programming (optimization) problem: min f (x) s.t. x X R n set of feasible solutions with linear objective function

More information

College of Computer & Information Science Fall 2007 Northeastern University 14 September 2007

College of Computer & Information Science Fall 2007 Northeastern University 14 September 2007 College of Computer & Information Science Fall 2007 Northeastern University 14 September 2007 CS G399: Algorithmic Power Tools I Scribe: Eric Robinson Lecture Outline: Linear Programming: Vertex Definitions

More information

Lecture 2 - Introduction to Polytopes

Lecture 2 - Introduction to Polytopes Lecture 2 - Introduction to Polytopes Optimization and Approximation - ENS M1 Nicolas Bousquet 1 Reminder of Linear Algebra definitions Let x 1,..., x m be points in R n and λ 1,..., λ m be real numbers.

More information

CS 473: Algorithms. Ruta Mehta. Spring University of Illinois, Urbana-Champaign. Ruta (UIUC) CS473 1 Spring / 29

CS 473: Algorithms. Ruta Mehta. Spring University of Illinois, Urbana-Champaign. Ruta (UIUC) CS473 1 Spring / 29 CS 473: Algorithms Ruta Mehta University of Illinois, Urbana-Champaign Spring 2018 Ruta (UIUC) CS473 1 Spring 2018 1 / 29 CS 473: Algorithms, Spring 2018 Simplex and LP Duality Lecture 19 March 29, 2018

More information

Linear Optimization. Andongwisye John. November 17, Linkoping University. Andongwisye John (Linkoping University) November 17, / 25

Linear Optimization. Andongwisye John. November 17, Linkoping University. Andongwisye John (Linkoping University) November 17, / 25 Linear Optimization Andongwisye John Linkoping University November 17, 2016 Andongwisye John (Linkoping University) November 17, 2016 1 / 25 Overview 1 Egdes, One-Dimensional Faces, Adjacency of Extreme

More information

3. The Simplex algorithmn The Simplex algorithmn 3.1 Forms of linear programs

3. The Simplex algorithmn The Simplex algorithmn 3.1 Forms of linear programs 11 3.1 Forms of linear programs... 12 3.2 Basic feasible solutions... 13 3.3 The geometry of linear programs... 14 3.4 Local search among basic feasible solutions... 15 3.5 Organization in tableaus...

More information

Linear and Integer Programming :Algorithms in the Real World. Related Optimization Problems. How important is optimization?

Linear and Integer Programming :Algorithms in the Real World. Related Optimization Problems. How important is optimization? Linear and Integer Programming 15-853:Algorithms in the Real World Linear and Integer Programming I Introduction Geometric Interpretation Simplex Method Linear or Integer programming maximize z = c T x

More information

Linear Programming: Introduction

Linear Programming: Introduction CSC 373 - Algorithm Design, Analysis, and Complexity Summer 2016 Lalla Mouatadid Linear Programming: Introduction A bit of a historical background about linear programming, that I stole from Jeff Erickson

More information

In this lecture, we ll look at applications of duality to three problems:

In this lecture, we ll look at applications of duality to three problems: Lecture 7 Duality Applications (Part II) In this lecture, we ll look at applications of duality to three problems: 1. Finding maximum spanning trees (MST). We know that Kruskal s algorithm finds this,

More information

Combinatorial Optimization

Combinatorial Optimization Combinatorial Optimization Frank de Zeeuw EPFL 2012 Today Introduction Graph problems - What combinatorial things will we be optimizing? Algorithms - What kind of solution are we looking for? Linear Programming

More information

Artificial Intelligence

Artificial Intelligence Artificial Intelligence Combinatorial Optimization G. Guérard Department of Nouvelles Energies Ecole Supérieur d Ingénieurs Léonard de Vinci Lecture 1 GG A.I. 1/34 Outline 1 Motivation 2 Geometric resolution

More information

Math 414 Lecture 30. The greedy algorithm provides the initial transportation matrix.

Math 414 Lecture 30. The greedy algorithm provides the initial transportation matrix. Math Lecture The greedy algorithm provides the initial transportation matrix. matrix P P Demand W ª «2 ª2 «W ª «W ª «ª «ª «Supply The circled x ij s are the initial basic variables. Erase all other values

More information

Module 10. Network Simplex Method:

Module 10. Network Simplex Method: Module 10 1 Network Simplex Method: In this lecture we shall study a specialized simplex method specifically designed to solve network structured linear programming problems. This specialized algorithm

More information

Easter Term OPTIMIZATION

Easter Term OPTIMIZATION DPK OPTIMIZATION Easter Term Example Sheet It is recommended that you attempt about the first half of this sheet for your first supervision and the remainder for your second supervision An additional example

More information

5. DUAL LP, SOLUTION INTERPRETATION, AND POST-OPTIMALITY

5. DUAL LP, SOLUTION INTERPRETATION, AND POST-OPTIMALITY 5. DUAL LP, SOLUTION INTERPRETATION, AND POST-OPTIMALITY 5.1 DUALITY Associated with every linear programming problem (the primal) is another linear programming problem called its dual. If the primal involves

More information

Lecture 6: Faces, Facets

Lecture 6: Faces, Facets IE 511: Integer Programming, Spring 2019 31 Jan, 2019 Lecturer: Karthik Chandrasekaran Lecture 6: Faces, Facets Scribe: Setareh Taki Disclaimer: These notes have not been subjected to the usual scrutiny

More information

OPERATIONS RESEARCH. Linear Programming Problem

OPERATIONS RESEARCH. Linear Programming Problem OPERATIONS RESEARCH Chapter 1 Linear Programming Problem Prof. Bibhas C. Giri Department of Mathematics Jadavpur University Kolkata, India Email: bcgiri.jumath@gmail.com 1.0 Introduction Linear programming

More information

Linear Programming Duality and Algorithms

Linear Programming Duality and Algorithms COMPSCI 330: Design and Analysis of Algorithms 4/5/2016 and 4/7/2016 Linear Programming Duality and Algorithms Lecturer: Debmalya Panigrahi Scribe: Tianqi Song 1 Overview In this lecture, we will cover

More information

The Matrix-Tree Theorem and Its Applications to Complete and Complete Bipartite Graphs

The Matrix-Tree Theorem and Its Applications to Complete and Complete Bipartite Graphs The Matrix-Tree Theorem and Its Applications to Complete and Complete Bipartite Graphs Frankie Smith Nebraska Wesleyan University fsmith@nebrwesleyan.edu May 11, 2015 Abstract We will look at how to represent

More information

Integer Programming. Leo Liberti. March 13, Abstract

Integer Programming. Leo Liberti. March 13, Abstract Integer Programming Leo Liberti LIX, École Polytechnique, F-9118 Palaiseau, France (liberti@lix.polytechnique.fr) March 1, 6 Abstract A short introduction to Integer Programming (IP). Problems leading

More information

Lecture Overview. 2 Shortest s t path. 2.1 The LP. 2.2 The Algorithm. COMPSCI 530: Design and Analysis of Algorithms 11/14/2013

Lecture Overview. 2 Shortest s t path. 2.1 The LP. 2.2 The Algorithm. COMPSCI 530: Design and Analysis of Algorithms 11/14/2013 COMPCI 530: Design and Analysis of Algorithms 11/14/2013 Lecturer: Debmalya Panigrahi Lecture 22 cribe: Abhinandan Nath 1 Overview In the last class, the primal-dual method was introduced through the metric

More information

Approximation Algorithms

Approximation Algorithms Approximation Algorithms Group Members: 1. Geng Xue (A0095628R) 2. Cai Jingli (A0095623B) 3. Xing Zhe (A0095644W) 4. Zhu Xiaolu (A0109657W) 5. Wang Zixiao (A0095670X) 6. Jiao Qing (A0095637R) 7. Zhang

More information

LP-Modelling. dr.ir. C.A.J. Hurkens Technische Universiteit Eindhoven. January 30, 2008

LP-Modelling. dr.ir. C.A.J. Hurkens Technische Universiteit Eindhoven. January 30, 2008 LP-Modelling dr.ir. C.A.J. Hurkens Technische Universiteit Eindhoven January 30, 2008 1 Linear and Integer Programming After a brief check with the backgrounds of the participants it seems that the following

More information

15-451/651: Design & Analysis of Algorithms October 11, 2018 Lecture #13: Linear Programming I last changed: October 9, 2018

15-451/651: Design & Analysis of Algorithms October 11, 2018 Lecture #13: Linear Programming I last changed: October 9, 2018 15-451/651: Design & Analysis of Algorithms October 11, 2018 Lecture #13: Linear Programming I last changed: October 9, 2018 In this lecture, we describe a very general problem called linear programming

More information

CS522: Advanced Algorithms

CS522: Advanced Algorithms Lecture 1 CS5: Advanced Algorithms October 4, 004 Lecturer: Kamal Jain Notes: Chris Re 1.1 Plan for the week Figure 1.1: Plan for the week The underlined tools, weak duality theorem and complimentary slackness,

More information

Recap, and outline of Lecture 18

Recap, and outline of Lecture 18 Recap, and outline of Lecture 18 Previously Applications of duality: Farkas lemma (example of theorems of alternative) A geometric view of duality Degeneracy and multiple solutions: a duality connection

More information

5. Lecture notes on matroid intersection

5. Lecture notes on matroid intersection Massachusetts Institute of Technology Handout 14 18.433: Combinatorial Optimization April 1st, 2009 Michel X. Goemans 5. Lecture notes on matroid intersection One nice feature about matroids is that a

More information

Outline: Finish uncapacitated simplex method Negative cost cycle algorithm The max-flow problem Max-flow min-cut theorem

Outline: Finish uncapacitated simplex method Negative cost cycle algorithm The max-flow problem Max-flow min-cut theorem Outline: Finish uncapacitated simplex method Negative cost cycle algorithm The max-flow problem Max-flow min-cut theorem Uncapacitated Networks: Basic primal and dual solutions Flow conservation constraints

More information

Lecture 4: Rational IPs, Polyhedron, Decomposition Theorem

Lecture 4: Rational IPs, Polyhedron, Decomposition Theorem IE 5: Integer Programming, Spring 29 24 Jan, 29 Lecture 4: Rational IPs, Polyhedron, Decomposition Theorem Lecturer: Karthik Chandrasekaran Scribe: Setareh Taki Disclaimer: These notes have not been subjected

More information

Submodularity Reading Group. Matroid Polytopes, Polymatroid. M. Pawan Kumar

Submodularity Reading Group. Matroid Polytopes, Polymatroid. M. Pawan Kumar Submodularity Reading Group Matroid Polytopes, Polymatroid M. Pawan Kumar http://www.robots.ox.ac.uk/~oval/ Outline Linear Programming Matroid Polytopes Polymatroid Polyhedron Ax b A : m x n matrix b:

More information

Graphs and Network Flows IE411. Lecture 21. Dr. Ted Ralphs

Graphs and Network Flows IE411. Lecture 21. Dr. Ted Ralphs Graphs and Network Flows IE411 Lecture 21 Dr. Ted Ralphs IE411 Lecture 21 1 Combinatorial Optimization and Network Flows In general, most combinatorial optimization and integer programming problems are

More information

EC 521 MATHEMATICAL METHODS FOR ECONOMICS. Lecture 2: Convex Sets

EC 521 MATHEMATICAL METHODS FOR ECONOMICS. Lecture 2: Convex Sets EC 51 MATHEMATICAL METHODS FOR ECONOMICS Lecture : Convex Sets Murat YILMAZ Boğaziçi University In this section, we focus on convex sets, separating hyperplane theorems and Farkas Lemma. And as an application

More information

Polyhedral Compilation Foundations

Polyhedral Compilation Foundations Polyhedral Compilation Foundations Louis-Noël Pouchet pouchet@cse.ohio-state.edu Dept. of Computer Science and Engineering, the Ohio State University Feb 15, 2010 888.11, Class #4 Introduction: Polyhedral

More information

Approximation Algorithms

Approximation Algorithms Approximation Algorithms Prof. Tapio Elomaa tapio.elomaa@tut.fi Course Basics A 4 credit unit course Part of Theoretical Computer Science courses at the Laboratory of Mathematics There will be 4 hours

More information

Material handling and Transportation in Logistics. Paolo Detti Dipartimento di Ingegneria dell Informazione e Scienze Matematiche Università di Siena

Material handling and Transportation in Logistics. Paolo Detti Dipartimento di Ingegneria dell Informazione e Scienze Matematiche Università di Siena Material handling and Transportation in Logistics Paolo Detti Dipartimento di Ingegneria dell Informazione e Scienze Matematiche Università di Siena Introduction to Graph Theory Graph Theory As Mathematical

More information

POLYHEDRAL GEOMETRY. Convex functions and sets. Mathematical Programming Niels Lauritzen Recall that a subset C R n is convex if

POLYHEDRAL GEOMETRY. Convex functions and sets. Mathematical Programming Niels Lauritzen Recall that a subset C R n is convex if POLYHEDRAL GEOMETRY Mathematical Programming Niels Lauritzen 7.9.2007 Convex functions and sets Recall that a subset C R n is convex if {λx + (1 λ)y 0 λ 1} C for every x, y C and 0 λ 1. A function f :

More information

Polyhedral Computation and their Applications. Jesús A. De Loera Univ. of California, Davis

Polyhedral Computation and their Applications. Jesús A. De Loera Univ. of California, Davis Polyhedral Computation and their Applications Jesús A. De Loera Univ. of California, Davis 1 1 Introduction It is indeniable that convex polyhedral geometry is an important tool of modern mathematics.

More information

A Comparative study on Algorithms for Shortest-Route Problem and Some Extensions

A Comparative study on Algorithms for Shortest-Route Problem and Some Extensions International Journal of Basic & Applied Sciences IJBAS-IJENS Vol: No: 0 A Comparative study on Algorithms for Shortest-Route Problem and Some Extensions Sohana Jahan, Md. Sazib Hasan Abstract-- The shortest-route

More information

CS675: Convex and Combinatorial Optimization Spring 2018 The Simplex Algorithm. Instructor: Shaddin Dughmi

CS675: Convex and Combinatorial Optimization Spring 2018 The Simplex Algorithm. Instructor: Shaddin Dughmi CS675: Convex and Combinatorial Optimization Spring 2018 The Simplex Algorithm Instructor: Shaddin Dughmi Algorithms for Convex Optimization We will look at 2 algorithms in detail: Simplex and Ellipsoid.

More information

NOTES ON COMBINATORIAL OPTIMIZATION

NOTES ON COMBINATORIAL OPTIMIZATION NOTES ON COMBINATORIAL OPTIMIZATION GEIR DAHL and CARLO MANNINO October 1, 01 Department of Mathematics and Department of Informatics, CMA, University of Oslo, Norway. geird@math.uio.no University of Rome,

More information

Approximation Algorithms: The Primal-Dual Method. My T. Thai

Approximation Algorithms: The Primal-Dual Method. My T. Thai Approximation Algorithms: The Primal-Dual Method My T. Thai 1 Overview of the Primal-Dual Method Consider the following primal program, called P: min st n c j x j j=1 n a ij x j b i j=1 x j 0 Then the

More information

New Directions in Linear Programming

New Directions in Linear Programming New Directions in Linear Programming Robert Vanderbei November 5, 2001 INFORMS Miami Beach NOTE: This is a talk mostly on pedagogy. There will be some new results. It is not a talk on state-of-the-art

More information

8 Matroid Intersection

8 Matroid Intersection 8 Matroid Intersection 8.1 Definition and examples 8.2 Matroid Intersection Algorithm 8.1 Definitions Given two matroids M 1 = (X, I 1 ) and M 2 = (X, I 2 ) on the same set X, their intersection is M 1

More information

Generalized Network Flow Programming

Generalized Network Flow Programming Appendix C Page Generalized Network Flow Programming This chapter adapts the bounded variable primal simplex method to the generalized minimum cost flow problem. Generalized networks are far more useful

More information

II. Linear Programming

II. Linear Programming II. Linear Programming A Quick Example Suppose we own and manage a small manufacturing facility that produced television sets. - What would be our organization s immediate goal? - On what would our relative

More information

CS599: Convex and Combinatorial Optimization Fall 2013 Lecture 14: Combinatorial Problems as Linear Programs I. Instructor: Shaddin Dughmi

CS599: Convex and Combinatorial Optimization Fall 2013 Lecture 14: Combinatorial Problems as Linear Programs I. Instructor: Shaddin Dughmi CS599: Convex and Combinatorial Optimization Fall 2013 Lecture 14: Combinatorial Problems as Linear Programs I Instructor: Shaddin Dughmi Announcements Posted solutions to HW1 Today: Combinatorial problems

More information

Algorithms for Integer Programming

Algorithms for Integer Programming Algorithms for Integer Programming Laura Galli November 9, 2016 Unlike linear programming problems, integer programming problems are very difficult to solve. In fact, no efficient general algorithm is

More information

ME 391Q Network Flow Programming

ME 391Q Network Flow Programming ME 9Q Network Flow Programming Final Exam, Summer 00. ( Points) The figure below shows an undirected network. The parameters on the edges are the edge lengths. Find the shortest path tree using Dijkstra

More information

Applied Lagrange Duality for Constrained Optimization

Applied Lagrange Duality for Constrained Optimization Applied Lagrange Duality for Constrained Optimization Robert M. Freund February 10, 2004 c 2004 Massachusetts Institute of Technology. 1 1 Overview The Practical Importance of Duality Review of Convexity

More information

Lecture 3. Corner Polyhedron, Intersection Cuts, Maximal Lattice-Free Convex Sets. Tepper School of Business Carnegie Mellon University, Pittsburgh

Lecture 3. Corner Polyhedron, Intersection Cuts, Maximal Lattice-Free Convex Sets. Tepper School of Business Carnegie Mellon University, Pittsburgh Lecture 3 Corner Polyhedron, Intersection Cuts, Maximal Lattice-Free Convex Sets Gérard Cornuéjols Tepper School of Business Carnegie Mellon University, Pittsburgh January 2016 Mixed Integer Linear Programming

More information

Solvers for Mixed Integer Programming /425 Declarative Methods - J. Eisner 1

Solvers for Mixed Integer Programming /425 Declarative Methods - J. Eisner 1 Solvers for Mixed Integer Programming 600.325/425 Declarative Methods - J. Eisner 1 Relaxation: A general optimization technique Want: x* = argmin x f(x) subject to x S S is the feasible set Start by getting:

More information

Lecture 4: Primal Dual Matching Algorithm and Non-Bipartite Matching. 1 Primal/Dual Algorithm for weighted matchings in Bipartite Graphs

Lecture 4: Primal Dual Matching Algorithm and Non-Bipartite Matching. 1 Primal/Dual Algorithm for weighted matchings in Bipartite Graphs CMPUT 675: Topics in Algorithms and Combinatorial Optimization (Fall 009) Lecture 4: Primal Dual Matching Algorithm and Non-Bipartite Matching Lecturer: Mohammad R. Salavatipour Date: Sept 15 and 17, 009

More information

Lecture 16 October 23, 2014

Lecture 16 October 23, 2014 CS 224: Advanced Algorithms Fall 2014 Prof. Jelani Nelson Lecture 16 October 23, 2014 Scribe: Colin Lu 1 Overview In the last lecture we explored the simplex algorithm for solving linear programs. While

More information