Introduction. Linear because it requires linear functions. Programming as synonymous of planning.
|
|
- Victoria Randall
- 5 years ago
- Views:
Transcription
1 LINEAR PROGRAMMING
2 Introduction Development of linear programming was among the most important scientific advances of mid-20th cent. Most common type of applications: allocate limited resources to competing activities in an optimal way. Very large and wide range of applications from local to very global ones. Linear programming uses a mathematical model. Linear because it requires linear functions. Programming as synonymous of planning. 31
3 Introduction Besides allocate resources to activities, any problem described by a mathematical model can be solved. Very efficient solution procedure: simplex method. This method will be described next as well as the interior-point algorithm for larger problems. Besides these algorithms, we will also discuss sensitivity analysis. 32
4 Prototype example Wyndor Glass Co. produces glass products, including windows and glass doors. Plant 1 produces aluminum frames, Plant 2 produces wood frames and Plant 3 produces glass and assembles. Two new products: Glass door with aluminum framing (Plant 1 and 3) New wood-framed glass window (Plant 2 and 3) As the products compete for Plant 3, the most profitable mix of the two products is needed. 33
5 Data for Wyndor Glass Co. Wyndor Glass Co. Product-Mix Problem Doors Windows Profit Per Batch $3.000 $5.000 (Batches of 20) Hours available per week Hours Used Per Batch Produced Plant Plant Plant
6 Formulation of the LP problem x 1 = number of batches of product 1 produced per week x 2 = number of batches of product 2 produced per week Z = total profit per week (in thousands) maximize Z 3x 5x 1 2 subject to x x 12 3x 2x 18 and x 0, x
7 Graphical solution Trial-and-error: Z = 10, 20, 36 Slope of the line is 3/5: 3 1 x2 x1 Z 5 5 Feasible region: satisfies all constraints and x 0, x
8 Solution (using Excel) Wyndor Glass Co. Product-Mix Problem Doors Windows Range Name Cells Profit Per Batch $3.000 $5.000 BatchesProduced C12:D12 Hours Hours HoursAvailable G7:G9 Hours Used Per Batch Produced Used Available HoursUsed E7:E9 Plant <= 4 HoursUsedPerBatchProduceC7:D9 Plant <= 12 ProfitPerBatch C4:D4 Plant <= 18 TotalProfit G12 Doors Windows Total Profit Batches Produced 2 6 $
9 Generalizing example Prototype example Production capacities of plants General problem Resources 3 plants m resources Production of products Activities 2 products n activities Production rate of product j, x j Profit Z Level of activity j, x j Overall measure of performance Z The most common type of LP application involves allocating resources to activities. 38
10 Linear programming model Z = value of overall performance measure x j = level of activity j, for j = 1, 2,, n. c j = parameters of Z related to x j. b j = amount of resource i that is available for allocation of activities, for i = 1, 2,, m. a ij = amount of resource i consumed by each unity of activity j. 39
11 Standard form maximize Zcx 1 1cx 2 2 cx n n subject to a x a x a x b n n 1 a x a x a x b n n 2 a x a x a x b m1 1 m2 2 mn n m and 0, 0,, 0. x1 x2 x n 40
12 Other possible forms Minimizing rather then maximizing minimize Zcxcx cx n n Some functional constraints are greater-than-or-equal ai1x1ai2x2 ainxn bi, for some values of i Some functional constraints in equation form ai1x1ai2x2 ainxn bi, for some values of i Deleting the non-negativity constraints for some vars x j unestricted in sign for some values of i 41
13 Allocation of resources to activities Resource Resource Usage per Unit of Activity Activity 1 2 n Amount of Resource available 1 a 11 a 12 a 1n b 1 2 a 21 a 22 a 2n b 2 m a m1 a m2 a mn b m Contribution to Z per unit of activity c 1 c 2 c n 42
14 Terminology for solutions Solution: any specification of values for the decision variables (x 1, x 2,, x n ). Feasible solution: solution for which all the constraints are satisfied. Infeasible solution: solution for which at least one constraint is violated. Feasible region No feasible solution: no solution satisfies all constraints. 43
15 Example: no feasible solution If in the Wyndor Glass Co. problem the profit should be above $50000 per week: 44
16 Terminology for solutions Optimal solution: solution with the most favorable value. Most favorable value: largest value if maximizing or smallest value if minimizing. No optimal solutions: (1) no feasible solutions or, (2) unbounded Z (see next slide). More than one solution: see next slide. 45
17 Examples of solutions More than one solution Unbounded cost function 46
18 Corner-point feasible solution Lies in a corner. Corners must have at least one optimal solution. 47
19 Assumptions of linear programming Proportionality: value of objective function Z is proportional to level of activity x j. Violations: 1) Setup costs 48
20 Violations of proportionality 2) Increase of marginal return due to economy of scale (longer production runs, quantity discounts, learning-curve effect, etc.) 49
21 Violations of proportionality 3) Decrease of marginal return due to e.g. marketing costs: to sell more the advertisement grows exponentially. 50
22 Assumptions of linear programming Additivity: every function in a linear programming model is the sum of the individual contributions. Divisibility: decision variables can have any values. If values are limited to integer values, the problem needs an integer programming model. Certainty: parameters of the model c j, a ij and b i are assumed to be known constants. In real applications parameters have always some degree of uncertainty, and sensitivity analysis must be conducted. 51
23 Conclusions Linear programming models can be solved using: Spreadsheet as Excel Solver for relatively simple problems Problems with thousands (or even millions!) of decision variables and/or functional constraints must use modeling languages such as: CPLEX/MDL or LINGO/LINDO Matlab Optimization Toolbox Linear programming solves many problems. However, when one or more assumptions are violated seriously, other programming techniques are needed. 52
24 SIMPLEX METHOD
25 Simplex method Algebraic procedure with underlying geometric concepts. Definitions: Constraint boundary: line of boundary of the constraint. Corner-point solution Corner-point feasible solution (CFP solution) CFP solutions are adjacent if they share n 1 constraint boundaries. The line segment between two CFP solutions is an edge. 54
26 Example revisited Wyndor Glass Co. 55
27 Optimality test Optimality test: consider LP with at least one optimal solution. If a CFP solution has no adjacent CFP solutions that are better, it must be an optimal solution. Adjacent CFP solutions for each CFP solution of Wyndor Glass Co. problem: CFP solution Its adjacent CFP solutions (0, 0) (0, 6) and (4, 0) (0, 6) (2, 6) and (0, 0) (2, 6) (4, 3) and (0, 6) (4, 3) (4, 0) and (2, 6) (4, 0) (0, 0) and (4, 3) 56
28 Solving the example Initialization: at CPF solution (0, 0). Optimality test: conclude that (0, 0) is not optimal Iteration 1: 1. Choose to move along the edge with faster rate (x 2 ) 2. Stop at new constraint boundary (2x 2 = 12) 3. Determine point of intersection of new set boundaries (0,6) Optimality test: conclude that (0, 6) is not optimal Iteration 2: repeat steps of iteration 1. CFP sol. (2,6) Optimality test: conclude that (2, 6) is optimal. Stop. 57
29 Steps of simplex algorithm Sequence of CFP solutions: 58
30 Setting up the simplex method Original form maximize Z 3x 5x subject to x 4 1 2x 12 3x 2x 18 and x 0, x Augmented form maximize Z 3x 5x subject to (1) x x 4 (2) 2x x 12 (3) 3x 2x x 18 and x 0, j 1,2,3,4,5. j Convert functional inequality constraints to equivalent equality constraints using slack variables. 59
31 Setting up the simplex method Augmented solution: solution with original variables (decision variables) and slack variables. Example: (3, 2, 1, 8, 5) Basic solution: augmented corner-point solution. Example (infeasible solution): (4, 6, 0, 0, 6) Basic feasible (BF) solution: augmented corner-point feasible solution. 60
32 Basic definitions Example problem has 5 variables and 3 non redundant equations, and 2 (5 3) degrees of freedom. Two variables have an arbitrary value. Simplex uses the zero value for these nonbasic variables. The solution for the other variables (basic variables) is a basic solution. Basic solutions have thus a number of properties. 61
33 Properties of a basic solution Each variable is basic or nonbasic. Number of basic variables is equal to number of functional constraints (equations). The nonbasic variables are set to zero. Values of basic variables are solving system of equations (functional constraints in augmented form). Set of basic variables are called the basis. If basic variables satisfy the nonnegativity constraints basic solution is a BF solution. 62
34 Final form maximize Z subject to (0) Z 3x 5x (1) x x (2) 2x x (3) 3x 2x x and x 0, j 1,,5. j 63
35 Tabular form (simplex tableau) (a) Algebraic form (b) Tabular Form Basic variable Eq. Coefficient of: Z x 1 x 2 x 3 x 4 x 5 Right side (0) Z 3x 1 5x 2 = 0 Z (0) (1) x 1 + x 3 = 4 x 3 (1) (2) 2x 2 + x 4 = 12 x 4 (2) (3) 3x 1 + 2x 2 + x 5 = 18 x 5 (3)
36 Simplex method in tabular form Initialization. Introduce slack variables. Select decision variables to be initial nonbasic variables and slack variables to be initial basic variables. Initial solution of example: (0, 0, 4, 12, 18) Optimality test. Current BF solution is optimal if every coefficient in row zero is nonnegative. If yes, stop. Example: coefficients of x 1 and x 2 are 3 and 5. 65
37 Simplex method in tabular form Iteration. Step 1: Determine entering basic variable, which is the nonbasic variable with the largest negative coefficient. pivot column entering basic variable Basic variable Eq. Coefficient of: Z x 1 x 2 x 3 x 4 x 5 Right side Z (0) x 3 (1) x 4 (2) x 5 (3)
38 Iteration Step 2: Determine leaving basic variable, by applying minimum ratio test: Basic variable Eq. Coefficient of: Z x 1 x 2 x 3 x 4 x 5 Right side Ratio Z (0) x 3 (1) x 4 (2) /2 = 6 minimum x 5 (3) /2 = 9 pivot number pivot row 67
39 Iteration Step 3: solve for the new BF solution by using elementary row operations. Iteration Basic variable Eq. Coefficient of: Z x 1 x 2 x 3 x 4 x 5 Right side Z (0) x 3 (1) x 4 (2) x 5 (3) Z (0) x 3 (1) x 2 (2) x 5 (3)
40 Iteration 2: Steps 1 and 2 Iteration Basic variable Eq. Coefficient of: Z x 1 x 2 x 3 x 4 x 5 Right side Ratio Z (0) x 3 (1) /1 = 4 x 2 (2) x 5 (3) /3 = 2 minimum 69
41 Complete set of simplex tableau Iteration Basic variable Eq. Coefficient of: Z x 1 x 2 x 3 x 4 x 5 Right side Z (0) x 3 (1) x 4 (2) x 5 (3) Z (0) x 3 (1) x 2 (2) x 5 (3) Z (0) x 3 (1) /3-1/3 2 x 2 (2) x 1 (3) /3 1/3 2 70
42 Other model forms Equality constraints In this case, artificial variables are used. The Big M method is used. Functional constraints in form Surplus variables are used. Minimization Maximize Z. Big M method can have two phases: 1) all artificial variables driven to zero; 2) compute BF solutions. 71
43 Postoptimality analysis Reoptimization: when the problem changes slightly, new solution is derived from the final simplex tableau. Shadow price for resource i (denoted y i* ) is the marginal value of i. i.e. the rate at which Z can be increased by slightly increasing the amount of this resource b i. Example: recall b i values of Wyndor Glass problem. The final tableau gives: y 1* = 0, y 2* = 1.5, y 3* = 1. 72
44 Graphical check Increasing b 2 in 1 unit, the new profit is
45 Shadow prices Increasing b 2 in 1 unit increases the profit in $1500. Should this be done? Depends on the marginal profitability of other products using that hour time. Shadow prices are part of the sensitivity analysis. Constraint on resource 1 is not binding the optimal solution. Resources as this are free goods. Constraints on resources 2 and 3 are binding constraints. Resources are scarce goods. 74
46 Sensitivity analysis Identify sensitive parameters (those that cannot be changed without changing optimal solution). Parameters b i can be analyzed using shadow prices. Parameters c i for Wyndor example (see figure in next slide). Parameters a ij can also be analyzed graphically. For problems with a large number of variables usually only b i and c i are analyzed, because a ij are determined by the technology being used. 75
47 Sensitivity analysis of parameters c i Graphical analysis of Wyndor example: c 1 = 3 can have values in [0, 7.5] without changing optimal c 2 = 5 can have any value greater than 2 without changing optimal 76
48 Interior-point approach Discovery made in 1984 by Narendra Karmarkar. Used in huge linear programming problems, beyond the scope of the simplex method. Starts by identifying a feasible trial solution, moving a better one until it reaches the optimal trial solution. Trial solutions are interior points. Interior-point or barrier algorithms (each constraint boundary is treated as a barrier). 77
49 Example The Wyndor Glass Co. example reaches the solution in 15 iterations for changes smaller than
50 Theory of simplex method Recall the standard form: maximize Zcx 1 1cx 2 2 cx n n subject to a x a x a x b n n 1 a x a x a x b n n 2 a x a x a x b m1 1 m2 2 mn n m x1 x2 x n and 0, 0,, 0. 79
51 Augmented form Z c x c x c x c x maximize 1 1 n n n1 n1 nm nm subject to a x a x a x x b n n n1 1 a x a x a x x b n n n2 2 a x a x a x x b m1 1 m2 2 mn n nm m and x 0, j 1,2,, m. j 80
52 Matrix form (standard form) maximize Z cx subject to Axb and x0 c [,,, ], c1 c2 c n x x x x 1 2 n, b b b b 1 2 m, 0 0 0, 0 A a a a a a a a a a n n m1 m2 mn. 81
53 Matrix augmented form Introduce the column vector of slack variables: x s x x x n1 n2 nm The constraints are (with I (mm) and 0 (1(n+m)) ): x x [ A, I] b and 0 xs xs 82
54 Solving for a BF solution One iteration of simplex: The n nonbasic variables are set to zero. The m basic variables is a column vector denoted as x B. The basic matrix B is obtained from [A, I], by eliminating the columns with coefficients of nonbasic variables. The problem becomes: Bx B = b. The solution for basic variables and the value of the objective function for this basic solution are: x B b and Z c x c B b 1 1 B B B B 83
55 Revised simplex method 1. Initialization: (as original) Introduce slack variables x s. Decision variables are initial nonbasic variables. 2. Iteration: Step 1: (as original) Determine entering basic variable (nonbasic variable with the largest negative coefficient). Step 2: Determine leaving basic variable. As original, but computations are simplified. Step 3: Determine new BF solution: set x B = B 1 b. 3. Optimality test: solution is optimal if every coefficient in Z is 0. Computations are simplified. 84
56 DUALITY THEORY AND SENSITIVITY ANALYSIS
57 Duality theory Every linear programming problem (primal) has a dual problem. Most problem parameters are estimates, others (as resource amounts) represent managerial decisions. The choice of parameter values is made based on a sensitivity analysis. Interpretation and implementation of sensitivity analysis are key uses of duality theory. 86
58 Primal and dual problems Primal problem Dual problem maximize Z subject to n j1 n cx j j1 a x b, for i 1,2,, m ij j i and x 0 for j 1,2,, n. j j minimize W subject to m i1 m by i i1 a y c, for j 1,2,, n ij i j and y 0 for i 1,2,, m. i i 87
59 Duality theory Relations between parameters: The coefficients of the objective functions of the primal are the right-hand sides of the functional constraints in the dual. The right-hand side of the functional constraints in the primal are coefficients of the objective functions in the dual. The coefficients of a variable in the functional constraints of the primal are the coefficients in the functional constraints of the dual. 88
60 Primal-dual table Primal problem Coefficient of: x 1 x 2 x n Right side Coefficient of: y 1 a 11 a 12 a 1n b 1 y 2 a 21 a 22 a 2n b 2 y m a n1 a n2 a mn b m Right side Coefficients of objective function (minimize) Dual problem c 1 c 2 c n Coefficients of objective function (maximize) 89
61 Example: Wyndor Glass Co. Primal problem Maximize Z subject to x x , x x x 0 x and. Dual problem 4 Minimize Z y 1 y2 y 3 12, subject to 18 y y y y y y and
62 Example: Wyndor Glass Co. Tableau representation x 1 x 2 y y y
63 Primal-dual relationships Weak duality property: If x is a feasible solution for the primal problem and y is a feasible solution for the dual problem, then cx yb Strong duality property: If x * is an optimal solution for the primal problem and y * is an optimal solution for the dual problem, then cx * = y * b 92
64 Primal-dual relationships Complementary solutions property: At each iteration, the simplex method identifies a CFP solution x for the primal problem and a complementary solution for the dual problem, where cx = yb If x is not optimal for the primal problem, then y is not feasible for the dual problem. 93
65 Primal-dual relationships Complementary optimal solutions property: At the final iteration, the simplex method identifies an optimal solution x* for the primal problem and a complementary optimal solution y* for the dual problem, where cx* = y*b The y i * are the shadow prices for the primal problem. 94
66 Primal-dual relationships Symmetry property: For any primal problem and its dual problem, all relationships between them must be symmetric because the dual of this dual problem is this primal problem. Duality theorem: The following are the only possible relationships between the primal and dual problems: 95
67 Primal-dual relationships 1. If one problem has feasible solutions and a bounded objective function, then so does the other problem, so both the weak and strong duality properties are applicable. 2. If one problem has feasible solutions and an unbounded objective function, then the other problem has no feasible solution. 3. If one problem has no feasible solutions, then the other problem has either no feasible solutions or an unbounded objective function. 96
68 Primal-dual relationships Relationships between complementary basic solutions Primal basic solution Complementary dual basic solution Both basic solutions Primal feasible? Dual feasible? Suboptimal Superoptimal Yes No Optimal Optimal Yes Yes Superoptimal Suboptimal No Yes Neither feasible nor superoptimal Neither feasible nor superoptimal No No 97
69 Primal-dual relationships 98
70 Applications of duality theory If the number of functional constraints m is bigger than the number of variables n, applying simplex directly to the dual problem will achieve a substantial reduction in computational effort. Evaluating a proposed solution for the primal problem. i) if cx = yb, x and y must be optimal even without applying simplex; ii) if cx < yb, yb provides an upper bound on the optimal value of Z. Economic interpretation as before 99
71 Duality theory in sensitivity analysis Sensitivity analysis investigate the effect of changing parameters a ij, b i, c j in the optimal solution. Can be easier to study these effects in the dual problem Optimal solution of the dual problem are the shadow prices of the primal problem. Changes in coefficients of a nonbasic variable. Only changes one constraint in the dual problem. If this constraint is satisfied the solution is still optimal. Introducing a new variable in the objective function. Only introduces a new constraint in the dual problem. If the dual problem is still feasible, solution is still optimal. 100
72 Essence of sensitivity analysis LP assumes that all the parameters of the model (a ij, b i and c j ) are known constants. Actually: The parameters values used are just estimates based on a prediction of future conditions; The data may represent deliberate overestimates or underestimates to protect the interests of the estimators. An optimal solution is optimal only with respect to the specific model being used to represent the real problem fi sensitivity analysis is crucial! 101
73 Simplex tableau with parameter changes What changes in the simplex tableau if changes are made in the model parameters, namely bfi b, cfi c, Afi A? New initial tableau Coefficient of: Eq. Z Original variables Slack variables Right side (0) 1 c 0 0 (1,2,,m) 0 A I b Revised final tableau (0) 1 z* cy* Ac y* (1,2,,m) 0 A* S* A S* Z* y* b b* S* b 102
74 Applying sensitivity analysis Changes in b: Allowable range: range of values for which the current optimal BF solution remains feasible (find range of b i such that b* S* b0, assuming this is the only change in the model). The shadow price for b i remains valid if b i stays within this interval. The 100% rule for simultaneous changes in right-hand side: the shadow prices remain valid as long as the changes are not too large. If the sum of the % changes does not exceed 100%, the shadow prices will still be valid. 103
75 Applying sensitivity analysis Changes in coefficients of nonbasic variable: Allowable range to stay optimal: range of values over which the current optimal solution remains optimal (find c j y* A j, assuming this is the only change in the model). The 100% rule for simultaneous changes in objective function coefficients: if the sum of the % changes does not exceed 100%, the original optimal solution will still be valid. Introduction of a new variable: Same as above. 104
76 Other simplex algorithms Dual simplex method Modification useful for sensitivity analysis Parametric linear programming Extension for systematic sensitivity analysis Upper bound technique A simplex version for dealing with decision variables having upper bounds: x j u j, where u j is the maximum feasible value of x j. 105
Linear Programming. Linear programming provides methods for allocating limited resources among competing activities in an optimal way.
University of Southern California Viterbi School of Engineering Daniel J. Epstein Department of Industrial and Systems Engineering ISE 330: Introduction to Operations Research - Deterministic Models Fall
More informationRead: H&L chapters 1-6
Viterbi School of Engineering Daniel J. Epstein Department of Industrial and Systems Engineering ISE 330: Introduction to Operations Research Fall 2006 (Oct 16): Midterm Review http://www-scf.usc.edu/~ise330
More informationLinear programming II João Carlos Lourenço
Decision Support Models Linear programming II João Carlos Lourenço joao.lourenco@ist.utl.pt Academic year 2012/2013 Readings: Hillier, F.S., Lieberman, G.J., 2010. Introduction to Operations Research,
More informationISE203 Optimization 1 Linear Models. Dr. Arslan Örnek Chapter 4 Solving LP problems: The Simplex Method SIMPLEX
ISE203 Optimization 1 Linear Models Dr. Arslan Örnek Chapter 4 Solving LP problems: The Simplex Method SIMPLEX Simplex method is an algebraic procedure However, its underlying concepts are geometric Understanding
More informationSome Advanced Topics in Linear Programming
Some Advanced Topics in Linear Programming Matthew J. Saltzman July 2, 995 Connections with Algebra and Geometry In this section, we will explore how some of the ideas in linear programming, duality theory,
More information5. DUAL LP, SOLUTION INTERPRETATION, AND POST-OPTIMALITY
5. DUAL LP, SOLUTION INTERPRETATION, AND POST-OPTIMALITY 5.1 DUALITY Associated with every linear programming problem (the primal) is another linear programming problem called its dual. If the primal involves
More informationAM 121: Intro to Optimization Models and Methods Fall 2017
AM 121: Intro to Optimization Models and Methods Fall 2017 Lecture 10: Dual Simplex Yiling Chen SEAS Lesson Plan Interpret primal simplex in terms of pivots on the corresponding dual tableau Dictionaries
More informationOther Algorithms for Linear Programming Chapter 7
Other Algorithms for Linear Programming Chapter 7 Introduction The Simplex method is only a part of the arsenal of algorithms regularly used by LP practitioners. Variants of the simplex method the dual
More informationAdvanced Operations Research Techniques IE316. Quiz 2 Review. Dr. Ted Ralphs
Advanced Operations Research Techniques IE316 Quiz 2 Review Dr. Ted Ralphs IE316 Quiz 2 Review 1 Reading for The Quiz Material covered in detail in lecture Bertsimas 4.1-4.5, 4.8, 5.1-5.5, 6.1-6.3 Material
More informationLinear Programming Problems
Linear Programming Problems Two common formulations of linear programming (LP) problems are: min Subject to: 1,,, 1,2,,;, max Subject to: 1,,, 1,2,,;, Linear Programming Problems The standard LP problem
More informationIntroduction to Mathematical Programming IE496. Final Review. Dr. Ted Ralphs
Introduction to Mathematical Programming IE496 Final Review Dr. Ted Ralphs IE496 Final Review 1 Course Wrap-up: Chapter 2 In the introduction, we discussed the general framework of mathematical modeling
More informationOptimization of Design. Lecturer:Dung-An Wang Lecture 8
Optimization of Design Lecturer:Dung-An Wang Lecture 8 Lecture outline Reading: Ch8 of text Today s lecture 2 8.1 LINEAR FUNCTIONS Cost Function Constraints 3 8.2 The standard LP problem Only equality
More informationChapter II. Linear Programming
1 Chapter II Linear Programming 1. Introduction 2. Simplex Method 3. Duality Theory 4. Optimality Conditions 5. Applications (QP & SLP) 6. Sensitivity Analysis 7. Interior Point Methods 1 INTRODUCTION
More informationAdvanced Operations Research Techniques IE316. Quiz 1 Review. Dr. Ted Ralphs
Advanced Operations Research Techniques IE316 Quiz 1 Review Dr. Ted Ralphs IE316 Quiz 1 Review 1 Reading for The Quiz Material covered in detail in lecture. 1.1, 1.4, 2.1-2.6, 3.1-3.3, 3.5 Background material
More informationSection Notes 5. Review of Linear Programming. Applied Math / Engineering Sciences 121. Week of October 15, 2017
Section Notes 5 Review of Linear Programming Applied Math / Engineering Sciences 121 Week of October 15, 2017 The following list of topics is an overview of the material that was covered in the lectures
More information5 The Theory of the Simplex Method
5 The Theory of the Simplex Method Chapter 4 introduced the basic mechanics of the simplex method. Now we shall delve a little more deeply into this algorithm by examining some of its underlying theory.
More informationArtificial Intelligence
Artificial Intelligence Combinatorial Optimization G. Guérard Department of Nouvelles Energies Ecole Supérieur d Ingénieurs Léonard de Vinci Lecture 1 GG A.I. 1/34 Outline 1 Motivation 2 Geometric resolution
More informationSimulation. Lecture O1 Optimization: Linear Programming. Saeed Bastani April 2016
Simulation Lecture O Optimization: Linear Programming Saeed Bastani April 06 Outline of the course Linear Programming ( lecture) Integer Programming ( lecture) Heuristics and Metaheursitics (3 lectures)
More informationChapter 7. Linear Programming Models: Graphical and Computer Methods
Chapter 7 Linear Programming Models: Graphical and Computer Methods To accompany Quantitative Analysis for Management, Eleventh Edition, by Render, Stair, and Hanna Power Point slides created by Brian
More informationIntroduction to Operations Research
- Introduction to Operations Research Peng Zhang April, 5 School of Computer Science and Technology, Shandong University, Ji nan 5, China. Email: algzhang@sdu.edu.cn. Introduction Overview of the Operations
More informationSection Notes 4. Duality, Sensitivity, and the Dual Simplex Algorithm. Applied Math / Engineering Sciences 121. Week of October 8, 2018
Section Notes 4 Duality, Sensitivity, and the Dual Simplex Algorithm Applied Math / Engineering Sciences 121 Week of October 8, 2018 Goals for the week understand the relationship between primal and dual
More informationOutline. CS38 Introduction to Algorithms. Linear programming 5/21/2014. Linear programming. Lecture 15 May 20, 2014
5/2/24 Outline CS38 Introduction to Algorithms Lecture 5 May 2, 24 Linear programming simplex algorithm LP duality ellipsoid algorithm * slides from Kevin Wayne May 2, 24 CS38 Lecture 5 May 2, 24 CS38
More informationBCN Decision and Risk Analysis. Syed M. Ahmed, Ph.D.
Linear Programming Module Outline Introduction The Linear Programming Model Examples of Linear Programming Problems Developing Linear Programming Models Graphical Solution to LP Problems The Simplex Method
More informationIntroduction to Linear Programming. Chapter 3: Hillier and Lieberman Chapter 3: Decision Tools for Agribusiness Dr. Hurley s AGB 328 Course
Introduction to Linear Programming Chapter 3: Hillier and Lieberman Chapter 3: Decision Tools for Agribusiness Dr Hurley s AGB 328 Course Terms to Know Simplex Method, Feasible Region, Slope- Intercept
More information16.410/413 Principles of Autonomy and Decision Making
16.410/413 Principles of Autonomy and Decision Making Lecture 17: The Simplex Method Emilio Frazzoli Aeronautics and Astronautics Massachusetts Institute of Technology November 10, 2010 Frazzoli (MIT)
More informationLinear Programming: Basic Concepts. Chapter 2: Hillier and Hillier
Linear Programming: Basic Concepts Chapter 2: Hillier and Hillier Agenda Define Linear Programming The Case of the Wyndor Glass Co. A Maximization Problem Developing a Mathematical Representation of Wyndor
More informationLinear Programming. L.W. Dasanayake Department of Economics University of Kelaniya
Linear Programming L.W. Dasanayake Department of Economics University of Kelaniya Linear programming (LP) LP is one of Management Science techniques that can be used to solve resource allocation problem
More informationControlling Air Pollution. A quick review. Reclaiming Solid Wastes. Chapter 4 The Simplex Method. Solving the Bake Sale problem. How to move?
ESE Operations Research 9// Controlling Air Pollution Technology can be use fully () or fractional thereof A quick review ESE Operations Research Reclaiming Solid Wastes Chapter The Simple Method ESE Operations
More informationChapter 15 Introduction to Linear Programming
Chapter 15 Introduction to Linear Programming An Introduction to Optimization Spring, 2015 Wei-Ta Chu 1 Brief History of Linear Programming The goal of linear programming is to determine the values of
More informationPart 4. Decomposition Algorithms Dantzig-Wolf Decomposition Algorithm
In the name of God Part 4. 4.1. Dantzig-Wolf Decomposition Algorithm Spring 2010 Instructor: Dr. Masoud Yaghini Introduction Introduction Real world linear programs having thousands of rows and columns.
More informationChap5 The Theory of the Simplex Method
College of Management, NCTU Operation Research I Fall, Chap The Theory of the Simplex Method Terminology Constraint oundary equation For any constraint (functional and nonnegativity), replace its,, sign
More informationGeorge B. Dantzig Mukund N. Thapa. Linear Programming. 1: Introduction. With 87 Illustrations. Springer
George B. Dantzig Mukund N. Thapa Linear Programming 1: Introduction With 87 Illustrations Springer Contents FOREWORD PREFACE DEFINITION OF SYMBOLS xxi xxxiii xxxvii 1 THE LINEAR PROGRAMMING PROBLEM 1
More information4.1 The original problem and the optimal tableau
Chapter 4 Sensitivity analysis The sensitivity analysis is performed after a given linear problem has been solved, with the aim of studying how changes to the problem affect the optimal solution In particular,
More informationLinear and Integer Programming :Algorithms in the Real World. Related Optimization Problems. How important is optimization?
Linear and Integer Programming 15-853:Algorithms in the Real World Linear and Integer Programming I Introduction Geometric Interpretation Simplex Method Linear or Integer programming maximize z = c T x
More informationDM545 Linear and Integer Programming. Lecture 2. The Simplex Method. Marco Chiarandini
DM545 Linear and Integer Programming Lecture 2 The Marco Chiarandini Department of Mathematics & Computer Science University of Southern Denmark Outline 1. 2. 3. 4. Standard Form Basic Feasible Solutions
More informationMathematical and Algorithmic Foundations Linear Programming and Matchings
Adavnced Algorithms Lectures Mathematical and Algorithmic Foundations Linear Programming and Matchings Paul G. Spirakis Department of Computer Science University of Patras and Liverpool Paul G. Spirakis
More informationLinear Programming. Course review MS-E2140. v. 1.1
Linear Programming MS-E2140 Course review v. 1.1 Course structure Modeling techniques Linear programming theory and the Simplex method Duality theory Dual Simplex algorithm and sensitivity analysis Integer
More informationCSC 8301 Design & Analysis of Algorithms: Linear Programming
CSC 8301 Design & Analysis of Algorithms: Linear Programming Professor Henry Carter Fall 2016 Iterative Improvement Start with a feasible solution Improve some part of the solution Repeat until the solution
More informationCivil Engineering Systems Analysis Lecture XV. Instructor: Prof. Naveen Eluru Department of Civil Engineering and Applied Mechanics
Civil Engineering Systems Analysis Lecture XV Instructor: Prof. Naveen Eluru Department of Civil Engineering and Applied Mechanics Today s Learning Objectives Sensitivity Analysis Dual Simplex Method 2
More informationINEN 420 Final Review
INEN 420 Final Review Office Hours: Mon, May 2 -- 2:00-3:00 p.m. Tues, May 3 -- 12:45-2:00 p.m. (Project Report/Critiques due on Thurs, May 5 by 5:00 p.m.) Tuesday, April 28, 2005 1 Final Exam: Wednesday,
More informationLinear Optimization. Andongwisye John. November 17, Linkoping University. Andongwisye John (Linkoping University) November 17, / 25
Linear Optimization Andongwisye John Linkoping University November 17, 2016 Andongwisye John (Linkoping University) November 17, 2016 1 / 25 Overview 1 Egdes, One-Dimensional Faces, Adjacency of Extreme
More informationSetup and graphical solution of Linear Programming Problems [2-variables] Mathematical Programming Characteristics
Setup and graphical solution of Linear Programming Problems [2-variables] Mathematical Programming Characteristics Decisions must be made on the levels of a two or more activities. The levels are represented
More informationLesson 08 Linear Programming
Lesson 08 Linear Programming A mathematical approach to determine optimal (maximum or minimum) solutions to problems which involve restrictions on the variables involved. 08 - Linear Programming Applications
More informationIntroduction to Linear Programming
Introduction to Linear Programming Eric Feron (updated Sommer Gentry) (updated by Paul Robertson) 16.410/16.413 Historical aspects Examples of Linear programs Historical contributor: G. Dantzig, late 1940
More informationCivil Engineering Systems Analysis Lecture XIV. Instructor: Prof. Naveen Eluru Department of Civil Engineering and Applied Mechanics
Civil Engineering Systems Analysis Lecture XIV Instructor: Prof. Naveen Eluru Department of Civil Engineering and Applied Mechanics Today s Learning Objectives Dual 2 Linear Programming Dual Problem 3
More informationMATHEMATICS II: COLLECTION OF EXERCISES AND PROBLEMS
MATHEMATICS II: COLLECTION OF EXERCISES AND PROBLEMS GRADO EN A.D.E. GRADO EN ECONOMÍA GRADO EN F.Y.C. ACADEMIC YEAR 2011-12 INDEX UNIT 1.- AN INTRODUCCTION TO OPTIMIZATION 2 UNIT 2.- NONLINEAR PROGRAMMING
More informationIntroduction to Operations Research Prof. G. Srinivasan Department of Management Studies Indian Institute of Technology, Madras
Introduction to Operations Research Prof. G. Srinivasan Department of Management Studies Indian Institute of Technology, Madras Module - 05 Lecture - 24 Solving LPs with mixed type of constraints In the
More informationTuesday, April 10. The Network Simplex Method for Solving the Minimum Cost Flow Problem
. Tuesday, April The Network Simplex Method for Solving the Minimum Cost Flow Problem Quotes of the day I think that I shall never see A poem lovely as a tree. -- Joyce Kilmer Knowing trees, I understand
More informationIntroduction to Operations Research Prof. G. Srinivasan Department of Management Studies Indian Institute of Technology, Madras
Introduction to Operations Research Prof. G. Srinivasan Department of Management Studies Indian Institute of Technology, Madras Module 03 Simplex Algorithm Lecture - 03 Tabular form (Minimization) In this
More informationCopyright 2007 Pearson Addison-Wesley. All rights reserved. A. Levitin Introduction to the Design & Analysis of Algorithms, 2 nd ed., Ch.
Iterative Improvement Algorithm design technique for solving optimization problems Start with a feasible solution Repeat the following step until no improvement can be found: change the current feasible
More informationMLR Institute of Technology
Course Name : Engineering Optimization Course Code : 56021 Class : III Year Branch : Aeronautical Engineering Year : 2014-15 Course Faculty : Mr Vamsi Krishna Chowduru, Assistant Professor Course Objective
More informationSolutions for Operations Research Final Exam
Solutions for Operations Research Final Exam. (a) The buffer stock is B = i a i = a + a + a + a + a + a 6 + a 7 = + + + + + + =. And the transportation tableau corresponding to the transshipment problem
More information4 LINEAR PROGRAMMING (LP) E. Amaldi Fondamenti di R.O. Politecnico di Milano 1
4 LINEAR PROGRAMMING (LP) E. Amaldi Fondamenti di R.O. Politecnico di Milano 1 Mathematical programming (optimization) problem: min f (x) s.t. x X R n set of feasible solutions with linear objective function
More informationFarming Example. Lecture 22. Solving a Linear Program. withthe Simplex Algorithm and with Excel s Solver
Lecture 22 Solving a Linear Program withthe Simplex Algorithm and with Excel s Solver m j winter, 2 Farming Example Constraints: acreage: x + y < money: x + 7y < 6 time: x + y < 3 y x + y = B (, 8.7) x
More informationVARIANTS OF THE SIMPLEX METHOD
C H A P T E R 6 VARIANTS OF THE SIMPLEX METHOD By a variant of the Simplex Method (in this chapter) we mean an algorithm consisting of a sequence of pivot steps in the primal system using alternative rules
More informationTRANSPORTATION AND ASSIGNMENT PROBLEMS
TRANSPORTATION AND ASSIGNMENT PROBLEMS Transportation problem Example P&T Company produces canned peas. Peas are prepared at three canneries (Bellingham, Eugene and Albert Lea). Shipped by truck to four
More informationMarginal and Sensitivity Analyses
8.1 Marginal and Sensitivity Analyses Katta G. Murty, IOE 510, LP, U. Of Michigan, Ann Arbor, Winter 1997. Consider LP in standard form: min z = cx, subject to Ax = b, x 0 where A m n and rank m. Theorem:
More informationCSE 40/60236 Sam Bailey
CSE 40/60236 Sam Bailey Solution: any point in the variable space (both feasible and infeasible) Cornerpoint solution: anywhere two or more constraints intersect; could be feasible or infeasible Feasible
More informationISE 203 OR I. Chapter 3 Introduction to Linear Programming. Asst. Prof. Dr. Nergiz Kasımbeyli
ISE 203 OR I Chapter 3 Introduction to Linear Programming Asst. Prof. Dr. Nergiz Kasımbeyli 1 Linear Programming 2 An Example 3 The Data Gathered 4 Definition of the Problem Determine what the production
More informationIntroduction to Linear Programming. Algorithmic and Geometric Foundations of Optimization
Introduction to Linear Programming Algorithmic and Geometric Foundations of Optimization Optimization and Linear Programming Mathematical programming is a class of methods for solving problems which ask
More informationOPERATIONS RESEARCH. Linear Programming Problem
OPERATIONS RESEARCH Chapter 1 Linear Programming Problem Prof. Bibhas C. Giri Department of Mathematics Jadavpur University Kolkata, India Email: bcgiri.jumath@gmail.com 1.0 Introduction Linear programming
More informationUNIT 2 LINEAR PROGRAMMING PROBLEMS
UNIT 2 LINEAR PROGRAMMING PROBLEMS Structure 2.1 Introduction Objectives 2.2 Linear Programming Problem (LPP) 2.3 Mathematical Formulation of LPP 2.4 Graphical Solution of Linear Programming Problems 2.5
More informationNOTATION AND TERMINOLOGY
15.053x, Optimization Methods in Business Analytics Fall, 2016 October 4, 2016 A glossary of notation and terms used in 15.053x Weeks 1, 2, 3, 4 and 5. (The most recent week's terms are in blue). NOTATION
More informationLinear programming and duality theory
Linear programming and duality theory Complements of Operations Research Giovanni Righini Linear Programming (LP) A linear program is defined by linear constraints, a linear objective function. Its variables
More informationGeneralized Network Flow Programming
Appendix C Page Generalized Network Flow Programming This chapter adapts the bounded variable primal simplex method to the generalized minimum cost flow problem. Generalized networks are far more useful
More informationLecture notes on Transportation and Assignment Problem (BBE (H) QTM paper of Delhi University)
Transportation and Assignment Problems The transportation model is a special class of linear programs. It received this name because many of its applications involve determining how to optimally transport
More informationUnit.9 Integer Programming
Unit.9 Integer Programming Xiaoxi Li EMS & IAS, Wuhan University Dec. 22-29, 2016 (revised) Operations Research (Li, X.) Unit.9 Integer Programming Dec. 22-29, 2016 (revised) 1 / 58 Organization of this
More information5.4 Pure Minimal Cost Flow
Pure Minimal Cost Flow Problem. Pure Minimal Cost Flow Networks are especially convenient for modeling because of their simple nonmathematical structure that can be easily portrayed with a graph. This
More informationII. Linear Programming
II. Linear Programming A Quick Example Suppose we own and manage a small manufacturing facility that produced television sets. - What would be our organization s immediate goal? - On what would our relative
More informationDiscrete Optimization. Lecture Notes 2
Discrete Optimization. Lecture Notes 2 Disjunctive Constraints Defining variables and formulating linear constraints can be straightforward or more sophisticated, depending on the problem structure. The
More informationDiscuss mainly the standard inequality case: max. Maximize Profit given limited resources. each constraint associated to a resource
Sensitivity Analysis Discuss mainly the standard inequality case: ma s.t. n a i, z n b, i c i,, m s.t.,,, n ma Maimize Profit given limited resources each constraint associated to a resource Alternate
More informationAdvanced Operations Research Prof. G. Srinivasan Department of Management Studies Indian Institute of Technology, Madras
Advanced Operations Research Prof. G. Srinivasan Department of Management Studies Indian Institute of Technology, Madras Lecture 16 Cutting Plane Algorithm We shall continue the discussion on integer programming,
More informationLinear Programming. Meaning of Linear Programming. Basic Terminology
Linear Programming Linear Programming (LP) is a versatile technique for assigning a fixed amount of resources among competing factors, in such a way that some objective is optimized and other defined conditions
More informationCHAPTER 11: BASIC LINEAR PROGRAMMING CONCEPTS
Linear programming is a mathematical technique for finding optimal solutions to problems that can be expressed using linear equations and inequalities. If a real-world problem can be represented accurately
More informationUsing the Simplex Method to Solve Linear Programming Maximization Problems J. Reeb and S. Leavengood
PERFORMANCE EXCELLENCE IN THE WOOD PRODUCTS INDUSTRY EM 8720-E October 1998 $3.00 Using the Simplex Method to Solve Linear Programming Maximization Problems J. Reeb and S. Leavengood A key problem faced
More informationGraphing Linear Inequalities in Two Variables.
Many applications of mathematics involve systems of inequalities rather than systems of equations. We will discuss solving (graphing) a single linear inequality in two variables and a system of linear
More informationLinear Programming Terminology
Linear Programming Terminology The carpenter problem is an example of a linear program. T and B (the number of tables and bookcases to produce weekly) are decision variables. The profit function is an
More informationMath Introduction to Operations Research
Math 300 Introduction to Operations Research Examination (50 points total) Solutions. (6 pt total) Consider the following linear programming problem: Maximize subject to and x, x, x 3 0. 3x + x + 5x 3
More informationLinear Programming has been used to:
Linear Programming Linear programming became important during World War II: used to solve logistics problems for the military. Linear Programming (LP) was the first widely used form of optimization in
More informationLinear Programming. Readings: Read text section 11.6, and sections 1 and 2 of Tom Ferguson s notes (see course homepage).
Linear Programming Learning Goals. Introduce Linear Programming Problems. Widget Example, Graphical Solution. Basic Theory: Feasible Set, Vertices, Existence of Solutions. Equivalent formulations. Outline
More informationLinear Programming. Widget Factory Example. Linear Programming: Standard Form. Widget Factory Example: Continued.
Linear Programming Widget Factory Example Learning Goals. Introduce Linear Programming Problems. Widget Example, Graphical Solution. Basic Theory:, Vertices, Existence of Solutions. Equivalent formulations.
More informationThe Simplex Algorithm
The Simplex Algorithm Uri Feige November 2011 1 The simplex algorithm The simplex algorithm was designed by Danzig in 1947. This write-up presents the main ideas involved. It is a slight update (mostly
More informationChapter 2 An Introduction to Linear Programming
Chapter 2 An Introduction to Linear Programming MULTIPLE CHOICE 1. The maximization or minimization of a quantity is the a. goal of management science. b. decision for decision analysis. c. constraint
More informationHeuristic Optimization Today: Linear Programming. Tobias Friedrich Chair for Algorithm Engineering Hasso Plattner Institute, Potsdam
Heuristic Optimization Today: Linear Programming Chair for Algorithm Engineering Hasso Plattner Institute, Potsdam Linear programming Let s first define it formally: A linear program is an optimization
More informationGraphical Analysis. Figure 1. Copyright c 1997 by Awi Federgruen. All rights reserved.
Graphical Analysis For problems with 2 variables, we can represent each solution as a point in the plane. The Shelby Shelving model (see the readings book or pp.68-69 of the text) is repeated below for
More informationThe Islamic University of Gaza Faculty of Commerce Quantitative Analysis - Dr. Samir Safi Midterm #2-28/4/2014
The Islamic University of Gaza Faculty of Commerce Quantitative Analysis - Dr. Samir Safi Midterm #2-28/4/2014 Name TRUE/FALSE. Write 'T' if the statement is true and 'F' if the statement is false. 1)
More informationLinear Programming. them such that they
Linear Programming l Another "Sledgehammer" in our toolkit l Many problems fit into the Linear Programming approach l These are optimization tasks where both the constraints and the objective are linear
More informationGraphs that have the feasible bases of a given linear
Algorithmic Operations Research Vol.1 (2006) 46 51 Simplex Adjacency Graphs in Linear Optimization Gerard Sierksma and Gert A. Tijssen University of Groningen, Faculty of Economics, P.O. Box 800, 9700
More informationHossein Arsham Johns Hopkins University, USA M. Bardossy University of Baltimore, USA D. K. Sharma University of Baltimore, USA This chapter provides a critical overview of Linear Programming (LP) from
More informationCS 473: Algorithms. Ruta Mehta. Spring University of Illinois, Urbana-Champaign. Ruta (UIUC) CS473 1 Spring / 36
CS 473: Algorithms Ruta Mehta University of Illinois, Urbana-Champaign Spring 2018 Ruta (UIUC) CS473 1 Spring 2018 1 / 36 CS 473: Algorithms, Spring 2018 LP Duality Lecture 20 April 3, 2018 Some of the
More informationFull file at https://fratstock.eu. Linear Programming Models: Graphical and Computer Methods
Chapter 2: Linear Programming Models: Graphical and Computer Methods Multiple Choice 1. Consider the following linear programming model: Max X 1 2 + X 2 + 3X 3 X 1 + X 2 3 X 1 + X 2 1 This problem violates
More informationPrepared By. Handaru Jati, Ph.D. Universitas Negeri Yogyakarta.
Prepared By Handaru Jati, Ph.D Universitas Negeri Yogyakarta handaru@uny.ac.id Chapter 8 Using The Excel Solver To Solve Mathematical Programs Chapter Overview 8.1 Introduction 8.2 Formulating Mathematical
More informationChapter 3: Towards the Simplex Method for Efficient Solution of Linear Programs
Chapter 3: Towards the Simplex Method for Efficient Solution of Linear Programs The simplex method, invented by George Dantzig in 1947, is the basic workhorse for solving linear programs, even today. While
More informationCMPSCI611: The Simplex Algorithm Lecture 24
CMPSCI611: The Simplex Algorithm Lecture 24 Let s first review the general situation for linear programming problems. Our problem in standard form is to choose a vector x R n, such that x 0 and Ax = b,
More information3. The Simplex algorithmn The Simplex algorithmn 3.1 Forms of linear programs
11 3.1 Forms of linear programs... 12 3.2 Basic feasible solutions... 13 3.3 The geometry of linear programs... 14 3.4 Local search among basic feasible solutions... 15 3.5 Organization in tableaus...
More informationLinear Programming Motivation: The Diet Problem
Agenda We ve done Greedy Method Divide and Conquer Dynamic Programming Network Flows & Applications NP-completeness Now Linear Programming and the Simplex Method Hung Q. Ngo (SUNY at Buffalo) CSE 531 1
More informationAMATH 383 Lecture Notes Linear Programming
AMATH 8 Lecture Notes Linear Programming Jakob Kotas (jkotas@uw.edu) University of Washington February 4, 014 Based on lecture notes for IND E 51 by Zelda Zabinsky, available from http://courses.washington.edu/inde51/notesindex.htm.
More information4 Linear Programming (LP) E. Amaldi -- Foundations of Operations Research -- Politecnico di Milano 1
4 Linear Programming (LP) E. Amaldi -- Foundations of Operations Research -- Politecnico di Milano 1 Definition: A Linear Programming (LP) problem is an optimization problem: where min f () s.t. X n the
More informationFinite Math Linear Programming 1 May / 7
Linear Programming Finite Math 1 May 2017 Finite Math Linear Programming 1 May 2017 1 / 7 General Description of Linear Programming Finite Math Linear Programming 1 May 2017 2 / 7 General Description of
More informationTribhuvan University Institute Of Science and Technology Tribhuvan University Institute of Science and Technology
Tribhuvan University Institute Of Science and Technology Tribhuvan University Institute of Science and Technology Course Title: Linear Programming Full Marks: 50 Course No. : Math 403 Pass Mark: 17.5 Level
More information