A COMPUTATIONAL STUDY OF THE CUTTING PLANE TREE ALGORITHM FOR GENERAL MIXED-INTEGER LINEAR PROGRAMS

Size: px
Start display at page:

Download "A COMPUTATIONAL STUDY OF THE CUTTING PLANE TREE ALGORITHM FOR GENERAL MIXED-INTEGER LINEAR PROGRAMS"

Transcription

1 A COMPUTATIONAL STUDY OF THE CUTTING PLANE TREE ALGORITHM FOR GENERAL MIXED-INTEGER LINEAR PROGRAMS BINYUAN CHEN, SİMGE KÜÇÜKYAVUZ, AND SUVRAJEET SEN Abstract. The cutting plane tree (CPT) algorithm provides a finite disjunctive programming procedure to obtain the solution of general mixed-integer linear programs (MILP) with bounded integer variables. In this paper, we present our computational experience with variants of the CPT algorithm. Because the CPT algorithm is based on discovering multi-term disjunctions, this paper is the first to present computational results with multi-term disjunctions. We implement two variants for cut generation using alternative normalization schemes. Our results demonstrate that even a preliminary implementation of the CPT algorithm (with either normalization) is able to close a significant portion of the integrality gap without resorting to branch-and-cut. As a by-product of our experiments, we also conclude that one of the cut generation schemes (namely minimizing the l 1 norm of cut coefficients) appears to have an edge over the other. Key words: Mixed-integer programming, disjunctive programming, cutting planes. 1. Introduction This work constitutes a follow-on to a recent paper (Chen et al., 2009) in which the authors settled several questions related to finite convergence of cutting plane algorithms that use disjunctive cuts for mixed-integer linear programs with general integer variables (MILP-G). The main algorithmic issue that was settled was an answer to the following question: If we are restricted to introducing only one (disjunctive) valid inequality in any iteration, is there a finitely convergent pure cutting plane algorithm that solves MILP-G? The main construct developed to answer this question affirmatively is the notion of a cutting plane tree (CPT). The CPT represents an adaptive sequence of disjunctions involving multiple variables, and is able to discover the convex hull (closure) of any instance of a bounded MILP-G, without having to specify an a priori hierarchy. This characterization is a generalization of the sequential convexification process of Balas (1979) for MILP with binary variables (MILP-B). However, it is important to note that the same sequential process of convexification (one variable at a time) does not yield the convex hull of MILP-G in finitely many steps (Owen and Mehrotra, 2001). Prior to this, Date: September 14, Binyuan Chen: Department of Systems and Industrial Engineering, University of Arizona, Tucson, AZ 85721, USA. bychen@ .arizona.edu. Simge Küçükyavuz: Department of Integrated Systems Engineering, The Ohio State University, Columbus, OH 43210, USA. kucukyavuz.2@osu.edu. Supported, in part, by NSF-CMMI Grant Suvrajeet Sen: (corresponding author) Department of Integrated Systems Engineering, The Ohio State University, Columbus, OH 43210, USA. sen.22@osu.edu. Supported, in part, AFOSR grant FA

2 2 BINYUAN CHEN, SİMGE KÜÇÜKYAVUZ, AND SUVRAJEET SEN Cook et al. (1990) showed non-convergence for MILP-G using split disjunctions, and even in the case of MILP-B, Sen and Sherali (1985) presented examples of non-convergence in which facet inequalities of two-term (simple) disjunctions are derived to cut away the solution to the most recent LP relaxation. Chen et al. (2009) use the CPT algorithm to solve the above instances in finitely many iterations. In this sense, the CPT algorithm has the algorithmic power to discern important disjunctions during the course of a cutting plane scheme. In the current paper, we pursue the next logical question: does the algorithmic power of CPT translate into superior computational performance? Since our goal is to investigate the effectiveness of CPT, we will focus on a pure cutting plane algorithm (i.e., no branch-and-cut). Given that there is no computational experience with multi-term disjunctions, this study also provides the first glimpse at the computational potential of using multi-term disjunctions. The only study that we are aware of is the paper by Perregaard and Balas (2001) in which they studied the computational time required to solve a cut generation LP (CGLP) with 2 k -term disjunctions representing all possible combinations of k 0-1 variables. They report computational experience with alternative values of k = 1,..., 4, and alternative solution algorithms for CGLP. However, their study was not intended to investigate the performance of multi-term disjunctions for solving MILP-G. Despite the recent explosion of computational experiments using disjunctive programming (Balas and Bonami, 2009, Balas and Saxena, 2008, Bonami and Minoux, 2005, Fischetti et al., 2009), there is a clear paucity of computational experience with multi-term disjunctions to solve MILPs, let alone, flexible disjunctions of the type generated by the CPT algorithm. In this paper, we investigate whether the cuts generated by the CPT algorithm have the power to close a significant portion of the optimality gap between the LP relaxation and the MILP optimum. Although environments like CPLEX and COIN-OR allow the use of a variety of other cuts, we will switch off all such options, thus testing only the CPT algorithm as a pure cutting plane algorithm. Thus, the current paper is embarking on a preliminary exploration of computations with the CPT process, which if promising, will provide the impetus for more streamlined computational software in the future. Our computational results show that a CPT algorithm can make significant progress towards closing the integrality gap for moderately large MILP instances from MIPLIB 3.0. These results are obtained using two variants, and for each of these, we report that the average gap closure is significant (54% and 61% respectively) within an hour of computing. This paper begins with a brief presentation of the CPT algorithm in Section 2. Following this background, Section 3 provides a discussion of the computer implementation, the experimental setting, and the computational results. In Section 4, we examine these results in connection with those that have appeared in the literature and based on this assessment, we recommend future research directions. 2. Cutting Plane Tree Algorithm Consider a mixed-integer linear program stated as min x X {c x X = {Ax b, x Z n 1 + Rn n 1 + }},

3 A COMPUTATIONAL STUDY OF THE CUTTING PLANE TREE ALGORITHM 3 where the first n 1 components of x are required to be integers. The set obtained by relaxing the integrality requirements of X is denoted by X L. Let all integer variables be bounded with x j [0, u j ] for all j = 1,..., n 1, where u j could be. Assuming that u j < for all j = 1,..., n 1, Chen et al. (2009) showed that the CPT algorithm is finitely convergent for a version that introduced one disjunctive cut in any iteration. Our computational experiments are carried out with a slight generalization in which multiple cuts are generated using those variables that are fractional in any iteration. This approach, which results in a round of cuts has become standard for computational experiments with lift-and-project cuts (Balas et al., 1996, Bonami and Minoux, 2005) as well as Gomory cuts with multiple source rows. In the cutting plane tree (CPT), T, there is a single root node o. For each node σ T, an integer m σ keeps track of the cutting planes that will be used to generate a disjunctive cut when this node is revisited, an integer v σ {1, 2,..., n 1 } stores the index of the integer variable that is split, and an integer q σ stores the (lower) level of the splitting. Let l σ, r σ and p σ denote links to the left child, right child and parent nodes of node σ, respectively. Let S(σ) be all nodes on the subtree rooted at node σ (not including node σ). Let N (σ) be the collection of the nodes on the path from the root node to node σ (not including the root node), let N (σ) be the collection of each node in N (σ) that is the left child node of its parent and let N + (σ) be the collection of each node in N (σ) that is the right child node of its parent. Given σ T define C σ = {x x j [0, u j ], j = 1,..., n 1, x vps q ps, s N (σ), x vps q ps + 1, s N + (σ)}. Let L k+1 denote the collection of all leaf nodes of the cutting plane tree at iteration k. Let L(t) be the set of leaf nodes on subtree rooted at node t. Let φ k be the number of disjunctive cuts generated until iteration k, hence the number of disjunctive cuts generated in iteration k is φ k+1 φ k. We let m σ store an iteration index, which gives the set X mσ to be used in the cut generation linear program (CGLP) (Balas, 1979, Sherali and Shetty, 1980). The set X k corresponds to X L together with the first φ k cuts added to it. If X k C lσ = (X k C rσ = ), we say that the left (right) child node of σ is fathomed, i.e., l σ = null (r σ = null). The pseudo-code of the cutting plane tree algorithm with rounds of cuts is given in Algorithm 1. At iteration k, if the current extreme point solution to min x Xk c x, given by x k is integral, then we have found the optimal solution to MILP-G. Otherwise, we search the cutting plane tree, to find the last node σ on the path from the root node such that x k C σ. There are two cases: Case (1) σ is a leaf node (σ L k ), Case (2) σ is not a leaf node (σ L k, x k C σ, x k C lσ and x k C rσ ). In Case (1), for each fractional variable x j, let the split variable be v σ = j. We create two new nodes: left (l σ ) and right (r σ ) children of σ at the split level q σ = x k j. We let C j l σ = {x C σ x j x k j } and Cj r σ = {x C σ x j x k j } and create an updated list of leaf nodes, L j k+1 that includes Cj l σ (Cr j σ ), unless C j l σ X k = (Cr j σ X k = ). In this case, we also let m σ = k, as this is the first time the tree search for a fractional solution stops at node σ. In Case (2), the cutting plane tree and m σ are unchanged. However, in this case, we update m t = k for all successors of σ, t S(σ). We generate a valid inequality for the set clconv{ t L j (X mσ C j t )} k+1 that cuts off x k (using CGLP). We describe the CGLP in greater detail in Section 2.1. The new

4 4 BINYUAN CHEN, SİMGE KÜÇÜKYAVUZ, AND SUVRAJEET SEN valid inequalities generated for each fractional x j, j {1,..., n 1 } are included along with those defining X k, and the resulting set is denoted by X k+1. This process continues until the stopping criterion is satisfied. Comparing the pseudo-code presented in Algorithm 1 with that presented in Chen et al. (2009), the differences are due to the implementation of the rounds of cuts in line 18 and lines The for loop in line 18 lets us generate multiple cuts. Lines 5 12 perform a specific tree management rule, which creates two new nodes in the CPT emanating from the current node σ, provided that one of the fractional variables x j that was used to form a disjunction in the previous iteration (k 1) is integral in iteration k. The split level is q σ = x k 1 j. In effect, the expansion of the tree is delayed until one round of cuts renders a fractional variable integral. Algorithm 1 Cutting plane tree algorithm 1: Initialization: k = 1, create a node o, where p o = null, m o = 1, φ k = 0. Let T = {o}, L k := {o} and C o = {x x j [0, u j ], j = 1,..., n 1 }. Also let X k = X L C o and x k arg min x Xk c T x, where x k is a vertex of X k. 2: while X k and x k j Z for some j {1,..., n 1} do 3: Search for node σ T such that: either σ L k and x k C σ ; or, node σ L k and x k C σ, x k C lσ and x k C rσ. 4: if σ L k then 5: if j = 1,..., n 1 with x k 1 j Z and x k j Z then 6: Let v σ = j, m σ = k, L k+1 L k \ {σ}. 7: Form disjunction(x k, T, L k+1, σ, j, x k 1 ). 8: if x k j q σ then 9: σ l σ. 10: else 11: σ r σ. 12: end if 13: end if 14: else if σ L k and x k C σ, x k C lσ and x k C rσ then 15: Let L k+1 L k, let m t k, t S(σ). 16: end if 17: φ k+1 = φ k, X k+1 X k. 18: for all j = 1,..., n 1 such that x k j Z do 19: Let σ j σ, v σj = j, q σj = x k j, T j T, L k j L k+1, L j k+1 Lj k \ L(σ j). 20: Form disjunction(x k, T j, L j k+1, σ j, j, x k ). 21: Generate a valid inequality for the set clconv{ t L j (X mσ C t )} that cuts off x k (using k+1 CGLP). Append this valid inequality to the set X k+1. Increment φ k+1. 22: end for 23: Let k k + 1. Let x k arg min x Xk c x, where x k is a vertex of X k. 24: end while

5 A COMPUTATIONAL STUDY OF THE CUTTING PLANE TREE ALGORITHM 5 Algorithm 2 function: Form disjunction (X, T, L, σ, j, x) 1: Create a node l with l σ = l, p l = σ and a node l + with r σ = l +, p l + = σ. 2: Let C l = {x C σ x j x j } and C l + = {x C σ x j x j }. 3: if C l X then 4: Let L L {l }. Let T T {l }. 5: else 6: Let l = null (fathom). 7: end if 8: if C l + X then 9: Let L L {l + }. Let T T {l + }. 10: else 11: Let l + = null (fathom). 12: end if 2.1. Cut Generation. Let x k C σ be the fractional solution at iteration k. For fractional variable x k j, j {1,..., n 1}, define the sets X m C j t = {x A mx b m, L t x U t } for t L j k+1, where A m, b m are the cut-enhanced matrix and right-hand-side vector of MILP-G, with m = m σ. Let the multipliers used in the CGLP be {λ t, µ t, ν t } t L j, where λ t corresponds to the vector of k+1 multipliers associated with A m x b m, and µ t, ν t denote the vectors of multipliers for the lower and upper bound constraints, L t x U t, respectively. The CGLP has the form: (1) (2) (3) (4) max π 0 π x k s.t. π = λ t A m + µ t ν t t L j k+1 π 0 λ t b m + µ t L t νt U t t L j k+1 (λ, µ, ν) 0. The optimal solution to the CGLP yields an inequality π x π 0 valid for X that cuts off x k. The feasible set defined by (2) (4) is a cone, and its extreme rays correspond to valid inequalities including all facets of the disjunctive program at hand. To truncate the feasible set and obtain a bounded solution, various normalization constraints have been studied in the literature (Balas, 1979, Balas and Bonami, 2009, Balas and Perregaard, 2002, Cadoux, 2010, Cornuéjols and Lemaréchal, 2006, Fischetti et al., 2009, Rey and Sagastizábal, 2002). The introduction of the normalization constraint may generate extreme points of CGLP that do not correspond to facets of the convex hull (closure) of the disjunctive set. The computational results presented in Balas et al. (1996), Fischetti et al. (2009), Balas and Bonami (2009), as well as the results summarized in Section 3, show that the choice of normalization has some impact on the performance and stability of the algorithm. Recognizing this, we experiment with two alternatives, although others are clearly possible (Balas and Bonami, 2009, Fischetti et al., 2009). (1) Weighted Cut Coefficients (WCC). This normalization constraint is a variant of that of Balas and Perregaard (2002), with w π = 1, where w = ˆx x k, and ˆx is some feasible solution to clconv{ t L j (X mσ C j t )}. In contrast to this choice of ˆx, Bonami and k+1

6 6 BINYUAN CHEN, SİMGE KÜÇÜKYAVUZ, AND SUVRAJEET SEN Minoux (2005) use a mixed-integer feasible solution to X. Since the latter would require our experiments to use either a pre-processing function, or a branch-and-cut algorithm, we modified the recommendation of Balas and Perregaard (2002) to one that fits more naturally in the CPT algorithm. In our implementation, we choose ˆx to be an optimal extreme point of either X k C j l σ or X k Cr j σ, whichever gives a better bound. As shown in Balas and Perregaard (2002), including the constraint w π = 1 to (1) (4) renders the CGLP objective bounded. (2) Minimum 1-Norm Cut (M1NC) Another way to ensure that the CGLP is bounded is to translate the coordinates to the point x k, and then to find a minimum norm hyperplane that separates the origin from the closure of the convex hull of the disjunctive set. As a result, such cuts may be referred to as deep cuts (Cornuéjols and Lemaréchal, 2006, Cadoux, 2010, Rey and Sagastizábal, 2002). As one can recognize, this idea can be traced back to the very origins of optimization, i.e., separating hyperplane theorems. However, care must be taken to implement such ideas in a computationally effective way. It turns out that the choice of the norm used in defining the projection is critical to the success of a computer implementation of the CGLP. Computational experiments reported in Cadoux (2010) suggest that cuts which minimize the l 2 norm do not lead to an effective computational approach. We have confirmed this conclusion in our own experiments. One of the normalizations that we report in Section 3 is based on choosing cut coefficients that minimize the l 1 norm. The resulting CGLP in the translated space, at iteration k for fractional variable x k j, j {1,..., n 1}, is (5) (6) (7) (8) min n j=1 π j s.t. π = λ t A m + µ t ν t t L j k+1 λ t b k m + µ t L k t νt Ut k 1 t L j k+1 (λ, µ, ν) 0 where b k m = b m A m x k, L k t = L t x k and U k t = U t x k. The cut that we obtain is π (x x k ) 1. For the sake of completeness, Appendix A presents the duality between the projection of the origin on to the convex hull (closure) of a disjunctive set using the l norm, and a cut with minimum l 1 norm. 3. Computations with the Cutting Plane Tree Algorithm In this section, we present the first computational study with the CPT algorithm. Since this algorithm creates multi-term disjunctions on-the-fly, it also constitutes the first experiment involving multi-term disjunctions for MILP-G. Our results show that even a preliminary implementation of the CPT algorithm is able to obtain significant reduction in the integrality gap in many of the mixed-integer instances in MIPLIB. As the cutting plane tree algorithm is developed for MILP-G, we tested it on mixed-integer instances in MIPLIB 3.0 (Bixby et al., 1996) that have less than 1000 variables (as in Bonami and Minoux (2005)). In addition, we exclude the

7 A COMPUTATIONAL STUDY OF THE CUTTING PLANE TREE ALGORITHM 7 Table 1. CPT - alternative normalizations. WCC M1NC Problem n # Z # B time cuts N T % gapcl time cuts N T % gapcl egout set1ch pp08a dcmulti bell pp08acuts gen vpm vpm modglob bell3a fixnet rgn blend qiu flugpl mas rout danoint markshare markshare pk instance noswot which does not have an integrality gap and the instance mas74 which results in numerical difficulties. In Table 1, we report our computational experiments using CPT with multiple cuts per iteration (one for each fractional variable). We compare the two normalization variants (WCC and M1NC) as described in Section 2.1. For each instance, we report the total number of variables (n), the number of general integer variables (#Z) and the number of 0-1 variables (#B). In addition, for each normalization, we report the solution time (in seconds), the number of cuts added, the total number of CPT nodes (N), the number of leaf nodes (disjunctions) in CPT at termination (T ), and the percentage gap closed, respectively. The asterisk in some entries under the WCC normalization indicate numerical difficulties that cause early termination. All computations are done on a 3.2 GHz Sun workstation with 4 GB RAM, under 3600 CPU seconds time limit. Because the implementation delegates cut generation to the LP solver, we are not able to enforce the time limit very strictly during cut generation. In all but one instance (bell3a), the run time is at most a few minutes over the time limit. It is quite remarkable that for several of these instances, both implementations of CPT are able to close more than 90% of the integrality gap with a pure cutting plane approach (especially

8 8 BINYUAN CHEN, SİMGE KÜÇÜKYAVUZ, AND SUVRAJEET SEN for bell5 which contains general integer variables). Overall, the average percentage gap improvements are 53.7% and 61.2%, for the WCC and M1NC normalizations, respectively. For over 20% of the test instances (highlighted in bold), there is over 15% increase in the gap improvement using the M1NC normalization compared with the WCC normalization. In particular, for qiu the M1NC normalization provides an additional 40% gap improvement within the same time limit. On the other hand, for instances dcmulti and rout, the WCC normalization provides about 10% gap improvement over the M1NC normalization. We also observe that markshare1, markshare2 and pk1 are hard instances for which Bonami and Minoux (2005), Balas and Saxena (2008), Balas and Bonami (2009) and Fischetti et al. (2009) also report 0% gap closure. If these instances are excluded, the average percentage gap improvements rise to 62.2% and 70.8%, for the WCC and M1NC normalizations, respectively. It should be noted that, M1NC is relatively stable, presenting numerical instability in only one of the instances, namely mas74 (not reported). Based on the above criteria (average gap closure within an hour of computing, and numerical stability), M1NC is clearly the normalization of choice. Table 1 also demonstrates that for moderately sized instances (e.g., less than 1000 variables), the number of disjunctions explored in the CPT is far less than the worst case (full expansion of integer variables), and for such instances, ordinary LP solvers may suffice for cut generation. Moreover, the guidance provided by the objective function and intermediate fractional solutions help limit the number of leaf nodes explored by the CPT algorithm, and does not come close to its worst case bound. 4. Connections with the Literature and Conclusions Over the past 15 years, computations using disjunctive cuts (Balas, 1979) have appeared in a variety of contexts. The first successful implementation of a special case of disjunctive cuts for 0-1 MILP within a branch-and-cut framework, known as the lift-and-project cuts (Balas et al., 1993), is described in Balas et al. (1996). Lift-and-project cuts rely on two-term (simple) disjunctions of the form x k 0 or x k 1, for some binary variable x k. Balas and Perregaard (2002) provide a survey on the recent progress with lift-and-project cuts for 0-1 MILP. In addition, they propose a new normalization constraint for the cut generation linear program (CGLP) of the lift-and-project cuts. Balas and Perregaard (2003) show that lift-and-project cuts from simple disjunctions can be obtained directly from the simplex tableau of the linear programming (LP) relaxation, without solving a larger CGLP. Bonami and Minoux (2005) provide a computational study on the strength of rank-1 lift-and-project cuts and the elementary lift-and-project closure for 0-1 MILP. They conclude that rank-1 lift-and-project cuts are useful in closing a high integrality gap in some instances of MIPLIB 3.0 (Bixby et al., 1996) even when only one round of these cuts is added. The case for MILP with general integers (MILP-G) has not been as well understood, even when the integer variables are bounded. While pure integer programming can be shown to have a finite representation using Gomory cuts (Gomory, 1963), the same is not true for MILP- G, unless the optimal objective function value is known to be integral. Adams and Sherali (2005) provided a generalization of the RLT methodology to the case of MILP-G problems

9 A COMPUTATIONAL STUDY OF THE CUTTING PLANE TREE ALGORITHM 9 using Lagrange Interpolation Polynomials to compute the bound factors in the RLT process. To the best of our knowledge, there are no computational experiments with this method. For MILP-G, Balas and Saxena (2008) report computational experiments on optimizing over the elementary split closure. Split cuts are obtained from disjunctions that are more general than the simple variable disjunctions, namely α x 1 β or α x 1 β+1, where (α, β) Z n1+1 and x 1 is the vector of integer variables. Despite the generality of the split disjunction, Cook et al. (1990) provide an example to show that the split rank of a MILP-G could be infinite. Furthermore, the separation of split cuts is shown to be N P-hard (Caprara and Letchford, 2003). In their computational study, Balas and Saxena (2008) solve a parametric integer program to generate a violated split cut. While the rank-1 split cuts seem to close a high percentage (about 72%) on average, the computational effort required for their separation is excessive (several hours/days) for most of the test instances. Finally, Zanette et al. (2008) implement Gomory s fractional cutting plane algorithm (Gomory, 1963), which is finitely convergent for MILP-Gs when the optimal objective function value is integral. They test the method on pure ILPs from MIPLIB instances and report that an average of about 40% gap can be closed on these instances within an hour time limit. Compared with previous computational results with cutting plane methods for MILP-G, the gap closure due to the multi-term disjunctive cuts provided by the CPT algorithm is significant (60% within an hour). The bottleneck however, is the solution of CGLP in the extended space. Although the number of disjunctions used for cut generation (T ) is moderate in all instances of Table 1, the overall solution time exceeds one hour. More research is necessary to develop methods to solve large-scale CGLPs arising from multi-term disjunctions effectively. The method proposed in Perregaard and Balas (2001), Balas and Bonami (2009) to solve the CGLP in the original space of the variables works specifically for the case of simple variable disjunctions. In contrast to the CPT, which discovers the multi-term disjunction to be used, Perregaard and Balas (2001) investigate cut generation for a fixed number of terms in a multi-term disjunction. They provide computational results which suggest that Benders decomposition algorithm is faster in generating a fixed number of cuts than solving a large-scale CGLP when there are more than two disjunctions in a CGLP. Nevertheless, the experiments reported in Perregaard and Balas (2001) were not intended to test the effectiveness of multi-term disjunctions in solving MILP-G instances. In this sense, our results are unique for pure cutting plane methods using multi-term disjunctions. Finally, the proposed cutting plane method would work best in a branch-and-cut framework. We are currently exploring these research questions. References Adams, W. P. and Sherali, H. D. (2005). A hierarchy of relaxations leading to the convex hull representation for general discrete optimization problems. Annals of Operations Research, 140(1): Balas, E. (1979). Disjunctive programming. Annals of Discrete Mathematics, 5:3 51. Balas, E. and Bonami, P. (2009). Generating lift-and-project cuts from the LP simplex tableau: open source implementation and testing of new variants. Mathematical Programming Computation, 1:

10 10 BINYUAN CHEN, SİMGE KÜÇÜKYAVUZ, AND SUVRAJEET SEN Balas, E., Ceria, S., and Cornuéjols, G. (1993). A lift-and-project cutting plane algorithm for mixed 0-1 programs. Mathematical Programming, 58: Balas, E., Ceria, S., and Cornuéjols, G. (1996). Mixed 0-1 programming by lift-and-project in a branch-and-cut framework. Management Science, 42(9): Balas, E. and Perregaard, M. (2002). Lift-and-project for mixed 0-1 programming: recent progress. Discrete Applied Mathematics, 123: Balas, E. and Perregaard, M. (2003). A precise correspondence between lift-and-project cuts, simple disjunctive cuts, and mixed integer Gomory cuts for 0-1 programming. Mathematical Programming, 94: Balas, E. and Saxena, A. (2008). Optimizing over the split closure. Mathematical Programming, 113: Bixby, R. E., Ceria, S., McZeal, C. M., and Savelsbergh, M. W. P. (1996). An updated mixed integer linear programming library: MIPLIB bixby/miplib/miplib.html. Bonami, P. and Minoux, M. (2005). Using rank-1 lift-and-project closures to generate cuts for 0-1 MIPs, a computational investigation. Discrete Optimization, 2: Cadoux, F. (2010). Computing deep facet-defining cuts for mixed-integer programming. Mathematical Programming, 122: Caprara, A. and Letchford, A. (2003). On the separation of split cuts and related inequalities. Mathematical Programming, 94: Chen, B., Küçükyavuz, S., and Sen, S. (2009). Finite disjunctive programming characterizations for general mixed-integer linear programs. Optimization Online, HTML/2009/08/2382.html, forthcoming in Operations Research. Cook, W., Kannan, R., and Schrijver, A. (1990). Chvátal closures for mixed integer programming problems. Mathematical Programming, 47: Cornuéjols, G. and Lemaréchal, C. (2006). A convex-analysis perspective on disjunctive cuts. Mathematical Programming, 106: Fischetti, M., Lodi, A., and Tramontani, A. (2009). On the separation of disjunctive cuts. forthcoming in Mathematical Programming. Gomory, R. E. (1963). An algorithm for integer solutions to linear programs. In Graves, P. and Wolfe, P., editors, Recent Advances in Mathematical Programming, pages McGraw- Hill, New York. Owen, J. H. and Mehrotra, S. (2001). A disjunctive cutting plane procedure for general mixedinteger linear programs. Mathematical Programming, 89: Perregaard, M. and Balas, E. (2001). Generating cuts from multiple-term disjunctions. In Proceedings of the 8th International IPCO Conference on Integer Programming and Combinatorial Optimization, pages , London, UK. Springer-Verlag. Rey, P. A. and Sagastizábal, C. A. (2002). Convex normalizations in lift-and-project methods for 0-1 programming. Annals of Operations Research, 116: Sen, S. and Sherali, H. D. (1985). On the convergence of cutting plane algorithms for a class of nonconvex mathematical programs. Mathematical Programming, 31:42 56.

11 A COMPUTATIONAL STUDY OF THE CUTTING PLANE TREE ALGORITHM 11 Sherali, H. D. and Shetty, C. M. (1980). Optimization with Disjunctive Constraints. Springer Verlag, Berlin. Zanette, A., Fischetti, M., and Balas, E. (2008). Can pure cutting plane algorithms work? In Proceedings of IPCO 2008, pages , London, UK. Springer-Verlag. Appendix A. The minimum l 1 norm CGLP For a fractional variable x k j, j {1,..., n 1}, consider the CGLP (in the translated space) that maximizes the violation, subject to an upper bound constraint on the l 1 norm of the cut coefficients: (9) (10) (11) (12) (13) (14) (15) max π 0 π 0 s.t. π = λ t A m + µ t ν t t L j k+1 π 0 λ t b k m µ t L k t + νt Ut k 0 t L j k+1 n i=1 α i = 1 π α π α (λ, µ, ν, α) 0. Because of the positive homogeneity of the the cut generation (set valued) mapping (Cornuéjols and Lemaréchal, 2006, Cadoux, 2010), this CGLP gives a cut π (x x k ) π 0, which is an optimum to M1NC up to a positive scalar multiple. Let y, z, η, y +, y be the dual multipliers of the constraints (10) (14) in that order. Then the dual problem is: min η s.t. η y + i y i 0 i = 1,..., n y + y t L j y t = 0 k+1 A m y t b k mz t 0 t L j k+1 y t L k t z t 0 t L j k+1 y t + Ut k z t 0 t L j k+1 z t = 1 t L j k+1 (y +, y, z) 0. This is the problem of projecting the origin on to the disjunctive set under the l norm, and hence the resulting cut is the deepest cut as measured by the l norm.

FINITE DISJUNCTIVE PROGRAMMING CHARACTERIZATIONS FOR GENERAL MIXED-INTEGER LINEAR PROGRAMS

FINITE DISJUNCTIVE PROGRAMMING CHARACTERIZATIONS FOR GENERAL MIXED-INTEGER LINEAR PROGRAMS FINITE DISJUNCTIVE PROGRAMMING CHARACTERIZATIONS FOR GENERAL MIXED-INTEGER LINEAR PROGRAMS BINYUAN CHEN, SİMGE KÜÇÜKYAVUZ, SUVRAJEET SEN Abstract. In this paper, we give a finite disjunctive programming

More information

Combining Lift-and-Project and Reduce-and-Split

Combining Lift-and-Project and Reduce-and-Split Combining Lift-and-Project and Reduce-and-Split Egon Balas Tepper School of Business, Carnegie Mellon University, PA Email: eb17@andrew.cmu.edu Gérard Cornuéjols Tepper School of Business, Carnegie Mellon

More information

Experiments On General Disjunctions

Experiments On General Disjunctions Experiments On General Disjunctions Some Dumb Ideas We Tried That Didn t Work* and Others We Haven t Tried Yet *But that may provide some insight Ted Ralphs, Serdar Yildiz COR@L Lab, Department of Industrial

More information

From final point cuts to!-polyhedral cuts

From final point cuts to!-polyhedral cuts AUSSOIS 2017 From final point cuts to!-polyhedral cuts Egon Balas, Aleksandr M. Kazachkov, François Margot Tepper School of Business, Carnegie Mellon University Overview Background Generalized intersection

More information

3 INTEGER LINEAR PROGRAMMING

3 INTEGER LINEAR PROGRAMMING 3 INTEGER LINEAR PROGRAMMING PROBLEM DEFINITION Integer linear programming problem (ILP) of the decision variables x 1,..,x n : (ILP) subject to minimize c x j j n j= 1 a ij x j x j 0 x j integer n j=

More information

On the selection of Benders cuts

On the selection of Benders cuts Mathematical Programming manuscript No. (will be inserted by the editor) On the selection of Benders cuts Matteo Fischetti Domenico Salvagnin Arrigo Zanette Received: date / Revised 23 February 2010 /Accepted:

More information

Constraint Branching and Disjunctive Cuts for Mixed Integer Programs

Constraint Branching and Disjunctive Cuts for Mixed Integer Programs Constraint Branching and Disunctive Cuts for Mixed Integer Programs Constraint Branching and Disunctive Cuts for Mixed Integer Programs Michael Perregaard Dash Optimization Constraint Branching and Disunctive

More information

Stable sets, corner polyhedra and the Chvátal closure

Stable sets, corner polyhedra and the Chvátal closure Stable sets, corner polyhedra and the Chvátal closure Manoel Campêlo Departamento de Estatística e Matemática Aplicada, Universidade Federal do Ceará, Brazil, mcampelo@lia.ufc.br. Gérard Cornuéjols Tepper

More information

Split-Cuts and the Stable Set Polytope of Quasi-Line Graphs

Split-Cuts and the Stable Set Polytope of Quasi-Line Graphs Split-Cuts and the Stable Set Polytope of Quasi-Line Graphs Friedrich Eisenbrand Joint work with G. Oriolo, P. Ventura and G. Stauffer Gomory cutting planes P = {x n Ax b} polyhedron, c T x δ, c n valid

More information

MVE165/MMG631 Linear and integer optimization with applications Lecture 9 Discrete optimization: theory and algorithms

MVE165/MMG631 Linear and integer optimization with applications Lecture 9 Discrete optimization: theory and algorithms MVE165/MMG631 Linear and integer optimization with applications Lecture 9 Discrete optimization: theory and algorithms Ann-Brith Strömberg 2018 04 24 Lecture 9 Linear and integer optimization with applications

More information

THEORY OF LINEAR AND INTEGER PROGRAMMING

THEORY OF LINEAR AND INTEGER PROGRAMMING THEORY OF LINEAR AND INTEGER PROGRAMMING ALEXANDER SCHRIJVER Centrum voor Wiskunde en Informatica, Amsterdam A Wiley-Inter science Publication JOHN WILEY & SONS^ Chichester New York Weinheim Brisbane Singapore

More information

MVE165/MMG630, Applied Optimization Lecture 8 Integer linear programming algorithms. Ann-Brith Strömberg

MVE165/MMG630, Applied Optimization Lecture 8 Integer linear programming algorithms. Ann-Brith Strömberg MVE165/MMG630, Integer linear programming algorithms Ann-Brith Strömberg 2009 04 15 Methods for ILP: Overview (Ch. 14.1) Enumeration Implicit enumeration: Branch and bound Relaxations Decomposition methods:

More information

5.3 Cutting plane methods and Gomory fractional cuts

5.3 Cutting plane methods and Gomory fractional cuts 5.3 Cutting plane methods and Gomory fractional cuts (ILP) min c T x s.t. Ax b x 0integer feasible region X Assumption: a ij, c j and b i integer. Observation: The feasible region of an ILP can be described

More information

1 date: September 15, 1998 file: mitche2

1 date: September 15, 1998 file: mitche2 1 date: September 15, 1998 file: mitche2 BRANCH-AND-CUT ALGORITHMS FOR INTEGER PROGRAMMING, Branch-and-cut Branch-and-cut methods are exact algorithms for integer programming problems. They consist of

More information

Pivot and Gomory Cut. A MIP Feasibility Heuristic NSERC

Pivot and Gomory Cut. A MIP Feasibility Heuristic NSERC Pivot and Gomory Cut A MIP Feasibility Heuristic Shubhashis Ghosh Ryan Hayward shubhashis@randomknowledge.net hayward@cs.ualberta.ca NSERC CGGT 2007 Kyoto Jun 11-15 page 1 problem given a MIP, find a feasible

More information

On Mixed-Integer (Linear) Programming and its connection with Data Science

On Mixed-Integer (Linear) Programming and its connection with Data Science On Mixed-Integer (Linear) Programming and its connection with Data Science Andrea Lodi Canada Excellence Research Chair École Polytechnique de Montréal, Québec, Canada andrea.lodi@polymtl.ca January 16-20,

More information

How to use your favorite MIP Solver: modeling, solving, cannibalizing. Andrea Lodi University of Bologna, Italy

How to use your favorite MIP Solver: modeling, solving, cannibalizing. Andrea Lodi University of Bologna, Italy How to use your favorite MIP Solver: modeling, solving, cannibalizing Andrea Lodi University of Bologna, Italy andrea.lodi@unibo.it January-February, 2012 @ Universität Wien A. Lodi, How to use your favorite

More information

Lecture 3. Corner Polyhedron, Intersection Cuts, Maximal Lattice-Free Convex Sets. Tepper School of Business Carnegie Mellon University, Pittsburgh

Lecture 3. Corner Polyhedron, Intersection Cuts, Maximal Lattice-Free Convex Sets. Tepper School of Business Carnegie Mellon University, Pittsburgh Lecture 3 Corner Polyhedron, Intersection Cuts, Maximal Lattice-Free Convex Sets Gérard Cornuéjols Tepper School of Business Carnegie Mellon University, Pittsburgh January 2016 Mixed Integer Linear Programming

More information

Exploiting Degeneracy in MIP

Exploiting Degeneracy in MIP Exploiting Degeneracy in MIP Tobias Achterberg 9 January 2018 Aussois Performance Impact in Gurobi 7.5+ 35% 32.0% 30% 25% 20% 15% 14.6% 10% 5.7% 7.9% 6.6% 5% 0% 2.9% 1.2% 0.1% 2.6% 2.6% Time limit: 10000

More information

Introduction to Mathematical Programming IE406. Lecture 20. Dr. Ted Ralphs

Introduction to Mathematical Programming IE406. Lecture 20. Dr. Ted Ralphs Introduction to Mathematical Programming IE406 Lecture 20 Dr. Ted Ralphs IE406 Lecture 20 1 Reading for This Lecture Bertsimas Sections 10.1, 11.4 IE406 Lecture 20 2 Integer Linear Programming An integer

More information

Integer Programming as Projection

Integer Programming as Projection Integer Programming as Projection H. P. Williams London School of Economics John Hooker Carnegie Mellon University INFORMS 2015, Philadelphia USA A Different Perspective on IP Projection of an IP onto

More information

Integer Programming Theory

Integer Programming Theory Integer Programming Theory Laura Galli October 24, 2016 In the following we assume all functions are linear, hence we often drop the term linear. In discrete optimization, we seek to find a solution x

More information

Primal Heuristics for Branch-and-Price Algorithms

Primal Heuristics for Branch-and-Price Algorithms Primal Heuristics for Branch-and-Price Algorithms Marco Lübbecke and Christian Puchert Abstract In this paper, we present several primal heuristics which we implemented in the branch-and-price solver GCG

More information

15.083J Integer Programming and Combinatorial Optimization Fall Enumerative Methods

15.083J Integer Programming and Combinatorial Optimization Fall Enumerative Methods 5.8J Integer Programming and Combinatorial Optimization Fall 9 A knapsack problem Enumerative Methods Let s focus on maximization integer linear programs with only binary variables For example: a knapsack

More information

On a Cardinality-Constrained Transportation Problem With Market Choice

On a Cardinality-Constrained Transportation Problem With Market Choice On a Cardinality-Constrained Transportation Problem With Market Choice Matthias Walter a, Pelin Damcı-Kurt b, Santanu S. Dey c,, Simge Küçükyavuz b a Institut für Mathematische Optimierung, Otto-von-Guericke-Universität

More information

TABU SEARCH FOR MIXED INTEGER PROGRAMMING

TABU SEARCH FOR MIXED INTEGER PROGRAMMING Chapter 11 TABU SEARCH FOR MIXED INTEGER PROGRAMMING João Pedro Pedroso Departamento de Ciência de Computadores, Faculdade de Ciências da Universidade do Porto, Rua do Campo Alegre, 823 4150-180 Porto,

More information

Pure Cutting Plane Methods for ILP: a computational perspective

Pure Cutting Plane Methods for ILP: a computational perspective Pure Cutting Plane Methods for ILP: a computational perspective Matteo Fischetti, DEI, University of Padova Rorschach test for OR disorders: can you see the tree? 1 Outline 1. Pure cutting plane methods

More information

Discrete Optimization. Lecture Notes 2

Discrete Optimization. Lecture Notes 2 Discrete Optimization. Lecture Notes 2 Disjunctive Constraints Defining variables and formulating linear constraints can be straightforward or more sophisticated, depending on the problem structure. The

More information

Motivation for Heuristics

Motivation for Heuristics MIP Heuristics 1 Motivation for Heuristics Why not wait for branching? Produce feasible solutions as quickly as possible Often satisfies user demands Avoid exploring unproductive sub trees Better reduced

More information

56:272 Integer Programming & Network Flows Final Examination -- December 14, 1998

56:272 Integer Programming & Network Flows Final Examination -- December 14, 1998 56:272 Integer Programming & Network Flows Final Examination -- December 14, 1998 Part A: Answer any four of the five problems. (15 points each) 1. Transportation problem 2. Integer LP Model Formulation

More information

Exact Algorithms for Mixed-Integer Bilevel Linear Programming

Exact Algorithms for Mixed-Integer Bilevel Linear Programming Exact Algorithms for Mixed-Integer Bilevel Linear Programming Matteo Fischetti, University of Padova (based on joint work with I. Ljubic, M. Monaci, and M. Sinnl) Lunteren Conference on the Mathematics

More information

Implementing a B&C algorithm for Mixed-Integer Bilevel Linear Programming

Implementing a B&C algorithm for Mixed-Integer Bilevel Linear Programming Implementing a B&C algorithm for Mixed-Integer Bilevel Linear Programming Matteo Fischetti, University of Padova 8th Cargese-Porquerolles Workshop on Combinatorial Optimization, August 2017 1 Bilevel Optimization

More information

DM545 Linear and Integer Programming. Lecture 2. The Simplex Method. Marco Chiarandini

DM545 Linear and Integer Programming. Lecture 2. The Simplex Method. Marco Chiarandini DM545 Linear and Integer Programming Lecture 2 The Marco Chiarandini Department of Mathematics & Computer Science University of Southern Denmark Outline 1. 2. 3. 4. Standard Form Basic Feasible Solutions

More information

Algorithms for Integer Programming

Algorithms for Integer Programming Algorithms for Integer Programming Laura Galli November 9, 2016 Unlike linear programming problems, integer programming problems are very difficult to solve. In fact, no efficient general algorithm is

More information

Introduction to Mathematical Programming IE496. Final Review. Dr. Ted Ralphs

Introduction to Mathematical Programming IE496. Final Review. Dr. Ted Ralphs Introduction to Mathematical Programming IE496 Final Review Dr. Ted Ralphs IE496 Final Review 1 Course Wrap-up: Chapter 2 In the introduction, we discussed the general framework of mathematical modeling

More information

Advanced Operations Research Prof. G. Srinivasan Department of Management Studies Indian Institute of Technology, Madras

Advanced Operations Research Prof. G. Srinivasan Department of Management Studies Indian Institute of Technology, Madras Advanced Operations Research Prof. G. Srinivasan Department of Management Studies Indian Institute of Technology, Madras Lecture 16 Cutting Plane Algorithm We shall continue the discussion on integer programming,

More information

Disjunctive Programming

Disjunctive Programming Chapter 10 Disjunctive Programming Egon Balas Introduction by Egon Balas In April 1967 I and my family arrived into the US as fresh immigrants from behind the Iron Curtain. After a fruitful semester spent

More information

A PARAMETRIC SIMPLEX METHOD FOR OPTIMIZING A LINEAR FUNCTION OVER THE EFFICIENT SET OF A BICRITERIA LINEAR PROBLEM. 1.

A PARAMETRIC SIMPLEX METHOD FOR OPTIMIZING A LINEAR FUNCTION OVER THE EFFICIENT SET OF A BICRITERIA LINEAR PROBLEM. 1. ACTA MATHEMATICA VIETNAMICA Volume 21, Number 1, 1996, pp. 59 67 59 A PARAMETRIC SIMPLEX METHOD FOR OPTIMIZING A LINEAR FUNCTION OVER THE EFFICIENT SET OF A BICRITERIA LINEAR PROBLEM NGUYEN DINH DAN AND

More information

Stable sets, corner polyhedra and the Chvátal closure

Stable sets, corner polyhedra and the Chvátal closure Stable sets, corner polyhedra and the Chvátal closure Manoel Campêlo Departamento de Estatística e Matemática Aplicada, Universidade Federal do Ceará, Brazil, mcampelo@lia.ufc.br. Gérard Cornuéjols Tepper

More information

A Generic Separation Algorithm and Its Application to the Vehicle Routing Problem

A Generic Separation Algorithm and Its Application to the Vehicle Routing Problem A Generic Separation Algorithm and Its Application to the Vehicle Routing Problem Presented by: Ted Ralphs Joint work with: Leo Kopman Les Trotter Bill Pulleyblank 1 Outline of Talk Introduction Description

More information

Heuristics in MILP. Group 1 D. Assouline, N. Molyneaux, B. Morén. Supervisors: Michel Bierlaire, Andrea Lodi. Zinal 2017 Winter School

Heuristics in MILP. Group 1 D. Assouline, N. Molyneaux, B. Morén. Supervisors: Michel Bierlaire, Andrea Lodi. Zinal 2017 Winter School Heuristics in MILP Group 1 D. Assouline, N. Molyneaux, B. Morén Supervisors: Michel Bierlaire, Andrea Lodi Zinal 2017 Winter School 0 / 23 Primal heuristics Original paper: Fischetti, M. and Lodi, A. (2011).

More information

Advanced Operations Research Techniques IE316. Quiz 1 Review. Dr. Ted Ralphs

Advanced Operations Research Techniques IE316. Quiz 1 Review. Dr. Ted Ralphs Advanced Operations Research Techniques IE316 Quiz 1 Review Dr. Ted Ralphs IE316 Quiz 1 Review 1 Reading for The Quiz Material covered in detail in lecture. 1.1, 1.4, 2.1-2.6, 3.1-3.3, 3.5 Background material

More information

9.4 SOME CHARACTERISTICS OF INTEGER PROGRAMS A SAMPLE PROBLEM

9.4 SOME CHARACTERISTICS OF INTEGER PROGRAMS A SAMPLE PROBLEM 9.4 SOME CHARACTERISTICS OF INTEGER PROGRAMS A SAMPLE PROBLEM Whereas the simplex method is effective for solving linear programs, there is no single technique for solving integer programs. Instead, a

More information

Unit.9 Integer Programming

Unit.9 Integer Programming Unit.9 Integer Programming Xiaoxi Li EMS & IAS, Wuhan University Dec. 22-29, 2016 (revised) Operations Research (Li, X.) Unit.9 Integer Programming Dec. 22-29, 2016 (revised) 1 / 58 Organization of this

More information

The Gurobi Solver V1.0

The Gurobi Solver V1.0 The Gurobi Solver V1.0 Robert E. Bixby Gurobi Optimization & Rice University Ed Rothberg, Zonghao Gu Gurobi Optimization 1 1 Oct 09 Overview Background Rethinking the MIP solver Introduction Tree of Trees

More information

Primal Heuristics in SCIP

Primal Heuristics in SCIP Primal Heuristics in SCIP Timo Berthold Zuse Institute Berlin DFG Research Center MATHEON Mathematics for key technologies Berlin, 10/11/2007 Outline 1 Introduction Basics Integration Into SCIP 2 Available

More information

Optimization Methods in Management Science

Optimization Methods in Management Science Problem Set Rules: Optimization Methods in Management Science MIT 15.053, Spring 2013 Problem Set 6, Due: Thursday April 11th, 2013 1. Each student should hand in an individual problem set. 2. Discussing

More information

LP-Modelling. dr.ir. C.A.J. Hurkens Technische Universiteit Eindhoven. January 30, 2008

LP-Modelling. dr.ir. C.A.J. Hurkens Technische Universiteit Eindhoven. January 30, 2008 LP-Modelling dr.ir. C.A.J. Hurkens Technische Universiteit Eindhoven January 30, 2008 1 Linear and Integer Programming After a brief check with the backgrounds of the participants it seems that the following

More information

S-free Sets for Polynomial Optimization

S-free Sets for Polynomial Optimization S-free Sets for and Daniel Bienstock, Chen Chen, Gonzalo Muñoz, IEOR, Columbia University May, 2017 SIAM OPT 2017 S-free sets for PolyOpt 1 The Polyhedral Approach TighteningP with an S-free setc conv(p

More information

A Comparison of Mixed-Integer Programming Models for Non-Convex Piecewise Linear Cost Minimization Problems

A Comparison of Mixed-Integer Programming Models for Non-Convex Piecewise Linear Cost Minimization Problems A Comparison of Mixed-Integer Programming Models for Non-Convex Piecewise Linear Cost Minimization Problems Keely L. Croxton Fisher College of Business The Ohio State University Bernard Gendron Département

More information

4 Integer Linear Programming (ILP)

4 Integer Linear Programming (ILP) TDA6/DIT37 DISCRETE OPTIMIZATION 17 PERIOD 3 WEEK III 4 Integer Linear Programg (ILP) 14 An integer linear program, ILP for short, has the same form as a linear program (LP). The only difference is that

More information

Algorithms for Decision Support. Integer linear programming models

Algorithms for Decision Support. Integer linear programming models Algorithms for Decision Support Integer linear programming models 1 People with reduced mobility (PRM) require assistance when travelling through the airport http://www.schiphol.nl/travellers/atschiphol/informationforpassengerswithreducedmobility.htm

More information

Fundamentals of Integer Programming

Fundamentals of Integer Programming Fundamentals of Integer Programming Di Yuan Department of Information Technology, Uppsala University January 2018 Outline Definition of integer programming Formulating some classical problems with integer

More information

Part 4. Decomposition Algorithms Dantzig-Wolf Decomposition Algorithm

Part 4. Decomposition Algorithms Dantzig-Wolf Decomposition Algorithm In the name of God Part 4. 4.1. Dantzig-Wolf Decomposition Algorithm Spring 2010 Instructor: Dr. Masoud Yaghini Introduction Introduction Real world linear programs having thousands of rows and columns.

More information

1 date: September 15, 1998 file: mitche1

1 date: September 15, 1998 file: mitche1 1 date: September 15, 1998 file: mitche1 CUTTING PLANE ALGORITHMS FOR INTEGER PROGRAMMING, Cutting plane algorithms Cutting plane methods are exact algorithms for integer programming problems. Theyhave

More information

On Applying Cutting Planes in DLL-Based Algorithms for Pseudo-Boolean Optimization

On Applying Cutting Planes in DLL-Based Algorithms for Pseudo-Boolean Optimization On Applying Cutting Planes in DLL-Based Algorithms for Pseudo-Boolean Optimization Vasco Manquinho and João Marques-Silva Technical University of Lisbon, IST/INESC-ID, Lisbon, Portugal {vmm, jpms}@sat.inesc-id.pt

More information

Target Cuts from Relaxed Decision Diagrams

Target Cuts from Relaxed Decision Diagrams Target Cuts from Relaxed Decision Diagrams Christian Tjandraatmadja 1, Willem-Jan van Hoeve 1 1 Tepper School of Business, Carnegie Mellon University, Pittsburgh, PA {ctjandra,vanhoeve}@andrew.cmu.edu

More information

Minimal Infeasible Subsystems and Benders cuts

Minimal Infeasible Subsystems and Benders cuts Mathematical Programming manuscript No. (will be inserted by the editor) Matteo Fischetti Domenico Salvagnin Arrigo Zanette Minimal Infeasible Subsystems and Benders cuts Received: date / Revised Sept.

More information

On the safety of Gomory cut generators

On the safety of Gomory cut generators On the safety of Gomory cut generators Gérard Cornuéjols 1, François Margot 1, Giacomo Nannicini 2 1 Tepper School of Business, Carnegie Mellon University, Pittsburgh, PA Email: {gc0v,fmargot}@andrew.cmu.edu

More information

A NEW SEQUENTIAL CUTTING PLANE ALGORITHM FOR SOLVING MIXED INTEGER NONLINEAR PROGRAMMING PROBLEMS

A NEW SEQUENTIAL CUTTING PLANE ALGORITHM FOR SOLVING MIXED INTEGER NONLINEAR PROGRAMMING PROBLEMS EVOLUTIONARY METHODS FOR DESIGN, OPTIMIZATION AND CONTROL P. Neittaanmäki, J. Périaux and T. Tuovinen (Eds.) c CIMNE, Barcelona, Spain 2007 A NEW SEQUENTIAL CUTTING PLANE ALGORITHM FOR SOLVING MIXED INTEGER

More information

An Extension of the Multicut L-Shaped Method. INEN Large-Scale Stochastic Optimization Semester project. Svyatoslav Trukhanov

An Extension of the Multicut L-Shaped Method. INEN Large-Scale Stochastic Optimization Semester project. Svyatoslav Trukhanov An Extension of the Multicut L-Shaped Method INEN 698 - Large-Scale Stochastic Optimization Semester project Svyatoslav Trukhanov December 13, 2005 1 Contents 1 Introduction and Literature Review 3 2 Formal

More information

A Lifted Linear Programming Branch-and-Bound Algorithm for Mixed Integer Conic Quadratic Programs

A Lifted Linear Programming Branch-and-Bound Algorithm for Mixed Integer Conic Quadratic Programs A Lifted Linear Programming Branch-and-Bound Algorithm for Mixed Integer Conic Quadratic Programs Juan Pablo Vielma Shabbir Ahmed George L. Nemhauser H. Milton Stewart School of Industrial and Systems

More information

lpsymphony - Integer Linear Programming in R

lpsymphony - Integer Linear Programming in R lpsymphony - Integer Linear Programming in R Vladislav Kim October 30, 2017 Contents 1 Introduction 2 2 lpsymphony: Quick Start 2 3 Integer Linear Programming 5 31 Equivalent and Dual Formulations 5 32

More information

Graph Coloring via Constraint Programming-based Column Generation

Graph Coloring via Constraint Programming-based Column Generation Graph Coloring via Constraint Programming-based Column Generation Stefano Gualandi Federico Malucelli Dipartimento di Elettronica e Informatica, Politecnico di Milano Viale Ponzio 24/A, 20133, Milan, Italy

More information

Improved Gomory Cuts for Primal Cutting Plane Algorithms

Improved Gomory Cuts for Primal Cutting Plane Algorithms Improved Gomory Cuts for Primal Cutting Plane Algorithms S. Dey J-P. Richard Industrial Engineering Purdue University INFORMS, 2005 Outline 1 Motivation The Basic Idea Set up the Lifting Problem How to

More information

Investigating Mixed-Integer Hulls using a MIP-Solver

Investigating Mixed-Integer Hulls using a MIP-Solver Investigating Mixed-Integer Hulls using a MIP-Solver Matthias Walter Otto-von-Guericke Universität Magdeburg Joint work with Volker Kaibel (OvGU) Aussois Combinatorial Optimization Workshop 2015 Outline

More information

Branch and Cut. John E. Mitchell. May 12, 2010

Branch and Cut. John E. Mitchell. May 12, 2010 Branch and Cut John E. Mitchell May 12, 2010 Combinatorial optimization problems can often be formulated as mixed integer linear programming problems, as discussed in Section 1.4.1.1 in this encyclopedia.

More information

Some Advanced Topics in Linear Programming

Some Advanced Topics in Linear Programming Some Advanced Topics in Linear Programming Matthew J. Saltzman July 2, 995 Connections with Algebra and Geometry In this section, we will explore how some of the ideas in linear programming, duality theory,

More information

A hard integer program made easy by lexicography

A hard integer program made easy by lexicography Noname manuscript No. (will be inserted by the editor) A hard integer program made easy by lexicography Egon Balas Matteo Fischetti Arrigo Zanette February 16, 2011 Abstract A small but notoriously hard

More information

Linear Programming Duality and Algorithms

Linear Programming Duality and Algorithms COMPSCI 330: Design and Analysis of Algorithms 4/5/2016 and 4/7/2016 Linear Programming Duality and Algorithms Lecturer: Debmalya Panigrahi Scribe: Tianqi Song 1 Overview In this lecture, we will cover

More information

Optimality certificates for convex minimization and Helly numbers

Optimality certificates for convex minimization and Helly numbers Optimality certificates for convex minimization and Helly numbers Amitabh Basu Michele Conforti Gérard Cornuéjols Robert Weismantel Stefan Weltge May 10, 2017 Abstract We consider the problem of minimizing

More information

15.082J and 6.855J. Lagrangian Relaxation 2 Algorithms Application to LPs

15.082J and 6.855J. Lagrangian Relaxation 2 Algorithms Application to LPs 15.082J and 6.855J Lagrangian Relaxation 2 Algorithms Application to LPs 1 The Constrained Shortest Path Problem (1,10) 2 (1,1) 4 (2,3) (1,7) 1 (10,3) (1,2) (10,1) (5,7) 3 (12,3) 5 (2,2) 6 Find the shortest

More information

Intersection Cuts with Infinite Split Rank

Intersection Cuts with Infinite Split Rank Intersection Cuts with Infinite Split Rank Amitabh Basu 1,2, Gérard Cornuéjols 1,3,4 François Margot 1,5 April 2010; revised April 2011; revised October 2011 Abstract We consider mixed integer linear programs

More information

Optimality certificates for convex minimization and Helly numbers

Optimality certificates for convex minimization and Helly numbers Optimality certificates for convex minimization and Helly numbers Amitabh Basu Michele Conforti Gérard Cornuéjols Robert Weismantel Stefan Weltge October 20, 2016 Abstract We consider the problem of minimizing

More information

Penalty Alternating Direction Methods for Mixed- Integer Optimization: A New View on Feasibility Pumps

Penalty Alternating Direction Methods for Mixed- Integer Optimization: A New View on Feasibility Pumps Penalty Alternating Direction Methods for Mixed- Integer Optimization: A New View on Feasibility Pumps Björn Geißler, Antonio Morsi, Lars Schewe, Martin Schmidt FAU Erlangen-Nürnberg, Discrete Optimization

More information

/ Approximation Algorithms Lecturer: Michael Dinitz Topic: Linear Programming Date: 2/24/15 Scribe: Runze Tang

/ Approximation Algorithms Lecturer: Michael Dinitz Topic: Linear Programming Date: 2/24/15 Scribe: Runze Tang 600.469 / 600.669 Approximation Algorithms Lecturer: Michael Dinitz Topic: Linear Programming Date: 2/24/15 Scribe: Runze Tang 9.1 Linear Programming Suppose we are trying to approximate a minimization

More information

Restrict-and-relax search for 0-1 mixed-integer programs

Restrict-and-relax search for 0-1 mixed-integer programs EURO J Comput Optim (23) :2 28 DOI.7/s3675-3-7-y ORIGINAL PAPER Restrict-and-relax search for - mixed-integer programs Menal Guzelsoy George Nemhauser Martin Savelsbergh Received: 2 September 22 / Accepted:

More information

Surrogate Gradient Algorithm for Lagrangian Relaxation 1,2

Surrogate Gradient Algorithm for Lagrangian Relaxation 1,2 Surrogate Gradient Algorithm for Lagrangian Relaxation 1,2 X. Zhao 3, P. B. Luh 4, and J. Wang 5 Communicated by W.B. Gong and D. D. Yao 1 This paper is dedicated to Professor Yu-Chi Ho for his 65th birthday.

More information

Advanced Operations Research Techniques IE316. Quiz 2 Review. Dr. Ted Ralphs

Advanced Operations Research Techniques IE316. Quiz 2 Review. Dr. Ted Ralphs Advanced Operations Research Techniques IE316 Quiz 2 Review Dr. Ted Ralphs IE316 Quiz 2 Review 1 Reading for The Quiz Material covered in detail in lecture Bertsimas 4.1-4.5, 4.8, 5.1-5.5, 6.1-6.3 Material

More information

Programming, numerics and optimization

Programming, numerics and optimization Programming, numerics and optimization Lecture C-4: Constrained optimization Łukasz Jankowski ljank@ippt.pan.pl Institute of Fundamental Technological Research Room 4.32, Phone +22.8261281 ext. 428 June

More information

POLYHEDRAL GEOMETRY. Convex functions and sets. Mathematical Programming Niels Lauritzen Recall that a subset C R n is convex if

POLYHEDRAL GEOMETRY. Convex functions and sets. Mathematical Programming Niels Lauritzen Recall that a subset C R n is convex if POLYHEDRAL GEOMETRY Mathematical Programming Niels Lauritzen 7.9.2007 Convex functions and sets Recall that a subset C R n is convex if {λx + (1 λ)y 0 λ 1} C for every x, y C and 0 λ 1. A function f :

More information

Gomory Reloaded. Matteo Fischetti, DEI, University of Padova (joint work with Domenico Salvagnin) 1 MIP 2010

Gomory Reloaded. Matteo Fischetti, DEI, University of Padova (joint work with Domenico Salvagnin) 1 MIP 2010 Gomory Reloaded Matteo Fischetti, DEI, University of Padova (joint work with Domenico Salvagnin) 1 Cutting planes (cuts) We consider a general MIPs of the form min { c x : A x = b, x 0, x j integer for

More information

SUBSTITUTING GOMORY CUTTING PLANE METHOD TOWARDS BALAS ALGORITHM FOR SOLVING BINARY LINEAR PROGRAMMING

SUBSTITUTING GOMORY CUTTING PLANE METHOD TOWARDS BALAS ALGORITHM FOR SOLVING BINARY LINEAR PROGRAMMING Bulletin of Mathematics Vol. 06, No. 0 (20), pp.. SUBSTITUTING GOMORY CUTTING PLANE METHOD TOWARDS BALAS ALGORITHM FOR SOLVING BINARY LINEAR PROGRAMMING Eddy Roflin, Sisca Octarina, Putra B. J Bangun,

More information

February 19, Integer programming. Outline. Problem formulation. Branch-andbound

February 19, Integer programming. Outline. Problem formulation. Branch-andbound Olga Galinina olga.galinina@tut.fi ELT-53656 Network Analysis and Dimensioning II Department of Electronics and Communications Engineering Tampere University of Technology, Tampere, Finland February 19,

More information

Integer Programming. Leo Liberti. March 13, Abstract

Integer Programming. Leo Liberti. March 13, Abstract Integer Programming Leo Liberti LIX, École Polytechnique, F-9118 Palaiseau, France (liberti@lix.polytechnique.fr) March 1, 6 Abstract A short introduction to Integer Programming (IP). Problems leading

More information

Lecture 2 September 3

Lecture 2 September 3 EE 381V: Large Scale Optimization Fall 2012 Lecture 2 September 3 Lecturer: Caramanis & Sanghavi Scribe: Hongbo Si, Qiaoyang Ye 2.1 Overview of the last Lecture The focus of the last lecture was to give

More information

A Computational Study of Conflict Graphs and Aggressive Cut Separation in Integer Programming

A Computational Study of Conflict Graphs and Aggressive Cut Separation in Integer Programming A Computational Study of Conflict Graphs and Aggressive Cut Separation in Integer Programming Samuel Souza Brito and Haroldo Gambini Santos 1 Dep. de Computação, Universidade Federal de Ouro Preto - UFOP

More information

Active-Constraint Variable Ordering for Faster Feasibility of Mixed Integer Linear Programs

Active-Constraint Variable Ordering for Faster Feasibility of Mixed Integer Linear Programs To appear in Mathematical Programming (2006) The original article is available at http://www.springerlink.com Active-Constraint Variable Ordering for Faster Feasibility of Mixed Integer Linear Programs

More information

COLUMN GENERATION IN LINEAR PROGRAMMING

COLUMN GENERATION IN LINEAR PROGRAMMING COLUMN GENERATION IN LINEAR PROGRAMMING EXAMPLE: THE CUTTING STOCK PROBLEM A certain material (e.g. lumber) is stocked in lengths of 9, 4, and 6 feet, with respective costs of $5, $9, and $. An order for

More information

A PRIMAL-DUAL EXTERIOR POINT ALGORITHM FOR LINEAR PROGRAMMING PROBLEMS

A PRIMAL-DUAL EXTERIOR POINT ALGORITHM FOR LINEAR PROGRAMMING PROBLEMS Yugoslav Journal of Operations Research Vol 19 (2009), Number 1, 123-132 DOI:10.2298/YUJOR0901123S A PRIMAL-DUAL EXTERIOR POINT ALGORITHM FOR LINEAR PROGRAMMING PROBLEMS Nikolaos SAMARAS Angelo SIFELARAS

More information

CS675: Convex and Combinatorial Optimization Spring 2018 The Simplex Algorithm. Instructor: Shaddin Dughmi

CS675: Convex and Combinatorial Optimization Spring 2018 The Simplex Algorithm. Instructor: Shaddin Dughmi CS675: Convex and Combinatorial Optimization Spring 2018 The Simplex Algorithm Instructor: Shaddin Dughmi Algorithms for Convex Optimization We will look at 2 algorithms in detail: Simplex and Ellipsoid.

More information

The SYMPHONY Callable Library for Mixed-Integer Linear Programming

The SYMPHONY Callable Library for Mixed-Integer Linear Programming The SYMPHONY Callable Library for Mixed-Integer Linear Programming Ted Ralphs and Menal Guzelsoy Industrial and Systems Engineering Lehigh University INFORMS Computing Society Conference, Annapolis, MD,

More information

Hybrid Enumeration Strategies for Mixed Integer Programming

Hybrid Enumeration Strategies for Mixed Integer Programming Hybrid Enumeration Strategies for Mixed Integer Programming João Pedro Pedroso Technical Report Series: DCC-2004-8 Departamento de Ciência de Computadores Faculdade de Ciências & Laboratório de Inteligência

More information

Can Interior Solutions Help in Solving Mixed Integer Programs?

Can Interior Solutions Help in Solving Mixed Integer Programs? Can Interior Solutions Help in Solving Mixed Integer Programs? Sanjay Mehrotra joint work with Kuo-Ling Huang, Utku Koc, Zhifeng Li Industrial Engineering and Management Sciences Northwestern University

More information

Conflict Analysis in Mixed Integer Programming

Conflict Analysis in Mixed Integer Programming Konrad-Zuse-Zentrum für Informationstechnik Berlin Takustraße 7 D-14195 Berlin-Dahlem Germany TOBIAS ACHTERBERG Conflict Analysis in Mixed Integer Programming URL: http://www.zib.de/projects/integer-optimization/mip

More information

Applied Lagrange Duality for Constrained Optimization

Applied Lagrange Duality for Constrained Optimization Applied Lagrange Duality for Constrained Optimization Robert M. Freund February 10, 2004 c 2004 Massachusetts Institute of Technology. 1 1 Overview The Practical Importance of Duality Review of Convexity

More information

Computational Integer Programming. Lecture 12: Branch and Cut. Dr. Ted Ralphs

Computational Integer Programming. Lecture 12: Branch and Cut. Dr. Ted Ralphs Computational Integer Programming Lecture 12: Branch and Cut Dr. Ted Ralphs Computational MILP Lecture 12 1 Reading for This Lecture Wolsey Section 9.6 Nemhauser and Wolsey Section II.6 Martin Computational

More information

56:272 Integer Programming & Network Flows Final Exam -- December 16, 1997

56:272 Integer Programming & Network Flows Final Exam -- December 16, 1997 56:272 Integer Programming & Network Flows Final Exam -- December 16, 1997 Answer #1 and any five of the remaining six problems! possible score 1. Multiple Choice 25 2. Traveling Salesman Problem 15 3.

More information

Towards a practical simplex method for second order cone programming

Towards a practical simplex method for second order cone programming Towards a practical simplex method for second order cone programming Kartik Krishnan Department of Computing and Software McMaster University Joint work with Gábor Pataki (UNC), Neha Gupta (IIT Delhi),

More information

SUBSTITUTING GOMORY CUTTING PLANE METHOD TOWARDS BALAS ALGORITHM FOR SOLVING BINARY LINEAR PROGRAMMING

SUBSTITUTING GOMORY CUTTING PLANE METHOD TOWARDS BALAS ALGORITHM FOR SOLVING BINARY LINEAR PROGRAMMING ASIAN JOURNAL OF MATHEMATICS AND APPLICATIONS Volume 2014, Article ID ama0156, 11 pages ISSN 2307-7743 http://scienceasia.asia SUBSTITUTING GOMORY CUTTING PLANE METHOD TOWARDS BALAS ALGORITHM FOR SOLVING

More information