arxiv: v2 [cs.ds] 15 Feb 2017
|
|
- Ross Hodge
- 5 years ago
- Views:
Transcription
1 ALGORITHMS FOR NON-LINEAR AND STOCHASTIC RESOURCE CONSTRAINED SHORTEST PATH. AXEL PARMENTIER arxiv: v2 [cs.ds] 15 Feb 2017 Abstract. Resource constrained shortest path problems are usually solved thanks to a smart enumeration of all the non-dominated paths. Recent improvements of these enumeration algorithms rely on the use of bounds on path resources to discard partial solutions. The quality of the bounds determines the performance of the algorithm. The main contribution of this paper is to intruce a standard procedure to generate bounds on paths resources in a general setting which covers most resource constrained shortest path problems, among which stochastic versions. In that purpose, we intruce a generalization of the resource constrained shortest path problem where the resources are taken in a monoid. The resource of a path is the monoid sum of the resources of its arcs. The problem consists in finding a path whose resource minimizes a nondecreasing cost function of the path resource among the paths that respect a given constraint. Enumeration algorithms are generalized to this framework. We use lattice theory to provide polynomial procedures to find go quality bounds. These procedures solve a generalization of the algebraic path problem, where arc resources belong to a lattice ordered monoid. The practical efficiency of the approach is proved through an extensive numerical study on some deterministic and stochastic resource constrained shortest path problems. 1. Intruction 1.1. Problem statement. Several meths have recently been developed to increase the efficiency of the shortest path problem solvers [8]. A common feature to all these meths is the use of lower bounds on costs of paths to discard partial paths in an enumeration of all the paths. In this paper, we exploit the properties of lattices to extend this lower bound idea to algorithms for a generic version of the resource constrained shortest path problem where arc resources belong to a lattice ordered monoid. The lattice ordered monoid point of view covers a wide range of applications, among which stochastic versions of the resource constrained shortest path problem. Let (R, ) and (S, ) be two partially ordered sets. A map ρ : R S is isotone if x y implies ρ(x) ρ(y). Let (R, ) be a set endowed with a law of composition. (R, ) is a monoid if is associative and admits a neutral element in R. A partial order is a compatible order on (R, ) if all translations y x y and y y x are isotone. An ordered monoid (R,, ) is a monoid endowed with a compatible order. A partially ordered set (R, ) is a lattice if any pair of elements (x, x) of R 2 admits a greatest lower bound x x or meet and a least upper bound x x. A lattice ordered monoid (R,, ) is an ordered monoid such that induces a lattice structure. Let (R,, ) be a lattice ordered monoid. Consider the following problem. Monoid Resource Constrained Shortest Path Problem Input. A digraph D = (V,A), two vertices o,d V, a collection (x a ) R A, and two isotone mappings c : R R and ρ : R {0,1}. Output. An o-d path P such that ρ ( a P x ) ( a = 0 and with minimum c a P x a). R is the set of resources. The resource of a path P is a P x a and we denote it x P, the cost of P is c ( a P x ) ( a, and P is feasible if and only if ρ a P x a) is a equal to 0. The function ρ is later referred as the infeasibility function. 1
2 The Monoid Resource Constrained Shortest Path Problem is N P-hard as it contains the usual Resource Constrained Shortest Path Problem, which is obtained by using the set R = R 2, the cost c(x 1,x 2 ) = x 1, and the function ρ((x 1,x 2 )) equal to 1 if and only if x 2 > M for a given M R. Finally, we emphasize that is possibly non commutative. This lattice ordered monoid framework has two main strengths. First, it enables to deal with stochasticity in path problems. And second, the lattice ordered monoid structure enables to define polynomial procedure to compute lower bounds on paths resources, and to use these bounds to speed-up solution algorithms. We now sketch the main ideas behind the treatment of stochastic path problems and the solution schemes Application to stochastic path problems. Suppose that for each arc a we have a random variable ξ a. A large class of stochastic path problems can be expressed as follows. Given an origin vertex o and a destination d, find an o-d path minimizing [ ( )] min E f ξ a, P under the constraint a P ( ) P ξ > τ α, a P where f is a non-decreasing function, and τ and α are constants. We use two main ideas to mel such problems within the Monoid Resource Constrained Shortest Path Problem framework. First, a space of random variables endowed with the addition and the almost sure order is a lattice ordered monoid. And second, many if not most probability functionals that intervene in stochastic path problems are monotone with respect to this order and can therefore be meled withing this framework. On our example, it suffices to define x a = ξ a, c(ξ) = E[f(ξ)], and ρ(ξ) = ½ (α,1] (P( a P ξ > τ)), where we intruce the notation ½ I that we frequently use in the paper to denote the indicator function of a set I. Finally, the use of alternative stochastic orders enables to exploit assumptions such as the independence of the ξ a to improve the performance of our solution algorithms Solution scheme. We propose solution schemes for the Monoid Resource Constrained Shortest Path Problem when a C x a 0 for each cycle C in D. These schemes are in two steps. We start by computing for each vertex v a lower bound b v on the resource x P of all the v-d paths. Then, we use these lower bounds to discard partial solutions in an enumeration of all the paths. Bounds b v are used in enumeration algorithms to compute lower bounds on the resource of any o-d path starting by an o-v path P. Indeed, given an o-v path P and a v-d path P, x P b v x P x P = x P+ P, where P + P denotes the path composed of P followed by P. The resource x P b v is therefore a lower bound on the resource of any o-d path starting by P. As ρ and c are isotone, ρ(x P b v ) = 1 implies that there is no feasible o-d path starting by P, and c(x P b v ) is a lower bound on the cost of any o-d path P starting by P. The enumeration algorithm we propose therefore enumerates all the paths satisfying (1) ρ(x P b v ) = 0 and c(x P b v ) c UB, where v is the destination of P and c UB is an upper bound on the cost of an optimal solution. The practical efficiency of the approach relies on our ability to compute in a preprocessing a tight lower bound on the resource of all the v-d paths. As (R, ) is a lattice, the meet b opt v = P P vd x P, 2
3 where P vd denotes the set of v-d paths, is the tightest lower bound. Indeed, by definition of the meet, b v x P for all P in P vd b b opt v = x P. P P vd Unfortunately, we have shown [71] that, unless P = NP, there is no polynomial algorithm that enables to compute b opt v in polynomial time even on some simple lattice ordered monoid where resources are positive. However, we provide polynomial procedures that compute lower bounds on b opt v. To that purpose, we show that the following equation always admits solutions, that its solutions are lower bounds on b opt v, and we intruce polynomial procedures that compute its greatest solution. b d = 0, (2) b v = b v (x (v,u) b u ) for all v V\{d}. (v,u) δ + (v) Note that Equation (2) can be interpreted as a generalization of the Ford-Bellman dynamic programming equation for the usual shortest path problem, where the minimum has been replaced by the meet operator, and the sum by the operator. Our polynomial procedures are generalizations of the Ford-Bellman and of the Dijkstra algorithm for the usual shortest path problem Contributions and plan. We can sum-up our contributions as follows: We intruce a versatile algebraic framework for constrained shortest path problems. This framework notably enables to deal with non-linearity and stochasticity in the objective and in the constraints. We provide polynomial procedures to compute the solution of the generalized dynamic programming equation (1). The problem of solving this equation when the resource set has the structure of idempotent semiring is known as the algebraic path problem and has received much attention. Our procedures extend well-known algorithms of this community to the more general setting of lattice ordered monoids. Besides, contrary to the algebraic path problem community, we do not interpret the solution of (1) as the solution of the problem but as lower bounds that can then be used in an enumeration algorithm. This new interpretation together with the extension to lattice ordered monoids enable to apply these algebraic meths to a much wider range of paths problems. The lattice ordered monoid point of view is notably essential to mel stochastic path problems. We generalize the usual enumeration algorithms for resource constrained shortest path problems to our framework. The use of bounds is these algorithms is easy thanks to the lattice ordered monoid structure. Concerning stochastic path problems, we show that our framework can deal with most probability functionals of interest, among which the version independent risk measures. Besides, we can deal with a wide range of probability distributions for the random variables ξ a, and we can solve approximated versions of problems with other distribution through sampling. We show the practical efficiency of our approach through extensive numerical experiments on deterministic and stochastic resource constrained shortest path problems. To the best of our knowledge, our algorithms are the first practically efficient ones for paths problems with probabilistic constraints. Finally, we provide strategies to improve the performance of our enumeration algorithms on difficult problems thanks to a longer preprocessing. After intrucing some notions on digraphs and ordered algebraic structures in Section 2, we detail the connections between our framework and algorithms and those of the literature on usual, 3
4 algebraic, resource constrained, and stochastic path problems in Section 3. Sections 4 and 5 intruce respectively our enumeration and bounding algorithms for the Monoid Resource Constrained Shortest Path Problem. Section 6 tests the numerical performance of our algorithms on instances of the usual resource constrained shortest path problem. In Section 7, we explain how to mel stochastic path problems within our framework, and test numerically the performance of our algorithm on some non-constrained and constrained stochastic path problems. We conclude the paper with techniques to improve the performance of our algorithms on difficult instances in Section Preliminaries 2.1. Digraphs. A digraph D is a pair (V,A), where V is the set of vertices and A is the set of arcs of D. An arc a links a tail vertex to a head vertex. An arc a is incoming to (resp. outgoing from) v if v is the head (resp. the tail) of v. The set of arcs incoming to (resp. outgoing from) v is denoted δ (v) (resp. δ + (v)). A path is a sequence of arcs a 1,...,a k such that for each i {1,...,k 1}, the head vertex of a i is the tail vertex of a i+1. Note that with this definition, paths can contain multiple copies of an arc or of a vertex. A path P is said to be elementary if it contains at most one copy of each vertex. The origin of a path it the tail of its first arc and its destination is the head of its last arc. Given two vertices o and d in V, an o-d path P is a path with origin o and destination d. Finally, a cycle is a path whose origin is identical to its destination. Given two paths P and Q such that P ends in the origin of Q, we denote P +Q the path made of P followed by Q. Given two vertices u and v, we denote P uv the set of u-v paths Lattice ordered monoids and algebraic structures. We now intruce additional properties on lattices. When a subset S of a partially ordered set admits a greatest lower bound (resp. a least upper bound), we again call it its meet (resp. its join), and denote it S or x S x (resp. S or x S x). Any finite subset of a lattice admits a meet and a join. A lattice is complete if any subset S R admits a meet and a join. It is conditionally complete if any bounded subset S R admits a meet and a join. (3) All the lattices we consider in this paper are conditionally complete. If R is conditionally complete, then R {, + } is complete, where (resp. + ) is smaller (resp. greater) than any element in R. The lattice R {,+ } is a completion of R. We sometimes need our lattices to be complete to be able to define some quantities needed in the paper. When such quantities are defined, we mention that they may belong to the completion R {,+ } of R. We denote 0 the neutral element of the operator of a lattice ordered monoid (R,, ). A resource x is positive if x > 0. A lattice ordered monoid (R,, ) is a lattice ordered group if (R, ) is a group. A lattice ordered group is Archimedean if, for each x, x R such that x > 0, there exists n in Z + such that nx x, where nx = x x }{{}. n times 3. Literature review As an algebraic framework for non-linear and stochastic resource constrained shortest path problems, our work is at the cross-road of several branches of the literature. First, our algorithms are naturally interpreted as generalizations of the usual shortest path problem algorithms. Second, our bounding algorithms are generalizations to lattice ordered monoids of those of the algebraic path problem community. Third, our framework can be seen as a versatile alternative to other resource constrained shortest path framework with enhanced version of the enumeration algorithms. 4
5 Finally, the restriction of our algorithms to stochastic path problems compare favorably to the existing literature on the topic Usual shortest path problem. Variants of the Shortest Path Problem have been thoroughly studied during the last six decades. As we already mentioned, there are two main types of algorithms for the Shortest Path Problem. The first ones, such as Dijkstra s algorithm or Ford-Bellman algorithm, compute the shortest path between one vertex and all the other ones. In that sense their output is a solution of the dynamic programming equation (2) where is the usual sum on R and the meet is the minimum. The standard algorithm to solve it is Dijkstra s algorithm [27] when arcs costs are non-negative, and Ford-Bellman [10, 36] when they can be negative. We generalize both of them to compute solutions of (2). The second ones are enumeration algorithms and use bounds to discard paths in an enumeration of all the paths. The typical example of enumeration algorithm is algorithm [45], that we generalize to our setting. These algorithms are called goal directed algorithms as they compute the shortest path only between a given pair of origin and destination vertices. When go bounds are used, enumeration algorithms are faster than polynomial algorithms. Bast et al. [8] survey the rich literature developed in the last few years on the topic in the context of online route planning systems. However, the goals of these recent contributions are orthogonal to our ones: their objective is to be able to compute quickly the solution of an easy path problem between any o-d pair, while we want to compute the solution of a difficult problem between one given o-d pair Bounding algorithms and algebraic path problems. Equation (2) is not the first generalization of the usual dynamic programming equation. Indeed, when (R,, ) is an idempotent semiring, the problem of solving Equation (2) is called the algebraic path problem. The literature on the topic considers idempotent semirings of various generality [3, 7, 17, 34, 40, 59, 65, 76, 84] and is surveyed in [34]. Our framework generalizes the algebraic path problem: the idempotent semiring structure is stronger than the lattice ordered monoid one. Indeed, if (R,+, ) is an idempotent semiring, then (R,, + ) is a lattice ordered monoid, where + is the idempotent semiring canonical order: x + x if and only if x+ x = x. Its meet operator is +. In the other direction, if (R,, ) is a lattice ordered monoid with meet operator, then (R,, ) is an idempotent semiring if and only if distributes with respect to, i.e. a (b c) = (a b) (a c) and (a b) c = (a b) (a c). If b v is not necessarily equal to b opt v on lattice ordered monoids, these two quantities are equal on idempotent semirings. Two types of algorithms have been developed for the algebraic path problem. The first ones generalize respectively the Ford-Bellman [22, 23] and the Dijkstra [65] algorithm. Our algorithms can be seen as generalization to the lattice ordered monoid setting of these algorithms. Our generalized Dijkstra algorithm is in particular very similar to the one developed by Mohri [65]. Therefore, we can use results from the algebraic path problem community to obtain stronger versions of our convergence theorems when distributes with respect to. The second type of algorithms for the algebraic path problem consider Equation (2) as a system of linear equations in the idempotent semiring (R,, ), and generalize the Gauss-Seidel and the Gauss-Jordan algorithms to that setting [40, 84]. Unfortunately, these algorithms do not generalize well to the lattice ordered monoid setting. Finally, we present in Section 8 a technique to improve the quality of bounds that builds a lower envelope on the set {x R x P x for some P in P vd }. Techniques to build such a lower envelope have recently been proposed [4, 5] in the context of static program analysis. However, their process for building the lower envelope is orthogonal to our one. 5
6 3.3. Enumeration algorithms and resource constrained shortest path problems. Irnich & Desaulniers [48] provide a resource constrained shortest path framework and survey the exact and heuristic approaches to resource constrained shortest path problems. Their resource constrained shortest path framework is based on the notion of resource extension functions[47]: there is one such function ζ a for each arc a, and the resource of a path formed of the arcs a 1,...,a k is ζ ak... ζ a1 (0). The main difference between their framework and our one is the associativity of. This makes our framework slightly less versatile, but enables us to compute lower bounds on paths resources and to use them to speed up the resolution. Besides, most problems of the literature can be meled within our framework, as we argue in Chapter 3 of [71]. There are three main types of exact solution schemes to solve resource constrained shortest path problems: constraint programming, branch and bound, and enumeration algorithms. Constraint programming approaches [25, 31, 42, 55, 75] combine specifically designed search, domain reduction, and propagation algorithms. Concerning Branch-and-Bound algorithms, specific branching patterns have been developed by branch and bound algorithms for resource constrained shortest path problems: they branch on cycles, on arcs, and on resources [9, 15, 47, 73]. Finally, our work enters in the field of enumeration algorithms, and we now detail the literature on that topic. In their survey on resource constrained shortest path problems, Irnich & Desaulniers [48] describe the enumeration algorithms of the literature as variants of a generic enumeration algorithm. This generic enumeration algorithm has many similarities with the one we propose in Section 4. To obtain a practical algorithm from the generic enumeration algorithm, one must choose define a key, some bounds, and a dominance rule. The key defines which paths are processed first. The bounds and the dominance rules are what enable to discard paths. The dominance rule is an order on the set of resources that enables to discard paths whose resources are dominated. Desrochers & Soumis [26] and [72] provide specific keys for routing problems with time windows, but these strategies apply to many resource constrained shortest path problems. Irnich [47] provides general techniques to define resource extension functions leading to go dominance rules, and techniques to handle path with identical resources [49]. The remaining of the techniques are problem-specific [9, 33, 46, 49, 56, 58]. Finally, we note that variants of the enumeration algorithm based on the k-shortest path problem [30] have been proposed [9, 44, 80]. These variants and problem-specific dominance rules can be used within our setting when appropriated. Several techniques have beenproposedto computeboundswhen(r,, ) isr n endowed with its pruct order and sum. Some contributions solve a usual shortest path problem for each component of the resource [26, 28, 53, 62]. Another branch of the literature uses Lagrangian relaxation on an integer formulation of the problem to obtain lower bounds [16, 28, 44, 80]. These meths require the absence of negative cost cycles, in order to be able to solve the Langrangian relaxation using a shortest path problem. The case with negative cost cycles is considered by Feillet et al. [33]. When (R,, ) is R n, these Lagrangian techniques provide bounds that are typically tighter than our ones, but that require longer computations along the enumeration algorithm. The strength of our framework lies in our bounding algorithms, that enable to use lower bounds to discard path and go keys in non-linear and stochastic settings Stochastic path problems. There are two types of stochastic path problems: offline problems, where the entire path is chosen a priori, and online problems, whose solution is a policy that updates the path used given the realization of uncertainty on the first arcs. Given that the solution of the Monoid Resource Constrained Shortest Path Problem in an o-d path, it enables to mel offline stochastic path problems. However, interestingly, the lower bounds computed in our framework provide an optimal policy [71] for the well-studied online stochastic on time arrival problem [32, 35, 38, 39, 43, 68, 78, 79]. We now review the approaches to the different offline stochastic path problems. 6
7 Stochastic shortest path problems without constraints have been extensively studied since the seminal work of Frank [37]. Mels differ by the type of distribution they use for arc random variables, and by the probability functional they optimize. The objective of a first line of paper is to find a path maximizing the probability of on time arrival, or analogously, a path with minimum quantile of given order. Approaches have been developed for both continuous [19, 37, 69, 70] and discrete [64] distributions. Chen et al. [20] describe an efficient labeling algorithm to deal with normal distributions on the arcs. This algorithm is not so far from our label correcting algorithm applied with the lattice ordered monoid presented in Section of [71] when restricted to ρ( ) = P( > τ). A second line of papers defines a shortest path as a path minimizing the expectation of a cost function [61]. Dynamic programming can be used when cost functions are affine or exponential [29]. Murthy & Sarkar [66, 67] present an efficient labeling algorithm when arc distributions are normal and cost functions are piecewise-linear and concave. All these objective functions are isotone with respect to the stochastic orders we use and can therefore be meled within the Monoid Resource Constrained Shortest Path Problem framework. Besides, we show in Section 7 that we can also mel version independent risk measures. Concerning the distributions, our approach can handle all the distributions used in the literature, among which discrete, normal, and gamma distributions for independent random variables, and scenario based distributions for non-independent random variables. In this paper, we focus on discrete independent distributions and scenario based distributions. Lattice ordered monoids for other distributions can be found in Chapter 5 of [71]. The specificity of our solution approach is the use of lower bounds for stochastic orders. Our approach cannot deal with positive linear combinations of means and variances in the objective [69, 70, 81], as these objective functions are not isotone with respect to stochastic order. The problem of finding a minimum cost path for deterministic arc costs under stochastic resource constraints have been intruced in [57], and a solution algorithm based on linear programming is derived. We are not aware of other approaches specifically dedicated to stochastic constraints in path problems. However, such problems have been considered in the context of column generation. A wide range of stochastic versions of the traveling salesman and the vehicle routing problems have been studied in the last decades. When such problems are solved by column generation, the pricing subproblem is a stochastic resource constrained shortest path problem. Uncertainty in customer presence [50, 51], in demand [11, 12, 41, 82], and in travel time [2, 18, 52, 54, 60, 63, 77, 83] have been considered. Using the meling techniques we intruce in Chapter 3 of [71], most probability functionals considered in this literature can be dealt with using the lattice ordered monoid and the probability functionals presented in this chapter. However, we underline that, in the context of vehicle routing problems, the graph is often complete. In that case, the bounds provided by our approach are likely to beof poor quality, and thus our solution approach may not suit to the specific structure of these problems on complete graphs. 4. Enumeration algorithms 4.1. Generic enumeration algorithms. In this section, we give three algorithms for the Monoid Resource Constrained Shortest Path Problem: the generalized, the label dominance, and the label correcting algorithms. These three algorithms share the same structure. They enumerate all the paths in the graph using tests to discard partial paths. They differ only by the tests they use to discard paths, and by the keys they use to determine in which order the paths are processed. We therefore give a generic algorithm, and define the algorithms used in practice as specializations of this generic algorithm. Later in this section, we sometimes call optimal path an optimal solution of the Monoid Resource Constrained Shortest Path Problem. 7
8 Algorithm Test Key Pre-processing Maintained structures structures Generalized ( ) (Low) c(x P b v ) b v L, c UB Label dominance () (Dom) c(x P ) L, c UB, M v Label correcting () (Dom), (Low) c(x P b v ) b v L, c UB, M v Table 1. Monoid Resource Constrained Shortest Path Problem algorithms. We now describe the generic enumeration algorithm. A list L of partial paths P, and an upper bound c UB on the cost of an optimal solution are maintained. Initially, L contains the empty path at the origin o, and c UB = +. While L is not empty, the following operations are repeated. (1) Extract a path P of minimum key from L. Let v be the destination of P. (2) If v = d and P is feasible and better than the current solution, i.e. ρ(x P ) = 0, and c(x P ) <, then update cub to c(x P ). c UB (3) Else if test returns yes, extend P: for each arc a outgoing from v, add P +a to L. We obtain our different algorithms by specifying the key and the test respectively in the first and in the last step. We now intruce several keys and test. Our first key and test rely on lower bounds b v on the resources of all the v-d paths. Section 5 provides polynomial algorithms to compute such bounds in a preprocessing. Given an o-v path P, the lower bound test is expressed as follows. (Low) Does P satisfy ρ(x P b v ) = 0 and c(x P b v ) c UB? The isotony of ρ and c implies that a subpath P of an optimal path satisfies this test. An o-v path P dominates an o-v path P if x P x P. The dominance test maintains along the algorithm a list M v of non-dominated o-v paths for each vertex v, and is expressed as follows. (Dom) Is P non-dominated by any path in M v? If the answer is yes, then before extending P, we remove from M v and L all the paths in M v dominated by P, and add P to M v. The rationale behind this test is that, given the way M v is built, there is an optimal path whose subpaths are all non-dominated. The aim of keys is to extend first the most promising paths. As an optimal solution is a feasible solution of minimum cost, we use as keys estimations of the cost of an optimal path. When bounds b v are computed, given an o-v path P, the quantity c(x P b v ) provides a lower bound on the cost of any o-d path starting by P, and is therefore a go estimator of how promising P is. When no bounds are computed, we use c(x P ), the cost of the partial solution considered. We can now describe our enumeration algorithms. The generalized is obtained from the generic algorithm by using the lower bound c(x P b v ) as key in Step 1, and extending a path P in Step 3 only if it satisfies the lower bound test (Low). When (R,, ) = (R,+, ), ρ = 0, and c(x) = x, it corresponds to the usual algorithm. The label dominance algorithm is obtained from the generic algorithm by using the partial path cost ρ(c P ) as key in Step 1, and extending an o-v path P in Step 3 only if it satisfies the dominance test (Dom). The label correcting algorithm is obtained from the generic algorithm by using the lower bounds c(x P b v ) as key in Step 1, and extending an o-v path P in Step 3 only if it satisfies both the lower bound test (Low) and the dominance test (Dom). The properties of these algorithms are summed up in Table 1. We underline fact that bounds b v must be computed in a preprocessing when the generalized and the label correcting algorithms are used, and that the label correcting and the label dominance algorithm need to maintain lists of non-dominated paths M v. Alternative combinations of our tests and keys are possible but less interesting. Indeed, our three algorithms reach trade-offs between the pre-processing time, and the quality of the keys and 8
9 tests. Once boundsb v have been computed, performingthe lower bound test (Low), and computing c(x P b v ) require a fix number of operations,, and of the lattice ordered monoid. Thus, if time has been spent computing bounds b v in a preprocessing, it is always better to use both the lower bound test and the key c(x P b v ). The alternative is to use the label dominance algorithm to avoid spending time in the preprocessing. The label dominance algorithm corresponds to the standard algorithm for the resource constrained shortest path problem [48] in the resource extension framework. The strength of the Monoid Resource Constrained Shortest Path Problem framework is that it enables to intruce the generalized and the label correcting algorithms, which both rely on the use of bounds. When it comes to practical performances, it is well known that when lower bounds b v can be computed, the label correcting algorithm outperforms the label dominance algorithm on usual resource constrained shortest path problems [28]. The relative performance of the generalized and of the label correcting algorithm depends on the problem considered. Indeed, the dominance test enables to discard more paths, but its complexity is linear in the size of M v, and it may slow the algorithm if dominance is rare and lists M v become large. This is notably the case of some problems with numerous or stochastic constraints. Finally, the numerical experiments in Sections 6 and 7 show that the label dominance algorithm tends to perform well on easy problems, while the generalized algorithm tends to perform better on difficult problems with many deterministic constraints or one stochastic constraint Convergence of the algorithms. We now prove the convergence of our enumeration algorithms when x C 0 for all the cycles C of D. When this assumption is not satisfied, these algorithms must be adapted to discard non-elementary paths, using for instance the techniques developed by Feillet et al. [33] Generalized algorithm. The following assumptions will be used to define some settings under which ones the generalized algorithm converges: (4) (5) For all a, b < R and x > 0 in R, there exists and n Z + such that nq a b. There exists a feasible o-d path P such that c 1 ((,c(x P )]) ρ 1 (0) is upper-bounded by a resource x M < R. In Assumptions (4) and (5), R may be in the completion of R. Assumption (4) is a weaker version for ordered monoid of the Archimedean property. It is satisfied by all the lattice ordered monoids considered in this paper. R 2 endowed with its pruct sum and order is an example of lattice ordered group that is not Archimedean but which satisfies Assumption (4). Finally, Assumption (5) says that the set of resources of potentially optimal solutions is bounded. Indeed, an optimal path must be feasible and of cost non-greater than c(x P ): the feasible resources belong to ρ 1 (0), and c 1 ((,c(x P )]) is the set of resources whose cost is non-greater than the cost of path P. Theorem 1. Suppose that at least one of the following conditions is satisfied. (a) D is acyclic. (b) Assumptions (4) and (5) are satisfied, x a is positive for each arc a, and b v 0 for each vertex v. (c) Assumptions (4) and (5) are satisfied, is commutative, and a C x a is positive for any cycle C in D. Then the generalized algorithm converges after a finite number of iterations, and at the end, if c UB is finite, then it is the cost of an optimal solution of the Monoid Resource Constrained Shortest Path Problem. Otherwise, the problem admits no feasible solutions. 9
10 We note that in case (b), the hypothesis that b v 0 is not restrictive, as x a > 0 implies that x P 0 for all paths P. Finally, Case (c) is notably satisfied when (R,, ) is an Archimedean lattice ordered group and cycle resources are positive. Indeed, Theorem in [13] ensures that any Archimedean lattice ordered group is commutative, and Assumption (4) is a consequence of the Archimedean property in ordered groups. Lemma 2. Let P be an o-d path satisfying ρ(x P ) = 0. Then at a given step of the generalized algorithm, at least one of the following statements is satisfied: there is a subpath P of P in L, c UB c(x P). Note that P can be equal to P. Remark 1. As c(x P b v ) c(x P ), where v is the destination of P, Lemma 2 implies that, if we stop the algorithm before its convergence, the minimum c(x P b v ) for P L provides a lower bound on the cost of an optimal path. Proof. We start with preliminary results. Paths are added to L only due to extension of paths in Step 3. A path Q can therefore be in L only if its subpaths have been considered, removed from L, and extended by the algorithm. Thus, at a given step of the generalized algorithm, for each path Q with origin o, exactly one of the following statements is satisfied: Q has been considered by the generalized algorithm, a subpath Q of Q is in L, a strict subpath Q of Q has not been extended by the algorithm when considered. Besides, if a feasible o-d path Q has already been considered, Step 2 of the algorithm implies c UB c(x Q). We now prove Lemma 2. Suppose that none of the statements of Lemma 2 are satisfied. As P is a feasible o-d path, the two results above imply that a subpath P of P has not been extended by the algorithm when considered. Let P be this subpath, and v be its destination. As c UB decreases along the algorithm, the hypothesis implies that c UB > c(x P ) when P is considered. As b v is a lower bound on the resource of all v -d paths, we have x P b v x P. By monotonicity of ρ and feasibility of P, we have ρ(x P b v ) = 0. By monotonicity of c, we have c(x P b v ) c(x P ) < c UB when P is considered. The two last inequalities imply that P satisfies the lower bound test, which contradicts the fact that P has not been extended, and we obtain the lemma. Lemma 3. Under Assumption (5), if an o-v path Q such that x Q b v x M is considered by the algorithm, it does not satisfy the lower bound test (Low). Proof. Suppose that Assumption (5) is satisfied, and that Q is considered by the algorithm. If ρ(x Q b v ) = 1, path Q does not satisfy the lower bound test and we obtain the result. We now prove that, if ρ(x Q b v ) = 0, we have c UB < c(x Q b v ) when Q is considered by the algorithm, which then implies that Q does not satisfy the lower bound test, which gives the lemma. Suppose that it is not the case. We place ourselves at the step when Q is considered. As a consequence, Q minimizes c(x Q b v ) among the paths in L. Let P and x M be as in Assumption (5). By definition of P and x M, the hypothesis x Q b v x M implies c(x P ) < c(x Q b v ) c UB when Q is considered. Lemma 2 implies that there is a subpath P of P in L when Q is considered. By monotonicity of c we have c(x P b v ) c(x P ) < c(x Q b v ). This contradicts the fact that Q minimizes c(x Q b v ) among the paths in L, and gives the lemma. Lemma 4. Suppose that (a), (b), or (c) is satisfied, then there is a finite number of paths in D that satisfy the lower-bound test. 10
11 Proof. In case (a), graph D is acyclic and there is a finite number of paths. We now suppose that we are in case (b) or (c): let x M be as in one Assumption (5). Lemma 3 ensures that only o-v paths P such that x P b v q M can satisfy the lower bound test. We show the lemma by proving that there is a finite number of such paths. As we are in case (b) or (c), any elementary cycle C in D satisfies x C > 0. Thus, given an elementary cycle C, an elementary path Q, and a vertex v in P, as the resource of C is positive, Assumption (4) implies that there exists an integer n C,Q,v such that (n C,Q,v x C ) x Q b v x M. As there is a finite number of elementary paths and a finite number of elementary cycles in D, we can define n to be an integer such that (6) (nx C ) x Q b v x M for any elementary cycle C, elementary path Q, and boundb v. Let n C be the number of elementary cycles in D. The proof of case (b) relies on the following well-known result. Any path in a directed graph can be decomposed in a sequence of elementary paths and elementary cycles. Suppose that we are in case (b), let P be a path with at least 2nn C V arcs and consider such a decomposition. As an elementary path or an elementary cycle contains at most V arcs, this decomposition contains at least nn C cycles, and thus at least n copies of a given cycle C 0. As the resource of all arcs are positive by hypothesis of case (b), we have x P nx C0. We therefore have x P b v nx C0 b v, and by applying Equation (6) with the empty path as Q, we obtain x P b v x M. As a consequence, only o-v paths P with fewer than 2nn C V arcs can satisfy x P b v q m, and Lemma 3 ensures that there is a finite number of paths that satisfy the lower bound test in case (b). We now consider case (c). As the monoid is supposed to be commutative, the resource of a path does not depend on the order of the sequence of its arcs, but only on its multiset of arcs. The proof of case (c) relies on the following well-known result. The multiset of arcs of any path in a directed graph can be decomposed in the union of the sets of arcs of an elementary path and of several elementary cycles. Supposethat we are in case (c), let P be a path with at least n V (n C +1) arcs and consider such a decomposition where Q denotes the elementary path. As by hypothesis of case (c), the operator is commutative, the resource of P is entirely defined by the resource of its arcs, independently of their order. As an elementary path or an elementary cycle contains at most V arcs, this decomposition contains at least nn C cycles, and thus at least n copies of a given cycle C 0. As, by hypothesis of case (c), all cycles are positive, we have x P b v nx C0 x Q b v. Equation 6 ensures that only paths with less than n V (n C +1) arcs can satisfy x P b v q m, and Lemma 3 ensures that there is a finite number of paths that satisfy the lower bound test in case (c). Proof of Theorem 1. As any path inserted in L is the extension of a previously considered path, a given path is considered at most once by the algorithm. Thus, Lemma 4 implies the convergence after a finite number of iterations as only paths satisfying the lower bound test can be extended by the algorithm. At the end of the algorithm, list L is empty and Lemma 2 ensures that c UB is a lower bound on the cost of any o-d path satisfying ρ(x P ) = 0. Besides, Step 2 of the algorithm ensures that if c UB is different from +, then there is a path P such that c(x P ) = c UB and ρ(x P) = 0. This concludes the proof Label correcting and label dominance algorithms. Theorem 5. Suppose that the resource of any cycle C in D satisfies x C 0, then the label correcting algorithm converges after a finite number of iterations, and at the end, if c UB is finite, 11
12 then c UB is the cost of a non-dominated optimal solution of the Monoid Resource Constrained Shortest Path Problem. Otherwise, the problem admits no feasible solutions. Theorem 6. Suppose that the resource of any cycle C in D satisfies x C 0, then the label dominance algorithm converges after a finite number of iterations, and at the end, if c UB is finite, then c UB is the cost of a non-dominated optimal solution of the Monoid Resource Constrained Shortest Path Problem. Otherwise, the problem admits no feasible solutions. Remark that the label correcting and the label dominance algorithms converge under weaker conditions than those required for the convergence of the generalized algorithm in Theorem 1. Lemma 7. Suppose that the resource of any C in D satisfies x C 0, then if a path P containing a cycle is considered by the label dominance or the label correcting algorithms, then it does not satisfy the dominance test (dom). Proof. As paths in L are added by extension of paths previously in L, we only need to prove the result for paths ending by a cycle. Let P be such a path, let Q + C be its decomposition into a path and a cycle, and let v be the common destination vertex of P and Q. By hypothesis, we have x C 0. As a consequence, x P = x Q x C x Q. As P is processed, all its subpaths have been extended by the algorithm, and thus path Q has necessarily been extended. This implies that either Q or a path Q such that x Q < x Q x P is in M v, and thus P is dominated by a path in M v and is therefore not extended. Proof of Theorem 5. As any path inserted in L is the extension of a previously considered path, a given path is considered at most once by the algorithm. Thus, as there is only a finite number of acyclic paths in a graph, Lemma 7 ensures that the algorithm converges after a finite number of iterations. Step (b) of the algorithm ensures that c UB is non-smaller than the cost of an optimal solution of the Monoid Resource Constrained Shortest Path Problem. We now prove that at the end of the algorithm, c UB is equal to the cost of an optimal solution. Indeed, suppose that it is not the case. Let P be an optimal solution. Let L be the set of all the paths that have been contained in L along the algorithm, and for each vertex v in P, let P ov be the subpath of P starting v. Let v be the last vertex of P such that there is an o-v path Q in L with x Q x Pov. It exists because the empty path P oo is added to L at the beginning of the algorithm, and is therefore in L. Besides, it is not equal to d, as otherwise we would have c UB c(x P ). Among the o-v paths dominating P ov in L, let Q be the first one generated by the algorithm. By definition of Q and as any path that has been in M v along the algorithm is in L, there is no path dominating Q in M v when Q is processed. As c UB decreases along the algorithm and by hypothesis, when Q is processed we have ρ(x Q b v ) ρ(x Pov b v ) ρ(x P ) = 0 and c(x Q b v ) c(x Pov b v ) c(x P ) < c UB. As a consequence, Q has been extended, and Q+(v,w) is in L, where w be the vertex after v in P. Besides, we have x Q+(v,w) = x Q x (v,w) x Pov x (v,w) = x Pow, which contradicts the definition of v. The proof of Theorem 6 is analogous and can be found in [71]. 5. Bounding algorithms We now come to the computation of lower bounds b v on the resource of any v-d path P. We have already mentioned in the intruction that such lower bounds b v satisfy b v b opt v, where b opt v = P P vd x P, and P vd is the set of v-d paths. The bound b opt v is therefore the best lower bound. We prove in Proposition 4.11 of [71] the following complexity results on the computation of b opt v. 12
13 Proposition 8. Unless P = NP, there is no polynomial algorithm independent of R that enables to compute b opt v even when restricted to a commutative monoid with positive resources. The proof is a reduction of the usual resource constrained shortest path problem. Computing b opt v is therefore difficult in the general case. However, Theorem 9 shows that when distributes with respect to, b opt v can be computed in polynomial time. The remaining of the section intruces polynomial procedures to compute lower bounds on b opt 5.1. Extended Ford-Bellman algorithm. Let (b n v ) n be the sequence of tuples of resources defined recursively as follows. b n d = 0, (7) b 0 v = and bn+1 v = b n v (v,u) δ + (v) As R is a complete lattice, we can define b v = v. (x (v,u) b n u ) for v V\{d}. n Z + b n v for each vertex v. Let bn denote the tuple (b n v) v V. Recall that we have defined b = (b v) v V to be the greatest solution of the following equation. (8) b d = 0, b v = b v (v,u) δ + (v) (x (v,u) b u ) for all v V\{d}. The existence of a greatest solution of Equation (8) is a direct consequence of the Knaster-Tarski fixed point theorem applied in the complete pruct lattice R V. This theorem states that the set of fixed points of a monotone mapping in a complete lattice is a non-empty complete lattice. Details on the Knaster-Tarski fixed point theorem can be found in [24]. We underline that both b v and b v may be defined only in the completion of R. Theorem 9. Let l be the length of the longest elementary v-d path. If x C 0 for each cycle C in D, then for each vertex and v-d path P, we have (9) b v b v bl v bopt v x P If distributes with respect to, then three first inequalities are equalities. Thesebounds b l v are go candidates to be used as bounds b v on the resource x P of all v-d paths P in the enumeration algorithms of Section 4. Indeed, they can becomputed in O( A l ) operations and bycomputingthel firsttermsofsequence(b n ) n usingitsdefinitioninequation(7). Besides, the sequence (b n ) n can be interpreted as a generalization of the Ford-Bellman algorithm. Indeed, when (R,, ) = (R,+, ), or more generally when (R,, ) is a totally ordered group, the meet x 1 x 2 of two resources x 1 and x 2 is the minimum of x 1 and x 2. In that case, the sequence of Equation (7) corresponds to the successive steps of the Ford-Bellman shortest path algorithm, and for each integer k, the bound b k v is the value of a shortest o-v path with at most k arcs. The proof of Theorem 9 relies on two lemmas. The mapping F : R V R V defined as follows is useful in the proof. b d = 0, (10) F(b) = b with b v = b v (x (v,u) b u ) for all v V\{d}, (v,u) δ + (v) 13
14 where R V denotes the Cartesian pruct. Note that b n+1 = F (b n ) and that F is isotone by monotonicity of the operators and. Lemma 10. For each vertex v and integer n, we have b v b v b n v. Proof. A straightforward induction on n based on the isotony of mapping F defined in Equation(10) gives b v b n v for all n, which implies that b v b v. Lemma 11. The resource b k v is a lower bound on the resource x P of the v-d paths P of length at most k. When distributes with respect to, b k v is the meet of the resources of the v-d paths of length at most k. Proof. The result is proved by induction on k. The result for k = 0, i.e. b 0 v is equal to 0 if v = d and otherwise, follows from the fact that the only path of length 0 is the trivial path. Let k > 0 be an integer and suppose the result is true up to k 1, let v be a vertex, and let P be a v-d path with l(p) k. If l(p) = 0 then v = d and x P b k d = 0. Otherwise let (v,u) be the first arc of P and Q be the subpath of P obtained by removing (v,u) from P. Then l(q) k 1, thus bu k 1 x Q which implies x (v,u) bu k 1 x (v,u) x Q and finally b k v x P, which gives that b k v is a lower bound on the resource x P of the v-d paths P of length at most k. When distributes with respect to, we have x 1 (x 2 x 3 ) = (x 1 x 2 ) (x 1 x 3 ). Suppose that bu k 1 is the meet of the resource of all the v-d paths of length at most k for each vertex u. Then x (v,u) bu k 1 is the meet of the resources x P of all the v-d paths P starting by (v,u) such ( ) that l(p) k. Thus bv k 1 x (v,u) bu k 1 is the meet of all the v-d paths of length at most k. (v,u) δ + (v) Proof of Theorem 9. As the resource of any cycle C in D satisfies x C 0, for each o-d path P, there is an elementary o-d path P such that x P x P. Hence, b opt v is the meet of the resources of all the elementary o-d paths. As the length of any elementary v-d path is non greater than l, Lemma 11 implies that b l v x P for all elementary v-d paths P, and thus b l v b opt v. Lemma 10 then gives Equation (9). Suppose now that distributes with respect to. We already mentioned that x C 0 for all cycles C implies that b opt v is themeet of all theelementary o-dpaths. As the length of an elementary path is non greater than l, Lemma 11 implies that b l v = b opt v. This implies that F(b l ) = b l and b l v is a solution of Equation (8). Thus, b l v = b v, which gives the result. Remark 2. If there are cycles with negative resources in D, then Theorem 9 remains true provided that, first, P is an elementary v-d path, and second, b opt v is defined as the meet of the resources of all the elementary v-d paths. Besides, Lemma 11 implies that b v = b v =. Remark 3. The sequence (b n ) n is the sequence used in the constructive proof by Cousot & Cousot [23] of the Knaster-Tarski fixed point theorem for mapping the F defined in Equation (10). Given a topology and some weak assumptions on R, it can be proved that b n v converges to b v and b v = b v. Theinequality (v,u) δ + (v) (x (v,u) b u ) b v is easy to prove: indeed, as x (v,u) b u x (v,u) b n u for each arc (v,u) in δ + (v) and for all n in Z +, we have (v,u) δ + (v) (x (v,u) b u ) (v,u) δ + (v) (x (v,u) b n u) = b n+1 v for all n Z +, which gives the result. The inequality (v,u) δ + (v) (x (v,u) b u ) b v requires a transfinite induction Generalized Dijkstra algorithm for faster bound computations. In all our numerical experiments, we have observed that practically, b v = b v = bl v. Therefore, the bounds we obtain if we compute b v are as go as those we obtain if we compute b l. When distributes with respect 14 v
3 No-Wait Job Shops with Variable Processing Times
3 No-Wait Job Shops with Variable Processing Times In this chapter we assume that, on top of the classical no-wait job shop setting, we are given a set of processing times for each operation. We may select
CS599: Convex and Combinatorial Optimization Fall 2013 Lecture 14: Combinatorial Problems as Linear Programs I. Instructor: Shaddin Dughmi
CS599: Convex and Combinatorial Optimization Fall 2013 Lecture 14: Combinatorial Problems as Linear Programs I Instructor: Shaddin Dughmi Announcements Posted solutions to HW1 Today: Combinatorial problems
15.082J and 6.855J. Lagrangian Relaxation 2 Algorithms Application to LPs
15.082J and 6.855J Lagrangian Relaxation 2 Algorithms Application to LPs 1 The Constrained Shortest Path Problem (1,10) 2 (1,1) 4 (2,3) (1,7) 1 (10,3) (1,2) (10,1) (5,7) 3 (12,3) 5 (2,2) 6 Find the shortest
The Encoding Complexity of Network Coding
The Encoding Complexity of Network Coding Michael Langberg Alexander Sprintson Jehoshua Bruck California Institute of Technology Email: mikel,spalex,bruck @caltech.edu Abstract In the multicast network
Theorem 2.9: nearest addition algorithm
There are severe limits on our ability to compute near-optimal tours It is NP-complete to decide whether a given undirected =(,)has a Hamiltonian cycle An approximation algorithm for the TSP can be used
Algorithms for Integer Programming
Algorithms for Integer Programming Laura Galli November 9, 2016 Unlike linear programming problems, integer programming problems are very difficult to solve. In fact, no efficient general algorithm is
Adaptations of the A* Algorithm for the Computation of Fastest Paths in Deterministic Discrete-Time Dynamic Networks
60 IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, VOL. 3, NO. 1, MARCH 2002 Adaptations of the A* Algorithm for the Computation of Fastest Paths in Deterministic Discrete-Time Dynamic Networks
Faster parameterized algorithms for Minimum Fill-In
Faster parameterized algorithms for Minimum Fill-In Hans L. Bodlaender Pinar Heggernes Yngve Villanger Technical Report UU-CS-2008-042 December 2008 Department of Information and Computing Sciences Utrecht
Monotone Paths in Geometric Triangulations
Monotone Paths in Geometric Triangulations Adrian Dumitrescu Ritankar Mandal Csaba D. Tóth November 19, 2017 Abstract (I) We prove that the (maximum) number of monotone paths in a geometric triangulation
MOST attention in the literature of network codes has
3862 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 56, NO. 8, AUGUST 2010 Efficient Network Code Design for Cyclic Networks Elona Erez, Member, IEEE, and Meir Feder, Fellow, IEEE Abstract This paper introduces
Fast algorithms for max independent set
Fast algorithms for max independent set N. Bourgeois 1 B. Escoffier 1 V. Th. Paschos 1 J.M.M. van Rooij 2 1 LAMSADE, CNRS and Université Paris-Dauphine, France {bourgeois,escoffier,paschos}@lamsade.dauphine.fr
/ Approximation Algorithms Lecturer: Michael Dinitz Topic: Linear Programming Date: 2/24/15 Scribe: Runze Tang
600.469 / 600.669 Approximation Algorithms Lecturer: Michael Dinitz Topic: Linear Programming Date: 2/24/15 Scribe: Runze Tang 9.1 Linear Programming Suppose we are trying to approximate a minimization
6. Lecture notes on matroid intersection
Massachusetts Institute of Technology 18.453: Combinatorial Optimization Michel X. Goemans May 2, 2017 6. Lecture notes on matroid intersection One nice feature about matroids is that a simple greedy algorithm
EXERCISES SHORTEST PATHS: APPLICATIONS, OPTIMIZATION, VARIATIONS, AND SOLVING THE CONSTRAINED SHORTEST PATH PROBLEM. 1 Applications and Modelling
SHORTEST PATHS: APPLICATIONS, OPTIMIZATION, VARIATIONS, AND SOLVING THE CONSTRAINED SHORTEST PATH PROBLEM EXERCISES Prepared by Natashia Boland 1 and Irina Dumitrescu 2 1 Applications and Modelling 1.1
2386 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 52, NO. 6, JUNE 2006
2386 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 52, NO. 6, JUNE 2006 The Encoding Complexity of Network Coding Michael Langberg, Member, IEEE, Alexander Sprintson, Member, IEEE, and Jehoshua Bruck,
Faster parameterized algorithms for Minimum Fill-In
Faster parameterized algorithms for Minimum Fill-In Hans L. Bodlaender Pinar Heggernes Yngve Villanger Abstract We present two parameterized algorithms for the Minimum Fill-In problem, also known as Chordal
Introduction to Graph Theory
Introduction to Graph Theory Tandy Warnow January 20, 2017 Graphs Tandy Warnow Graphs A graph G = (V, E) is an object that contains a vertex set V and an edge set E. We also write V (G) to denote the vertex
Single Source Shortest Path
Single Source Shortest Path A directed graph G = (V, E) and a pair of nodes s, d is given. The edges have a real-valued weight W i. This time we are looking for the weight and the shortest path from s
Mathematical and Algorithmic Foundations Linear Programming and Matchings
Adavnced Algorithms Lectures Mathematical and Algorithmic Foundations Linear Programming and Matchings Paul G. Spirakis Department of Computer Science University of Patras and Liverpool Paul G. Spirakis
Linear Programming in Small Dimensions
Linear Programming in Small Dimensions Lekcija 7 sergio.cabello@fmf.uni-lj.si FMF Univerza v Ljubljani Edited from slides by Antoine Vigneron Outline linear programming, motivation and definition one dimensional
/633 Introduction to Algorithms Lecturer: Michael Dinitz Topic: Approximation algorithms Date: 11/27/18
601.433/633 Introduction to Algorithms Lecturer: Michael Dinitz Topic: Approximation algorithms Date: 11/27/18 22.1 Introduction We spent the last two lectures proving that for certain problems, we can
CS 473: Algorithms. Ruta Mehta. Spring University of Illinois, Urbana-Champaign. Ruta (UIUC) CS473 1 Spring / 36
CS 473: Algorithms Ruta Mehta University of Illinois, Urbana-Champaign Spring 2018 Ruta (UIUC) CS473 1 Spring 2018 1 / 36 CS 473: Algorithms, Spring 2018 LP Duality Lecture 20 April 3, 2018 Some of the
Greedy Algorithms 1 {K(S) K(S) C} For large values of d, brute force search is not feasible because there are 2 d {1,..., d}.
Greedy Algorithms 1 Simple Knapsack Problem Greedy Algorithms form an important class of algorithmic techniques. We illustrate the idea by applying it to a simplified version of the Knapsack Problem. Informally,
Solution for Homework set 3
TTIC 300 and CMSC 37000 Algorithms Winter 07 Solution for Homework set 3 Question (0 points) We are given a directed graph G = (V, E), with two special vertices s and t, and non-negative integral capacities
Rigidity, connectivity and graph decompositions
First Prev Next Last Rigidity, connectivity and graph decompositions Brigitte Servatius Herman Servatius Worcester Polytechnic Institute Page 1 of 100 First Prev Next Last Page 2 of 100 We say that a framework
Chordal deletion is fixed-parameter tractable
Chordal deletion is fixed-parameter tractable Dániel Marx Institut für Informatik, Humboldt-Universität zu Berlin, Unter den Linden 6, 10099 Berlin, Germany. dmarx@informatik.hu-berlin.de Abstract. It
CS261: A Second Course in Algorithms Lecture #16: The Traveling Salesman Problem
CS61: A Second Course in Algorithms Lecture #16: The Traveling Salesman Problem Tim Roughgarden February 5, 016 1 The Traveling Salesman Problem (TSP) In this lecture we study a famous computational problem,
Scan Scheduling Specification and Analysis
Scan Scheduling Specification and Analysis Bruno Dutertre System Design Laboratory SRI International Menlo Park, CA 94025 May 24, 2000 This work was partially funded by DARPA/AFRL under BAE System subcontract
The External Network Problem
The External Network Problem Jan van den Heuvel and Matthew Johnson CDAM Research Report LSE-CDAM-2004-15 December 2004 Abstract The connectivity of a communications network can often be enhanced if the
Approximation Algorithms: The Primal-Dual Method. My T. Thai
Approximation Algorithms: The Primal-Dual Method My T. Thai 1 Overview of the Primal-Dual Method Consider the following primal program, called P: min st n c j x j j=1 n a ij x j b i j=1 x j 0 Then the
A CSP Search Algorithm with Reduced Branching Factor
A CSP Search Algorithm with Reduced Branching Factor Igor Razgon and Amnon Meisels Department of Computer Science, Ben-Gurion University of the Negev, Beer-Sheva, 84-105, Israel {irazgon,am}@cs.bgu.ac.il
CPSC 536N: Randomized Algorithms Term 2. Lecture 10
CPSC 536N: Randomized Algorithms 011-1 Term Prof. Nick Harvey Lecture 10 University of British Columbia In the first lecture we discussed the Max Cut problem, which is NP-complete, and we presented a very
On the Relationships between Zero Forcing Numbers and Certain Graph Coverings
On the Relationships between Zero Forcing Numbers and Certain Graph Coverings Fatemeh Alinaghipour Taklimi, Shaun Fallat 1,, Karen Meagher 2 Department of Mathematics and Statistics, University of Regina,
Dynamic programming. Trivial problems are solved first More complex solutions are composed from the simpler solutions already computed
Dynamic programming Solves a complex problem by breaking it down into subproblems Each subproblem is broken down recursively until a trivial problem is reached Computation itself is not recursive: problems
Lecture notes on the simplex method September We will present an algorithm to solve linear programs of the form. maximize.
Cornell University, Fall 2017 CS 6820: Algorithms Lecture notes on the simplex method September 2017 1 The Simplex Method We will present an algorithm to solve linear programs of the form maximize subject
22 Elementary Graph Algorithms. There are two standard ways to represent a
VI Graph Algorithms Elementary Graph Algorithms Minimum Spanning Trees Single-Source Shortest Paths All-Pairs Shortest Paths 22 Elementary Graph Algorithms There are two standard ways to represent a graph
The Size Robust Multiple Knapsack Problem
MASTER THESIS ICA-3251535 The Size Robust Multiple Knapsack Problem Branch and Price for the Separate and Combined Recovery Decomposition Model Author: D.D. Tönissen, Supervisors: dr. ir. J.M. van den
LECTURES 3 and 4: Flows and Matchings
LECTURES 3 and 4: Flows and Matchings 1 Max Flow MAX FLOW (SP). Instance: Directed graph N = (V,A), two nodes s,t V, and capacities on the arcs c : A R +. A flow is a set of numbers on the arcs such that
FUTURE communication networks are expected to support
1146 IEEE/ACM TRANSACTIONS ON NETWORKING, VOL 13, NO 5, OCTOBER 2005 A Scalable Approach to the Partition of QoS Requirements in Unicast and Multicast Ariel Orda, Senior Member, IEEE, and Alexander Sprintson,
Module 11. Directed Graphs. Contents
Module 11 Directed Graphs Contents 11.1 Basic concepts......................... 256 Underlying graph of a digraph................ 257 Out-degrees and in-degrees.................. 258 Isomorphism..........................
These are not polished as solutions, but ought to give a correct idea of solutions that work. Note that most problems have multiple good solutions.
CSE 591 HW Sketch Sample Solutions These are not polished as solutions, but ought to give a correct idea of solutions that work. Note that most problems have multiple good solutions. Problem 1 (a) Any
Chapter 9 Graph Algorithms
Chapter 9 Graph Algorithms 2 Introduction graph theory useful in practice represent many real-life problems can be if not careful with data structures 3 Definitions an undirected graph G = (V, E) is a
Solutions for the Exam 6 January 2014
Mastermath and LNMB Course: Discrete Optimization Solutions for the Exam 6 January 2014 Utrecht University, Educatorium, 13:30 16:30 The examination lasts 3 hours. Grading will be done before January 20,
Lecture 5: Duality Theory
Lecture 5: Duality Theory Rajat Mittal IIT Kanpur The objective of this lecture note will be to learn duality theory of linear programming. We are planning to answer following questions. What are hyperplane
Lecture Overview. 2 Shortest s t path. 2.1 The LP. 2.2 The Algorithm. COMPSCI 530: Design and Analysis of Algorithms 11/14/2013
COMPCI 530: Design and Analysis of Algorithms 11/14/2013 Lecturer: Debmalya Panigrahi Lecture 22 cribe: Abhinandan Nath 1 Overview In the last class, the primal-dual method was introduced through the metric
Lecture 10,11: General Matching Polytope, Maximum Flow. 1 Perfect Matching and Matching Polytope on General Graphs
CMPUT 675: Topics in Algorithms and Combinatorial Optimization (Fall 2009) Lecture 10,11: General Matching Polytope, Maximum Flow Lecturer: Mohammad R Salavatipour Date: Oct 6 and 8, 2009 Scriber: Mohammad
Paths, Flowers and Vertex Cover
Paths, Flowers and Vertex Cover Venkatesh Raman M. S. Ramanujan Saket Saurabh Abstract It is well known that in a bipartite (and more generally in a König) graph, the size of the minimum vertex cover is
Math 5593 Linear Programming Lecture Notes
Math 5593 Linear Programming Lecture Notes Unit II: Theory & Foundations (Convex Analysis) University of Colorado Denver, Fall 2013 Topics 1 Convex Sets 1 1.1 Basic Properties (Luenberger-Ye Appendix B.1).........................
CS 372: Computational Geometry Lecture 10 Linear Programming in Fixed Dimension
CS 372: Computational Geometry Lecture 10 Linear Programming in Fixed Dimension Antoine Vigneron King Abdullah University of Science and Technology November 7, 2012 Antoine Vigneron (KAUST) CS 372 Lecture
The complement of PATH is in NL
340 The complement of PATH is in NL Let c be the number of nodes in graph G that are reachable from s We assume that c is provided as an input to M Given G, s, t, and c the machine M operates as follows:
A GRAPH FROM THE VIEWPOINT OF ALGEBRAIC TOPOLOGY
A GRAPH FROM THE VIEWPOINT OF ALGEBRAIC TOPOLOGY KARL L. STRATOS Abstract. The conventional method of describing a graph as a pair (V, E), where V and E repectively denote the sets of vertices and edges,
Solution Approaches for the Elementary Shortest Path Problem
Solution Approaches for the Elementary Shortest Path Problem Luigi Di Puglia Pugliese Francesca Guerriero Department of Electronics, Computer Science and Systems, University of Calabria, Rende, Italy.
Boolean networks, local models, and finite polynomial dynamical systems
Boolean networks, local models, and finite polynomial dynamical systems Matthew Macauley Department of Mathematical Sciences Clemson University http://www.math.clemson.edu/~macaule/ Math 4500, Spring 2017
K 4 C 5. Figure 4.5: Some well known family of graphs
08 CHAPTER. TOPICS IN CLASSICAL GRAPH THEORY K, K K K, K K, K K, K C C C C 6 6 P P P P P. Graph Operations Figure.: Some well known family of graphs A graph Y = (V,E ) is said to be a subgraph of a graph
12.1 Formulation of General Perfect Matching
CSC5160: Combinatorial Optimization and Approximation Algorithms Topic: Perfect Matching Polytope Date: 22/02/2008 Lecturer: Lap Chi Lau Scribe: Yuk Hei Chan, Ling Ding and Xiaobing Wu In this lecture,
A Vizing-like theorem for union vertex-distinguishing edge coloring
A Vizing-like theorem for union vertex-distinguishing edge coloring Nicolas Bousquet, Antoine Dailly, Éric Duchêne, Hamamache Kheddouci, Aline Parreau Abstract We introduce a variant of the vertex-distinguishing
Distributed minimum spanning tree problem
Distributed minimum spanning tree problem Juho-Kustaa Kangas 24th November 2012 Abstract Given a connected weighted undirected graph, the minimum spanning tree problem asks for a spanning subtree with
Chapter 9 Graph Algorithms
Introduction graph theory useful in practice represent many real-life problems can be if not careful with data structures Chapter 9 Graph s 2 Definitions Definitions an undirected graph is a finite set
Lecture 2 - Introduction to Polytopes
Lecture 2 - Introduction to Polytopes Optimization and Approximation - ENS M1 Nicolas Bousquet 1 Reminder of Linear Algebra definitions Let x 1,..., x m be points in R n and λ 1,..., λ m be real numbers.
THREE LECTURES ON BASIC TOPOLOGY. 1. Basic notions.
THREE LECTURES ON BASIC TOPOLOGY PHILIP FOTH 1. Basic notions. Let X be a set. To make a topological space out of X, one must specify a collection T of subsets of X, which are said to be open subsets of
1 Variations of the Traveling Salesman Problem
Stanford University CS26: Optimization Handout 3 Luca Trevisan January, 20 Lecture 3 In which we prove the equivalence of three versions of the Traveling Salesman Problem, we provide a 2-approximate algorithm,
The Structure of Bull-Free Perfect Graphs
The Structure of Bull-Free Perfect Graphs Maria Chudnovsky and Irena Penev Columbia University, New York, NY 10027 USA May 18, 2012 Abstract The bull is a graph consisting of a triangle and two vertex-disjoint
x ji = s i, i N, (1.1)
Dual Ascent Methods. DUAL ASCENT In this chapter we focus on the minimum cost flow problem minimize subject to (i,j) A {j (i,j) A} a ij x ij x ij {j (j,i) A} (MCF) x ji = s i, i N, (.) b ij x ij c ij,
Dual-Based Approximation Algorithms for Cut-Based Network Connectivity Problems
Dual-Based Approximation Algorithms for Cut-Based Network Connectivity Problems Benjamin Grimmer bdg79@cornell.edu arxiv:1508.05567v2 [cs.ds] 20 Jul 2017 Abstract We consider a variety of NP-Complete network
On the Max Coloring Problem
On the Max Coloring Problem Leah Epstein Asaf Levin May 22, 2010 Abstract We consider max coloring on hereditary graph classes. The problem is defined as follows. Given a graph G = (V, E) and positive
{ 1} Definitions. 10. Extremal graph theory. Problem definition Paths and cycles Complete subgraphs
Problem definition Paths and cycles Complete subgraphs 10. Extremal graph theory 10.1. Definitions Let us examine the following forbidden subgraph problems: At most how many edges are in a graph of order
Math 170- Graph Theory Notes
1 Math 170- Graph Theory Notes Michael Levet December 3, 2018 Notation: Let n be a positive integer. Denote [n] to be the set {1, 2,..., n}. So for example, [3] = {1, 2, 3}. To quote Bud Brown, Graph theory
Linear Programming Duality and Algorithms
COMPSCI 330: Design and Analysis of Algorithms 4/5/2016 and 4/7/2016 Linear Programming Duality and Algorithms Lecturer: Debmalya Panigrahi Scribe: Tianqi Song 1 Overview In this lecture, we will cover
Vertex 3-colorability of claw-free graphs
Algorithmic Operations Research Vol.2 (27) 5 2 Vertex 3-colorability of claw-free graphs Marcin Kamiński a Vadim Lozin a a RUTCOR - Rutgers University Center for Operations Research, 64 Bartholomew Road,
Geometric Unique Set Cover on Unit Disks and Unit Squares
CCCG 2016, Vancouver, British Columbia, August 3 5, 2016 Geometric Unique Set Cover on Unit Disks and Unit Squares Saeed Mehrabi Abstract We study the Unique Set Cover problem on unit disks and unit squares.
1 Linear programming relaxation
Cornell University, Fall 2010 CS 6820: Algorithms Lecture notes: Primal-dual min-cost bipartite matching August 27 30 1 Linear programming relaxation Recall that in the bipartite minimum-cost perfect matching
CS261: Problem Set #1
CS261: Problem Set #1 Due by 11:59 PM on Tuesday, April 21, 2015 Instructions: (1) Form a group of 1-3 students. You should turn in only one write-up for your entire group. (2) Turn in your solutions by
Lecture 7: Asymmetric K-Center
Advanced Approximation Algorithms (CMU 18-854B, Spring 008) Lecture 7: Asymmetric K-Center February 5, 007 Lecturer: Anupam Gupta Scribe: Jeremiah Blocki In this lecture, we will consider the K-center
Network Topology and Equilibrium Existence in Weighted Network Congestion Games
Network Topology and Equilibrium Existence in Weighted Network Congestion Games Igal Milchtaich, Bar-Ilan University August 2010 Abstract. Every finite noncooperative game can be presented as a weighted
Randomized algorithms have several advantages over deterministic ones. We discuss them here:
CS787: Advanced Algorithms Lecture 6: Randomized Algorithms In this lecture we introduce randomized algorithms. We will begin by motivating the use of randomized algorithms through a few examples. Then
Chapter 9 Graph Algorithms
Chapter 9 Graph Algorithms 2 Introduction graph theory useful in practice represent many real-life problems can be slow if not careful with data structures 3 Definitions an undirected graph G = (V, E)
11/22/2016. Chapter 9 Graph Algorithms. Introduction. Definitions. Definitions. Definitions. Definitions
Introduction Chapter 9 Graph Algorithms graph theory useful in practice represent many real-life problems can be slow if not careful with data structures 2 Definitions an undirected graph G = (V, E) is
Principles of AI Planning. Principles of AI Planning. 7.1 How to obtain a heuristic. 7.2 Relaxed planning tasks. 7.1 How to obtain a heuristic
Principles of AI Planning June 8th, 2010 7. Planning as search: relaxed planning tasks Principles of AI Planning 7. Planning as search: relaxed planning tasks Malte Helmert and Bernhard Nebel 7.1 How to
Ma/CS 6a Class 27: Shortest Paths
// Ma/CS a Class 7: Shortest Paths By Adam Sheffer Naïve Path Planning Problem. We are given a map with cities and noncrossing roads between pairs of cities. Describe an algorithm for finding a path between
Greedy Algorithms 1. For large values of d, brute force search is not feasible because there are 2 d
Greedy Algorithms 1 Simple Knapsack Problem Greedy Algorithms form an important class of algorithmic techniques. We illustrate the idea by applying it to a simplified version of the Knapsack Problem. Informally,
Min-Cost Multicast Networks in Euclidean Space
Min-Cost Multicast Networks in Euclidean Space Xunrui Yin, Yan Wang, Xin Wang, Xiangyang Xue School of Computer Science Fudan University {09110240030,11110240029,xinw,xyxue}@fudan.edu.cn Zongpeng Li Dept.
CSE 417 Branch & Bound (pt 4) Branch & Bound
CSE 417 Branch & Bound (pt 4) Branch & Bound Reminders > HW8 due today > HW9 will be posted tomorrow start early program will be slow, so debugging will be slow... Review of previous lectures > Complexity
1 The Traveling Salesperson Problem (TSP)
CS 598CSC: Approximation Algorithms Lecture date: January 23, 2009 Instructor: Chandra Chekuri Scribe: Sungjin Im In the previous lecture, we had a quick overview of several basic aspects of approximation
Basic Graph Theory with Applications to Economics
Basic Graph Theory with Applications to Economics Debasis Mishra February, 0 What is a Graph? Let N = {,..., n} be a finite set. Let E be a collection of ordered or unordered pairs of distinct elements
Topic: Local Search: Max-Cut, Facility Location Date: 2/13/2007
CS880: Approximations Algorithms Scribe: Chi Man Liu Lecturer: Shuchi Chawla Topic: Local Search: Max-Cut, Facility Location Date: 2/3/2007 In previous lectures we saw how dynamic programming could be
Computation with No Memory, and Rearrangeable Multicast Networks
Discrete Mathematics and Theoretical Computer Science DMTCS vol. 16:1, 2014, 121 142 Computation with No Memory, and Rearrangeable Multicast Networks Serge Burckel 1 Emeric Gioan 2 Emmanuel Thomé 3 1 ERMIT,
Integer Programming Theory
Integer Programming Theory Laura Galli October 24, 2016 In the following we assume all functions are linear, hence we often drop the term linear. In discrete optimization, we seek to find a solution x
Problem Set 2 Solutions
Problem Set 2 Solutions Graph Theory 2016 EPFL Frank de Zeeuw & Claudiu Valculescu 1. Prove that the following statements about a graph G are equivalent. - G is a tree; - G is minimally connected (it is
Advanced Operations Research Prof. G. Srinivasan Department of Management Studies Indian Institute of Technology, Madras
Advanced Operations Research Prof. G. Srinivasan Department of Management Studies Indian Institute of Technology, Madras Lecture - 35 Quadratic Programming In this lecture, we continue our discussion on
arxiv: v2 [cs.ds] 30 Nov 2012
A New Upper Bound for the Traveling Salesman Problem in Cubic Graphs Maciej Liśkiewicz 1 and Martin R. Schuster 1 1 Institute of Theoretical Computer Science, University of Lübeck Ratzeburger Allee 160,
Chapter 24. Shortest path problems. Chapter 24. Shortest path problems. 24. Various shortest path problems. Chapter 24. Shortest path problems
Chapter 24. Shortest path problems We are given a directed graph G = (V,E) with each directed edge (u,v) E having a weight, also called a length, w(u,v) that may or may not be negative. A shortest path
Approximation Algorithms
Approximation Algorithms Group Members: 1. Geng Xue (A0095628R) 2. Cai Jingli (A0095623B) 3. Xing Zhe (A0095644W) 4. Zhu Xiaolu (A0109657W) 5. Wang Zixiao (A0095670X) 6. Jiao Qing (A0095637R) 7. Zhang
Notes on Minimum Cuts and Modular Functions
Notes on Minimum Cuts and Modular Functions 1 Introduction The following are my notes on Cunningham s paper [1]. Given a submodular function f and a set S, submodular minimisation is the problem of finding
A step towards the Bermond-Thomassen conjecture about disjoint cycles in digraphs
A step towards the Bermond-Thomassen conjecture about disjoint cycles in digraphs Nicolas Lichiardopol Attila Pór Jean-Sébastien Sereni Abstract In 1981, Bermond and Thomassen conjectured that every digraph
CSE 417 Network Flows (pt 4) Min Cost Flows
CSE 417 Network Flows (pt 4) Min Cost Flows Reminders > HW6 is due Monday Review of last three lectures > Defined the maximum flow problem find the feasible flow of maximum value flow is feasible if it
Recognizing Interval Bigraphs by Forbidden Patterns
Recognizing Interval Bigraphs by Forbidden Patterns Arash Rafiey Simon Fraser University, Vancouver, Canada, and Indiana State University, IN, USA arashr@sfu.ca, arash.rafiey@indstate.edu Abstract Let
1. Lecture notes on bipartite matching February 4th,
1. Lecture notes on bipartite matching February 4th, 2015 6 1.1.1 Hall s Theorem Hall s theorem gives a necessary and sufficient condition for a bipartite graph to have a matching which saturates (or matches)
On the Page Number of Upward Planar Directed Acyclic Graphs
Journal of Graph Algorithms and Applications http://jgaa.info/ vol. 17, no. 3, pp. 221 244 (2013) DOI: 10.7155/jgaa.00292 On the Page Number of Upward Planar Directed Acyclic Graphs Fabrizio Frati 1 Radoslav
The Shortest Path Problem. The Shortest Path Problem. Mathematical Model. Integer Programming Formulation
The Shortest Path Problem jla,jc@imm.dtu.dk Department of Management Engineering Technical University of Denmark The Shortest Path Problem Given a directed network G = (V,E,w) for which the underlying
5. Lecture notes on matroid intersection
Massachusetts Institute of Technology Handout 14 18.433: Combinatorial Optimization April 1st, 2009 Michel X. Goemans 5. Lecture notes on matroid intersection One nice feature about matroids is that a