# 1 Variations of the Traveling Salesman Problem

Save this PDF as:

Size: px
Start display at page:

## Transcription

1 Stanford University CS26: Optimization Handout 3 Luca Trevisan January, 20 Lecture 3 In which we prove the equivalence of three versions of the Traveling Salesman Problem, we provide a 2-approximate algorithm, we review the notion of Eulerian cycle, we think of the TSP as the problem of finding a minimum-cost connected Eulerian graph, and we revisit the 2-approximate algorithm from this perspective. Variations of the Traveling Salesman Problem Recall that an input of the Traveling Salesman Problem is a set of points X and a nonnegative, symmetric, distance function d : X X R such that d(x, y) = d(y, x) 0 for every x, y X. The goal is to find a cycle C = v 0 v v 2 v m v m = v 0 that reaches every vertex and that has minimal total length cost d (C) := m i=0 d(v i, v i+ ). There are different versions of this problem depending on whether we require d(, ) to satisfy the triangle inequality or not, and whether we allow the loop to pass through the same point more than once.. General TSP without repetitions (General TSP-NR): we allow arbitrary symmetric distance functions, and we require the solution to be a cycle that contains every point exactly once; 2. General TSP with repetitions (General TSP-R): we allow arbitrary symmetric distance functions, and we allow all cycles as an admissible solution, even those that contain some point more than once; 3. Metric TSP without repetitions (Metric TSP-NR): we only allow inputs in which the distance function d(, ) satisfies the triangle inequality, that is x, y, z X. d(x, z) d(x, y) + d(y, z) and we only allow solutions in which each point is reached exactly once;

2 4. Metric TSP with repetitions (Metric TSP-R): we only allow inputs in which the distance function satisfies the triangle inequality, and we allow all cycles as admissible solutions, even those that contain some point more than once. If we allow arbitrary distance functions, and we require the solution to be a cycle that reaches every point exactly once, then we have a problem for which no kind of efficient approximation is possible. Fact If P NP then there is no polynomial-time constant-factor approximation algorithm for General TSP-NR. More generally, if there is a function r : N N such that r(n) can be computable in time polynomial in n (for example, r(n) = n2 ), and a polynomial time algorithm that, on input an instance (X, d) of General TSP-NR with n points finds a solution of cost at most r(n) times the optimum, then P = NP. The other three versions, however, are completely equivalent from the point of view of approximation and, as we will see, can be efficiently approximated reasonably well. Lemma 2 For every c, there is a polynomial time c-approximate algorithm for Metric TSP-NR if and only if there is a polynomial time c-approximate approximation algorithm for Metric TSP-R. In particular:. If (X, d) is a Metric TSP input, then the cost of the optimum is the same whether or not we allow repetitions. 2. Every c-approximate algorithm for Metric TSP-NR is also a c-approximate algorithm for Metric TSP-R. 3. Every c-approximate algorithm for Metric TSP-R can be turned into a c-approximate algorithm for Metric TSP-NR after adding a linear-time post-processing step. Proof: Let opt T SP R (X, d) be the cost of an optimal solution for (X, d) among all solutions with or without repetitions, and opt T SP NR (X, d) be the cost of an optimal solution for (X, d) among all solutions without repetitions. Then clearly in the former case we are minimizing over a larger set of possible solutions, and so opt T SP R (X, d) opt T SP NR (X, d) Consider now any cycle, possibly with repetitions, C = v 0 v v 2 v m v m = v 0. Create a new cycle C from C by removing from C all the repeated occurrences of any vertex. (With the special case of v 0 which is repeated at the end.) For 2

3 example, the cycle C = a c b a d b a becomes a c b d a. Because of the triangle inequality, the total length of C is at most the total length of C, and C is a cycle with no repetitions. If we apply the above process by taking C to be the optimal solution of (X, d) allowing repetitions, we see that opt T SP R (X, d) opt T SP NR (X, d) and so we have proved our first claim that opt T SP R (X, d) = opt T SP NR (X, d). Regarding the second claim, suppose that we have a c-approximate algorithm for Metric TSP-NR. Then, given an input (X, d) the algorithm finds a cycle C with no repetitions such that cost d (C) c opt T SP NR (X, d) but C is also an admissible solution for the problem Metric TSP-R, and cost d (C) c opt T SP NR (X, d) = c opt T SP R (X, d) and so our algorithm is also a c-approximate algorithm for opt T SP NR. To prove the third claim, suppose we have a c-approximate algorithm for Metric TSP-R. Then, given an input (X, d) the algorithm finds a cycle C, possibly with repetitions, such that cost d (C) c opt T SP R (X, d) Now, convert C to a solution C that has no repetitions and such that cost d (C ) cost d (C) as described above, and output the solution C. We have just described a c-approximate algorithm for Metric TSP-NR, because cost d (C ) cost d (C) c opt T SP R (X, d) = c opt T SP NR (X, d) Lemma 3 For every c, there is a polynomial time c-approximate algorithm for Metric TSP-NR if and only if there is a polynomial time c-approximate approximation algorithm for General TSP-R. In particular:. Every c-approximate algorithm for General TSP-R is also a c-approximate algorithm for Metric TSP-R. 3

4 2. Every c-approximate algorithm for Metric TSP-R can be turned into a c-approximate algorithm for General TSP-R after adding polynomial-time pre-processing and post-processing steps. Proof: The first claim just follows from the fact that General and Metric TSP-R are the same problem, except that in the general problem we allow a larger set of admissible inputs. The proof of the second claim is similar to the proof that an approximation algorithm for Metric Steiner Tree can be converted to an approximation algorithm for General Steiner Tree. Consider the following algorithm: on input an instance (X, d) of General TSP-R, we compute the new distance function d (, ) such that d (x, y) is the length of a shortest path from x to y in a weighted graph that has vertex set X and weights d(, ). Note that d (, ) is a distance function that satisfies the triangle inequality. We also compute the shortest path between any pair x, y. We then pass the input (X, d ) to our c-approximate algorithm for Metric TSP-R, and find a cycle C such that cost d (C ) c opt T SP R (X, d ) Note that, for every pair of points (x, y), we have d (x, y) d(x, y) and so this implies that opt T SP R (X, d ) opt T SP R (X, d) Finally, we construct a cycle C by replacing each transition x y in C by the shortest path from x to y according to d(, ). Because of the definition of d (, ), we have cost d (C) = cost d (C ) and, combining the inequalities we have proved so far, cost d (C) c opt T SP R (X, d) meaning that the algorithm that we have described is a c-approximate algorithm for General TSP-R. 4

5 2 A 2-approximate Algorithm When discussing approximation algorithms for the Minimum Steiner Tree problem in the last lecture, we proved (without stating it explicitly) the following result. Lemma 4 Let T (X, E) be a tree over a set of vertices X, and d : X X R 0 a symmetric distance function. Then there is a cycle C = v 0 v v m = v 0 that reaches every vertex at least once, and such that cost d (C) = 2 cost d (T ) where cost d (C) = i=0,...m d(v i, v i+ ) and cost d (T ) = (x,y) E d(x, y). The proof is simply to consider a DFS visit of the tree, starting at the root; we define C to be the order in which vertices are visited, counting both the beginning of the recursive call in which they are reached, and also the time when we return at a vertex after the end of a recursive call originated at the vertex. For example, revisiting an example from the last lecture, from the tree a 2 e g h d f c b We get the cycle a e a g d g f g a h c b h a, in which every point is visited at least once (indeed, a number of times equal to its degree in the tree) and every edge is traversed precisely twice. Theorem 5 There is a polynomial-time 2-approximate algorithm for General TSP- R. (And hence for Metric TSP-NR and Metric TSP-R.) Proof: The algorithm is very simple: on input a (X, d) we find a minimum spanning tree T of the weighted graph with vertex set X and weights d, and then we find the cycle C of cost 2cost d (T ) as in Lemma 4. 5

6 It remains to prove that opt T SP R (X, d) opt MST (X, d) = cost d (T ), which will then imply that we have found a solution whose cost is 2 opt T SP R (X, d), and that our algorithm is 2-approximate. Let C be an optimal solution for (X, d), and consider the set of edges E which are used in the cycle, then (X, E ) is a connected graph; take any spanning tree T = (X, E ) of the graph (X, E ), then cost d (T ) cost d (C ) = opt T SP R (X, d) because T uses a subset of the edges of C. On the other hand, T is a spanning tree, and so So we have cost d (T ) opt MST (X, d) opt T SP R (X, d) opt MST (X, d) from which it follows that our algorithm achieves a 2-approximation. 3 Eulerian Cycles In this section we review the definition of Eulerian cycle. In the next section, we will use this notion to give a new view of the 2-approximate algorithm of the previous section, and we willnote that this new perspective suggests a potentially better algorithm, that we will analyze in the next lecture. In this section, it will be convenient to work with multi-graphs instead of graphs. In an undirected multi-graph G = (V, E), E is a multi-set of pairs of vertices, that is, the same pair (u, v) can appear more than once in E. Graphically, we can represent a multi-graph in which there are k edges between u and v by drawing k parallel edges between u and v. The degree of a vertex in a multigraph is the number of edges of the graph that have that vertex as an endpoint, counting multiplicities. Definition 6 (Eulerian Cycle) An Eulerian cycle in a multi-graph G = (V, E) is a cycle v 0 v v m = v 0 such that the number of edges (u, v) in E is equal to the number of times (u, v) is used in the cycle. In a standard graph, a Eulerian cycle is a cycle that uses every edge of the graph exactly once. 6

7 Theorem 7 A multi-graph G = (V, E) has an Eulerian cycle if and only if every vertex has even degree and the vertices of positive degree are connected. Furthermore, there is a polynomial time algorithm that, on input a connected graph in which every vertex has even degree, outputs an Eulerian cycle. Proof: If G is Eulerian, then the cycle gives a way to go from every vertex to every other vertex, except the vertices of zero degree. Furthermore, if a vertex v appears k times in the cycle, then there are 2k edges involving v in the cycle (because, each time v is reached, there is an edge used to reach v and one to leave from v); since the cycle contains all the edges of the graph, it follows that v has degree 2k, thus all vertices have even degree. This shows that if a graph contains an Eulerian cycle, then every vertex has even degree and all the vertices of non-zero degree are connected. For the other direction, we will prove by induction a slightly stronger statement, that is we will prove that if G is a graph in which every vertex has even degree, then every connected component of G with more than one vertex has a Eulerian cycle. We will proceed by induction on the number of edges. If there are zero edges, then every connected component has only one vertex and so there is nothing to prove. This is the base case of the induction. If we have a graph G = (V, E) with a non-empty set of edges and in which every vertex has even degree, then let V,..., V m be the connected components of G that have at least two vertices. If m 2, then every connected component has strictly fewer vertices than G, and so we can apply the inductive hypothesis and find Eulerian cycles in each of V,...,V m. It remains to consider the case in which the set V of vertices of positive degree of G are all in the same connected component. Let G = (V, E ) be the restriction of G to the vertices of V. Since every vertex of G has degree 2, there must be a cycle in G. This is because if a connected graph with n vertices has no cycles, then it is a tree, and so it has n edges; but in a graph in which there are n vertices and every vertex has degree 2, the number of edges is at least 2 n = n. Let C be a 2 simple cycle (that is, a cycle with no vertices repeated) in G, and let G be the graph obtained from G by removing the edges of C. Since we have removed two edges from every vertex, we have that G is still a graph in which every vertex has even degree. Since G has fewer edges than G we can apply the induction hypothesis, and find a Eulerian cycle in each non-trivial connected component (a connected component is trivial if it contains only an isolated vertex of degree zero) of G. We can then patch together these Eulerian cycles with C as follows: we traverse C, starting from any vertex; the first time we reach one of the non-trivial connected components of G, we stop traversing C, and we traverse the Eulerian cycle of the component, then continue on C, until we reach for the first time one of the non-trivial connected components of G that we haven t traversed yet, and so on. This describes a Eulerian path into all of G 7

8 Finally, we note that this inductive argument can be converted into a recursive algorithm. The main computation is to find the connected components of a graph, which can be done in linear time, and to find a cycle in a given graph, which can also be done in linear time using a DFS. Hence the algorithm runs in polynomial time. 4 Eulerian Cycles and TSP Approximation Let (X, d) be an instance of General TSP-R. Suppose that G = (X, E) is a connected multi-graph with vertex set X that admits an Eulerian cycle C. Then the Eulerian cycle C is also an admissible solution for the TSP problem, and its cost is (u,v) E d(u, v). Conversely, if we take any cycle which is a TSP-R solution for the input (X, d), and we let E be the multiset of edges used by the cycle (if the cycle uses the same edge more than once, we put as many copies of the edge in E as the number of times it appears in the cycle), then we obtain a graph G = (X, E) which is connected and which admits an Eulerian cycle. In other words, we can think of the General TSP-R as the following problem: given a set of points X and a symmetric distance function d(, ), find the multi-set of edges E such that the graph G = (V, E) is connected and Eulerian, and such that (u,v) E d(u, v) is minimized. The approach that we took in our 2-approximate algorithm was to start from a spanning tree, which is guaranteed to be connected, and then take every edge of the spanning tree twice, which guarantees that every vertex has even degree, and hence that an Eulerian cycle exists. The reader should verify that if we take a tree, double all the edges, and then apply to the resulting multigraph the algorithm of Theorem 7, we get the same cycle as the one obtained by following the order in which the vertices of the tree are traversed in a DFS, as in the proof of Lemma 4. From this point of view, the 2-approximate algorithm seems rather wasteful: once we have a spanning tree, our goal is to add edges so that we obtain an Eulerian graph in which every vertex has even degree. Doubling every edge certainly works, but it is a rather brute force approach: for example if a vertex has degree in the tree, we are going to add another edges incident on that vertex, while we could have fixed the degree of that vertex by just adding one more edge. We will see next time that there is a way to implement this intuition and to improve the factor of 2 approximation. 8

### 1 Better Approximation of the Traveling Salesman

Stanford University CS261: Optimization Handout 4 Luca Trevisan January 13, 2011 Lecture 4 In which we describe a 1.5-approximate algorithm for the Metric TSP, we introduce the Set Cover problem, observe

### Lecture 8: The Traveling Salesman Problem

Lecture 8: The Traveling Salesman Problem Let G = (V, E) be an undirected graph. A Hamiltonian cycle of G is a cycle that visits every vertex v V exactly once. Instead of Hamiltonian cycle, we sometimes

### 1 The Traveling Salesperson Problem (TSP)

CS 598CSC: Approximation Algorithms Lecture date: January 23, 2009 Instructor: Chandra Chekuri Scribe: Sungjin Im In the previous lecture, we had a quick overview of several basic aspects of approximation

### COMP 355 Advanced Algorithms Approximation Algorithms: VC and TSP Chapter 11 (KT) Section (CLRS)

COMP 355 Advanced Algorithms Approximation Algorithms: VC and TSP Chapter 11 (KT) Section 35.1-35.2(CLRS) 1 Coping with NP-Completeness Brute-force search: This is usually only a viable option for small

### Notes for Recitation 9

6.042/18.062J Mathematics for Computer Science October 8, 2010 Tom Leighton and Marten van Dijk Notes for Recitation 9 1 Traveling Salesperson Problem Now we re going to talk about a famous optimization

### Greedy Approximations

CS 787: Advanced Algorithms Instructor: Dieter van Melkebeek Greedy Approximations Approximation algorithms give a solution to a problem in polynomial time, at most a given factor away from the correct

### 11.1 Facility Location

CS787: Advanced Algorithms Scribe: Amanda Burton, Leah Kluegel Lecturer: Shuchi Chawla Topic: Facility Location ctd., Linear Programming Date: October 8, 2007 Today we conclude the discussion of local

### 1 Connected components in undirected graphs

Lecture 10 Connected components of undirected and directed graphs Scribe: Luke Johnston (2016) and Mary Wootters (2017) Date: October 25, 2017 Much of the following notes were taken from Tim Roughgarden

### 2 Approximation Algorithms for Metric TSP

Comp260: Advanced Algorithms Tufts University, Spring 2002 Professor Lenore Cowen Scribe: Stephanie Tauber Lecture 3: The Travelling Salesman Problem (TSP) 1 Introduction A salesman wishes to visit every

### Module 6 NP-Complete Problems and Heuristics

Module 6 NP-Complete Problems and Heuristics Dr. Natarajan Meghanathan Professor of Computer Science Jackson State University Jackson, MS 97 E-mail: natarajan.meghanathan@jsums.edu Optimization vs. Decision

### Definition For vertices u, v V (G), the distance from u to v, denoted d(u, v), in G is the length of a shortest u, v-path. 1

Graph fundamentals Bipartite graph characterization Lemma. If a graph contains an odd closed walk, then it contains an odd cycle. Proof strategy: Consider a shortest closed odd walk W. If W is not a cycle,

### Problem Set 2 Solutions

Design and Analysis of Algorithms February, 01 Massachusetts Institute of Technology 6.046J/18.410J Profs. Dana Moshkovitz and Bruce Tidor Handout 8 Problem Set Solutions This problem set is due at 9:00pm

### 35 Approximation Algorithms

35 Approximation Algorithms Many problems of practical significance are NP-complete, yet they are too important to abandon merely because we don t know how to find an optimal solution in polynomial time.

### Problem Set 2 Solutions

Problem Set 2 Solutions Graph Theory 2016 EPFL Frank de Zeeuw & Claudiu Valculescu 1. Prove that the following statements about a graph G are equivalent. - G is a tree; - G is minimally connected (it is

### Discrete Mathematics and Probability Theory Fall 2009 Satish Rao,David Tse Note 8

CS 70 Discrete Mathematics and Probability Theory Fall 2009 Satish Rao,David Tse Note 8 An Introduction to Graphs Formulating a simple, precise specification of a computational problem is often a prerequisite

### Topic: Local Search: Max-Cut, Facility Location Date: 2/13/2007

CS880: Approximations Algorithms Scribe: Chi Man Liu Lecturer: Shuchi Chawla Topic: Local Search: Max-Cut, Facility Location Date: 2/3/2007 In previous lectures we saw how dynamic programming could be

### Graph Connectivity G G G

Graph Connectivity 1 Introduction We have seen that trees are minimally connected graphs, i.e., deleting any edge of the tree gives us a disconnected graph. What makes trees so susceptible to edge deletions?

### Shortest path problems

Next... Shortest path problems Single-source shortest paths in weighted graphs Shortest-Path Problems Properties of Shortest Paths, Relaxation Dijkstra s Algorithm Bellman-Ford Algorithm Shortest-Paths

### Algorithm Design and Analysis

Algorithm Design and Analysis LECTURE 29 Approximation Algorithms Load Balancing Weighted Vertex Cover Reminder: Fill out SRTEs online Don t forget to click submit Sofya Raskhodnikova 12/7/2016 Approximation

### 2. CONNECTIVITY Connectivity

2. CONNECTIVITY 70 2. Connectivity 2.1. Connectivity. Definition 2.1.1. (1) A path in a graph G = (V, E) is a sequence of vertices v 0, v 1, v 2,..., v n such that {v i 1, v i } is an edge of G for i =

### Vertex Cover Approximations

CS124 Lecture 20 Heuristics can be useful in practice, but sometimes we would like to have guarantees. Approximation algorithms give guarantees. It is worth keeping in mind that sometimes approximation

### DO NOT RE-DISTRIBUTE THIS SOLUTION FILE

Professor Kindred Math 104, Graph Theory Homework 2 Solutions February 7, 2013 Introduction to Graph Theory, West Section 1.2: 26, 38, 42 Section 1.3: 14, 18 Section 2.1: 26, 29, 30 DO NOT RE-DISTRIBUTE

### Introduction to Approximation Algorithms

Introduction to Approximation Algorithms Dr. Gautam K. Das Departmet of Mathematics Indian Institute of Technology Guwahati, India gkd@iitg.ernet.in February 19, 2016 Outline of the lecture Background

### Module 6 P, NP, NP-Complete Problems and Approximation Algorithms

Module 6 P, NP, NP-Complete Problems and Approximation Algorithms Dr. Natarajan Meghanathan Associate Professor of Computer Science Jackson State University Jackson, MS 39217 E-mail: natarajan.meghanathan@jsums.edu

### Modules. 6 Hamilton Graphs (4-8 lectures) Introduction Necessary conditions and sufficient conditions Exercises...

Modules 6 Hamilton Graphs (4-8 lectures) 135 6.1 Introduction................................ 136 6.2 Necessary conditions and sufficient conditions............. 137 Exercises..................................

### Steiner Trees and Forests

Massachusetts Institute of Technology Lecturer: Adriana Lopez 18.434: Seminar in Theoretical Computer Science March 7, 2006 Steiner Trees and Forests 1 Steiner Tree Problem Given an undirected graph G

### The External Network Problem

The External Network Problem Jan van den Heuvel and Matthew Johnson CDAM Research Report LSE-CDAM-2004-15 December 2004 Abstract The connectivity of a communications network can often be enhanced if the

### List of Theorems. Mat 416, Introduction to Graph Theory. Theorem 1 The numbers R(p, q) exist and for p, q 2,

List of Theorems Mat 416, Introduction to Graph Theory 1. Ramsey s Theorem for graphs 8.3.11. Theorem 1 The numbers R(p, q) exist and for p, q 2, R(p, q) R(p 1, q) + R(p, q 1). If both summands on the

### CPSC 536N: Randomized Algorithms Term 2. Lecture 10

CPSC 536N: Randomized Algorithms 011-1 Term Prof. Nick Harvey Lecture 10 University of British Columbia In the first lecture we discussed the Max Cut problem, which is NP-complete, and we presented a very

### Traveling Salesperson Problem (TSP)

TSP-0 Traveling Salesperson Problem (TSP) Input: Undirected edge weighted complete graph G = (V, E, W ), where W : e R +. Tour: Find a path that starts at vertex 1, visits every vertex exactly once, and

### Advanced Algorithms Class Notes for Monday, October 23, 2012 Min Ye, Mingfu Shao, and Bernard Moret

Advanced Algorithms Class Notes for Monday, October 23, 2012 Min Ye, Mingfu Shao, and Bernard Moret Greedy Algorithms (continued) The best known application where the greedy algorithm is optimal is surely

### Graphic TSP in cubic graphs

Graphic TSP in cubic graphs arxiv:1608.07568v2 [cs.dm] 30 Aug 2016 Zdeněk Dvořák Daniel Král Bojan Mohar Abstract We prove that every simple 2-connected cubic n-vertex graph contains a spanning closed

### 6. Lecture notes on matroid intersection

Massachusetts Institute of Technology 18.453: Combinatorial Optimization Michel X. Goemans May 2, 2017 6. Lecture notes on matroid intersection One nice feature about matroids is that a simple greedy algorithm

### Traveling Salesman Problem (TSP) Input: undirected graph G=(V,E), c: E R + Goal: find a tour (Hamiltonian cycle) of minimum cost

Traveling Salesman Problem (TSP) Input: undirected graph G=(V,E), c: E R + Goal: find a tour (Hamiltonian cycle) of minimum cost Traveling Salesman Problem (TSP) Input: undirected graph G=(V,E), c: E R

### 3 Euler Tours, Hamilton Cycles, and Their Applications

3 Euler Tours, Hamilton Cycles, and Their Applications 3.1 Euler Tours and Applications 3.1.1 Euler tours Carefully review the definition of (closed) walks, trails, and paths from Section 1... Definition

### Lecture 13. Reading: Weiss, Ch. 9, Ch 8 CSE 100, UCSD: LEC 13. Page 1 of 29

Lecture 13 Connectedness in graphs Spanning trees in graphs Finding a minimal spanning tree Time costs of graph problems and NP-completeness Finding a minimal spanning tree: Prim s and Kruskal s algorithms

### 9.1 Cook-Levin Theorem

CS787: Advanced Algorithms Scribe: Shijin Kong and David Malec Lecturer: Shuchi Chawla Topic: NP-Completeness, Approximation Algorithms Date: 10/1/2007 As we ve already seen in the preceding lecture, two

### Traveling Salesman Problem. Algorithms and Networks 2014/2015 Hans L. Bodlaender Johan M. M. van Rooij

Traveling Salesman Problem Algorithms and Networks 2014/2015 Hans L. Bodlaender Johan M. M. van Rooij 1 Contents TSP and its applications Heuristics and approximation algorithms Construction heuristics,

### February 24, :52 World Scientific Book - 9in x 6in soltys alg. Chapter 3. Greedy Algorithms

Chapter 3 Greedy Algorithms Greedy algorithms are algorithms prone to instant gratification. Without looking too far ahead, at each step they make a locally optimum choice, with the hope that it will lead

### Figure 4.1: The evolution of a rooted tree.

106 CHAPTER 4. INDUCTION, RECURSION AND RECURRENCES 4.6 Rooted Trees 4.6.1 The idea of a rooted tree We talked about how a tree diagram helps us visualize merge sort or other divide and conquer algorithms.

### 15-451/651: Design & Analysis of Algorithms November 4, 2015 Lecture #18 last changed: November 22, 2015

15-451/651: Design & Analysis of Algorithms November 4, 2015 Lecture #18 last changed: November 22, 2015 While we have good algorithms for many optimization problems, the previous lecture showed that many

### Multicasting in the Hypercube, Chord and Binomial Graphs

Multicasting in the Hypercube, Chord and Binomial Graphs Christopher C. Cipriano and Teofilo F. Gonzalez Department of Computer Science University of California, Santa Barbara, CA, 93106 E-mail: {ccc,teo}@cs.ucsb.edu

### Dynamic programming. Trivial problems are solved first More complex solutions are composed from the simpler solutions already computed

Dynamic programming Solves a complex problem by breaking it down into subproblems Each subproblem is broken down recursively until a trivial problem is reached Computation itself is not recursive: problems

### Greedy algorithms is another useful way for solving optimization problems.

Greedy Algorithms Greedy algorithms is another useful way for solving optimization problems. Optimization Problems For the given input, we are seeking solutions that must satisfy certain conditions. These

### Scheduling, Map Coloring, and Graph Coloring

Scheduling, Map Coloring, and Graph Coloring Scheduling via Graph Coloring: Final Exam Example Suppose want to schedule some ;inal exams for CS courses with following course numbers: 1007, 3137, 3157,

### Approximation Algorithms: The Primal-Dual Method. My T. Thai

Approximation Algorithms: The Primal-Dual Method My T. Thai 1 Overview of the Primal-Dual Method Consider the following primal program, called P: min st n c j x j j=1 n a ij x j b i j=1 x j 0 Then the

### Graphs and trees come up everywhere. We can view the internet as a graph (in many ways) Web search views web pages as a graph

Graphs and Trees Graphs and trees come up everywhere. We can view the internet as a graph (in many ways) who is connected to whom Web search views web pages as a graph Who points to whom Niche graphs (Ecology):

### Cache-Oblivious Traversals of an Array s Pairs

Cache-Oblivious Traversals of an Array s Pairs Tobias Johnson May 7, 2007 Abstract Cache-obliviousness is a concept first introduced by Frigo et al. in [1]. We follow their model and develop a cache-oblivious

### Basic Graph Theory with Applications to Economics

Basic Graph Theory with Applications to Economics Debasis Mishra February, 0 What is a Graph? Let N = {,..., n} be a finite set. Let E be a collection of ordered or unordered pairs of distinct elements

### Fast algorithms for max independent set

Fast algorithms for max independent set N. Bourgeois 1 B. Escoffier 1 V. Th. Paschos 1 J.M.M. van Rooij 2 1 LAMSADE, CNRS and Université Paris-Dauphine, France {bourgeois,escoffier,paschos}@lamsade.dauphine.fr

### On median graphs and median grid graphs

On median graphs and median grid graphs Sandi Klavžar 1 Department of Mathematics, PEF, University of Maribor, Koroška cesta 160, 2000 Maribor, Slovenia e-mail: sandi.klavzar@uni-lj.si Riste Škrekovski

### These notes present some properties of chordal graphs, a set of undirected graphs that are important for undirected graphical models.

Undirected Graphical Models: Chordal Graphs, Decomposable Graphs, Junction Trees, and Factorizations Peter Bartlett. October 2003. These notes present some properties of chordal graphs, a set of undirected

### arxiv: v1 [cs.ds] 15 Jan 2014

Better Approximation Algorithms for Maximum Asymmetric Traveling Salesman and Shortest Superstring Katarzyna Paluch Institute of Computer Science, University of Wrocław abraka@cs.uni.wroc.pl arxiv:1401.3670v1

### v V Question: How many edges are there in a graph with 10 vertices each of degree 6?

ECS20 Handout Graphs and Trees March 4, 2015 (updated 3/9) Notion of a graph 1. A graph G = (V,E) consists of V, a nonempty set of vertices (or nodes) and E, a set of pairs of elements of V called edges.

### Rigidity, connectivity and graph decompositions

First Prev Next Last Rigidity, connectivity and graph decompositions Brigitte Servatius Herman Servatius Worcester Polytechnic Institute Page 1 of 100 First Prev Next Last Page 2 of 100 We say that a framework

### Design and Analysis of Algorithms

CSE 101, Winter 2018 Design and Analysis of Algorithms Lecture 9: Minimum Spanning Trees Class URL: http://vlsicad.ucsd.edu/courses/cse101-w18/ Goal: MST cut and cycle properties Prim, Kruskal greedy algorithms

### 2. Lecture notes on non-bipartite matching

Massachusetts Institute of Technology 18.433: Combinatorial Optimization Michel X. Goemans February 15th, 013. Lecture notes on non-bipartite matching Given a graph G = (V, E), we are interested in finding

### 1 The Traveling Salesman Problem

Comp 260: Advanced Algorithms Tufts University, Spring 2011 Prof. Lenore Cowen Scribe: Jisoo Park Lecture 3: The Traveling Salesman Problem 1 The Traveling Salesman Problem The Traveling Salesman Problem

### CS261: A Second Course in Algorithms Lecture #15: Introduction to Approximation Algorithms

CS6: A Second Course in Algorithms Lecture #5: Introduction to Approximation Algorithms Tim Roughgarden February 3, 06 Coping with N P -Completeness All of CS6 and the first half of CS6 focus on problems

### 1 Dijkstra s Algorithm

Lecture 11 Dijkstra s Algorithm Scribes: Himanshu Bhandoh (2015), Virginia Williams, and Date: November 1, 2017 Anthony Kim (2016), G. Valiant (2017), M. Wootters (2017) (Adapted from Virginia Williams

### Solving Linear Recurrence Relations (8.2)

EECS 203 Spring 2016 Lecture 18 Page 1 of 10 Review: Recurrence relations (Chapter 8) Last time we started in on recurrence relations. In computer science, one of the primary reasons we look at solving

### Introduction to Algorithms / Algorithms I Lecturer: Michael Dinitz Topic: Shortest Paths Date: 10/13/15

600.363 Introduction to Algorithms / 600.463 Algorithms I Lecturer: Michael Dinitz Topic: Shortest Paths Date: 10/13/15 14.1 Introduction Today we re going to talk about algorithms for computing shortest

### Proof: if not f[u] < d[v], then u still grey while v is being visited. DFS visit(v) will then terminate before DFS visit(u).

Parenthesis property of DFS discovery and finishing times (Thm 23.6 of CLR): For any two nodes u,v of a directed graph, if d[u] < d[v] (i.e. u discovered before v), either f[v] < f[u] (i.e. visit time

### Solutions to Problem Set 2

Massachusetts Institute of Technology Michel X. Goemans 18.453: Combinatorial Optimization 017 Spring Solutions to Problem Set -3 Let U be any minimizer in the Tutte-Berge formula. Let K 1,, K k be the

### CME 305: Discrete Mathematics and Algorithms Instructor: Reza Zadeh HW#3 Due at the beginning of class Thursday 03/02/17

CME 305: Discrete Mathematics and Algorithms Instructor: Reza Zadeh (rezab@stanford.edu) HW#3 Due at the beginning of class Thursday 03/02/17 1. Consider a model of a nonbipartite undirected graph in which

### Artificial Intelligence

Artificial Intelligence Graph theory G. Guérard Department of Nouvelles Energies Ecole Supérieur d Ingénieurs Léonard de Vinci Lecture 1 GG A.I. 1/37 Outline 1 Graph theory Undirected and directed graphs

### 12/5/17. trees. CS 220: Discrete Structures and their Applications. Trees Chapter 11 in zybooks. rooted trees. rooted trees

trees CS 220: Discrete Structures and their Applications A tree is an undirected graph that is connected and has no cycles. Trees Chapter 11 in zybooks rooted trees Rooted trees. Given a tree T, choose

### Dijkstra s algorithm for shortest paths when no edges have negative weight.

Lecture 14 Graph Algorithms II 14.1 Overview In this lecture we begin with one more algorithm for the shortest path problem, Dijkstra s algorithm. We then will see how the basic approach of this algorithm

### COP 4531 Complexity & Analysis of Data Structures & Algorithms

COP 4531 Complexity & Analysis of Data Structures & Algorithms Lecture 9 Minimum Spanning Trees Thanks to the text authors who contributed to these slides Why Minimum Spanning Trees (MST)? Example 1 A

### MATH 682 Notes Combinatorics and Graph Theory II. One interesting class of graphs rather akin to trees and acyclic graphs is the bipartite graph:

1 Bipartite graphs One interesting class of graphs rather akin to trees and acyclic graphs is the bipartite graph: Definition 1. A graph G is bipartite if the vertex-set of G can be partitioned into two

### Dynamic Programming II

Lecture 11 Dynamic Programming II 11.1 Overview In this lecture we continue our discussion of dynamic programming, focusing on using it for a variety of path-finding problems in graphs. Topics in this

### 4 Generating functions in two variables

4 Generating functions in two variables (Wilf, sections.5.6 and 3.4 3.7) Definition. Let a(n, m) (n, m 0) be a function of two integer variables. The 2-variable generating function of a(n, m) is F (x,

### Varying Applications (examples)

Graph Theory Varying Applications (examples) Computer networks Distinguish between two chemical compounds with the same molecular formula but different structures Solve shortest path problems between cities

### THE GROUP OF SYMMETRIES OF THE TOWER OF HANOI GRAPH

THE GROUP OF SYMMETRIES OF THE TOWER OF HANOI GRAPH SOEUN PARK arxiv:0809.1179v1 [math.co] 7 Sep 2008 Abstract. The Tower of Hanoi problem with k pegs and n disks has been much studied via its associated

### CS261: Problem Set #2

CS261: Problem Set #2 Due by 11:59 PM on Tuesday, February 9, 2016 Instructions: (1) Form a group of 1-3 students. You should turn in only one write-up for your entire group. (2) Submission instructions:

### 1 Definition of Reduction

1 Definition of Reduction Problem A is reducible, or more technically Turing reducible, to problem B, denoted A B if there a main program M to solve problem A that lacks only a procedure to solve problem

### Finding Strongly Connected Components

Yufei Tao ITEE University of Queensland We just can t get enough of the beautiful algorithm of DFS! In this lecture, we will use it to solve a problem finding strongly connected components that seems to

### CS369G: Algorithmic Techniques for Big Data Spring

CS369G: Algorithmic Techniques for Big Data Spring 2015-2016 Lecture 11: l 0 -Sampling and Introduction to Graph Streaming Prof. Moses Charikar Scribe: Austin Benson 1 Overview We present and analyze the

### 14 More Graphs: Euler Tours and Hamilton Cycles

14 More Graphs: Euler Tours and Hamilton Cycles 14.1 Degrees The degree of a vertex is the number of edges coming out of it. The following is sometimes called the First Theorem of Graph Theory : Lemma

### Graph Representations and Traversal

COMPSCI 330: Design and Analysis of Algorithms 02/08/2017-02/20/2017 Graph Representations and Traversal Lecturer: Debmalya Panigrahi Scribe: Tianqi Song, Fred Zhang, Tianyu Wang 1 Overview This lecture

### The Structure of Bull-Free Perfect Graphs

The Structure of Bull-Free Perfect Graphs Maria Chudnovsky and Irena Penev Columbia University, New York, NY 10027 USA May 18, 2012 Abstract The bull is a graph consisting of a triangle and two vertex-disjoint

### High Dimensional Indexing by Clustering

Yufei Tao ITEE University of Queensland Recall that, our discussion so far has assumed that the dimensionality d is moderately high, such that it can be regarded as a constant. This means that d should

### CS364A: Algorithmic Game Theory Lecture #19: Pure Nash Equilibria and PLS-Completeness

CS364A: Algorithmic Game Theory Lecture #19: Pure Nash Equilibria and PLS-Completeness Tim Roughgarden December 2, 2013 1 The Big Picture We now have an impressive list of tractability results polynomial-time

### princeton univ. F 15 cos 521: Advanced Algorithm Design Lecture 2: Karger s Min Cut Algorithm

princeton univ. F 5 cos 5: Advanced Algorithm Design Lecture : Karger s Min Cut Algorithm Lecturer: Pravesh Kothari Scribe:Pravesh (These notes are a slightly modified version of notes from previous offerings

### On 2-Subcolourings of Chordal Graphs

On 2-Subcolourings of Chordal Graphs Juraj Stacho School of Computing Science, Simon Fraser University 8888 University Drive, Burnaby, B.C., Canada V5A 1S6 jstacho@cs.sfu.ca Abstract. A 2-subcolouring

### Maximal Independent Set

Chapter 0 Maximal Independent Set In this chapter we present a highlight of this course, a fast maximal independent set (MIS) algorithm. The algorithm is the first randomized algorithm that we study in

### CS 598CSC: Approximation Algorithms Lecture date: March 2, 2011 Instructor: Chandra Chekuri

CS 598CSC: Approximation Algorithms Lecture date: March, 011 Instructor: Chandra Chekuri Scribe: CC Local search is a powerful and widely used heuristic method (with various extensions). In this lecture

### Lecture 2. 1 Introduction. 2 The Set Cover Problem. COMPSCI 632: Approximation Algorithms August 30, 2017

COMPSCI 632: Approximation Algorithms August 30, 2017 Lecturer: Debmalya Panigrahi Lecture 2 Scribe: Nat Kell 1 Introduction In this lecture, we examine a variety of problems for which we give greedy approximation

### Ramsey s Theorem on Graphs

Ramsey s Theorem on Graphs 1 Introduction Exposition by William Gasarch Imagine that you have 6 people at a party. We assume that, for every pair of them, either THEY KNOW EACH OTHER or NEITHER OF THEM

### Pebbling on Directed Graphs

Pebbling on Directed Graphs Gayatri Gunda E-mail: gundagay@notes.udayton.edu Dr. Aparna Higgins E-mail: Aparna.Higgins@notes.udayton.edu University of Dayton Dayton, OH 45469 Submitted January 25 th, 2004

### Edge colorings. Definition The minimum k such that G has a proper k-edge-coloring is called the edge chromatic number of G and is denoted

Edge colorings Edge coloring problems often arise when objects being scheduled are pairs of underlying elements, e.g., a pair of teams that play each other, a pair consisting of a teacher and a class,

### Rainbow game domination subdivision number of a graph

Rainbow game domination subdivision number of a graph J. Amjadi Department of Mathematics Azarbaijan Shahid Madani University Tabriz, I.R. Iran j-amjadi@azaruniv.edu Abstract The rainbow game domination

### Shortest Path Problem

Shortest Path Problem CLRS Chapters 24.1 3, 24.5, 25.2 Shortest path problem Shortest path problem (and variants) Properties of shortest paths Algorithmic framework Bellman-Ford algorithm Shortest paths

### CS 125 Section #6 Graph Traversal and Linear Programs 10/13/14

CS 125 Section #6 Graph Traversal and Linear Programs 10/13/14 1 Depth first search 1.1 The Algorithm Besides breadth first search, which we saw in class in relation to Dijkstra s algorithm, there is one

### Minimum sum multicoloring on the edges of trees

Minimum sum multicoloring on the edges of trees Dániel Marx a,1 a Department of Computer Science and Information Theory, Budapest University of Technology and Economics, H-1521 Budapest, Hungary. Abstract

### CSC 373: Algorithm Design and Analysis Lecture 3

CSC 373: Algorithm Design and Analysis Lecture 3 Allan Borodin January 11, 2013 1 / 13 Lecture 3: Outline Write bigger and get better markers A little more on charging arguments Continue examples of greedy

### U.C. Berkeley CS170 : Algorithms, Fall 2013 Midterm 1 Professor: Satish Rao October 10, Midterm 1 Solutions

U.C. Berkeley CS170 : Algorithms, Fall 2013 Midterm 1 Professor: Satish Rao October 10, 2013 Midterm 1 Solutions 1 True/False 1. The Mayan base 20 system produces representations of size that is asymptotically

### Solution for Homework set 3

TTIC 300 and CMSC 37000 Algorithms Winter 07 Solution for Homework set 3 Question (0 points) We are given a directed graph G = (V, E), with two special vertices s and t, and non-negative integral capacities