HEARIN CENTER FOR ENTERPRISE SCIENCE
|
|
- Victoria Fields
- 5 years ago
- Views:
Transcription
1 Working Paper Series HEARIN CENTER FOR ENTERPRISE SCIENCE HCES An Experimental Evaluation of a Scatter Search for the Linear Ordering Problem by Vicente Campos Rafael Martí Fred Glover Manuel Laguna The university of Mississippi Director, Keith Womer School of Business Administration The University of Mississippi Post Office Box 1848 University, MS (662)
2 An Experimental Evaluation of a Scatter Search for the Linear Ordering Problem Vicente Campos a, Fred Glover b, Manuel Laguna c, and Rafael Martí a a b c Dpto. de Estadística e Investigación Operativa, Facultad de Matemáticas, Universitat de Valencia, Dr. Moliner, 50, Burjassot, Valencia, Spain. Vicente.Campos@uv.es and Rafael.Marti@uv.es Hearin Center for Enterprise Science, University of Mississippi, University, MS 38677, USA. fglover@bus.olemiss.edu Graduate School of Business and Administration, Campus Box 419, University of Colorado, Boulder, CO , USA. Manuel.Laguna@Colorado.edu Latest Revision: November 23, 1999 Abstract Scatter search is a population-based method that has recently been shown to yield promising outcomes for solving combinatorial and nonlinear global optimization problems. Based on formulations originally proposed in the 1960s for combining decision rules and problem constraints, such as in generating surrogate constraints, scatter search uses strategies for combining solution vectors that have proved effective in a variety of problem settings. In this paper, we present a scatter search implementation designed to find high quality solutions for the NP-hard linear ordering problem, which has a significant number of applications in practice. The LOP, for example, is equivalent to the so-called triangulation problem for input-output tables in economics. Our implementation goes beyond a simple exercise on applying scatter search, by incorporating innovative mechanisms to combine solutions and to create a balance between quality and diversification in the reference set. We also use a tracking process that generates solution statistics disclosing the nature of combinations and the ranks of antecedent solutions that produced the best final solutions. Our extensive computational experiments with more than 300 instances establishes the effectiveness of our procedure in relation to approaches previously identified to be best. 1
3 1. Introduction The goal of the research presented in this paper is to expand the scatter search methodology for global optimization by implementing innovative strategies to apply its underlying framework to the linear ordering problem. The linear ordering problem (or LOP) has generated a considerable amount of research interest over the years, as documented in Grotschel, et al. (1984) and Chanas and Kobylanski (1996). Because of its practical and theoretical relevance for a significant range of global optimization applications, we use this problem as a test case for our strategies and search mechanisms. Given a matrix of weights E = { eij }m m, the LOP consists of finding a permutation p of the columns (and rows) in order to maximize the sum of the weights in the upper triangle. In mathematical terms, we seek to maximize: m 1 m ( p) = C. E e p ( i ) p( j ) i = 1 j = i + 1 where p(i) is the index of the column (and row) in position i in the permutation. Note that in the LOP, the permutation p provides the ordering of both the columns and the rows. The equivalent problem in graphs consists of finding, in a complete weighted graph, an acyclic tournament with a maximal sum of arc weights (Reinelt, 1985). In economics, the LOP is equivalent to the so-called triangulation problem for inputoutput tables, which can be described as follows. The economy of a region (generally a country) is divided into m sectors and an m m input-output table E is constructed where the entry eij denotes the amount of deliveries (in monetary value) from sector i to sector j in a given year. The triangulation problem then consists of simultaneously permuting the rows and columns of E, to make the sum of the entries above the main diagonal as large as possible. An optimal solution then orders the sectors in such a way that the suppliers (i.e., sectors that tend to produce materials for other industries) come first, followed by the consumers (i.e., sectors that tend to be final-product industries that deliver their output mostly to end users). Instances of input-output tables from sectors in the European Economy can be found in the public-domain library LOLIB (1997). In the computational experimental section, we employ these problem instances to test the merit of our scatter search implementation. Scatter search, from the standpoint of metaheuristic classification, may be viewed as an evolutionary (population-based) algorithm that constructs solutions by combining others. It derives its foundations from strategies originally proposed for combining decision rules and constraints in the context of integer programming. The goal of this methodology is to enable the implementation of solution procedures that can derive new solutions from combined elements in order to yield better solutions than those procedures that base their combinations only on a set of original elements. E.g., see the overview by Glover (1998). In the area of scheduling, researchers introduced the notion of combining rules to obtain improved local decisions. Numerically weighted combinations of existing rules, suitably restructured so that their evaluations embodied a common metric, generated new rules. The approach was motivated by the conjecture that information about the relative desirability of alternative choices is captured in different forms by different 2
4 rules, and that this information can be exploited more effectively when integrated than when treated in isolation (i.e., by choosing selection rules one at a time). Empirical outcomes disclosed that the decision rules created from such combination strategies produced better outcomes than standard applications of local decision rules. The strategy of creating combined rules also proved superior to a probabilistic learning approach that used stochastic selection of rules at different junctures, but without the integration effect provided by the combined rules (Crowston, et al., 1963; Fisher and Thompson, 1963). The associated procedures for combining constraints likewise employed a mechanism of generating weighted combinations. In this case, nonnegative weights were introduced to create new constraint inequalities, called surrogate constraints, in the context of integer and nonlinear programming (Glover, 1965, 1968). The approach isolated subsets of (original) constraints that were gauged to be most critical, relative to trial solutions that were obtained based on the surrogate constraints. This critical subset was used to produce new weights that reflected the degree to which the component constraints were satisfied or violated. In addition, the resulting surrogate constraints served as source constraints for deriving new inequalities (cutting planes) which in turn provide material for creating further surrogate constraints. The main function of surrogate constraints was to provide ways to evaluate choices that could be used to generate and modify trial solutions. A variety of heuristic processes that employed such evaluations evolved from this foundation. As a natural extension, these processes led to the related strategy of combining solutions, as a primal counterpart to the dual strategy of combining constraints, which became manifest in scatter search. 2. Main Scatter Search Elements Our solution method for the linear ordering problem is based on the scatter search template in Glover (1998). The procedure combines the following elements: a) Diversification Generator b) Improvement Method c) Reference Set Update Method d) Subset Generation Method e) Solution Combination Method We describe the implementation of each of these elements, as adapted in the context of the linear ordering problem. a) Diversification Generator This element of the scatter search approach is particularly important, given the goal of developing a method that balances diversification and intensification in the search. For this purpose, we have developed and tested 10 diversification generation methods. Six of these methods are based on GRASP (Feo and Resende, 1995) constructions with a greedy function that selects sectors based on a measure of attractiveness. DG01. A GRASP construction where the attractiveness of a sector is the sum of the elements in its corresponding row. The method randomly selects from a short list of the most attractive sectors and constructs the solution starting from the first position of the permutation. 3
5 DG02. DG03. A GRASP construction where the attractiveness of a sector is the sum of the elements in its corresponding column. The method randomly selects from a short list of the most attractive sectors and constructs the solution starting from the first position of the permutation. A GRASP construction where the attractiveness of a sector is the sum of the elements in its corresponding row divided by the sum of the elements in its corresponding column. The method randomly selects from a short list of the most attractive sectors and constructs the solution starting from the first position of the permutation. DG04, DG05 and DG06. These methods are identical to the first three, except that the selection of sectors is from a short list of the least attractive and the solution is constructed starting from the last position of the permutation. DG07. A mixed procedure derived from the previous 6. The procedure generates an even number of solutions from each of the previous six methods and combines these solutions in a single set. That is, if n solutions are required, then each method DG0i (for i = 1,, 6) contributes with n/6 solutions. DG08. A random generator. This method simply generates random permutations. DG09. DG10. A method suggested in Glover (1998) which generates diversified permutations in a systematic way without reference to the objective function. A method using frequency-based memory, as proposed in tabu search (Glover and Laguna, 1997). This method is based on modifying a measure of attractiveness proposed by Becker (1967) with a frequency measure that discourages sectors from occupying positions that they have frequently occupied in previous solution generations. We now provide a detailed description of DG10, and then show that this generator outperforms the others in terms of solution quality and diversification power. The DG10 generator is based on the notion of constructing solutions employing modified frequencies. The generator exploits the permutation nature of a linear ordering. A frequency counter is maintained to record the number of times an element i appears in position j. The frequency counters are used to penalize the attractiveness of an element with respect to a given position, as in the approach of Laguna and Glover (1993). To illustrate, suppose that the generator has created 30 solutions to be included in a set of solutions P. If 20 of the 30 solutions have element 3 in position 5, then the frequency counter freq(3,5) = 20. This frequency value is used to bias the potential assignment of element 3 in position 5 during subsequent constructions, and therefore, inducing diversification with respect to the solutions already in P. The attractiveness of assigning element i to position j is given by the greedy function G(i,j), as proposed in Becker (1967). We modify the value of G(i,j) to reflect previous assignments of element i to position j, as follows: 4
6 MaxG G ( i, j ) = G( i, j ) β * * Freq( i, j). MaxF Where MaxF is the maximum Freq(i,j) value for all i and j, and MaxG is the maximum G(i,j) value for all i and j. It is important to point out that in each iteration of the construction procedure, G(i,j) is an adaptive function since its value depends on attributes of the unassigned elements. A pseudo-code of the diversification generator to produce a set P with PSize solutions, appears in Figure 1. The pseudo-code in Figure 1 is written using general mathematical notation. However, the actual implementation takes advantage of quick updating mechanisms that are hard to represent mathematically. For example, the value of MaxF in step 13 can be maintained by keeping track of the updates of the frequency matrix Freq. Clearly, the performance of the diversification generator depends on the value of the parameter β. In order to determine effective values for this parameter, we have created a measure of diversity for a set of solutions. The diversity measure is calculated as follows: 1. Calculate the median position of each sector i in the solutions in P. 2. Calculate the dissimilarity of each solution in the population with respect to the median position. The dissimilarity is calculated as the sum of the absolute difference between the position in the solution under consideration and the median solution. 3. Calculate d as the sum of all the individual dissimilarities. To illustrate, suppose that P consists of the following three orderings: (A,B,C,D), (B,D,C,A), (C,B,A,D). Then the median position of sector A is 3, since it occupies positions 1, 3 and 4 in the given orderings. In the same way, the median positions of B, C and D are 2, 3 and 4, respectively. Note that the median positions might not induce an ordering, as in the case of this example. The dissimilarity of the first solution is then calculated as follows: d 1 = = 2. In the same way, the dissimilarities of the other two solutions are d 2 = 4 and d 3 = 2. The diversity measure for P is then given by d = = 8. Since we are interested in finding a β -value that generates balanced populations, we use two relative measures: one based on the diversity value d, and one based on the objective function value C. Given a set of populations Π = { P1, P 2,, Pn }, where Pi has been generated with β, we calculate d(i) and C(i ) for each population Pi as follows: () d i () C i d( i) d = d d max max min C( i) C = C C min min i min, where d ( i) =, d = min{ d( i) } and d = max{ d( i) }; j P i j d j min i, where C ( i) =, C = min{ C( i) } and C = max{ C( i) }. P i C j min i max max i i 5
7 Figure 2 shows the values of our relative measures of quality and diversity when the diversification generator is executed with different β -values. This figure discloses that a value of 0.3 for β provides a good balance between diversity and quality in the population. As β increases, the diversity increases but the quality decreases. Therefore the value of d( i) + C( i) is highest at β = 0. 3, with a similar contribution from both relative deviation measures. We use our measure of diversity and quality to compare the performance of the 10 competing diversification generators. Figure 3 shows the C, d and C + d values achieved by each procedure. As expected, the random generator (DG08) produces the maximum diversity (as measured by the dissimilarity value). DG09 matches the diversity of DG08 using a systematic approach instead of randomness. The mixed method DG07 provides a good balance between dissimilarity and quality, by the union of solutions generated with methods DG01 to DG06. Clearly, DG10 outperforms the competing methods, by producing the highest combined score. b) Improvement Method The improvement method is based on the neighborhood search developed for the LOP in Laguna, Martí and Campos (1998). Two neighborhoods were considered in that study: N 2 j N 1 = {p : INSERT_MOVE(p(j), i), for j = 1,..., m-1 and i = j+1} N 2 = {p : INSERT_MOVE(p(j), i), for j = 1,..., m and i = 1, 2,..., j-1, j+1,..., m} N 1 consists of permutations that are reached by switching the positions of contiguous sectors p(j) and p(j+1). N 2 consists of all permutations resulting from executing general insertion moves, as defined above. In conjunction with these neighborhoods, two strategies are defined. The best strategy selects the move with the largest move value among all the moves in the neighborhood. The first strategy, on the other hand, scans the list of sectors (in the order given by the current permutation) in search for the first sector p(f) whose movement results in an strictly positive move value (i.e., a move such that CE(p ) > CE(p)). The move selected by the first strategy is then INSERT_MOVE(p(f), i * ), where i * is the position that maximizes CE(p ). Note that for N 1, i * = f+1, while for N 2, i * is chosen from i = 1, 2,..., f-1, f+1,..., m. Therefore, the first strategy used in combination with N 1 is equivalent to searching for the first improving move in the neighborhood. Combining the selection strategies with the neighborhood definitions results in four greedy local search procedures: first(n 1 ), best(n 1 ), first(n 2 ), and best(n 2 ). The experimentation in Laguna, Martí and Campos (1998) showed that the greedy procedure first(n 2 ) was the most effective. Based on this finding, we partition N 2 into m neighborhoods N 2 j = {p : INSERT_MOVE(p(j), i), i = 1, 2,..., j-1, j+1,..., m} 6
8 associated with each sector p(j), for j = 1,..., m. We therefore base our improvement method on choosing the best insertion associated with a given sector as proposed in Laguna, Martí and Campos (1998). c) Reference Set Update Method The Reference Set Update Method accompanies each application of the Improvement Method, and is generally examined right after the Improvement Method, because of its linking role with the Subset Generation Method. The update operation consists of maintaining a record of the b best solutions found, where the value of b is treated as a constant search parameter. The issues associated with this updating function are conceptually straightforward. Glover (1998) provides a detailed pseudo-code description of the procedure for maintaining RefSet (i.e., the Reference Set), called the RefSet Update Routine. This routine is organized to handle vectors of 0-1 variables. We have adapted the RefSet Update Routine to handle permutation vectors, as needed in our current application. d) Subset Generation Method This procedure consists of creating different subsets X of RefSet, as a basis for implementing the subsequent combination method. The scatter search methodology prescribes that the set of combined solutions (i.e., the set of all combined solutions that the implementation intends to generate) is produced in its entirety at the point where X is created. Therefore, once a given subset X is created, there is no merit in creating it again. This creates a situation that differs noticeably from those considered in the context of genetic algorithms, where the combinations are typically determined by the spin of a roulette wheel. The procedure seeks to generate subsets X of RefSet that have useful properties, while avoiding the duplication of subsets previously generated. The approach for doing this is organized to generate four different collections of subsets of RefSet, SubSetType 1, 2, 3 and 4, with the following characteristics: SubsetType 1: all 2-element subsets. SubsetType 2: 3-element subsets derived from the 2-element subsets by augmenting each 2-element subset to include the best solution not in this subset. SubsetType 3: 4-element subsets derived from the 3-element subsets by augmenting each 3-element subset to include the best solutions not in this subset. SubsetType 4: the subsets consisting of the best i elements, for i = 5 to b. A central consideration of this design is that RefSet itself might not be static, because it might be changing as new solutions are added to replace old ones (when these new solutions qualify to be among the current b best solutions found). In our implementation, however, we maintain a static updating of RefSet, but use a broad definition of best for the membership in this set. In other words, we do not allow RefSet to dynamically change its size, but we use two criteria to allow solutions to initially become members of this set. One criterion is the quality of the solution (as given by the objective function value) and the other is the diversity of the solution (as given by the dissimilarity measure). In this sense, our definition of best to construct the first RefSet is broader than one that considers only the value of the objective function. 7
9 After the first RefSet has been created, subsequent membership in the set can only be obtained by means of solution quality. That is, RefSet changes when the Combination Method generates solutions of higher quality and the process stops when RefSet converges. e) Solution Combination Method The Solution Combination Method as well as the Improvement Method are elements of scatter search that are context-dependent. Although it is possible to design generic combination procedures, it is more effective to base the design on specific characteristics of the problem setting. Our Solution Combination Method, which is applied to each subset generated in the previous step, uses a min-max construction based on votes. The method scans (from left to right) each reference permutation in the subset, and uses the rule that each reference permutation votes for its first element that is still not included in the combined permutation (referred to as the incipient element ). The voting determines the next element to enter the first still unassigned position of the combined permutation. This is a min-max rule in the sense that if any element of the reference permutation is chosen other than the incipient element, then it would increase the deviation between the reference and the combined permutations. Similarly, if the incipient element were placed later in the combined permutation than its next available position, this deviation would also increase. So the rule attempts to minimize the maximum deviation of the combined solution from the reference solution, subject to the fact that other reference solutions in the subset are also competing to contribute. This voting scheme can be implemented using a couple of variations that depend on the way votes are modified: (V1) The vote of a given reference solution is weighted according to the incipient element s position (referred to as the incipient position ). A smaller incipient position gets a higher vote. For example, if the element in the first position of some reference permutation is not assigned to the combined permutation during the first 4 assignments, then the vote is weighted more heavily to increase the chances of having that element assigned to position 5 of the combined permutation. The rule emphasizes the preference to this assignment versus having a later occurring element of some other reference permutation (which is the incipient element for that other permutation) become assigned. (V2) A bias factor that gives more weight to the vote of a reference permutation with higher quality. Within the current organization of our scatter search implementation such a factor should be very slight because it is expected that high quality solutions will be strongly represented anyway. We chose to implement V1 with a tie-breaking rule that is based on solution quality. The rule is used when more than one element receives the same votes. Then the element with highest weighted vote is selected, where the weight of a vote is directly proportional to the objective function value of the corresponding reference solution. 8
10 3. Overall Procedure The proposed procedure can be summarized as follows: 1. Start with P = Ø. Use the diversification generator DG10 to construct a solution s. * * Apply the Improvement Method to s to obtain the improved solution s. If s P * * then, add s to P (i.e., P = PSize. P = P s ), otherwise, discard s *. Repeat this step until 2. Order the solutions in P according to their objective function value (where the best overall solution is first on the list). 3. Build RefSet from P, with RefSet = b 1 +b 2 (i.e., b = b 1 +b 2 ). Take the first b 1 solutions in P and assign them to RefSet. For each solution x in P-RefSet, calculate the minimum dissimilarity d(refset,x) to all solutions in RefSet. Select the solution x with the maximum dissimilarity d(refset,x ) of all x in P-RefSet. Add x to RefSet, until RefSet = b 1 +b 2. Make NewElements = TRUE. While (NewElements) do 4. Calculate the number of subsets (MaxSubset) that include at least one new element. Make NewElements = FALSE. For (SubsetCounter = 1,, MaxSubset) do 5. Generate the next subset r from RefSet with the Subset Generation Method. This method generates one of four types of subsets with number of elements ranging from 2 to RefSet. Let subset r = { r 1,, rk }, for 2 k RefSet. 6. Apply the Solution Combination Method to r to obtain a new solution sr. 7. Apply the Improvement Method to sr, to obtain the improved solution. * s r * r If (s is not in RefSet and the objective function value of s is better than the objective function value of the worst element in RefSet ) then End if End for End while * r 8. Add s to RefSet and delete the worst element currently in RefSet. 9. Make NewElements = TRUE. The procedure starts with the generation of PSize distinct solutions. These solutions are originally generated to be diverse and subsequently improved by the application of the Improvement Method (step 1). The set P of PSize solutions is ordered in step 2, in order to facilitate the task of creating the reference set in step 3. The reference set (RefSet) is constructed with the first b 1 solutions in P and b 2 solutions that are diverse with respect to the members in RefSet. * r 9
11 The search consists of a while-loop and a for-loop that are designed to control both the presence of new elements and the examination of all the subsets with at least one new element. In step 4, the number of subsets with at least one new element is counted and this value is assigned to MaxSubset. The Boolean variable NewElements is made FALSE before the subsets are examined, since it is not known whether a new solution will enter the reference set in the current examination of the subsets. The actual generation of the subsets occurs in step 5. Note that only subsets with at least one new element are generated in this step. A solution is generated in step 6 by applying the Combination Method. Step 7 attempts to improve this solution with the application of the Improvement Method. If the improved solution from step 7 is better than the worst solution in the reference set, then the improved solution becomes a new element of RefSet. The solution is added in step 8 and the NewElements indicator is switched to TRUE in step 9. We now turn our attention to the computational experiments used to assess the merit of our scatter search implementations. Details of such experiments are provided in the next section. 4. Computational Experiments The overall procedure described in section 3 was implemented in C, and all experiments were performed on a Pentium 166 Mhz personal computer. Parameter Tuning The first set of experiments is designed to find the best values for the key parameters of our scatter search implementation. For this experiment, we use 15 instances from the public-domain library LOLIB (1997) and 15 randomly generated instances with 100 sectors and with weight values uniformly distributed between 0 and 100. The following values were tested during these experiments: PSize 50, 100, and 150 b 10, 20 and 40 (b 1, b 2 ) (5, 5), (10,10), (5, 15), (15, 5) and (20, 20) The experiments reveled that a significant change in the solution quality is due to the increase in PSize. The experiments were inconclusive about the advantage of increasing the size of the reference set (i.e., the value of b) beyond 20 when PSize is no more than 100. In the same way, the experiments showed that the best results are obtained when b 1 = b 2. For the next set of experiments, we set our key parameters to the following values: PSize = 100, b = 20 and b 1 = b 2 = 10. Tracking Combination Strategies This experiment is designed to assess the contribution of the different types of combinations embedded in our implementation. In other words, we would like to know if the best solution was generated from the combination of 2, 3 or 4 reference solutions. (The answer could be all of the above, since the best solution can result from a succession of combinations, each of a different type.) In general, we undertake to identify how often, across a set of benchmark problems, the best solutions came from various combinations of k reference solutions. 10
12 Since SubsetType 1 through 4 respectively generate solutions from 2 to up to b reference solutions, we keep a 4 element array RS(i) for each solution in rank i of RefSet (corresponding to SubsetType 1 to 4). The array starts (0,0,0,0), meaning that there are no sources, and then counts the number of times those different subset types are used. For instance, suppose three solutions with (2,0,0,1), (5,1,0,0) and (0,1,0,0) are combined by SubsetType 2. Then the new solution is accompanied by the array (7,3,0,1) the sum of the other arrays, plus 1 added to position 2. We use 15 instances from LOLIB and the RS arrays corresponding to the solutions generated during the search to find the percentage of time that each subset type is used to combine solutions that become members of the reference set. The percentages are 86.9%, 11%, 2% and 0.1%, for SubsetType 1, 2, 3 and 4, respectively. This experiment provides an idea of the relative importance of these combination strategies. (However, we observe that these percentages could change if the subset types were generated in a different sequence.) We perform the same experiment with 15 randomly generated instances with 100 sectors and with weight values uniformly distributed between 0 and 100. The results are similar to those obtained before, with values of 80.3%, 15.1%, 4.3% and 0.4%, for SubsetType 1, 2, 3, and 4, respectively. Tracking Best Solutions An item of special relevance in scatter search is to know not only how often the best solutions come from different types of combinations, but also to know the ranks of the reference solutions that generated these best solutions. That is, a trace could be enlightening that says: the overall best solution came from combining the 3rd and 5th best solutions where one of these came from combining the 1st, 2nd and 6th best solutions, and the other came from... etc. This trace gives us an idea of what solutions are important as components of others. For this experiment, we keep at most 20 best solutions in RefSet. Then we create a 20 by 20 matrix Source(i,j), where Source(i,j) counts the number of times a solution of rank j was a reference point for the current solution for rank i. (To begin, this matrix is all 0.) Then, suppose next that the current solution to be assigned rank 2 is created from 3 reference points, of rank 1, 4 and 6. Before shifting the records so that the previous rank 2 will be the new rank 3, etc., we create a working space Work(j) that will become the row Source(2,j) after the shift. Work(j) in the present example just sums the contents of the three rows Source(1,j), Source(4,j) and Source(6,j), and then also increases Work(1), Work(4) and Work(6) by 1. The data structure is maintained and updated by this basic type of process. Figure 4 shows the average of rows 1, 10 and 20 of the Source matrix after running scatter search on 15 LOLIB instances. The interpretation of the lines in Figure 4 is as follows. Consider the line associated with rank 1. Then, a count of almost 18 in the first point of this line indicates that rank 1 solutions were generated 18 times from other rank 1 solutions. Similarly, rank 1 solutions were generated 8 times from rank 2 solutions. The decaying effect exhibited by all the lines indicate that high quality solutions tend to generate new solutions that are admitted to the reference set. This is evident by the counts corresponding to rank 1 in the x-axis. During the search, rank 1 solutions generated 18 rank 1 solutions, 4 rank 10 solutions and 1 rank 20 solution, on average. 11
13 We performed the same experiment using randomly generated instances and observed the same behavior depicted in Figure 4. The magnitude of the counts, however, drastically changed, because the number of solutions added to the reference set in the LOLIB problems is in the order of 20, while this value is in the order of 100 for randomly generated problems. Assessing Performance In the following set of experiments we compare the performance of two variants of our scatter search implementation with three methods: Chanas and Kobylanski (1996), Tabu Search (Laguna, Martí and Campos, 1998) and a greedy procedure described below. The two variants of scatter search are SS and SS40-200, indicating that b = 20 and 40 and PSize = 100 and 200, respectively. In both variants, b 1 = b 2. Given the results of our experiments tracking the combination method, we restrict the procedure to exclusively operate with SubsetType 1, 2 and 3. The greedy local search procedure is based on deleting a sector from its current position and inserting it in another position. An iteration of the algorithm consists of scanning the list of sectors in search for the first one whose movement results in an improvement of the objective function value. The algorithm ends when there is no improving move. We have tested the procedures on four sets of instances: (1) LOLIB Instances. These instances from the public-domain library consist of input-output tables from sectors in the European economy. Total number of instances is 49. (2) SGB Instances. These instances from the Stanford GraphBase (Knuth, 1993) consist of input-output tables from sectors in the economy of the United States. The set has a total of 25 instances with 75 sectors. (3) Random Type I. These instances are generated from a (0,100) uniform distribution. Reinelt (1985) considers these instances. We generate instances of sizes ranging from 35 to 200. There are 25 instances in each set for a total of 125. (4) Random Type II. These instances are generating by counting the number of times a sector appears in a higher position than anther in a set of randomly generated permutations. For a problem of size m, m/2 permutations are generated. Chanas and Kobilansky (1996) consider these instances. We generate instances of sizes 100, 150 and 200. There are 25 instances in each set for a total of 75. To reduce the computational effort related to avoiding duplications in the population, we have implemented the following hash function to compare solutions and avoid duplications: hash m 2 ( p) = ip(i) We have empirically determined that two different solutions almost always have different hash values (with a few rare exceptions). Therefore, in our implementation, when two solutions have the same hash value we consider that both are the same and eliminate one of them from further consideration. This implementation results in average computational-time savings of about 7% in LOLIB instances and 1.5% in i = 1 12
14 random instances when compared to a full duplication checking mechanism. The scatter search procedure yields significantly lower duplications in random instances than in real-world examples. Intuitively, this can be explained by the relationships between sectors in real-world examples, which tend to favor the generation of similar solutions. Tables 1 to 5 show, for each procedure, the average objective function value, the average percent deviation from optimality, the number of optimal solutions, and the average CPU time in seconds. Since optimal solutions are not known for the SGB and the large random instances, the deviation in Tables 3, 4 and 5 is reported considering the best solution found during each experiment. Also for these tables, the number of best solutions found is reported instead of the number of optimal solutions. We refer to Chanas and Kobylanski s method as CK, and as CK10 to the application of the method from 10 randomly generated initial solutions. The tabu search method will be denoted as TS. Table 1. Results with LOLIB instances. greedy CK CK10 TS SS SS value optima dev. 0.15% 0.15% 0.02% 0.04% 0.01% 0.01% number of optima run time (sec.) Table 2. Results with random type I instances (m = 35). greedy CK CK10 TS SS SS value optima dev. 0.47% 0.56% 0.12% 0.07% 0.00% 0.00% number of optima run time (sec.) Table 3. Results with SGB Instances. greedy CK CK10 TS SS SS value best dev % 0.054% 0.011% 0.013% 0.002% 0.001% number of best run time (sec.) Table 4. Results with random type I instances (m = 100, 150 and 200). greedy CK CK10 TS SS SS value best dev. 0.45% 0.48% 0.29% 0.11% 0.02% 0.01% number of best run time (sec.) Table 5. Results with random type II instances (m = 100, 150 and 200). greedy CK CK10 TS SS SS value best dev. 0.02% 0.02% 0.01% 0.00% 0.00% 0.00% number of best run time (sec.)
15 The greedy procedure is clearly inferior in terms of solution quality, although given its simplicity, its performance is quite acceptable. The performance of the greedy and CK methods is very similar within each of the four problem sets, but their deviation from the optimal (or best) solutions is significantly higher in the case of the random instances type I. Both the greedy and the CK procedures are performed from a randomly generated initial solution. TS and the SS variants, on the other hand, are quite robust, as evident by the negligible change in the deviation values across tables. It is difficult to measure solution quality in terms of percent deviation, since TS and both SS variants have very small average deviations from optimality. In terms of number of optima (or best solutions), TS is very competitive, considering that is able to match 33 (out of 49) optima in the LOLIB and 16 (out of 25) optima in the small random type I problems (see Tables 1 and 2). TS is also computationally efficient, requiring a maximum of less than 13 seconds per problem, on the average. The most robust method is SS in terms of number of optima or best solutions found. However, this is done at the expense of higher computational times. It should be mentioned that the optimal solutions to the random type I problem instances with 35 sectors were found by solving the following integer programming problem: Max x x x ij ij ij + x x ik c jk x ij ij i< j j < i subject to {01, } x + x ik jk c ij (1 x ( i, j ) : i < j ji ) ( i, j, k) : i < ( i, j, k) : i < j < k j < k In this formulation, xij = 1if sector i goes before sector j in the ordering, and 0 otherwise. The problems were solved with CPLEX 6.0 on a Pentium machine with 450 Mhz. The minimum time required was 101 seconds with a maximum of 13.3 hours and an average of 1.5 hours. Finally, Figure 5 shows a performance graph that compares four procedures using 10 random type I instances of size 100. The procedures were run for 20 seconds and the best solution found was reported every second. The greedy procedure is performed from random starts. Note that SS uses the first 3 seconds to generate the set P and construct the RefSet. When the optimization process starts, the procedure quickly moves to the range of high quality solutions and maintains its lead during the rest of the solution time. 5. Conclusions The objective of our study has been to expand and advance the knowledge associated with the implementation of scatter search procedures for global optimization. Unlike its close cousin, tabu search, scatter search has not yet been extensively studied. In particular, we have undertaken to examine the critical issue of what form of diversification proves effective in this setting. We have also exploited a definition of 14
16 quality that depends not only on an objective function value, or even on the properties of a given solution in isolation, but which considers the relative differences of the solutions maintained in the reference set. Finally, we have generated solution statistics that show the origins of the best solutions, both in terms of the types of combinations that produced them and in terms of the ranks of the ancestor solutions. Our resulting scatter search implementation is highly effective, rivaling (and often surpassing) the best procedures in the literature. 15
17 References Becker, O. (1967) Das Helmstädtersche Reihenfolgeproblem die Effizienz verschiedener Näherungsverfahren in Computer uses in the Social Sciences, Berichteiner Working Conference, Wien, January Chanas, S. and P. Kobylanski (1996) A New Heuristic Algorithm Solving the Linear Ordering Problem, Computational Optimization and Applications, vol. 6, pp Crowston, W. B., F. Glover, G. L. Thompson and J. D. Trawick (1963) Probabilistic and Parametric Learning Combinations of Local Job Shop Scheduling Rules, ONR Research Memorandum No. 117, GSIA, Carnegie Mellon University, Pittsburgh, PA. Feo, T. and M. G. C. Resende (1995) Greedy Randomized Adaptive Search Procedures, Journal of Global Optimization, vol. 2, pp Fisher, H. and G. L. Thompson (1963) Probabilistic Learning Combinations of Local Job-Shop Scheduling Rules, Industrial Scheduling, J. F. Muth and G. L. Thompson (eds.) Prentice-Hall, pp Glover, F. (1965) A Multiphase Dual Algorithm for the Zero-One Integer Programming Problem, Operations Research, vol. 13, no. 6, pp Glover, F. (1968) Surrogate Constraints, Operations Research, vol. 16, pp Glover, F. (1998) A Template for Scatter Search and Path Relinking, in Artificial Evolution, Lecture Notes in Computer Science 1363, J.-K. Hao, E. Lutton, E. Ronald, M. Schoenauer and D. Snyers (Eds.), Springer, pp Glover, F. and M. Laguna (1997) Tabu Search, Kluwer Academic Publishers, Boston. Grotschel, M., M. Junger and G. Reinelt (1984), A Cutting Plane Algorithm for the Linear Ordering Problem, Operations Research, vol. 32, no. 6, pp Knuth, D. E. (1993) The Stanford GraphBase: A Platform for Combinatorial Computing, Addison Wesley, New York. Laguna, M. and F. Glover (1993) Integrating Target Analysis and Tabu Search for Improved Scheduling Systems, Expert Systems with Applications, vol. 6, pp Laguna, M., R. Martí and V. Campos (1998) Intensification and Diversification with Elite Tabu Search Solutions for the Linear Ordering Problem, to appear in Computers and Operations Research. LOLIB (1997) Reinelt, G. (1985) The Linear Ordering Problem: Algorithms and Applications, Research and Exposition in Mathematics, Vol. 8, H. H. Hofmann and R. Wille (Eds.), Heldermann Verlag Berlin. 16
Scatter Search: Methodology and Applications
Scatter Search: Methodology and Applications Manuel Laguna University of Colorado Rafael Martí University of Valencia Based on Scatter Search: Methodology and Implementations in C Laguna, M. and R. Martí
Chapter 8 SCATTER SEARCH 1. INTRODUCTION
Chapter 8 SCATTER SEARCH Manuel Laguna 1 and Rafael Martí 2 1 Leeds School of Business, University of Colorado at Boulder, laguna@colorado.edu; 2 Dpto. de Estadística e Investigación Operativa, Universidad
Metaheuristic Optimization with Evolver, Genocop and OptQuest
Metaheuristic Optimization with Evolver, Genocop and OptQuest MANUEL LAGUNA Graduate School of Business Administration University of Colorado, Boulder, CO 80309-0419 Manuel.Laguna@Colorado.EDU Last revision:
Scatter Search. 1. Introduction. Fred Glover 1, Manuel Laguna 1 and Rafael Martí 2
Scatter Search Fred Glover 1, Manuel Laguna 1 and Rafael Martí 2 1 Leeds School of Business, University of Colorado, Boulder, CO 80309-0419, USA, {Fred.Glover}{Manuel.Laguna}@Colorado.edu 2 Departamento
Heuristics and Meta-Heuristics for 2-Layer Straight Line Crossing Minimization
Heuristics and Meta-Heuristics for 2-Layer Straight Line Crossing Minimization Rafael Martí 1 and Manuel Laguna 2 November 13, 2001 1 Departamento de Estadística e I.O. Universidad de Valencia. Dr. Moliner
Regensburger DISKUSSIONSBEITRÄGE zur Wirtschaftswissenschaft
Regensburger DISKUSSIONSBEITRÄGE zur Wirtschaftswissenschaft A Cluster Based Scatter Search Heuristic for the Vehicle Routing Problem University of Regensburg Discussion Papers in Economics No. 415, November
The Linear Ordering Problem: Instances, Search Space Analysis and Algorithms
The Linear Ordering Problem: Instances, Search Space Analysis and Algorithms Tommaso Schiavinotto and Thomas Stützle Darmstadt University of Technology, Computer Science Department Alexanderstr. 10, 64283
6. Tabu Search. 6.3 Minimum k-tree Problem. Fall 2010 Instructor: Dr. Masoud Yaghini
6. Tabu Search 6.3 Minimum k-tree Problem Fall 2010 Instructor: Dr. Masoud Yaghini Outline Definition Initial Solution Neighborhood Structure and Move Mechanism Tabu Structure Illustrative Tabu Structure
A Diversified Multi-Start Algorithm for Unconstrained Binary Quadratic Problems Leveraging the Graphics Processor Unit
A Diversified Multi-Start Algorithm for Unconstrained Binary Quadratic Problems Leveraging the Graphics Processor Unit Mark Lewis Missouri Western State University, Saint Joseph, Missouri 64507, USA mlewis14@missouriwestern.edu
GRASP and path-relinking: Recent advances and applications
and path-relinking: Recent advances and applications Mauricio G.C. Rese Celso C. Ribeiro April 6, 23 Abstract This paper addresses recent advances and application of hybridizations of greedy randomized
Unidimensional Search for solving continuous high-dimensional optimization problems
2009 Ninth International Conference on Intelligent Systems Design and Applications Unidimensional Search for solving continuous high-dimensional optimization problems Vincent Gardeux, Rachid Chelouah,
SCATTER SEARCH AND PATH-RELINKING: FUNDAMENTALS, ADVANCES, AND APPLICATIONS
SCATTER SEARCH AND PATH-RELINKING: FUNDAMENTALS, ADVANCES, AND APPLICATIONS M.G.C. RESENDE, C.C. RIBEIRO, F. GLOVER, AND R. MARTÍ Abstract. Scatter Search is an evolutionary metaheuristic that explores
Tabu Search for a Multi-Objective Routing Problem
Tabu Search for a Multi-Objective Routing Problem JOAQUÍN PACHECO Fac. C Económicas y Empresariales. Universidad de Burgos. Plaza Infanta Elena s/n. Burgos 09001, Spain. RAFAEL MARTÍ * Departament d Estadística
GRASP. Greedy Randomized Adaptive. Search Procedure
GRASP Greedy Randomized Adaptive Search Procedure Type of problems Combinatorial optimization problem: Finite ensemble E = {1,2,... n } Subset of feasible solutions F 2 Objective function f : 2 Minimisation
6. Tabu Search 6.1 Basic Concepts. Fall 2010 Instructor: Dr. Masoud Yaghini
6. Tabu Search 6.1 Basic Concepts Fall 2010 Instructor: Dr. Masoud Yaghini Outline Tabu Search: Part 1 Introduction Illustrative Problems Search Space Neighborhood Structure Tabus Aspiration Criteria Termination
Metaheuristic Development Methodology. Fall 2009 Instructor: Dr. Masoud Yaghini
Metaheuristic Development Methodology Fall 2009 Instructor: Dr. Masoud Yaghini Phases and Steps Phases and Steps Phase 1: Understanding Problem Step 1: State the Problem Step 2: Review of Existing Solution
SCATTER SEARCH BASED METAHEURISTIC FOR ROBUST OPTIMIZATION OF THE DEPLOYING OF DWDM TECHNOLOGY ON OPTICAL NETWORKS WITH SURVIVABILITY
Yugoslav Journal of Operations Research 15 (2005), Number 1, 65-77 SCATTER SEARCH BASED METAHEURISTIC FOR ROBUST OPTIMIZATION OF THE DEPLOYING OF DWDM TECHNOLOGY ON OPTICAL NETWORKS WITH SURVIVABILITY
LOCAL SEARCH WITH PERTURBATIONS FOR THE PRIZE-COLLECTING STEINER TREE PROBLEM IN GRAPHS
LOCAL SEARCH WITH PERTURBATIONS FOR THE PRIZE-COLLECTING STEINER TREE PROBLEM IN GRAPHS S.A. CANUTO, M.G.C. RESENDE, AND C.C. RIBEIRO Abstract. Given an undirected graph with prizes associated with its
Lecture 06 Tabu Search
Lecture 06 Tabu Search s.l. dr. ing. Ciprian-Bogdan Chirila chirila@cs.upt.ro http://www.cs.upt.ro/~chirila Heuristic Methods Outline Introduction The TS framework Example Notation and problem description
Scatter search and path-relinking: Fundamentals, advances, and applications
Scatter search and path-relinking: Fundamentals, advances, and applications Mauricio G.C. Resende, Celso C. Ribeiro, Fred Glover, and Rafael Martí Abstract Scatter search is an evolutionary metaheuristic
3. Genetic local search for Earth observation satellites operations scheduling
Distance preserving recombination operator for Earth observation satellites operations scheduling Andrzej Jaszkiewicz Institute of Computing Science, Poznan University of Technology ul. Piotrowo 3a, 60-965
Sequential and Parallel Path-Relinking Algorithms for the Quadratic Assignment Problem
Sequential and Parallel Path-Relinking Algorithms for the Quadratic Assignment Problem Tabitha James a,, Cesar Rego b, and Fred Glover c a Department of Business Information Technology, Pamplin College
A Study of Neighborhood Structures for the Multiple Depot Vehicle Scheduling Problem
A Study of Neighborhood Structures for the Multiple Depot Vehicle Scheduling Problem Benoît Laurent 1,2 and Jin-Kao Hao 2 1 Perinfo SA, Strasbourg, France 2 LERIA, Université d Angers, Angers, France blaurent@perinfo.com,
Optimization of Complex Systems with OptQuest
Optimization of Complex Systems with OptQuest MANUEL LAGUNA Graduate School of Business Administration University of Colorado, Boulder, CO 80309-0419 Manuel.Laguna@Colorado.EDU Latest revision: April 8,
Scatter Search for the Bi-criteria p-median p-dispersion problem
Noname manuscript No. (will be inserted by the editor) Scatter Search for the Bi-criteria p-median p-dispersion problem J. Manuel Colmenar Arild Hoff Rafael Martí Abraham Duarte Received: date / Accepted:
Branch-and-bound: an example
Branch-and-bound: an example Giovanni Righini Università degli Studi di Milano Operations Research Complements The Linear Ordering Problem The Linear Ordering Problem (LOP) is an N P-hard combinatorial
A LOCAL SEARCH GENETIC ALGORITHM FOR THE JOB SHOP SCHEDULING PROBLEM
A LOCAL SEARCH GENETIC ALGORITHM FOR THE JOB SHOP SCHEDULING PROBLEM Kebabla Mebarek, Mouss Leila Hayat and Mouss Nadia Laboratoire d'automatique et productique, Université Hadj Lakhdar -Batna kebabla@yahoo.fr,
MIC 99. III Metaheuristics International Conference. PUC-Rio - Catholic University of Rio de Janeiro. Angra dos Reis, Brazil.
MIC 99 III Metaheuristics International Conference organized by PUC-Rio - Catholic University of Rio de Janeiro Angra dos Reis, Brazil July 19-22, 1999 MIC 99 - III Metaheuristics International Conference
A tabu search based memetic algorithm for the max-mean dispersion problem
A tabu search based memetic algorithm for the max-mean dispersion problem Xiangjing Lai a and Jin-Kao Hao a,b, a LERIA, Université d'angers, 2 Bd Lavoisier, 49045 Angers, France b Institut Universitaire
Comparisons of Commercial MIP Solvers and an Adaptive Memory (Tabu Search) Procedure for a Class of 0-1 Integer Programming Problems
Comparisons of Commercial MIP Solvers and an Adaptive Memory (Tabu Search) Procedure for a Class of 0-1 Integer Programming Problems Lars M. Hvattum The Norwegian University of Science and Technology Trondheim,
Tabu Search for the Founder Sequence Reconstruction Problem: A Preliminary Study
Alma Mater Studiorum Università degli Studi di Bologna DEIS Tabu Search for the Founder Sequence Reconstruction Problem: A Preliminary Study Andrea Roli and Christian Blum January 10, 2009 DEIS Technical
Structural Advantages for Ant Colony Optimisation Inherent in Permutation Scheduling Problems
Structural Advantages for Ant Colony Optimisation Inherent in Permutation Scheduling Problems James Montgomery No Institute Given Abstract. When using a constructive search algorithm, solutions to scheduling
Scatter Search and Path Relinking: A Tutorial on the Linear Arrangement Problem
International Journal of Swarm Intelligence Research, 2(2), 1-21, April-June 2011 1 Scatter Search and Path Relinking: A Tutorial on the Linear Arrangement Problem Rafael Martí, Universidad de Valencia,
Effective probabilistic stopping rules for randomized metaheuristics: GRASP implementations
Effective probabilistic stopping rules for randomized metaheuristics: GRASP implementations Celso C. Ribeiro Isabel Rosseti Reinaldo C. Souza Universidade Federal Fluminense, Brazil July 2012 1/45 Contents
Neighborhood Combination for Unconstrained Binary Quadratic Programming
id-1 Neighborhood Combination for Unconstrained Binary Quadratic Programming Zhipeng Lü Fred Glover Jin-Kao Hao LERIA, Université d Angers 2 boulevard Lavoisier, 49045 Angers, France lu@info.univ-angers.fr
Lamarckian Repair and Darwinian Repair in EMO Algorithms for Multiobjective 0/1 Knapsack Problems
Repair and Repair in EMO Algorithms for Multiobjective 0/ Knapsack Problems Shiori Kaige, Kaname Narukawa, and Hisao Ishibuchi Department of Industrial Engineering, Osaka Prefecture University, - Gakuen-cho,
Job Shop Scheduling Problem (JSSP) Genetic Algorithms Critical Block and DG distance Neighbourhood Search
A JOB-SHOP SCHEDULING PROBLEM (JSSP) USING GENETIC ALGORITHM (GA) Mahanim Omar, Adam Baharum, Yahya Abu Hasan School of Mathematical Sciences, Universiti Sains Malaysia 11800 Penang, Malaysia Tel: (+)
Non-deterministic Search techniques. Emma Hart
Non-deterministic Search techniques Emma Hart Why do local search? Many real problems are too hard to solve with exact (deterministic) techniques Modern, non-deterministic techniques offer ways of getting
CHAPTER 4 GENETIC ALGORITHM
69 CHAPTER 4 GENETIC ALGORITHM 4.1 INTRODUCTION Genetic Algorithms (GAs) were first proposed by John Holland (Holland 1975) whose ideas were applied and expanded on by Goldberg (Goldberg 1989). GAs is
Information Fusion Dr. B. K. Panigrahi
Information Fusion By Dr. B. K. Panigrahi Asst. Professor Department of Electrical Engineering IIT Delhi, New Delhi-110016 01/12/2007 1 Introduction Classification OUTLINE K-fold cross Validation Feature
CHAPTER 3.4 AND 3.5. Sara Gestrelius
CHAPTER 3.4 AND 3.5 Sara Gestrelius 3.4 OTHER EVOLUTIONARY ALGORITHMS Estimation of Distribution algorithms Differential Evolution Coevolutionary algorithms Cultural algorithms LAST TIME: EVOLUTIONARY
GRASP WITH PATH-RELINKING FOR THE GENERALIZED QUADRATIC ASSIGNMENT PROBLEM
GRASP WITH PATH-RELINKING FOR THE GENERALIZED QUADRATIC ASSIGNMENT PROBLEM GERALDO R. MATEUS, MAURICIO G.C. RESENDE, AND RICARDO M. A. SILVA Abstract. The generalized quadratic assignment problem (GQAP)
Assigning Judges to Competitions Using Tabu Search Approach
Assigning Judges to Competitions Using Tabu Search Approach Amina Lamghari Jacques A. Ferland Computer science and OR dept. University of Montreal Faculty of Information Technology University of Science
Algorithms for Integer Programming
Algorithms for Integer Programming Laura Galli November 9, 2016 Unlike linear programming problems, integer programming problems are very difficult to solve. In fact, no efficient general algorithm is
Reducing the Bandwidth of a Sparse Matrix with Tabu Search
Reducing the Bandwidth o a Sparse Matrix with Tabu Search Raael Martí a, Manuel Laguna b, Fred Glover b and Vicente Campos a a b Dpto. de Estadística e Investigación Operativa, Facultad de Matemáticas,
Solving dynamic memory allocation problems in embedded systems with parallel variable neighborhood search strategies
Available online at www.sciencedirect.com Electronic Notes in Discrete Mathematics 47 (2015) 85 92 www.elsevier.com/locate/endm Solving dynamic memory allocation problems in embedded systems with parallel
Surrogate Gradient Algorithm for Lagrangian Relaxation 1,2
Surrogate Gradient Algorithm for Lagrangian Relaxation 1,2 X. Zhao 3, P. B. Luh 4, and J. Wang 5 Communicated by W.B. Gong and D. D. Yao 1 This paper is dedicated to Professor Yu-Chi Ho for his 65th birthday.
GRASP WITH PATH-RELINKING FOR THE GENERALIZED QUADRATIC ASSIGNMENT PROBLEM
GRASP WITH PATH-RELINKING FOR THE GENERALIZED QUADRATIC ASSIGNMENT PROBLEM GERALDO R. MATEUS, MAURICIO G.C. RESENDE, AND RICARDO M. A. SILVA Abstract. The generalized quadratic assignment problem (GQAP)
Fast Point-Feature Label Placement Algorithm for Real Time Screen Maps
Fast Point-Feature Label Placement Algorithm for Real Time Screen Maps Missae Yamamoto, Gilberto Camara, Luiz Antonio Nogueira Lorena National Institute of Space Research - INPE, São José dos Campos, SP,
Optimization Techniques for Design Space Exploration
0-0-7 Optimization Techniques for Design Space Exploration Zebo Peng Embedded Systems Laboratory (ESLAB) Linköping University Outline Optimization problems in ERT system design Heuristic techniques Simulated
A Tabu Search solution algorithm
Chapter 5 A Tabu Search solution algorithm The TS examines a trajectory sequence of solutions and moves to the best neighbor of the current solution. To avoid cycling, solutions that were recently examined
A Steady-State Genetic Algorithm for Traveling Salesman Problem with Pickup and Delivery
A Steady-State Genetic Algorithm for Traveling Salesman Problem with Pickup and Delivery Monika Sharma 1, Deepak Sharma 2 1 Research Scholar Department of Computer Science and Engineering, NNSS SGI Samalkha,
The Genetic Algorithm for finding the maxima of single-variable functions
Research Inventy: International Journal Of Engineering And Science Vol.4, Issue 3(March 2014), PP 46-54 Issn (e): 2278-4721, Issn (p):2319-6483, www.researchinventy.com The Genetic Algorithm for finding
A Relative Neighbourhood GRASP for the SONET Ring Assignment Problem
A Relative Neighbourhood GRASP for the SONET Ring Assignment Problem Lucas de Oliveira Bastos 1, Luiz Satoru Ochi 1, Elder M. Macambira 2 1 Instituto de Computação, Universidade Federal Fluminense Address:
Sparse Matrices Reordering using Evolutionary Algorithms: A Seeded Approach
1 Sparse Matrices Reordering using Evolutionary Algorithms: A Seeded Approach David Greiner, Gustavo Montero, Gabriel Winter Institute of Intelligent Systems and Numerical Applications in Engineering (IUSIANI)
Pole Shape Optimization Using a Tabu Search Scheme P. J. Leonard and A. M. Connor
Pole Shape Optimization Using a Tabu Search Scheme P. J. Leonard and A. M. Connor Abstract: The pole shape optimization of an electromagnet typical of an MRI type application is investigated. We compare
Overview of Tabu Search
Overview of Tabu Search The word tabu (or taboo) comes from Tongan, a language of Polynesia, where it was used by the aborigines of Tonga island to indicate things that cannot be touched because they are
Automated Test Data Generation and Optimization Scheme Using Genetic Algorithm
2011 International Conference on Software and Computer Applications IPCSIT vol.9 (2011) (2011) IACSIT Press, Singapore Automated Test Data Generation and Optimization Scheme Using Genetic Algorithm Roshni
Grouping Genetic Algorithm with Efficient Data Structures for the University Course Timetabling Problem
Grouping Genetic Algorithm with Efficient Data Structures for the University Course Timetabling Problem Felipe Arenales Santos Alexandre C. B. Delbem Keywords Grouping Genetic Algorithm Timetabling Problem
GRASP with evolutionary path-relinking for the antibandwidth problem
GRASP with evolutionary path-relinking for the antibandwidth problem VIII Metaheuristics International Conference (MIC 009) Hamburg, Germany July 3-6, 009 Mauricio G. C. Resende AT&T Labs Research Florham
Escaping Local Optima: Genetic Algorithm
Artificial Intelligence Escaping Local Optima: Genetic Algorithm Dae-Won Kim School of Computer Science & Engineering Chung-Ang University We re trying to escape local optima To achieve this, we have learned
The Dynamic Hungarian Algorithm for the Assignment Problem with Changing Costs
The Dynamic Hungarian Algorithm for the Assignment Problem with Changing Costs G. Ayorkor Mills-Tettey Anthony Stentz M. Bernardine Dias CMU-RI-TR-07-7 July 007 Robotics Institute Carnegie Mellon University
Evolutionary Computation Algorithms for Cryptanalysis: A Study
Evolutionary Computation Algorithms for Cryptanalysis: A Study Poonam Garg Information Technology and Management Dept. Institute of Management Technology Ghaziabad, India pgarg@imt.edu Abstract The cryptanalysis
D-Optimal Designs. Chapter 888. Introduction. D-Optimal Design Overview
Chapter 888 Introduction This procedure generates D-optimal designs for multi-factor experiments with both quantitative and qualitative factors. The factors can have a mixed number of levels. For example,
TABU SEARCH HEURISTIC FOR POINT-FEATURE CARTOGRAPHIC LABEL PLACEMENT
c GeoInformatica,, 1 11 () Kluwer Academic Publishers, Boston. Manufactured in The Netherlands. TABU SEARCH HEURISTIC FOR POINT-FEATURE CARTOGRAPHIC LABEL PLACEMENT MISSAE YAMAMOTO, GILBERTO CAMARA AND
arxiv: v1 [cs.ai] 12 Feb 2017
GENETIC AND MEMETIC ALGORITHM WITH DIVERSITY EQUILIBRIUM BASED ON GREEDY DIVERSIFICATION ANDRÉS HERRERA-POYATOS 1 AND FRANCISCO HERRERA 1,2 arxiv:1702.03594v1 [cs.ai] 12 Feb 2017 1 Research group Soft
LEXICOGRAPHIC LOCAL SEARCH AND THE P-CENTER PROBLEM
LEXICOGRAPHIC LOCAL SEARCH AND THE P-CENTER PROBLEM Refael Hassin, Asaf Levin and Dana Morad Abstract We introduce a local search strategy that suits combinatorial optimization problems with a min-max
Incorporation of Scalarizing Fitness Functions into Evolutionary Multiobjective Optimization Algorithms
H. Ishibuchi, T. Doi, and Y. Nojima, Incorporation of scalarizing fitness functions into evolutionary multiobjective optimization algorithms, Lecture Notes in Computer Science 4193: Parallel Problem Solving
LOCAL SEARCH FOR THE MINIMUM FUNDAMENTAL CYCLE BASIS PROBLEM
LOCAL SEARCH FOR THE MINIMUM FUNDAMENTAL CYCLE BASIS PROBLEM Abstract E.Amaldi, L.Liberti, N.Maculan, F.Maffioli DEI, Politecnico di Milano, I-20133 Milano amaldi,liberti,maculan,maffioli @elet.polimi.it
Principles of Scatter Search
Principles of Scatter Search RAFAEL MARTÍ Dpto. de Estadística e Investigación Operativa, Facultad de Matemáticas, Universidad de Valencia, Dr. Moliner 50, 4600 Burjassot (Valencia) Spain. Rafael.Marti@uv.es
A Genetic Algorithm for Multiprocessor Task Scheduling
A Genetic Algorithm for Multiprocessor Task Scheduling Tashniba Kaiser, Olawale Jegede, Ken Ferens, Douglas Buchanan Dept. of Electrical and Computer Engineering, University of Manitoba, Winnipeg, MB,
New Trials on Test Data Generation: Analysis of Test Data Space and Design of Improved Algorithm
New Trials on Test Data Generation: Analysis of Test Data Space and Design of Improved Algorithm So-Yeong Jeon 1 and Yong-Hyuk Kim 2,* 1 Department of Computer Science, Korea Advanced Institute of Science
Variable Neighborhood Search for Solving the Balanced Location Problem
TECHNISCHE UNIVERSITÄT WIEN Institut für Computergraphik und Algorithmen Variable Neighborhood Search for Solving the Balanced Location Problem Jozef Kratica, Markus Leitner, Ivana Ljubić Forschungsbericht
A Two-Dimensional Mapping for the Traveling Salesman Problem
Computers Math. Apphc. Vol. 26, No. 12, pp. 65-73, 1993 0898-1221/93 $6.00 + 0.00 Printed in Great Britain. All rights reserved Copyright 1993 Pergarnon Press Ltd A Two-Dimensional Mapping for the Traveling
A Genetic Approach for Solving Minimum Routing Cost Spanning Tree Problem
A Genetic Approach for Solving Minimum Routing Cost Spanning Tree Problem Quoc Phan Tan Abstract Minimum Routing Cost Spanning Tree (MRCT) is one of spanning tree optimization problems having several applications
HYBRID GENETIC ALGORITHM AND GREEDY RANDOMIZED ADAPTIVE SEARCH PROCEDURE FOR SOLVING A NURSE SCHEDULING PROBLEM
HYBRID GENETIC ALGORITHM AND GREEDY RANDOMIZED ADAPTIVE SEARCH PROCEDURE FOR SOLVING A NURSE SCHEDULING PROBLEM 1 CHEBIHI FAYCAL, 2 MOHAMMED ESSAID RIFFI, 3 BELAID AHIOD 1 Research Scholar, Department
A Hybrid Improvement Heuristic for the Bin Packing Problem
MIC 2001-4th Metaheuristics International Conference 63 A Hybrid Improvement Heuristic for the Bin Packing Problem Adriana C.F. Alvim Dario J. Aloise Fred Glover Celso C. Ribeiro Department of Computer
A Metaheuristic Algorithm for the Minimum Routing Cost Spanning Tree Problem
Iranian Journal of Operations Research Vol. 6, No. 1, 2015, pp. 65-78 A Metaheuristic Algorithm for the Minimum Routing Cost Spanning Tree Problem S. Sattari 1, F. Didehvar 2,* The routing cost of a spanning
ALGORITHM SYSTEMS FOR COMBINATORIAL OPTIMIZATION: HIERARCHICAL MULTISTAGE FRAMEWORK
ALGORITHM SYSTEMS FOR COMBINATORIAL OPTIMIZATION: HIERARCHICAL MULTISTAGE FRAMEWORK Dr. Mark Sh. Levin, The Research Inst., The College Judea & Samaria, Ariel, Israel Introduction In recent decades, signicance
Improving Iterated Local Search Solution for the Linear Ordering Problem with Cumulative Costs (LOPCC)
Improving Iterated Local Search Solution for the Linear Ordering Problem with Cumulative Costs (LOPCC) David Terán Villanueva 1,, Héctor Joaquín Fraire Huacuja 2, Abraham Duarte 3,RodolfoPazosR. 2, Juan
Fuzzy Ant Clustering by Centroid Positioning
Fuzzy Ant Clustering by Centroid Positioning Parag M. Kanade and Lawrence O. Hall Computer Science & Engineering Dept University of South Florida, Tampa FL 33620 @csee.usf.edu Abstract We
Restart strategies for
Restart strategies for GRASP with pathrelinking heuristics Talk given at the 10 th International Symposium on Experimental Algorithms (SEA 2011) Chania, Crete, Greece May 5, 2011 Mauricio G. C. Resende
Optimizing Flow Shop Sequencing Through Simulation Optimization Using Evolutionary Methods
Optimizing Flow Shop Sequencing Through Simulation Optimization Using Evolutionary Methods Sucharith Vanguri 1, Travis W. Hill 2, Allen G. Greenwood 1 1 Department of Industrial Engineering 260 McCain
A Development of Hybrid Cross Entropy-Tabu Search Algorithm for Travelling Repairman Problem
Proceedings of the 2012 International Conference on Industrial Engineering and Operations Management Istanbul, Turkey, July 3 6, 2012 A Development of Hybrid Cross Entropy-Tabu Search Algorithm for Travelling
CS5401 FS2015 Exam 1 Key
CS5401 FS2015 Exam 1 Key This is a closed-book, closed-notes exam. The only items you are allowed to use are writing implements. Mark each sheet of paper you use with your name and the string cs5401fs2015
Hybridization EVOLUTIONARY COMPUTING. Reasons for Hybridization - 1. Naming. Reasons for Hybridization - 3. Reasons for Hybridization - 2
Hybridization EVOLUTIONARY COMPUTING Hybrid Evolutionary Algorithms hybridization of an EA with local search techniques (commonly called memetic algorithms) EA+LS=MA constructive heuristics exact methods
International Journal of Computational Intelligence and Applications c World Scientific Publishing Company
International Journal of Computational Intelligence and Applications c World Scientific Publishing Company The Accumulated Experience Ant Colony for the Traveling Salesman Problem JAMES MONTGOMERY MARCUS
GT HEURISTIC FOR SOLVING MULTI OBJECTIVE JOB SHOP SCHEDULING PROBLEMS
GT HEURISTIC FOR SOLVING MULTI OBJECTIVE JOB SHOP SCHEDULING PROBLEMS M. Chandrasekaran 1, D. Lakshmipathy 1 and P. Sriramya 2 1 Department of Mechanical Engineering, Vels University, Chennai, India 2
An Ant Approach to the Flow Shop Problem
An Ant Approach to the Flow Shop Problem Thomas Stützle TU Darmstadt, Computer Science Department Alexanderstr. 10, 64283 Darmstadt Phone: +49-6151-166651, Fax +49-6151-165326 email: stuetzle@informatik.tu-darmstadt.de
New algorithm for analyzing performance of neighborhood strategies in solving job shop scheduling problems
Journal of Scientific & Industrial Research ESWARAMURTHY: NEW ALGORITHM FOR ANALYZING PERFORMANCE OF NEIGHBORHOOD STRATEGIES 579 Vol. 67, August 2008, pp. 579-588 New algorithm for analyzing performance
Ant Algorithms for the University Course Timetabling Problem with Regard to the State-of-the-Art
Ant Algorithms for the University Course Timetabling Problem with Regard to the State-of-the-Art Krzysztof Socha, Michael Sampels, and Max Manfrin IRIDIA, Université Libre de Bruxelles, CP 194/6, Av. Franklin
Simplicial Global Optimization
Simplicial Global Optimization Julius Žilinskas Vilnius University, Lithuania September, 7 http://web.vu.lt/mii/j.zilinskas Global optimization Find f = min x A f (x) and x A, f (x ) = f, where A R n.
Metaheuristics: a quick overview
Metaheuristics: a quick overview Marc Sevaux University of Valenciennes CNRS, UMR 8530, LAMIH / Production systems Marc.Sevaux@univ-valenciennes.fr Marc Sevaux TEW Antwerp 2003 1 Outline Outline Neighborhood
Online algorithms for clustering problems
University of Szeged Department of Computer Algorithms and Artificial Intelligence Online algorithms for clustering problems Summary of the Ph.D. thesis by Gabriella Divéki Supervisor Dr. Csanád Imreh
Diversification Methods for Zero-One Optimization
Diversification Methods for Zero-One Optimization Fred Glover ECEE- College of Engineering and Applied Science University of Colorado - Boulder Boulder, CO, 80309 USA glover@colorado.edu Abstract We introduce
Evolving SQL Queries for Data Mining
Evolving SQL Queries for Data Mining Majid Salim and Xin Yao School of Computer Science, The University of Birmingham Edgbaston, Birmingham B15 2TT, UK {msc30mms,x.yao}@cs.bham.ac.uk Abstract. This paper
An Evolutionary Algorithm for the Multi-objective Shortest Path Problem
An Evolutionary Algorithm for the Multi-objective Shortest Path Problem Fangguo He Huan Qi Qiong Fan Institute of Systems Engineering, Huazhong University of Science & Technology, Wuhan 430074, P. R. China
Automatic Generation of Test Case based on GATS Algorithm *
Automatic Generation of Test Case based on GATS Algorithm * Xiajiong Shen and Qian Wang Institute of Data and Knowledge Engineering Henan University Kaifeng, Henan Province 475001, China shenxj@henu.edu.cn
A New Exam Timetabling Algorithm
A New Exam Timetabling Algorithm K.J. Batenburg W.J. Palenstijn Leiden Institute of Advanced Computer Science (LIACS), Universiteit Leiden P.O. Box 9512, 2300 RA Leiden, The Netherlands {kbatenbu, wpalenst}@math.leidenuniv.nl
Tabu search and genetic algorithms: a comparative study between pure and hybrid agents in an A-teams approach
Tabu search and genetic algorithms: a comparative study between pure and hybrid agents in an A-teams approach Carlos A. S. Passos (CenPRA) carlos.passos@cenpra.gov.br Daniel M. Aquino (UNICAMP, PIBIC/CNPq)