Lecture: Iterative Search Methods
|
|
- Arlene Patterson
- 6 years ago
- Views:
Transcription
1 Lecture: Iterative Search Methods Overview Constructive Search is exponential. State-Space Search exhibits better performance on some problems. Research in understanding heuristic and iterative search methods. Topics Comparison of Iterative vs. Constructive search. Iterative Repair as state space search. Notion of local Neighbourhood Min-Conflicts heuristic in backtrack search. Simulated Annealing algorithm GSAT Randomized Algorithms October 19, 1998 Copyright 1998 by Bill Havens 1 of 26
2 Conflict: Iterative vs. Constructive Search Goal: Constructive Search Methods Explore the search space nondeterministically and systematically. Notion of extending a partial solution. Starting with the empty solution. On failure, backtracking to some previous partial solution. Complete (every possible solution found). Guarantees termination. Precludes use of heuristic knowledge to guide backtracking. October 19, 1998 Copyright 1998 by Bill Havens 2 of 26
3 Goal: Iterative Search Methods Explore the search space using local information about solutions. Starts with a total answer (which may not be a solution). Often a greedy algorithm is used to generate a starting point. Assumes a metric on states which gives a (usually) accurate measure of which direction to search. Iteratively improves the answer until either: 1. all constraints are satisfied; and/or 2. an acceptable best solution is found. Not guaranteed to terminate. Hence incomplete October 19, 1998 Copyright 1998 by Bill Havens 3 of 26
4 Notion of Neighbourhood p A neighbour of some point X D 1... D n is another point Y D 1... D n such that X Y but Y is near to X under some metric. Possible Metrics Geometric Distance: a neighbour Y is any point such that X - Y < d where d is some maximum distance. Hamming Distance: point Y is a maximum of d-bits different than point X. (see Limited Discrepancy Search later) NonGeometric: Other neighbourhood topologies (research topic). Heuristic: Prior knowledge of the connectedness of the solution space in the neighbourhood of X. October 19, 1998 Copyright 1998 by Bill Havens 4 of 26
5 Smoothness of Solution Space Assumption: if X is a solution then X ± ε is probably also a solution. Hill-Climbing depends on the gradient being defined in the neighbourhood of X. Consider the following... October 19, 1998 Copyright 1998 by Bill Havens 5 of 26
6 Hill Climbing Neighbourhood X 4 F objective Y Algorithm iterates uphill towards solution At point #4, moves towards a false maxima. No escape possible!! m What can we do? Y October 19, 1998 Copyright 1998 by Bill Havens 6 of 26
7 Variable and Value Ordering Heuristics Variable Ordering: Which variable should be chosen next? All variables have to be assigned => Pick the toughest first Called the First-fail Principle. m Secretary s dilemma: How to schedule a meeting of many busy executives? October 19, 1998 Copyright 1998 by Bill Havens 7 of 26
8 Value Ordering: Which value for the chosen variable should be tried? 1. Least-commitment: pick a value such that the resulting CSP is likely to have a solution 2. Greedy: pick a value that minimizes / maximizes the objective function. 3. Min-conflict: pick a value which violates the least number of constraints on the variable. More on Min-conflict heuristic... October 19, 1998 Copyright 1998 by Bill Havens 8 of 26
9 Min-Conflicts Heuristic Reference: M. Johnston & S. Minton, Analysing a Heuristic Strategy for Constraint Satisfaction and Scheduling, in M. Zweben & M. Fox (eds.) Intelligent Scheduling, Morgan Kaufmann, 1994, p Basic Idea Given: A CSP with binary constraints and a total (but inconsistent) assignment of variables to values. Two variables X and Y conflict if their assigned values violate a constraint C. Procedure: 1. Select any conflicting variable and assign it a new value that minimizes the number of conflicts with other related variables. 2. Break ties randomly. October 19, 1998 Copyright 1998 by Bill Havens 9 of 26
10 Example C1 X C6 Y C3 C4 C2 C5 X = a 1 ( C 6, C 1 ) X = a 2 ( C 1 ) X = a 3 ( C 6, C 1, C 2 ) Y = b 1 ( C 6, C 3 ) Y = b 2 ( C 3, C 4 ) Y = b 3 ( C 6, C 3, C 5 ) October 19, 1998 Copyright 1998 by Bill Havens 10 of 26
11 Discussion Assume culprit = Y: Which value minimizes constraint violations? m How about Min-Conflicts Heuristic for n-ary constraints? How do you count conflicting variables? Two aspects to the repair problem 1. Identify culprit 2. Choose new value for culprit variable. m Max-Conflicts Heuristic 1. Choose variable as culprit which maximizes the number of conflicting constraints. 2. Break ties randomly. 3. Use Min-Conflicts to assign a new value. October 19, 1998 Copyright 1998 by Bill Havens 11 of 26
12 Iterative Repair Methods Reference: S. Minton et.al., Minimizing Conflicts: a heuristic repair method for constraint satisfaction and scheduling problems, Artificial Intelligence 58, 1992, pp Introduction Alternative to Constructive (Backtracking) methods Applicable to scheduling and CSPs in general Developed in response to exponential behaviour of constructive techniques. Comparison: 100-queens is very hard for backtracking while 1,000,000-queens is easy for iterative repair! Caveat: n-queens has a solution density which increases with n. October 19, 1998 Copyright 1998 by Bill Havens 12 of 26
13 Basic Idea 1. Start with a complete (but inconsistent) variable assignment. 2. Heuristically choose some inconsistent variable assignment. 3. Iteratively repair variable assignments until a consistent solution is found. October 19, 1998 Copyright 1998 by Bill Havens 13 of 26
14 Iterative Repair Methodology ALgorithm Given a point X D 1... D n, in the search space. Call IterSearch(X) IterSearch(X) if goal(x) then return(x) let Y = some neighbour(x) IterSearch(Y) end Justification More effective on many CSPs than constructive methods. Argument: a complete but inconsistent assignment provides more guidance (information) than a partial assignment. October 19, 1998 Copyright 1998 by Bill Havens 14 of 26
15 Shortcomings Depends on effective notion of neighbourhood. Requires a good objective function over the neighbourhood. Domain independent objective functions are hard to find. Incomplete search. No termination possible. October 19, 1998 Copyright 1998 by Bill Havens 15 of 26
16 Using Min-Conflicts in Backtrack Search Method Start with complete assignment of variables. Let VarsLeft = variables which have not yet been repaired. Let VarsDone = variables already repaired. Algorithm attempts to repair each variable only once. If no possible consistent assignment in VarsLeft, then backtrack. October 19, 1998 Copyright 1998 by Bill Havens 16 of 26
17 Informed Backtrack Algorithm Procedure InformedBacktrack (VarsLeft, VarsDone) if consistent assignment then Halt. let Var = some conflicting variable in VarsLeft. VarsLeft := Varsleft - {Var}. VarsDone := VarsDone + {Var}. Let Values = domain of Var sorted by min-conflicts. for each Value in Values until solution found If Value does Not conflict with VarsDone then Var := Value. InformedBacktrack (VarsLeft, VarsDone) end. Begin program Let VarsLeft = all variables in CSP with initial assignments. Let VarsDone = nil. InformedBacktrack (VarsLeft, VarsDone) end program. October 19, 1998 Copyright 1998 by Bill Havens 17 of 26
18 Experimental Results Ubiquitous n-queens Problem! Evaluated using both Iterative Repair and InformedBacktrack algorithms. n Standard Backtrack MinConflict Repair Informed Backtrack n= n= (70%) n= (13%) n= 10 4 too big n= 10 5 too big n= 10 6 too big October 19, 1998 Copyright 1998 by Bill Havens 18 of 26
19 Notes: 1. Bound of n x 100 queen movements enforced. 2. Results in parantheses indicate fraction that were successful in move limit. October 19, 1998 Copyright 1998 by Bill Havens 19 of 26
20 Simulated Annealing Search Reference: S. Kirkpatrick et.al., Optimization by Simulated Annealing, Science 220, #4598, Overview How can local maxima be avoided? Yet retain the advantages of hill-climbing search. Based on analogy to slow cooling of metal (called annealing ) to allow crystal structures to form properly. m Basic Idea: Use standard hill-climbing but occasionally move in a direction which is not the gradient with a probability that declines over time. This probability is analogous to the temperature T of the cooling metal. October 19, 1998 Copyright 1998 by Bill Havens 20 of 26
21 Requires a cooling schedule T(time). Pathology: All local search easily gets caught in local maxima. Random noise can avoid this problem. October 19, 1998 Copyright 1998 by Bill Havens 21 of 26
22 Simulated Annealing is optimal 2Strong result: given slow enough cooling schedule, Simulated Annealing will find the optimal (maximal) solution on any landscape. BUT it may require a very very long time!. Figure 4.7 from Ginsberg October 19, 1998 Copyright 1998 by Bill Havens 22 of 26
23 Argument Normally the algorithm proceeds uphill along the gradient. With low probability which decreases towards zero over time, the algorithm moves a random distance elswhere. Assume the search space has a smoothly varying evaluation function. Suppose the evaluation function f(p) = m for the true optimum point p in the search space. Every other point x will have f(x) < m. Initially for high temperature T, occasional random moves will cause the current point x to move among all hills. Eventually a transition temperature will be reached where it is no longer possible to move off the largest hill but still possible for all other hills. October 19, 1998 Copyright 1998 by Bill Havens 23 of 26
24 Given enough random movements at this temperature, the algorithm will eventually climb and remain on the peak of the largest hill October 19, 1998 Copyright 1998 by Bill Havens 24 of 26
25 GSAT Algorithm Reference: B. Selman, H. Levesque & D. Mitchell (1992) A New Method for Solving Hard Satisfiability Problems, Proc. 10th Nat. Conf. of A.I., pp Introduction Heuristic algorithm for binary variable CSPs. Example of the class of Iterative Repair methods. Not systematic. Uses objective function MaxSat which measures the gradient direction of which variable flip will result in the maximum number of Boolean clauses being satisfied. Suffers local maxima problem of all Hill Climbing algorithms. October 19, 1998 Copyright 1998 by Bill Havens 25 of 26
26 GSAT Algorithm. for i := 1 to MaxTries do P := some random truth assignment. for j := 1 to MaxFlips do if P is consistent then Halt, else flip any assignment in P under MaxSat heuristic. return failure. end. Algorithm explained! October 19, 1998 Copyright 1998 by Bill Havens 26 of 26
Example: Map coloring
Today s s lecture Local Search Lecture 7: Search - 6 Heuristic Repair CSP and 3-SAT Solving CSPs using Systematic Search. Victor Lesser CMPSCI 683 Fall 2004 The relationship between problem structure and
More informationSet 5: Constraint Satisfaction Problems Chapter 6 R&N
Set 5: Constraint Satisfaction Problems Chapter 6 R&N ICS 271 Fall 2017 Kalev Kask ICS-271:Notes 5: 1 The constraint network model Outline Variables, domains, constraints, constraint graph, solutions Examples:
More informationSpeeding Up the ESG Algorithm
Speeding Up the ESG Algorithm Yousef Kilani 1 and Abdullah. Mohdzin 2 1 Prince Hussein bin Abdullah Information Technology College, Al Al-Bayt University, Jordan 2 Faculty of Information Science and Technology,
More informationSet 5: Constraint Satisfaction Problems
Set 5: Constraint Satisfaction Problems ICS 271 Fall 2014 Kalev Kask ICS-271:Notes 5: 1 The constraint network model Outline Variables, domains, constraints, constraint graph, solutions Examples: graph-coloring,
More informationModule 4. Constraint satisfaction problems. Version 2 CSE IIT, Kharagpur
Module 4 Constraint satisfaction problems Lesson 10 Constraint satisfaction problems - II 4.5 Variable and Value Ordering A search algorithm for constraint satisfaction requires the order in which variables
More informationKalev Kask and Rina Dechter. Department of Information and Computer Science. University of California, Irvine, CA
GSAT and Local Consistency 3 Kalev Kask and Rina Dechter Department of Information and Computer Science University of California, Irvine, CA 92717-3425 fkkask,dechterg@ics.uci.edu Abstract It has been
More informationmywbut.com Informed Search Strategies-II
Informed Search Strategies-II 1 3.3 Iterative-Deepening A* 3.3.1 IDA* Algorithm Iterative deepening A* or IDA* is similar to iterative-deepening depth-first, but with the following modifications: The depth
More informationGSAT and Local Consistency
GSAT and Local Consistency Kalev Kask Computer Science Department University of California at Irvine Irvine, CA 92717 USA Rina Dechter Computer Science Department University of California at Irvine Irvine,
More informationLocal Search and Optimization Chapter 4. Mausam (Based on slides of Padhraic Smyth, Stuart Russell, Rao Kambhampati, Raj Rao, Dan Weld )
Local Search and Optimization Chapter 4 Mausam (Based on slides of Padhraic Smyth, Stuart Russell, Rao Kambhampati, Raj Rao, Dan Weld ) 1 Outline Local search techniques and optimization Hill-climbing
More informationMassively Parallel Seesaw Search for MAX-SAT
Massively Parallel Seesaw Search for MAX-SAT Harshad Paradkar Rochester Institute of Technology hp7212@rit.edu Prof. Alan Kaminsky (Advisor) Rochester Institute of Technology ark@cs.rit.edu Abstract The
More informationA Re-examination of Limited Discrepancy Search
A Re-examination of Limited Discrepancy Search W. Ken Jackson, Morten Irgens, and William S. Havens Intelligent Systems Lab, Centre for Systems Science Simon Fraser University Burnaby, B.C., CANADA V5A
More informationRecap Hill Climbing Randomized Algorithms SLS for CSPs. Local Search. CPSC 322 Lecture 12. January 30, 2006 Textbook 3.8
Local Search CPSC 322 Lecture 12 January 30, 2006 Textbook 3.8 Local Search CPSC 322 Lecture 12, Slide 1 Lecture Overview Recap Hill Climbing Randomized Algorithms SLS for CSPs Local Search CPSC 322 Lecture
More informationConstraint Satisfaction Problems
Constraint Satisfaction Problems Tuomas Sandholm Carnegie Mellon University Computer Science Department [Read Chapter 6 of Russell & Norvig] Constraint satisfaction problems (CSPs) Standard search problem:
More informationLocal Search and Optimization Chapter 4. Mausam (Based on slides of Padhraic Smyth, Stuart Russell, Rao Kambhampati, Raj Rao, Dan Weld )
Local Search and Optimization Chapter 4 Mausam (Based on slides of Padhraic Smyth, Stuart Russell, Rao Kambhampati, Raj Rao, Dan Weld ) 1 2 Outline Local search techniques and optimization Hill-climbing
More informationLocal Search and Optimization Chapter 4. Mausam (Based on slides of Padhraic Smyth, Stuart Russell, Rao Kambhampati, Raj Rao, Dan Weld )
Local Search and Optimization Chapter 4 Mausam (Based on slides of Padhraic Smyth, Stuart Russell, Rao Kambhampati, Raj Rao, Dan Weld ) 1 2 Outline Local search techniques and optimization Hill-climbing
More informationSet 5: Constraint Satisfaction Problems
Set 5: Constraint Satisfaction Problems ICS 271 Fall 2013 Kalev Kask ICS-271:Notes 5: 1 The constraint network model Outline Variables, domains, constraints, constraint graph, solutions Examples: graph-coloring,
More informationSatisfiability. Michail G. Lagoudakis. Department of Computer Science Duke University Durham, NC SATISFIABILITY
Satisfiability Michail G. Lagoudakis Department of Computer Science Duke University Durham, NC 27708 COMPSCI 271 - Spring 2001 DUKE UNIVERSITY Page 1 Why SAT? Historical Reasons The first NP-COMPLETE problem
More informationCMU-Q Lecture 8: Optimization I: Optimization for CSP Local Search. Teacher: Gianni A. Di Caro
CMU-Q 15-381 Lecture 8: Optimization I: Optimization for CSP Local Search Teacher: Gianni A. Di Caro LOCAL SEARCH FOR CSP Real-life CSPs can be very large and hard to solve Methods so far: construct a
More informationSet 5: Constraint Satisfaction Problems
Set 5: Constraint Satisfaction Problems ICS 271 Fall 2012 Rina Dechter ICS-271:Notes 5: 1 Outline The constraint network model Variables, domains, constraints, constraint graph, solutions Examples: graph-coloring,
More informationConstraint Satisfaction Problems
Constraint Satisfaction Problems CE417: Introduction to Artificial Intelligence Sharif University of Technology Spring 2013 Soleymani Course material: Artificial Intelligence: A Modern Approach, 3 rd Edition,
More informationKalev Kask and Rina Dechter
From: AAAI-96 Proceedings. Copyright 1996, AAAI (www.aaai.org). All rights reserved. A Graph-Based Method for Improving GSAT Kalev Kask and Rina Dechter Department of Information and Computer Science University
More informationFoundations of AI. 8. Satisfiability and Model Construction. Davis-Putnam, Phase Transitions, GSAT and GWSAT. Wolfram Burgard & Bernhard Nebel
Foundations of AI 8. Satisfiability and Model Construction Davis-Putnam, Phase Transitions, GSAT and GWSAT Wolfram Burgard & Bernhard Nebel Contents Motivation Davis-Putnam Procedure Average complexity
More informationChapter 27. Other Approaches to Reasoning and Representation
Chapter 27. Other Approaches to Reasoning and Representation The Quest for Artificial Intelligence, Nilsson, N. J., 2009. Lecture Notes on Artificial Intelligence Summarized by Ha, Jung-Woo and Lee, Beom-Jin
More informationLocal Search. (Textbook Chpt 4.8) Computer Science cpsc322, Lecture 14. May, 30, CPSC 322, Lecture 14 Slide 1
Local Search Computer Science cpsc322, Lecture 14 (Textbook Chpt 4.8) May, 30, 2017 CPSC 322, Lecture 14 Slide 1 Announcements Assignment1 due now! Assignment2 out today CPSC 322, Lecture 10 Slide 2 Lecture
More informationOther approaches. Marco Kuhlmann & Guido Tack Lecture 11
Other approaches Marco Kuhlmann & Guido Tack Lecture 11 Plan for today CSP-based propagation Constraint-based local search Linear programming CSP-based propagation History of CSP-based propagation AI research
More information10/11/2017. Constraint Satisfaction Problems II. Review: CSP Representations. Heuristic 1: Most constrained variable
//7 Review: Constraint Satisfaction Problems Constraint Satisfaction Problems II AIMA: Chapter 6 A CSP consists of: Finite set of X, X,, X n Nonempty domain of possible values for each variable D, D, D
More informationCS 331: Artificial Intelligence Local Search 1. Tough real-world problems
CS 331: Artificial Intelligence Local Search 1 1 Tough real-world problems Suppose you had to solve VLSI layout problems (minimize distance between components, unused space, etc.) Or schedule airlines
More informationNon-deterministic Search techniques. Emma Hart
Non-deterministic Search techniques Emma Hart Why do local search? Many real problems are too hard to solve with exact (deterministic) techniques Modern, non-deterministic techniques offer ways of getting
More informationArtificial Intelligence
Artificial Intelligence Informed Search and Exploration Chapter 4 (4.3 4.6) Searching: So Far We ve discussed how to build goal-based and utility-based agents that search to solve problems We ve also presented
More informationABHELSINKI UNIVERSITY OF TECHNOLOGY
Local Search Algorithms for Random Satisfiability Pekka Orponen (joint work with Sakari Seitz and Mikko Alava) Helsinki University of Technology Local Search Algorithms for Random Satisfiability 1/30 Outline
More informationArtificial Intelligence
Artificial Intelligence Local Search Vibhav Gogate The University of Texas at Dallas Some material courtesy of Luke Zettlemoyer, Dan Klein, Dan Weld, Alex Ihler, Stuart Russell, Mausam Systematic Search:
More information6.034 Notes: Section 3.1
6.034 Notes: Section 3.1 Slide 3.1.1 In this presentation, we'll take a look at the class of problems called Constraint Satisfaction Problems (CSPs). CSPs arise in many application areas: they can be used
More informationConstraint Satisfaction Problems
Constraint Satisfaction Problems Greedy Local Search Bernhard Nebel, Julien Hué, and Stefan Wölfl Albert-Ludwigs-Universität Freiburg June 19, 2007 Nebel, Hué and Wölfl (Universität Freiburg) Constraint
More informationCS-E3200 Discrete Models and Search
Shahab Tasharrofi Department of Information and Computer Science, Aalto University Lecture 7: Complete and local search methods for SAT Outline Algorithms for solving Boolean satisfiability problems Complete
More informationHeuristic Optimisation
Heuristic Optimisation Part 2: Basic concepts Sándor Zoltán Németh http://web.mat.bham.ac.uk/s.z.nemeth s.nemeth@bham.ac.uk University of Birmingham S Z Németh (s.nemeth@bham.ac.uk) Heuristic Optimisation
More informationConstraint Satisfaction Problems. slides from: Padhraic Smyth, Bryan Low, S. Russell and P. Norvig, Jean-Claude Latombe
Constraint Satisfaction Problems slides from: Padhraic Smyth, Bryan Low, S. Russell and P. Norvig, Jean-Claude Latombe Standard search problems: State is a black box : arbitrary data structure Goal test
More informationIntroduction to Artificial Intelligence 2 nd semester 2016/2017. Chapter 4: Beyond Classical Search
Introduction to Artificial Intelligence 2 nd semester 2016/2017 Chapter 4: Beyond Classical Search Mohamed B. Abubaker Palestine Technical College Deir El-Balah 1 Outlines local search algorithms and optimization
More informationToday. CS 188: Artificial Intelligence Fall Example: Boolean Satisfiability. Reminder: CSPs. Example: 3-SAT. CSPs: Queries.
CS 188: Artificial Intelligence Fall 2007 Lecture 5: CSPs II 9/11/2007 More CSPs Applications Tree Algorithms Cutset Conditioning Today Dan Klein UC Berkeley Many slides over the course adapted from either
More informationalgorithms, i.e., they attempt to construct a solution piece by piece and are not able to offer a complete solution until the end. The FM algorithm, l
The FMSAT Satisfiability Solver: Hypergraph Partitioning meets Boolean Satisfiability Arathi Ramani, Igor Markov framania, imarkovg@eecs.umich.edu February 6, 2002 Abstract This report is intended to present
More informationLocal Search for CSPs
Local Search for CSPs Alan Mackworth UBC CS CSP February, 0 Textbook. Lecture Overview Domain splitting: recap, more details & pseudocode Local Search Time-permitting: Stochastic Local Search (start) Searching
More informationOutline of the module
Evolutionary and Heuristic Optimisation (ITNPD8) Lecture 2: Heuristics and Metaheuristics Gabriela Ochoa http://www.cs.stir.ac.uk/~goc/ Computing Science and Mathematics, School of Natural Sciences University
More informationOutline. Best-first search
Outline Best-first search Greedy best-first search A* search Heuristics Local search algorithms Hill-climbing search Beam search Simulated annealing search Genetic algorithms Constraint Satisfaction Problems
More informationAnnouncements. CS 188: Artificial Intelligence Spring Production Scheduling. Today. Backtracking Search Review. Production Scheduling
CS 188: Artificial Intelligence Spring 2009 Lecture : Constraint Satisfaction 2/3/2009 Announcements Project 1 (Search) is due tomorrow Come to office hours if you re stuck Today at 1pm (Nick) and 3pm
More informationSimple mechanisms for escaping from local optima:
The methods we have seen so far are iterative improvement methods, that is, they get stuck in local optima. Simple mechanisms for escaping from local optima: I Restart: re-initialise search whenever a
More informationCS 188: Artificial Intelligence
CS 188: Artificial Intelligence Constraint Satisfaction Problems II and Local Search Instructors: Sergey Levine and Stuart Russell University of California, Berkeley [These slides were created by Dan Klein
More informationWeek 8: Constraint Satisfaction Problems
COMP3411/ 9414/ 9814: Artificial Intelligence Week 8: Constraint Satisfaction Problems [Russell & Norvig: 6.1,6.2,6.3,6.4,4.1] COMP3411/9414/9814 18s1 Constraint Satisfaction Problems 1 Outline Constraint
More informationCS 771 Artificial Intelligence. Constraint Satisfaction Problem
CS 771 Artificial Intelligence Constraint Satisfaction Problem Constraint Satisfaction Problems So far we have seen a problem can be solved by searching in space of states These states can be evaluated
More informationEECS 219C: Computer-Aided Verification Boolean Satisfiability Solving. Sanjit A. Seshia EECS, UC Berkeley
EECS 219C: Computer-Aided Verification Boolean Satisfiability Solving Sanjit A. Seshia EECS, UC Berkeley Project Proposals Due Friday, February 13 on bcourses Will discuss project topics on Monday Instructions
More informationspace. We will apply the idea of enforcing local consistency to GSAT with the hope that its performance can
GSAT and Local Consistency 3 Kalev Kask Computer Science Department University of California at Irvine Irvine, CA 92717 USA Rina Dechter Computer Science Department University of California at Irvine Irvine,
More informationLocal Search. (Textbook Chpt 4.8) Computer Science cpsc322, Lecture 14. Oct, 7, CPSC 322, Lecture 14 Slide 1
Local Search Computer Science cpsc322, Lecture 14 (Textbook Chpt 4.8) Oct, 7, 2013 CPSC 322, Lecture 14 Slide 1 Department of Computer Science Undergraduate Events More details @ https://www.cs.ubc.ca/students/undergrad/life/upcoming-events
More informationNote: In physical process (e.g., annealing of metals), perfect ground states are achieved by very slow lowering of temperature.
Simulated Annealing Key idea: Vary temperature parameter, i.e., probability of accepting worsening moves, in Probabilistic Iterative Improvement according to annealing schedule (aka cooling schedule).
More informationCS 188: Artificial Intelligence Spring Today
CS 188: Artificial Intelligence Spring 2006 Lecture 7: CSPs II 2/7/2006 Dan Klein UC Berkeley Many slides from either Stuart Russell or Andrew Moore Today More CSPs Applications Tree Algorithms Cutset
More informationAr#ficial)Intelligence!!
Introduc*on! Ar#ficial)Intelligence!! Roman Barták Department of Theoretical Computer Science and Mathematical Logic We know how to use heuristics in search BFS, A*, IDA*, RBFS, SMA* Today: What if the
More informationCS 188: Artificial Intelligence
CS 188: Artificial Intelligence CSPs II + Local Search Prof. Scott Niekum The University of Texas at Austin [These slides based on those of Dan Klein and Pieter Abbeel for CS188 Intro to AI at UC Berkeley.
More informationLars Schmidt-Thieme, Information Systems and Machine Learning Lab (ISMLL), University of Hildesheim, Germany, Course on Artificial Intelligence,
Course on Artificial Intelligence, winter term 2012/2013 0/35 Artificial Intelligence Artificial Intelligence 3. Constraint Satisfaction Problems Lars Schmidt-Thieme Information Systems and Machine Learning
More informationA Hybrid Schema for Systematic Local Search
A Hybrid Schema for Systematic Local Search William S. Havens and Bistra N. Dilkina Intelligent Systems Lab Simon Fraser University Burnaby, British Columbia Canada V5A 1S6 {havens, bnd}@cs.sfu.ca Abstract.
More informationAnnouncements. CS 188: Artificial Intelligence Fall Reminder: CSPs. Today. Example: 3-SAT. Example: Boolean Satisfiability.
CS 188: Artificial Intelligence Fall 2008 Lecture 5: CSPs II 9/11/2008 Announcements Assignments: DUE W1: NOW P1: Due 9/12 at 11:59pm Assignments: UP W2: Up now P2: Up by weekend Dan Klein UC Berkeley
More informationCS 188: Artificial Intelligence Fall 2008
CS 188: Artificial Intelligence Fall 2008 Lecture 5: CSPs II 9/11/2008 Dan Klein UC Berkeley Many slides over the course adapted from either Stuart Russell or Andrew Moore 1 1 Assignments: DUE Announcements
More informationCS227: Assignment 1 Report
1 CS227: Assignment 1 Report Lei Huang and Lawson Wong April 20, 2008 1 Introduction Propositional satisfiability (SAT) problems have been of great historical and practical significance in AI. Despite
More informationSpezielle Themen der Künstlichen Intelligenz
Spezielle Themen der Künstlichen Intelligenz 2. Termin: Constraint Satisfaction Dr. Stefan Kopp Center of Excellence Cognitive Interaction Technology AG A Recall: Best-first search Best-first search =
More informationBeyond Classical Search: Local Search. CMPSCI 383 September 23, 2011
Beyond Classical Search: Local Search CMPSCI 383 September 23, 2011 1 Today s lecture Local Search Hill-climbing Simulated annealing Local beam search Genetic algorithms Genetic programming Local search
More informationConflict-based Statistics
Conflict-based Statistics Tomáš Müller 1, Roman Barták 1 and Hana Rudová 2 1 Faculty of Mathematics and Physics, Charles University Malostranské nám. 2/25, Prague, Czech Republic {muller bartak}@ktiml.mff.cuni.cz
More informationThe Island Confinement Method for Reducing Search Space in Local Search Methods
The Island Confinement Method for Reducing Search Space in Local Search Methods H. Fang Y. Kilani J.H.M. Lee P.J. Stuckey July 14, 2006 Abstract Typically local search methods for solving constraint satisfaction
More informationStochastic greedy local search Chapter 7
Stochastic greedy local search Chapter 7 ICS-275 Winter 2016 Example: 8-queen problem Main elements Choose a full assignment and iteratively improve it towards a solution Requires a cost function: number
More informationRecap Randomized Algorithms Comparing SLS Algorithms. Local Search. CPSC 322 CSPs 5. Textbook 4.8. Local Search CPSC 322 CSPs 5, Slide 1
Local Search CPSC 322 CSPs 5 Textbook 4.8 Local Search CPSC 322 CSPs 5, Slide 1 Lecture Overview 1 Recap 2 Randomized Algorithms 3 Comparing SLS Algorithms Local Search CPSC 322 CSPs 5, Slide 2 Stochastic
More informationLecture 9. Heuristic search, continued. CS-424 Gregory Dudek
Lecture 9 Heuristic search, continued A* revisited Reminder: with A* we want to find the best-cost (C ) path to the goal first. To do this, all we have to do is make sure our cost estimates are less than
More informationCS 188: Artificial Intelligence
CS 188: Artificial Intelligence Constraint Satisfaction Problems II Instructors: Dan Klein and Pieter Abbeel University of California, Berkeley [These slides were created by Dan Klein and Pieter Abbeel
More informationOutline. Best-first search. Greedy best-first search A* search Heuristics Local search algorithms
Outline Best-first search Greedy best-first search A* search Heuristics Local search algorithms Hill-climbing search Beam search Simulated annealing search Genetic algorithms Constraint Satisfaction Problems
More informationLocal Search. CS 486/686: Introduction to Artificial Intelligence Winter 2016
Local Search CS 486/686: Introduction to Artificial Intelligence Winter 2016 1 Overview Uninformed Search Very general: assumes no knowledge about the problem BFS, DFS, IDS Informed Search Heuristics A*
More informationTDDC17. Intuitions behind heuristic search. Recall Uniform-Cost Search. Best-First Search. f(n) =... + h(n) g(n) = cost of path from root node to n
Intuitions behind heuristic search The separation property of GRAPH-SEARCH TDDC17 Seminar III Search II Informed or Heuristic Search Beyond Classical Search Find a heuristic measure h(n) which estimates
More informationHill Climbing. Assume a heuristic value for each assignment of values to all variables. Maintain an assignment of a value to each variable.
Hill Climbing Many search spaces are too big for systematic search. A useful method in practice for some consistency and optimization problems is hill climbing: Assume a heuristic value for each assignment
More informationA Graph-Based Method for Improving GSAT. Kalev Kask and Rina Dechter. fkkask,
A Graph-Based Method for Improving GSAT Kalev Kask and Rina Dechter Department of Information and Computer Science University of California, Irvine, CA 92717 fkkask, dechterg@ics.uci.edu Abstract GSAT
More informationLecture 18. Questions? Monday, February 20 CS 430 Artificial Intelligence - Lecture 18 1
Lecture 18 Questions? Monday, February 20 CS 430 Artificial Intelligence - Lecture 18 1 Outline Chapter 6 - Constraint Satisfaction Problems Path Consistency & Global Constraints Sudoku Example Backtracking
More informationIterative improvement algorithms. Today. Example: Travelling Salesperson Problem. Example: n-queens
Today See Russell and Norvig, chapters 4 & 5 Local search and optimisation Constraint satisfaction problems (CSPs) CSP examples Backtracking search for CSPs 1 Iterative improvement algorithms In many optimization
More informationTDDC17. Intuitions behind heuristic search. Best-First Search. Recall Uniform-Cost Search. f(n) =... + h(n) g(n) = cost of path from root node to n
Intuitions behind heuristic search The separation property of GRAPH-SEARCH TDDC17 Seminar III Search II Informed or Heuristic Search Beyond Classical Search Find a heuristic measure h(n) which estimates
More informationOutline. Best-first search
Outline Best-first search Greedy best-first search A* search Heuristics Local search algorithms Hill-climbing search Beam search Simulated annealing search Genetic algorithms Constraint Satisfaction Problems
More information3.6.2 Generating admissible heuristics from relaxed problems
3.6.2 Generating admissible heuristics from relaxed problems To come up with heuristic functions one can study relaxed problems from which some restrictions of the original problem have been removed The
More informationConstraint Satisfaction Problems
Constraint Satisfaction Problems Frank C. Langbein F.C.Langbein@cs.cf.ac.uk Department of Computer Science Cardiff University 13th February 2001 Constraint Satisfaction Problems (CSPs) A CSP is a high
More informationAI Programming CS S-08 Local Search / Genetic Algorithms
AI Programming CS662-2013S-08 Local Search / Genetic Algorithms David Galles Department of Computer Science University of San Francisco 08-0: Overview Local Search Hill-Climbing Search Simulated Annealing
More informationWhat is Search For? CSE 473: Artificial Intelligence. Example: N-Queens. Example: N-Queens. Example: Map-Coloring 4/7/17
CSE 473: Artificial Intelligence Constraint Satisfaction Dieter Fox What is Search For? Models of the world: single agent, deterministic actions, fully observed state, discrete state space Planning: sequences
More informationCS 188: Artificial Intelligence Fall 2011
CS 188: Artificial Intelligence Fall 2011 Lecture 5: CSPs II 9/8/2011 Dan Klein UC Berkeley Multiple slides over the course adapted from either Stuart Russell or Andrew Moore 1 Today Efficient Solution
More informationConstraint Satisfaction Problems
Constraint Satisfaction Problems Chapter 5 Section 1 3 Constraint Satisfaction 1 Outline Constraint Satisfaction Problems (CSP) Backtracking search for CSPs Local search for CSPs Constraint Satisfaction
More informationRandom Subset Optimization
Random Subset Optimization Boi Faltings and Quang-Huy Nguyen Artificial Intelligence Laboratory (LIA), Swiss Federal Institute of Technology (EPFL), IN-Ecublens, CH-1015 Ecublens, Switzerland, boi.faltings
More informationLocal Search. CS 486/686: Introduction to Artificial Intelligence
Local Search CS 486/686: Introduction to Artificial Intelligence 1 Overview Uninformed Search Very general: assumes no knowledge about the problem BFS, DFS, IDS Informed Search Heuristics A* search and
More informationCopyright 2000, Kevin Wayne 1
Guessing Game: NP-Complete? 1. LONGEST-PATH: Given a graph G = (V, E), does there exists a simple path of length at least k edges? YES. SHORTEST-PATH: Given a graph G = (V, E), does there exists a simple
More informationMidterm Examination CS540-2: Introduction to Artificial Intelligence
Midterm Examination CS540-2: Introduction to Artificial Intelligence March 15, 2018 LAST NAME: FIRST NAME: Problem Score Max Score 1 12 2 13 3 9 4 11 5 8 6 13 7 9 8 16 9 9 Total 100 Question 1. [12] Search
More informationConstraint Satisfaction Problems
Last update: February 25, 2010 Constraint Satisfaction Problems CMSC 421, Chapter 5 CMSC 421, Chapter 5 1 Outline CSP examples Backtracking search for CSPs Problem structure and problem decomposition Local
More informationEECS 219C: Formal Methods Boolean Satisfiability Solving. Sanjit A. Seshia EECS, UC Berkeley
EECS 219C: Formal Methods Boolean Satisfiability Solving Sanjit A. Seshia EECS, UC Berkeley The Boolean Satisfiability Problem (SAT) Given: A Boolean formula F(x 1, x 2, x 3,, x n ) Can F evaluate to 1
More informationMachine Learning for Software Engineering
Machine Learning for Software Engineering Single-State Meta-Heuristics Prof. Dr.-Ing. Norbert Siegmund Intelligent Software Systems 1 2 Recap: Goal is to Find the Optimum Challenges of general optimization
More informationArtificial Intelligence p.1/49. n-queens. Artificial Intelligence p.2/49. Initial state: the empty board or a board with n random
Example: n-queens Put n queens on an n n board with no two queens on the same row, column, or diagonal A search problem! State space: the board with 0 to n queens Initial state: the empty board or a board
More informationRecap Arc Consistency Example Local Search Hill Climbing. Local Search. CPSC 322 CSPs 4. Textbook 4.8. Local Search CPSC 322 CSPs 4, Slide 1
Local Search CPSC 322 CSPs 4 Textbook 4.8 Local Search CPSC 322 CSPs 4, Slide 1 Lecture Overview 1 Recap 2 Arc Consistency Example 3 Local Search 4 Hill Climbing Local Search CPSC 322 CSPs 4, Slide 2 Arc
More informationConstraint Satisfaction Problems
Constraint Satisfaction Problems Berlin Chen Department of Computer Science & Information Engineering National Taiwan Normal University References: 1. S. Russell and P. Norvig. Artificial Intelligence:
More informationLecture 6: Constraint Satisfaction Problems (CSPs)
Lecture 6: Constraint Satisfaction Problems (CSPs) CS 580 (001) - Spring 2018 Amarda Shehu Department of Computer Science George Mason University, Fairfax, VA, USA February 28, 2018 Amarda Shehu (580)
More informationConstraint Satisfaction Problems
Constraint Satisfaction Problems Constraint satisfaction problems Backtracking algorithms for CSP Heuristics Local search for CSP Problem structure and difficulty of solving Search Problems The formalism
More information4 INFORMED SEARCH AND EXPLORATION. 4.1 Heuristic Search Strategies
55 4 INFORMED SEARCH AND EXPLORATION We now consider informed search that uses problem-specific knowledge beyond the definition of the problem itself This information helps to find solutions more efficiently
More informationBeyond Classical Search
Beyond Classical Search Chapter 3 covered problems that considered the whole search space and produced a sequence of actions leading to a goal. Chapter 4 covers techniques (some developed outside of AI)
More informationConstraint Satisfaction Problems. A Quick Overview (based on AIMA book slides)
Constraint Satisfaction Problems A Quick Overview (based on AIMA book slides) Constraint satisfaction problems What is a CSP? Finite set of variables V, V 2,, V n Nonempty domain of possible values for
More informationInformed search algorithms. Chapter 4
Informed search algorithms Chapter 4 Material Chapter 4 Section 1 - Exclude memory-bounded heuristic search 3 Outline Best-first search Greedy best-first search A * search Heuristics Local search algorithms
More informationConstraint Satisfaction
Constraint Satisfaction Philipp Koehn 1 October 2015 Outline 1 Constraint satisfaction problems (CSP) examples Backtracking search for CSPs Problem structure and problem decomposition Local search for
More informationIncremental Breakout Algorithm with Variable Ordering
Incremental Breaout Algorithm with Variable Ordering Carlos Eisenberg and Boi Faltings Artificial Intelligence Laboratory (LIA) Swiss Federal Institute of Technology (EPFL) IN-Ecublens, Lausanne, Switzerland
More information