A Survey of Suboptimal Search Algorithms

Size: px
Start display at page:

Download "A Survey of Suboptimal Search Algorithms"

Transcription

1 A Survey of Search Algorithms Jordan T. Thayer and Wheeler Ruml jtd7, ruml at cs.unh.edu slides at: jtd7/papers/ Jordan Thayer and Wheeler Ruml (UNH) Search 1 / 28

2 This is Search Search duplicates structs Search Types Search Tips Outline Not Discussed Bounded initial state expand generates all successor states, implicitly computes g(n) goal test h(n) estimates cost of reaching a goal admissibility: non-overestimating consistency: obeys triangle inequality state: problem data node: state, g, parent pointer Jordan Thayer and Wheeler Ruml (UNH) Search 2 / 28

3 What is a duplicate? Search duplicates structs Search Types Search Tips Outline Not Discussed 1. while open has nodes 2. remove n from open with minimum h(n) 3. if n is a goal then return n 4. otherwise expand n, inserting its children into open 5. return failure Bounded same state, different path Jordan Thayer and Wheeler Ruml (UNH) Search 3 / 28

4 Common Data Structures Search duplicates structs Search Types Search Tips Outline Not Discussed 1. while open has nodes 2. remove n from open with minimum h(n) 3. if n is a goal then return n 4. otherwise expand n, inserting its children into open 5. return failure Bounded openlist: heap: handles real costs, large ranges of values, etc bucket list: more efficient, requires integer values closed list: hash table: in practice, also includes open nodes Jordan Thayer and Wheeler Ruml (UNH) Search 4 / 28

5 Different Kinds of Search Search duplicates structs Search Types Search Tips Outline Not Discussed Grid Four-way 35% A* greedy Bounded total nodes generated width 800 suboptimal search scales better than optimal search Jordan Thayer and Wheeler Ruml (UNH) Search 5 / 28

6 Different Kinds of Search Search duplicates structs Search Types Search Tips Outline Not Discussed Bounded total nodes generated Grid Four-way 35% A* greedy final sol cost relative to A* greedy A* Grid Four-way 35% width width 800 it does so at the cost of solution quality Jordan Thayer and Wheeler Ruml (UNH) Search 5 / 28

7 Different Kinds of Search Search duplicates structs Search Types Search Tips Outline Not Discussed Bounded total nodes generated Grid Four-way 35% A* wa*, w = 1.5 greedy final sol cost relative to A* Grid Four-way 35% greedy wa*, w = 1.5 A* Size Size 800 bounded suboptimal search presents a middle ground Jordan Thayer and Wheeler Ruml (UNH) Search 5 / 28

8 Simple Tips for Efficient Search Search duplicates structs Search Types Search Tips Outline Not Discussed Bounded store open nodes in closed list as well prevents multiple copies of a state being open at once duplicate checking and delaying or dropping correct tie breaking varies by search, generally prefer high g goal test on generation then prune for bounded suboptimal search recursive expansions (to reduce heap operations) Jordan Thayer and Wheeler Ruml (UNH) Search 6 / 28

9 About the Tutorial Search duplicates structs Search Types Search Tips Outline Not Discussed Bounded Jordan and I will alternate bibliography at the end the pseudo code not presented during talk included for later review not comprehensive due to time constraints each section covers greatest hits our personal experience and biases Jordan Thayer and Wheeler Ruml (UNH) Search 7 / 28

10 Things We Will Discuss Search duplicates structs Search Types Search Tips Outline Not Discussed suboptimal search minimize solving time greedy best-first search beam search LSS-learning real-time Search (LSS-LRTA*) Bounded bounded suboptimal search weighted A* optimistic search anytime search anytime repairing A* anytime weighted A* restarting weighted A* balance time and cost unknown deadlines Jordan Thayer and Wheeler Ruml (UNH) Search 8 / 28

11 Things We Won t Discuss Search duplicates structs Search Types Search Tips Outline Not Discussed Bounded optimal search strategies bounded-depth tree search local search strategies constructing heuristics using disk parallel algorithms anything relying on distance estimates (come back next session) Jordan Thayer and Wheeler Ruml (UNH) Search 9 / 28

12 Greedy Beam LSS-LRTA* Bounded Unboundedly Search Jordan Thayer and Wheeler Ruml (UNH) Search 10 / 28

13 Search: Outline Greedy Beam LSS-LRTA* Bounded greedy best-first search variant of best-first search beam search: best-first, breadth-first irrevocable pruning real-time search: LSS-LRTA* interleaves planning and acting next session: speedy search, A* on length, beam search on d. Jordan Thayer and Wheeler Ruml (UNH) Search 11 / 28

14 Greedy Best-first Search Doran and Michie 1966 Greedy Beam LSS-LRTA* Bounded 1. Best-first Search On Cost-to-go Estimate, h(n). A* root with admissible h, f rises resulting in vacillation in optimal search, h prunes, in greedy it guides Jordan Thayer and Wheeler Ruml (UNH) Search 12 / 28

15 Greedy Best-first Search Doran and Michie 1966 Greedy Beam LSS-LRTA* Bounded 1. while open has nodes 2. remove n from open with minimum h(n) 3. if n is a goal then return n 4. otherwise expand n, inserting its children into open 5. return failure Jordan Thayer and Wheeler Ruml (UNH) Search 12 / 28

16 Greedy Best-first Search Doran and Michie 1966 Greedy Beam LSS-LRTA* Bounded 1. while open has nodes 2. remove n from open with minimum h(n) 2a. break ties on h in favor of low g(n) 3. if n is a goal then return n 4. otherwise expand n, inserting its children into open 5. return failure Jordan Thayer and Wheeler Ruml (UNH) Search 12 / 28

17 Greedy Best-first Search Doran and Michie 1966 Greedy Beam LSS-LRTA* Bounded 1. while open has nodes 2. remove n from open with minimum h(n) 2a. break ties on h in favor of low g(n) 3. if n is a goal then return n 4. otherwise for each child c of n 4a. if c was ever expanded, discard it 4b. if c is in open, keep c with smallest g 4c. otherwise insert c into open 5. return failure Jordan Thayer and Wheeler Ruml (UNH) Search 12 / 28

18 Greedy Best-first Search Doran and Michie 1966 Greedy Beam LSS-LRTA* Bounded total nodes generated Grid Four-way 35% expand duplicates drop duplicates final sol cost Grid Four-way 35% drop duplicates expand duplicates 400 width Size 800 dropping duplicates improves time, harms quality Jordan Thayer and Wheeler Ruml (UNH) Search 12 / 28

19 Greedy Best-first Search Doran and Michie 1966 Greedy Beam LSS-LRTA* Bounded greedy best-first search: h(n) A*: f(n) = g(n)+h(n) Jordan Thayer and Wheeler Ruml (UNH) Search 12 / 28

20 Greedy Best-first Search Doran and Michie 1966 Greedy Beam LSS-LRTA* Bounded greedy best-first search: h(n) A*: f(n) = g(n)+h(n) basic brittle Jordan Thayer and Wheeler Ruml (UNH) Search 12 / 28

21 Beam Search Rich and Knight 1991, Bisani 1992 Greedy Beam LSS-LRTA* Bounded Best-First Beam Search 1. run A* with a fixed sized open list 2. filter out nodes with high f(n) fixed memory (sometimes) conflates propulsion with pruning doesn t work well in practice Wilt et al SoCS-10 Jordan Thayer and Wheeler Ruml (UNH) Search 13 / 28

22 Beam Search Rich and Knight 1991, Bisani 1992 Greedy Beam LSS-LRTA* Bounded Best-First Beam Search 1. while open has nodes 2. remove n from open with minimum f(n) 3. if n is a goal then return n 4. otherwise for each child c of n 5. insert c into open 6. if open is larger than width 7. discard worst node on open 8. return failure Jordan Thayer and Wheeler Ruml (UNH) Search 13 / 28

23 Beam Search Rich and Knight 1991, Bisani 1992 Greedy Beam LSS-LRTA* Bounded Breadth-First Beam Search 1. run breadth-first search with a fixed sized open list 2. filter out nodes with high f(n) Jordan Thayer and Wheeler Ruml (UNH) Search 13 / 28

24 Beam Search Rich and Knight 1991, Bisani 1992 Greedy Beam LSS-LRTA* Bounded Breadth-First Beam Search 1. while open has nodes 2. for each n open 3. if n is a goal, return n 4. otherwise expand n, adding to children 5. open becomes best width nodes in children 5a. best according to f(n) = g(n)+h(n) 6. return failure Jordan Thayer and Wheeler Ruml (UNH) Search 13 / 28

25 Beam Search Rich and Knight 1991, Bisani 1992 Greedy Beam LSS-LRTA* Bounded Breadth-First Beam Search 1. while open has nodes 2. for each n open 3. for each child c of n 4. if c is a goal, return it 5. otherwise add c to children 6. open becomes best width nodes in children 6a. best according to f(n) = g(n)+h(n) 6b. break ties in favor of high g(n) 7. return failure Jordan Thayer and Wheeler Ruml (UNH) Search 13 / 28

26 Beam Search Rich and Knight 1991, Bisani 1992 for the uninitiated, the 15 puzzle Greedy Beam LSS-LRTA* Bounded Jordan Thayer and Wheeler Ruml (UNH) Search 13 / 28

27 Beam Search Rich and Knight 1991, Bisani 1992 Greedy Beam LSS-LRTA* Bounded Solution Quality Korf's Puzzles Solution Quality Life Four-way Grids 35% Obstacles A* wa* greedy breadth IDA* breadth wa* greedy 0-3 log10 total raw cpu time 0 0 log10 total raw 1 cpu time 2 beam search might be best approach, or it might be awful Jordan Thayer and Wheeler Ruml (UNH) Search 13 / 28

28 Beam Search Rich and Knight 1991, Bisani 1992 Greedy Beam LSS-LRTA* Bounded no goals dead ends (left) and many duplicates (right) cause problems Jordan Thayer and Wheeler Ruml (UNH) Search 13 / 28

29 LSS-LRTA* Koenig And Sun, 2008 Greedy Beam LSS-LRTA* Bounded real-time search: interleave planning and acting time bound on planning per action 1. run A* for a fixed number of expansions 2. commit to best f 3. back-up heuristic values using djikstra variant 4. act and repeat Jordan Thayer and Wheeler Ruml (UNH) Search 14 / 28

30 LSS-LRTA* Koenig And Sun, 2008 Greedy Beam LSS-LRTA* Bounded real-time search: interleave planning and acting time bound on planning per action 1. run A* for a fixed number of expansions 2. commit to best f 3. back-up heuristic values using djikstra variant 4. act and repeat Jordan Thayer and Wheeler Ruml (UNH) Search 14 / 28

31 LSS-LRTA* Koenig And Sun, 2008 Greedy Beam LSS-LRTA* Bounded real-time search: interleave planning and acting time bound on planning per action 1. run A* for a fixed number of expansions 2. commit to best f 3. back-up heuristic values using djikstra variant 4. act and repeat Jordan Thayer and Wheeler Ruml (UNH) Search 14 / 28

32 LSS-LRTA* Koenig And Sun, 2008 Greedy Beam LSS-LRTA* Bounded real-time search: interleave planning and acting time bound on planning per action 1. run A* for a fixed number of expansions 2. commit to best f 3. back-up heuristic values using djikstra variant 4. act and repeat Jordan Thayer and Wheeler Ruml (UNH) Search 14 / 28

33 LSS-LRTA* Koenig And Sun, 2008 Greedy Beam LSS-LRTA* Bounded real-time search: interleave planning and acting time bound on planning per action 1. run A* for a fixed number of expansions 2. commit to best f 3. back-up heuristic values using djikstra variant 4. act and repeat Jordan Thayer and Wheeler Ruml (UNH) Search 14 / 28

34 LSS-LRTA* Koenig And Sun, 2008 Greedy Beam LSS-LRTA* Bounded Solution Quality Korf's Puzzles Solution Quality Life Four-way Grids 35% Obstacles greedy breadth LSS-LRTA* breadth LSS-LRTA* greedy log10 total raw cpu time log10 total raw cpu time don t commit if you don t have to! Jordan Thayer and Wheeler Ruml (UNH) Search 14 / 28

35 Section Greedy Beam LSS-LRTA* Bounded duplicate policy affects solution cost and solving time beam searches breadth-first generally better than best-first need closed lists, see Wilt et al SoCS-10 topology dictates algorithm choice greedy if problems are small beam search if problems too big for greedy many dead necessitates complete searches many duplicates necessitates duplicate dropping real-time only if you have real-time constraints Jordan Thayer and Wheeler Ruml (UNH) Search 15 / 28

36 Bounded Weighted A* Optimistic Search Bounded Search Jordan Thayer and Wheeler Ruml (UNH) Search 16 / 28

37 Bounded Search: Outline Bounded Weighted A* Optimistic Search weighted A* larger w faster search optimistic search selecting an appropriate optimism handling duplicates effectively next tutorial: skeptical search, A ǫ, EES Jordan Thayer and Wheeler Ruml (UNH) Search 17 / 28

38 Weighted A* Pohl 1970 Bounded Weighted A* Optimistic Search 1. Best-first Search on f (n) = g(n)+w h(n) w 1 placing additional emphasis on h should encourage progress admissible h ensures bound. Jordan Thayer and Wheeler Ruml (UNH) Search 18 / 28

39 Weighted A* Pohl 1970 Bounded Weighted A* Optimistic Search 1. while open has nodes 2. remove n from open with minimum f (n) 3. if n is a goal then return n 4. otherwise expand n, inserting its children into open 5. return failure placing additional emphasis on h should encourage progress Jordan Thayer and Wheeler Ruml (UNH) Search 18 / 28

40 Weighted A* Pohl 1970 Bounded Weighted A* Optimistic Search 1. while open has nodes 2. remove n from open with minimum f (n) 2a f (n) = g(n)+w h(n) 2b. break ties on in favor of low f(n) 3. if n is a goal then return n 4. otherwise for each child c of n 4a. if c was ever expanded, discard it 4b. if c is in open, keep c with smallest g 4c. otherwise insert c into open 5. return failure discarding duplicates greatly improves performance at the cost of solution quality only applicable with consistent heuristics Jordan Thayer and Wheeler Ruml (UNH) Search 18 / 28

41 Weighted A* Pohl 1970 Bounded Weighted A* Optimistic Search total nodes generated relative to A* 4 2 Life Four-way Grid World expand duplicates drop_duplicates final sol cost 2.7e e+06 Life Four-way Grid World drop duplicates expand duplicates 2 ity 4 2 ity 4 discard duplicates when possible Jordan Thayer and Wheeler Ruml (UNH) Search 18 / 28

42 Weighted A* Pohl 1970 Dynamic Robot Motion Planning wa* Dock Robot wa* Bounded Weighted A* Optimistic Search total nodes generated 2e+07 1e+07 total nodes generated 8e+06 4e ity 3 40 ity 80 larger w does not always mean better performance Jordan Thayer and Wheeler Ruml (UNH) Search 18 / 28

43 Bound for Weighted A* Bounded Weighted A* Optimistic Search f(n) = g(n)+h(n) f (n) = g(n)+w h(n) p is the deepest node on an optimal path to opt. g(sol) f (sol) f (p) g(p)+w h(p) w (g(p)+h(p)) w f(p) w f(opt) w g(opt) 1. works for any f (p) w f(p) 2. g(p)+w h(p) w(g(p)+h(p))! Jordan Thayer and Wheeler Ruml (UNH) Search 19 / 28

44 Optimistic Search Thayer and Ruml, ICAPS-08 Bounded Weighted A* Optimistic Search run weighted A with a high weight. expand node with lowest f value after a solution is found. continue until w best f f(sol) this clean up guarantees solution quality. Jordan Thayer and Wheeler Ruml (UNH) Search 20 / 28

45 Optimistic Search Thayer and Ruml, ICAPS-08 Bounded Weighted A* Optimistic Search p is the deepest node on an optimal path to opt. best f isthenodewiththe smallest f value. f(p) f(opt) f(best f ) f(p) best f provides a lower bound on solution cost Determine best f via priority queue sorted on f Jordan Thayer and Wheeler Ruml (UNH) Search 20 / 28

46 Optimistic Search Thayer and Ruml, ICAPS-08 Bounded Weighted A* Optimistic Search 1. run weighted A with weight (bound 1) expand node with lowest f value after a solution is found. Continue until w best f f(sol) this clean up guarantees solution quality. Jordan Thayer and Wheeler Ruml (UNH) Search 20 / 28

47 Optimistic Search Thayer and Ruml, ICAPS-08 Bounded Weighted A* Optimistic Search 1. run weighted A with a high weight. 2. expand node with lowest f value after a solution is found. continue until w best f f(sol) this clean up guarantees solution quality. Jordan Thayer and Wheeler Ruml (UNH) Search 20 / 28

48 Optimistic Search Thayer and Ruml, ICAPS-08 Bounded Weighted A* Optimistic Search Jordan Thayer and Wheeler Ruml (UNH) Search 20 / 28

49 Optimistic Search Thayer and Ruml, ICAPS-08 Bounded Weighted A* Optimistic Search 1. w = (bound 1) optimism 2. while open and clean contain nodes 3. if no incumbent has been found 4. remove n from open with minimum f (n) 5. remove n from clean 5. if n is a goal, set incumbent to n 6. otherwise expand n, inserting its children into open and c 7. otherwise remove n from clean with minimum f(n) 8. if bound f(n) f(incumbent), return incumbent 9. otherwise expand n, inserting its children into open 10. return failure In practice, clean isn t constructed until an incumbent is found. Jordan Thayer and Wheeler Ruml (UNH) Search 20 / 28

50 Optimistic Search Thayer and Ruml, ICAPS-08 Bounded Weighted A* Optimistic Search log10 total nodes generated Dynamic Robot Motion Planinng wa* Optimism 2 Optimism 5 Optimism ity proper optimism depends on h accuracy Jordan Thayer and Wheeler Ruml (UNH) Search 20 / 28

51 Section Bounded Weighted A* Optimistic Search use weighted A* as a first approach to a problem use optimistic search if you know weighted A* works well duplicate handling can be important wa* can drop, requires consistent heuristic other algorithms can delay solving problems and showing bounds can be separate steps Jordan Thayer and Wheeler Ruml (UNH) Search 21 / 28

52 Bounded wa* Variants Jordan Thayer and Wheeler Ruml (UNH) Search 22 / 28

53 Algorithms: Outline Bounded wa* Variants anytime repairing A* anytime weighted A* restarting weighted A* come back next session for d-fenestration, size-cost search Jordan Thayer and Wheeler Ruml (UNH) Search 23 / 28

54 Anytime Algorithms Based on Weighted A* Bounded wa* Variants anytime weighted A*, Hansen and Zhou run weighted A* 2. if you find a goal, keep going. anytime repairing A*, Likhachev et al, run weighted A* 2. if you find a duplicate, don t look at it just yet. 3. if you find a goal 4. dump duplicates into open, reduce w, keep going. restarting weighted A*, Richter et al run weighted A* 2. if you find a goal, start over with a lower weight. Jordan Thayer and Wheeler Ruml (UNH) Search 24 / 28

55 Anytime Algorithms Based on Weighted A* Bounded wa* Variants anytime weighted A*, Hansen and Zhou run weighted A* 2. if you find a goal, keep going. anytime repairing A*, Likhachev et al, run weighted A* 2. if you find a duplicate, don t look at it just yet. 3. if you find a goal 4. dump duplicates into open, reduce w, keep going. restarting weighted A*, Richter et al run weighted A* 2. if you find a goal, start over with a lower weight. Jordan Thayer and Wheeler Ruml (UNH) Search 24 / 28

56 Anytime Algorithms Based on Weighted A* Bounded wa* Variants continued search, Hansen and Zhou run some complete suboptimal search 2. if you find a goal, keep going. repairing search, Likhachev et al, run some complete parameterized search 2. if you find a duplicate, don t look at it just yet. 3. if you find a goal 4. dump duplicates into open, change parameter, keep going. restarting search, Richter et al run some complete parameterized search 2. if you find a goal, start over with a different parameter. Jordan Thayer and Wheeler Ruml (UNH) Search 24 / 28

57 Anytime Algorithms Based on Weighted A* anytime weighted A*, Hansen and Zhou 1997 Bounded wa* Variants 1. while open has nodes 2. remove n from open with minimum f (n) 3. if n is a goal set n as incumbent 4. otherwise for each child c of n 5. if f(c) < f(incumbent) insert c into open 6. return incumbent anytime repairing A*, Likhachev et al, 2003 restarting weighted A*, Richter et al 2010 Jordan Thayer and Wheeler Ruml (UNH) Search 24 / 28

58 Anytime Algorithms Based on Weighted A* anytime weighted A*, Hansen and Zhou 1997 anytime repairing A*, Likhachev et al, 2003 Bounded wa* Variants 1. while open has nodes 2. remove n from open with minimum f (n) 3. if n is a goal 4. set n as incumbent 5. empty delay into open 6. reduce w 7. otherwise for each child c of n 8. if c was ever expanded, add it to delay 9. otherwise insert c into open 10. return incumbent restarting weighted A*, Richter et al 2010 Jordan Thayer and Wheeler Ruml (UNH) Search 24 / 28

59 Anytime Algorithms Based on Weighted A* Bounded wa* Variants anytime weighted A*, Hansen and Zhou 1997 anytime repairing A*, Likhachev et al, 2003 restarting weighted A*, Richter et al while open has nodes 2. remove n from open with minimum f (n) 3. if n is a goal 4. set n as incumbent 5. reduce w 6. if w < 1, return incumbent 7. otherwise restart the search 8. otherwise for each child c of n 9. if f(c) < f(incumbent) insert c into open 10. return incumbent Jordan Thayer and Wheeler Ruml (UNH) Search 24 / 28

60 Anytime Algorithms Based on Weighted A* Life Four-way Grids 35% Obstacles Korf's Puzzles Bounded wa* Variants Solution Quality 0.4 Solution Quality ARA* AwA* RWA* 0.8 RwA* ARA* AwA* 0 20 raw cpu time raw cpu time 300 no one best anytime algorithm (or even framework) generally, try repairing first. Jordan Thayer and Wheeler Ruml (UNH) Search 24 / 28

61 Anytime Algorithms Based on Weighted A* effort of anytime A* Bounded wa* Variants Jordan Thayer and Wheeler Ruml (UNH) Search 24 / 28

62 Anytime Algorithms Based on Weighted A* effort of anytime repairing A* Bounded wa* Variants Jordan Thayer and Wheeler Ruml (UNH) Search 24 / 28

63 Anytime Algorithms Based on Weighted A* effort of restarting A* Bounded wa* Variants Jordan Thayer and Wheeler Ruml (UNH) Search 24 / 28

64 Bounded wa* Variants ARA*, AwA*, RwA* describe general frameworks (wa* not important) continued few duplicates, tight lower bound repairing many duplicates, high initial bound restarting low h bias, cheap expansions great for unknown deadlines for known deadlines, deadline aware search (Dionne et al, SoCS-11) Jordan Thayer and Wheeler Ruml (UNH) Search 25 / 28

65 Bounded Bibliography Jordan Thayer and Wheeler Ruml (UNH) Search 26 / 28

66 Things We Discussed Bounded Bibliography suboptimal search no guarantees on solution quality so use inadmissible heuristics and drop duplicate states minimize solving time bounded suboptimal search balance time and cost bounds on solution quality drop duplicates when possible looser bounds always better performance anytime search unknown deadlines automatically trades time for quality deadline agnostic frameworks can be used with any complete algorithm Jordan Thayer and Wheeler Ruml (UNH) Search 27 / 28

67 Bibliography Bounded Bibliography J. E. Dorand and D. Michie, Experiments with the Graph Traverser Program, Proceedings of the Royal Society of London. Series A, Mathematical and Physical Sciences, Ira Pohl, Heuristic Search Viewed as Path Finding in a Graph, Artificial Intelligence volume 1, Elain Rich and Kevin Knight, Artificial Intelligence, Sven Koenig and Xiaoxun Sun, Comparing Real-Time and Incremental Heuristic Search for Real-Time Situated Agents, AAMAS Jordan T. Thayer and Wheeler Ruml, Faster Than Weigthed A*: An Optimistic Approach to Bounded Search, ICAPS Jordan Thayer and Wheeler Ruml (UNH) Search 28 / 28

68 Bibliography Bounded Bibliography Eric A. Hansen, Shlomo Zilberstein and Victor A. Danilchenko, Anytime Heuristic Search: First Results, University of Massachusetts, Amherst Technical Repart 97-50, Maxim Likhachev, Geoff Gordon and Sebastian Thrun ARA*: Anytime A* with Provable Bounds on Sub-Optimality, NIPS Eric A. Hansen and Rong Zhou, Anytime Heuristic Search, Journal of Artificial Intelligence Research volume 28, Silvia Richter, Jordan T. Thayer and Wheeler Ruml, The Joy of Forgetting: Faster via Restarting, ICAPS Chris Wilt, Jordan T. Thayer, and Wheeler Ruml, A Comparison of Greedy Search Algorithms, SoCS Jordan Thayer and Wheeler Ruml (UNH) Search 28 / 28

Bounded Suboptimal Search: A Direct Approach Using Inadmissible Estimates

Bounded Suboptimal Search: A Direct Approach Using Inadmissible Estimates Bounded Suboptimal Search: A Direct Approach Using Inadmissible Estimates Jordan T. Thayer and Wheeler Ruml jtd7, ruml at cs.unh.edu With Thanks To NSF-IIS0812141 and DARPA CSSG N10AP20029 Jordan T. Thayer

More information

Faster Than Weighted A*: An Optimistic Approach to Bounded Suboptimal Search

Faster Than Weighted A*: An Optimistic Approach to Bounded Suboptimal Search Faster Than Weighted A*: An Approach to Bounded Suboptimal Search Jordan T. Thayer and Wheeler Ruml Department of Computer Science University of New Hampshire Durham, NH 08 USA jtd7, ruml at cs.unh.edu

More information

Bounded Suboptimal Search: A Direct Approach Using Inadmissible Estimates

Bounded Suboptimal Search: A Direct Approach Using Inadmissible Estimates Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence Bounded Suboptimal Search: A Direct Approach Using Inadmissible Estimates Jordan T. Thayer and Wheeler Ruml Department

More information

Informed Backtracking Beam Search

Informed Backtracking Beam Search Informed Backtracking Beam earch Christopher ilt Department of Computer cience University of New Hampshire wilt@cs.unh.edu Abstract Beam searches are a very effective algorithm for solving problems that

More information

Fast and Loose in Bounded Suboptimal Heuristic Search

Fast and Loose in Bounded Suboptimal Heuristic Search Fast and Loose in Bounded Suboptimal Heuristic Search Jordan T. Thayer and Wheeler Ruml Department of Computer Science University of New Hampshire Durham, NH 84 USA jtd7, ruml at cs.unh.edu Ephrat Bitton

More information

Bounded Suboptimal Heuristic Search in Linear Space

Bounded Suboptimal Heuristic Search in Linear Space Proceedings of the Sixth International Symposium on Combinatorial Search Bounded Suboptimal Heuristic Search in Linear Space Matthew Hatem Department of Computer Science University of New Hampshire Durham,

More information

Recursive Best-First Search with Bounded Overhead

Recursive Best-First Search with Bounded Overhead Recursive Best-First Search with Bounded Overhead Matthew Hatem and Scott Kiesel and Wheeler Ruml with support from NSF grant IIS-1150068 Wheeler Ruml (UNH) Recursive Best-First Search with Bounded Overhead

More information

HEURISTIC SEARCH UNDER A DEADLINE. Austin Dionne

HEURISTIC SEARCH UNDER A DEADLINE. Austin Dionne HEURISTIC SEARCH UNDER A DEADLINE BY Austin Dionne B.S., University of New Hampshire (2008) THESIS Submitted to the University of New Hampshire in Partial Fulfillment of the Requirements for the Degree

More information

Recursive Best-First Search with Bounded Overhead

Recursive Best-First Search with Bounded Overhead Recursive Best-First Search with Bounded Overhead Matthew Hatem and Scott Kiesel and Wheeler Ruml Department of Computer Science University of New Hampshire Durham, NH 03824 USA mhatem and skiesel and

More information

CS 331: Artificial Intelligence Informed Search. Informed Search

CS 331: Artificial Intelligence Informed Search. Informed Search CS 331: Artificial Intelligence Informed Search 1 Informed Search How can we make search smarter? Use problem-specific knowledge beyond the definition of the problem itself Specifically, incorporate knowledge

More information

CS 331: Artificial Intelligence Informed Search. Informed Search

CS 331: Artificial Intelligence Informed Search. Informed Search CS 331: Artificial Intelligence Informed Search 1 Informed Search How can we make search smarter? Use problem-specific knowledge beyond the definition of the problem itself Specifically, incorporate knowledge

More information

Suboptimal and Anytime Heuristic Search on Multi-Core Machines

Suboptimal and Anytime Heuristic Search on Multi-Core Machines uboptimal and Anytime Heuristic earch on Multi-Core Machines Ethan Burns and eth Lemons and heeler Ruml Department of Computer cience University of New Hampshire Durham, NH 03824 UA eaburns, seth.lemons,

More information

Best-first Utility-guided Search

Best-first Utility-guided Search Best-first Utility-guided Search Wheeler Ruml and Minh B. Do Palo Alto Research Center 3333 Coyote Hill Road Palo Alto, CA 94304 USA ruml, minhdo at parc dot com Abstract In many shortest-path problems

More information

Anytime Heuristic Search

Anytime Heuristic Search Journal of Artificial Intelligence Research 28 (2007) 267-297 Submitted 05/06; published 03/07 Anytime Heuristic Search Eric A. Hansen Department of Computer Science and Engineering Mississippi State University

More information

Does Fast Beat Thorough? Comparing RTAA* and LSS-LRTA*

Does Fast Beat Thorough? Comparing RTAA* and LSS-LRTA* Does Fast Beat Thorough? Comparing and Shane Kochvi and Wheeler Ruml Department of Computer Science University of New Hampshire Durham, NH 3824 USA shl29 at wildcats.unh.edu and ruml at cs.unh.edu Abstract

More information

3 SOLVING PROBLEMS BY SEARCHING

3 SOLVING PROBLEMS BY SEARCHING 48 3 SOLVING PROBLEMS BY SEARCHING A goal-based agent aims at solving problems by performing actions that lead to desirable states Let us first consider the uninformed situation in which the agent is not

More information

Heuristic (Informed) Search

Heuristic (Informed) Search Heuristic (Informed) Search (Where we try to choose smartly) R&N: Chap., Sect..1 3 1 Search Algorithm #2 SEARCH#2 1. INSERT(initial-node,Open-List) 2. Repeat: a. If empty(open-list) then return failure

More information

Problem Solving & Heuristic Search

Problem Solving & Heuristic Search 190.08 Artificial 2016-Spring Problem Solving & Heuristic Search Byoung-Tak Zhang School of Computer Science and Engineering Seoul National University 190.08 Artificial (2016-Spring) http://www.cs.duke.edu/courses/fall08/cps270/

More information

Searching with Partial Information

Searching with Partial Information Searching with Partial Information Above we (unrealistically) assumed that the environment is fully observable and deterministic Moreover, we assumed that the agent knows what the effects of each action

More information

Informed search. Soleymani. CE417: Introduction to Artificial Intelligence Sharif University of Technology Spring 2016

Informed search. Soleymani. CE417: Introduction to Artificial Intelligence Sharif University of Technology Spring 2016 Informed search CE417: Introduction to Artificial Intelligence Sharif University of Technology Spring 2016 Soleymani Artificial Intelligence: A Modern Approach, Chapter 3 Outline Best-first search Greedy

More information

The Joy of Forgetting: Faster Anytime Search via Restarting

The Joy of Forgetting: Faster Anytime Search via Restarting The Joy of Forgetting: Faster Anytime Search via Restarting Silvia Richter IIIS, Griffith University, Australia and NICTA silvia.richter@nicta.com.au Jordan T. Thayer and Wheeler Ruml Department of Computer

More information

Notes. Video Game AI: Lecture 5 Planning for Pathfinding. Lecture Overview. Knowledge vs Search. Jonathan Schaeffer this Friday

Notes. Video Game AI: Lecture 5 Planning for Pathfinding. Lecture Overview. Knowledge vs Search. Jonathan Schaeffer this Friday Notes Video Game AI: Lecture 5 Planning for Pathfinding Nathan Sturtevant COMP 3705 Jonathan Schaeffer this Friday Planning vs localization We cover planning today Localization is just mapping a real-valued

More information

Introduction to Multi-Agent Programming

Introduction to Multi-Agent Programming Introduction to Multi-Agent Programming 4. Search algorithms and Pathfinding Uninformed & informed search, online search, ResQ Freiburg path planner Alexander Kleiner, Bernhard Nebel Contents Problem-Solving

More information

Heuristic (Informed) Search

Heuristic (Informed) Search Heuristic (Informed) Search (Where we try to choose smartly) R&N: Chap. 4, Sect. 4.1 3 1 Recall that the ordering of FRINGE defines the search strategy Search Algorithm #2 SEARCH#2 1. INSERT(initial-node,FRINGE)

More information

Problem Solving and Search

Problem Solving and Search Artificial Intelligence Problem Solving and Search Dae-Won Kim School of Computer Science & Engineering Chung-Ang University Outline Problem-solving agents Problem types Problem formulation Example problems

More information

Artificial Intelligence

Artificial Intelligence Artificial Intelligence Informed Search and Exploration Chapter 4 (4.1 4.2) A General Search algorithm: Chapter 3: Search Strategies Task : Find a sequence of actions leading from the initial state to

More information

ANA*: Anytime Nonparametric A*

ANA*: Anytime Nonparametric A* ANA*: Anytime Nonparametric A* Jur van den Berg 1 and Rajat Shah 2 and Arthur Huang 2 and Ken Goldberg 2 1 University of North Carolina at Chapel Hill. E-mail: berg@cs.unc.edu. 2 University of California,

More information

CS 730/730W/830: Intro AI

CS 730/730W/830: Intro AI CS 730/730W/830: Intro AI 1 handout: slides asst 1 milestone was due Wheeler Ruml (UNH) Lecture 4, CS 730 1 / 19 EOLQs Wheeler Ruml (UNH) Lecture 4, CS 730 2 / 19 Comparison Heuristics Search Algorithms

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science Artificial Intelligence Fall, 2010

MASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science Artificial Intelligence Fall, 2010 MSSHUSETTS INSTITUTE OF TEHNOLOY epartment of Electrical Engineering and omputer Science 6.0 rtificial Intelligence Fall, 00 Search Me! Recitation, Thursday September Prof. ob erwick. ifference between

More information

Informed search strategies (Section ) Source: Fotolia

Informed search strategies (Section ) Source: Fotolia Informed search strategies (Section 3.5-3.6) Source: Fotolia Review: Tree search Initialize the frontier using the starting state While the frontier is not empty Choose a frontier node to expand according

More information

This lecture. Lecture 6: Search 5. Other Time and Space Variations of A* Victor R. Lesser. RBFS - Recursive Best-First Search Algorithm

This lecture. Lecture 6: Search 5. Other Time and Space Variations of A* Victor R. Lesser. RBFS - Recursive Best-First Search Algorithm Lecture 6: Search 5 Victor R. Lesser CMPSCI 683 Fall 2010 This lecture Other Time and Space Variations of A* Finish off RBFS SMA* Anytime A* RTA* (maybe if have time) RBFS - Recursive Best-First Search

More information

Breadth-first heuristic search. Paper by Rong Zhou, Eric A. Hansen Presentation by Salomé Simon

Breadth-first heuristic search. Paper by Rong Zhou, Eric A. Hansen Presentation by Salomé Simon Breadth-first heuristic search Paper by Rong Zhou, Eric A. Hansen Presentation by Salomé Simon Breadth-first tree search 1 2 3 4 5 6 7 Used for search problems with uniform edge cost Prerequisite for presented

More information

Route planning / Search Movement Group behavior Decision making

Route planning / Search Movement Group behavior Decision making Game AI Where is the AI Route planning / Search Movement Group behavior Decision making General Search Algorithm Design Keep a pair of set of states: One, the set of states to explore, called the open

More information

Artificial Intelligence

Artificial Intelligence Artificial Intelligence Information Systems and Machine Learning Lab (ISMLL) Tomáš Horváth 10 rd November, 2010 Informed Search and Exploration Example (again) Informed strategy we use a problem-specific

More information

Beam-Stack Search: Integrating Backtracking with Beam Search

Beam-Stack Search: Integrating Backtracking with Beam Search 15th International Conference on Automated Planning and Scheduling Monterey, CA June 5-10, 2005 Beam-Stack Search: Integrating Backtracking with Beam Search Rong Zhou and Eric A. Hansen Department of Computer

More information

Evaluating Weighted DFS Branch and Bound over Graphical Models

Evaluating Weighted DFS Branch and Bound over Graphical Models Evaluating Weighted DFS Branch and Bound over Graphical Models Natalia Flerova University of California Irvine Radu Marinescu IBM Research Dublin, Ireland Rina Dechter University of California Irvine Abstract

More information

4 INFORMED SEARCH AND EXPLORATION. 4.1 Heuristic Search Strategies

4 INFORMED SEARCH AND EXPLORATION. 4.1 Heuristic Search Strategies 55 4 INFORMED SEARCH AND EXPLORATION We now consider informed search that uses problem-specific knowledge beyond the definition of the problem itself This information helps to find solutions more efficiently

More information

Artificial Intelligence

Artificial Intelligence Artificial Intelligence Search Marc Toussaint University of Stuttgart Winter 2015/16 (slides based on Stuart Russell s AI course) Outline Problem formulation & examples Basic search algorithms 2/100 Example:

More information

Search : Lecture 2. September 9, 2003

Search : Lecture 2. September 9, 2003 Search 6.825: Lecture 2 September 9, 2003 1 Problem-Solving Problems When your environment can be effectively modeled as having discrete states and actions deterministic, known world dynamics known initial

More information

Today s s lecture. Lecture 3: Search - 2. Problem Solving by Search. Agent vs. Conventional AI View. Victor R. Lesser. CMPSCI 683 Fall 2004

Today s s lecture. Lecture 3: Search - 2. Problem Solving by Search. Agent vs. Conventional AI View. Victor R. Lesser. CMPSCI 683 Fall 2004 Today s s lecture Search and Agents Material at the end of last lecture Lecture 3: Search - 2 Victor R. Lesser CMPSCI 683 Fall 2004 Continuation of Simple Search The use of background knowledge to accelerate

More information

Informed State Space Search B4B36ZUI, LS 2018

Informed State Space Search B4B36ZUI, LS 2018 Informed State Space Search B4B36ZUI, LS 2018 Branislav Bošanský, Martin Schaefer, David Fiedler, Jaromír Janisch {name.surname}@agents.fel.cvut.cz Artificial Intelligence Center, Czech Technical University

More information

Advanced A* Improvements

Advanced A* Improvements Advanced A* Improvements 1 Iterative Deepening A* (IDA*) Idea: Reduce memory requirement of A* by applying cutoff on values of f Consistent heuristic function h Algorithm IDA*: 1. Initialize cutoff to

More information

Bounded Suboptimal Search in Linear Space: New Results

Bounded Suboptimal Search in Linear Space: New Results Proceedings of the Seventh Annual Symposium on Combinatorial Search (SoCS 2014) Bounded Suboptimal Search in Linear Space: New Results Matthew Hatem and Wheeler Ruml Department of Computer Science University

More information

A Survey and Classification of A* based Best-First Heuristic Search Algorithms

A Survey and Classification of A* based Best-First Heuristic Search Algorithms A Survey and Classification of A* based Best-First Heuristic Search Algorithms Luis Henrique Oliveira Rios and Luiz Chaimowicz Departamento de Ciência da Computação Universidade Federal de Minas Gerais

More information

INTRODUCTION TO HEURISTIC SEARCH

INTRODUCTION TO HEURISTIC SEARCH INTRODUCTION TO HEURISTIC SEARCH What is heuristic search? Given a problem in which we must make a series of decisions, determine the sequence of decisions which provably optimizes some criterion. What

More information

CPS 170: Artificial Intelligence Search

CPS 170: Artificial Intelligence   Search CPS 170: Artificial Intelligence http://www.cs.duke.edu/courses/spring09/cps170/ Search Instructor: Vincent Conitzer Search We have some actions that can change the state of the world Change resulting

More information

CS 771 Artificial Intelligence. Informed Search

CS 771 Artificial Intelligence. Informed Search CS 771 Artificial Intelligence Informed Search Outline Review limitations of uninformed search methods Informed (or heuristic) search Uses problem-specific heuristics to improve efficiency Best-first,

More information

HEURISTIC SEARCH WITH LIMITED MEMORY. Matthew Hatem

HEURISTIC SEARCH WITH LIMITED MEMORY. Matthew Hatem HEURISTIC SEARCH WITH LIMITED MEMORY BY Matthew Hatem Bachelor s in Computer Science, Plymouth State College, 1999 Master s in Computer Science, University of New Hampshire, 2010 DISSERTATION Submitted

More information

Class Overview. Introduction to Artificial Intelligence COMP 3501 / COMP Lecture 2. Problem Solving Agents. Problem Solving Agents: Assumptions

Class Overview. Introduction to Artificial Intelligence COMP 3501 / COMP Lecture 2. Problem Solving Agents. Problem Solving Agents: Assumptions Class Overview COMP 3501 / COMP 4704-4 Lecture 2 Prof. JGH 318 Problem Solving Agents Problem Solving Agents: Assumptions Requires a goal Assume world is: Requires actions Observable What actions? Discrete

More information

Artificial Intelligence

Artificial Intelligence Artificial Intelligence Information Systems and Machine Learning Lab (ISMLL) Tomáš Horváth 16 rd November, 2011 Informed Search and Exploration Example (again) Informed strategy we use a problem-specific

More information

Discrete Motion Planning

Discrete Motion Planning RBE MOTION PLANNING Discrete Motion Planning Jane Li Assistant Professor Mechanical Engineering & Robotics Engineering http://users.wpi.edu/~zli11 Announcement Homework 1 is out Due Date - Feb 1 Updated

More information

ANA*: Anytime Nonparametric A*

ANA*: Anytime Nonparametric A* ANA*: Anytime Nonparametric A* Jur van den Berg 1 and Rajat Shah 2 and Arthur Huang 2 and Ken Goldberg 2 1 University of North Carolina at Chapel Hill. E-mail: berg@cs.unc.edu. 2 University of California,

More information

Informed search methods

Informed search methods Informed search methods Tuomas Sandholm Computer Science Department Carnegie Mellon University Read Section 3.5-3.7 of Russell and Norvig Informed Search Methods Heuristic = to find, to discover Heuristic

More information

Breadth-first heuristic search

Breadth-first heuristic search Artificial Intelligence 170 (2006) 385 408 www.elsevier.com/locate/artint Breadth-first heuristic search Rong Zhou, Eric A. Hansen Department of Computer Science and Engineering, Mississippi State University,

More information

Class Overview. Introduction to Artificial Intelligence COMP 3501 / COMP Lecture 2: Search. Problem Solving Agents

Class Overview. Introduction to Artificial Intelligence COMP 3501 / COMP Lecture 2: Search. Problem Solving Agents Class Overview COMP 3501 / COMP 4704-4 Lecture 2: Search Prof. 1 2 Problem Solving Agents Problem Solving Agents: Assumptions Requires a goal Assume world is: Requires actions Observable What actions?

More information

ITSA*: Iterative Tunneling Search with A*

ITSA*: Iterative Tunneling Search with A* ITSA*: Iterative Tunneling Search with A* David A. Furcy University of Wisconsin Computer Science Department 800 Algoma Boulevard Oshkosh, WI 54901-8643 furcyd@uwosh.edu Abstract This paper describes a

More information

A.I.: Informed Search Algorithms. Chapter III: Part Deux

A.I.: Informed Search Algorithms. Chapter III: Part Deux A.I.: Informed Search Algorithms Chapter III: Part Deux Best-first search Greedy best-first search A * search Heuristics Outline Overview Informed Search: uses problem-specific knowledge. General approach:

More information

Informed (Heuristic) Search. Idea: be smart about what paths to try.

Informed (Heuristic) Search. Idea: be smart about what paths to try. Informed (Heuristic) Search Idea: be smart about what paths to try. 1 Blind Search vs. Informed Search What s the difference? How do we formally specify this? A node is selected for expansion based on

More information

AI: Week 2. Tom Henderson. Fall 2014 CS 5300

AI: Week 2. Tom Henderson. Fall 2014 CS 5300 AI: Week 2 Tom Henderson Fall 2014 What s a Problem? Initial state Actions Transition model Goal Test Path Cost Does this apply to: Problem: Get A in CS5300 Solution: action sequence from initial to goal

More information

Informed Search A* Algorithm

Informed Search A* Algorithm Informed Search A* Algorithm CE417: Introduction to Artificial Intelligence Sharif University of Technology Spring 2018 Soleymani Artificial Intelligence: A Modern Approach, Chapter 3 Most slides have

More information

Autonomous Navigation in Unknown Environments via Language Grounding

Autonomous Navigation in Unknown Environments via Language Grounding Autonomous Navigation in Unknown Environments via Language Grounding Koushik (kbhavani) Aditya (avmandal) Sanjay (svnaraya) Mentor Jean Oh Introduction As robots become an integral part of various domains

More information

ArvandHerd Nathan R. Sturtevant University of Denver 1 Introduction. 2 The Components of ArvandHerd 2.

ArvandHerd Nathan R. Sturtevant University of Denver 1 Introduction. 2 The Components of ArvandHerd 2. ArvandHerd 2014 Richard Valenzano, Hootan Nakhost*, Martin Müller, Jonathan Schaeffer University of Alberta {valenzan, nakhost, mmueller, jonathan}@ualberta.ca Nathan R. Sturtevant University of Denver

More information

Binary Trees

Binary Trees Binary Trees 4-7-2005 Opening Discussion What did we talk about last class? Do you have any code to show? Do you have any questions about the assignment? What is a Tree? You are all familiar with what

More information

Lecture 4: Search 3. Victor R. Lesser. CMPSCI 683 Fall 2010

Lecture 4: Search 3. Victor R. Lesser. CMPSCI 683 Fall 2010 Lecture 4: Search 3 Victor R. Lesser CMPSCI 683 Fall 2010 First Homework 1 st Programming Assignment 2 separate parts (homeworks) First part due on (9/27) at 5pm Second part due on 10/13 at 5pm Send homework

More information

ARTIFICIAL INTELLIGENCE LECTURE 3. Ph. D. Lect. Horia Popa Andreescu rd year, semester 5

ARTIFICIAL INTELLIGENCE LECTURE 3. Ph. D. Lect. Horia Popa Andreescu rd year, semester 5 ARTIFICIAL INTELLIGENCE LECTURE 3 Ph. D. Lect. Horia Popa Andreescu 2012-2013 3 rd year, semester 5 The slides for this lecture are based (partially) on chapter 4 of the Stuart Russel Lecture Notes [R,

More information

CS 380/480 Foundations of Artificial Intelligence Winter 2007 Assignment 2 Solutions to Selected Problems

CS 380/480 Foundations of Artificial Intelligence Winter 2007 Assignment 2 Solutions to Selected Problems CS 380/480 Foundations of Artificial Intelligence Winter 2007 Assignment 2 Solutions to Selected Problems 1. Search trees for the state-space graph given below: We only show the search trees corresponding

More information

Anytime search in dynamic graphs

Anytime search in dynamic graphs University of Pennsylvania ScholarlyCommons Lab Papers (GRASP) General Robotics, Automation, Sensing and Perception Laboratory 9-2008 Anytime search in dynamic graphs Maxim Likhachev University of Pennsylvania,

More information

A Visual Treatment of the N-Puzzle

A Visual Treatment of the N-Puzzle A Visual Treatment of the N-Puzzle Matthew T. Hatem University of New Hampshire mtx23@cisunix.unh.edu Abstract Informed search strategies rely on information or heuristics to find the shortest path to

More information

Informed Search Lecture 5

Informed Search Lecture 5 Lecture 5 How can we exploit problem-specific knowledge to find solutions more efficiently? Where does this knowledge come from and under what conditions is it useful? 1 Agenda Review: Uninformed Search

More information

Potential-Based Bounded-Cost Search and Anytime Non-Parametric A

Potential-Based Bounded-Cost Search and Anytime Non-Parametric A Potential-Based Bounded-Cost Search and Anytime Non-Parametric A Roni Stern a, Ariel Felner a, Jur van den Berg b, Rami Puzis a, Rajat Shah c, Ken Goldberg c a Information Systems Engineering, Ben Gurion

More information

Anytime Search in Dynamic Graphs

Anytime Search in Dynamic Graphs Anytime Search in Dynamic Graphs Maxim Likhachev a, Dave Ferguson b,c, Geoff Gordon c, Anthony Stentz c, and Sebastian Thrun d a Computer and Information Science, University of Pennsylvania, Philadelphia,

More information

University of Alberta. Richard Valenzano. Master of Science. Department of Computing Science

University of Alberta. Richard Valenzano. Master of Science. Department of Computing Science University of Alberta SIMULTANEOUSLY SEARCHING WITH MULTIPLE ALGORITHM SETTINGS: AN ALTERNATIVE TO PARAMETER TUNING FOR SUBOPTIMAL SINGLE-AGENT SEARCH by Richard Valenzano A thesis submitted to the Faculty

More information

Planning for Markov Decision Processes with Sparse Stochasticity

Planning for Markov Decision Processes with Sparse Stochasticity Planning for Markov Decision Processes with Sparse Stochasticity Maxim Likhachev Geoff Gordon Sebastian Thrun School of Computer Science School of Computer Science Dept. of Computer Science Carnegie Mellon

More information

Real-Time Search in Dynamic Worlds

Real-Time Search in Dynamic Worlds Real-Time Search in Dynamic Worlds David M. Bond, Niels A. Widger, Wheeler Ruml Department of Computer Science University of New Hampshire Durham, NH 0384 USA david.bond at iol.unh.edu niels.widger, ruml

More information

ITCS 6150 Intelligent Systems. Lecture 5 Informed Searches

ITCS 6150 Intelligent Systems. Lecture 5 Informed Searches ITCS 6150 Intelligent Systems Lecture 5 Informed Searches Informed Searches We are informed (in some way) about future states and future paths We use this information to make better decisions about which

More information

Anytime AND/OR Best-First Search for Optimization in Graphical Models

Anytime AND/OR Best-First Search for Optimization in Graphical Models Anytime AND/OR Best-First Search for Optimization in Graphical Models Natalia Flerova University of California Irvine Radu Marinescu IBM Research, Dublin, Ireland Rina Dechter University of California

More information

Chapter S:IV. IV. Informed Search

Chapter S:IV. IV. Informed Search Chapter S:IV IV. Informed Search Best-First Search Best-First Search for State-Space Graphs Cost Functions for State-Space Graphs Evaluation of State-Space Graphs Algorithm A* BF* Variants Hybrid Strategies

More information

Real-Time Adaptive A*

Real-Time Adaptive A* Real-Time Adaptive A* Sven Koenig Computer Science Department University of Southern California Los Angeles, CA - skoenig@usc.edu Maxim Likhachev Computer Science Department Carnegie Mellon University

More information

Heuris'c Search. Reading note: Chapter 4 covers heuristic search.

Heuris'c Search. Reading note: Chapter 4 covers heuristic search. Heuris'c Search Reading note: Chapter 4 covers heuristic search. Credits: Slides in this deck are drawn from or inspired by a multitude of sources including: Shaul Markovitch Jurgen Strum Sheila McIlraith

More information

Informed Search Methods

Informed Search Methods Informed Search Methods How can we improve searching strategy by using intelligence? Map example: Heuristic: Expand those nodes closest in as the crow flies distance to goal 8-puzzle: Heuristic: Expand

More information

Chapter 3: Informed Search and Exploration. Dr. Daisy Tang

Chapter 3: Informed Search and Exploration. Dr. Daisy Tang Chapter 3: Informed Search and Exploration Dr. Daisy Tang Informed Search Definition: Use problem-specific knowledge beyond the definition of the problem itself Can find solutions more efficiently Best-first

More information

Iterative-Deepening Search with On-line Tree Size Prediction

Iterative-Deepening Search with On-line Tree Size Prediction Iterative-Deepening Search with On-line Tree Size Prediction Ethan Burns and Wheeler Ruml University of New Hampshire Department of Computer Science eaburns at cs.unh.edu and ruml at cs.unh.edu Abstract.

More information

New Settings in Heuristic Search. Roni Stern

New Settings in Heuristic Search. Roni Stern New Settings in Heuristic Search Roni Stern September 23, 2011 This work was carried out under the supervision of Dr. Ariel Felner and Dr. Meir Kalech at the Department of Information Systems Engineering,

More information

CSE 332 Winter 2015: Midterm Exam (closed book, closed notes, no calculators)

CSE 332 Winter 2015: Midterm Exam (closed book, closed notes, no calculators) _ UWNetID: Lecture Section: A CSE 332 Winter 2015: Midterm Exam (closed book, closed notes, no calculators) Instructions: Read the directions for each question carefully before answering. We will give

More information

DIT411/TIN175, Artificial Intelligence. Peter Ljunglöf. 23 January, 2018

DIT411/TIN175, Artificial Intelligence. Peter Ljunglöf. 23 January, 2018 DIT411/TIN175, Artificial Intelligence Chapters 3 4: More search algorithms CHAPTERS 3 4: MORE SEARCH ALGORITHMS DIT411/TIN175, Artificial Intelligence Peter Ljunglöf 23 January, 2018 1 TABLE OF CONTENTS

More information

Robotic Motion Planning: A* and D* Search

Robotic Motion Planning: A* and D* Search Robotic Motion Planning: A* and D* Search Robotics Institute 6-75 http://voronoi.sbp.ri.cmu.edu/~motion Howie Choset http://voronoi.sbp.ri.cmu.edu/~choset 6-75, Howie Choset with slides from G. Ayorker

More information

Best-First Search! Minimizing Space or Time!! RBFS! Save space, take more time!

Best-First Search! Minimizing Space or Time!! RBFS! Save space, take more time! Best-First Search! Minimizing Space or Time!! RBFS! Save space, take more time! RBFS-1 RBFS general properties! Similar to A* algorithm developed for heuristic search! RBFS-2 RBFS general properties 2!

More information

Basic Search Algorithms

Basic Search Algorithms Basic Search Algorithms Tsan-sheng Hsu tshsu@iis.sinica.edu.tw http://www.iis.sinica.edu.tw/~tshsu 1 Abstract The complexities of various search algorithms are considered in terms of time, space, and cost

More information

A* optimality proof, cycle checking

A* optimality proof, cycle checking A* optimality proof, cycle checking CPSC 322 Search 5 Textbook 3.6 and 3.7.1 January 21, 2011 Taught by Mike Chiang Lecture Overview Recap Admissibility of A* Cycle checking and multiple path pruning Slide

More information

Solving problems by searching

Solving problems by searching Solving problems by searching Chapter 3 Some slide credits to Hwee Tou Ng (Singapore) Outline Problem-solving agents Problem types Problem formulation Example problems Basic search algorithms Heuristics

More information

DIT411/TIN175, Artificial Intelligence. Peter Ljunglöf. 19 January, 2018

DIT411/TIN175, Artificial Intelligence. Peter Ljunglöf. 19 January, 2018 DIT411/TIN175, Artificial Intelligence Chapter 3: Classical search algorithms CHAPTER 3: CLASSICAL SEARCH ALGORITHMS DIT411/TIN175, Artificial Intelligence Peter Ljunglöf 19 January, 2018 1 DEADLINE FOR

More information

Informed search algorithms

Informed search algorithms Informed search algorithms This lecture topic Chapter 3.5-3.7 Next lecture topic Chapter 4.1-4.2 (Please read lecture topic material before and after each lecture on that topic) Outline Review limitations

More information

Comparative Study of RBFS & ARBFS Algorithm

Comparative Study of RBFS & ARBFS Algorithm IOSR Journal of Computer Engineering (IOSR-JCE) e-issn: 78-066, p- ISSN: 78-877Volume 0, Issue 5 (Mar. - Apr. 0), PP 05-0 Comparative Study of RBFS & ARBFS Algorithm Disha Sharma, Sanjay Kumar Dubey (Information

More information

Humanoid Robotics. Path Planning and Walking. Maren Bennewitz

Humanoid Robotics. Path Planning and Walking. Maren Bennewitz Humanoid Robotics Path Planning and Walking Maren Bennewitz 1 Introduction Given the robot s pose in a model of the environment Compute a path to a target location First: 2D path in a 2D grid map representation

More information

Lecture 5 Heuristics. Last Time: A* Search

Lecture 5 Heuristics. Last Time: A* Search CSE 473 Lecture 5 Heuristics CSE AI Faculty Last Time: A* Search Use an evaluation function f(n) for node n. f(n) = estimated total cost of path thru n to goal f(n) = g(n) + h(n) g(n) = cost so far to

More information

Informed State Space Search B4B36ZUI, LS 2018

Informed State Space Search B4B36ZUI, LS 2018 Informed State Space Search B4B36ZUI, LS 2018 Branislav Bošanský, Martin Schaefer, David Fiedler, Jaromír Janisch {name.surname}@agents.fel.cvut.cz Artificial Intelligence Center, Czech Technical University

More information

Informed Search and Exploration

Informed Search and Exploration Informed Search and Exploration Chapter 4 (4.1-4.3) CS 2710 1 Introduction Ch.3 searches good building blocks for learning about search But vastly inefficient eg: Can we do better? Breadth Depth Uniform

More information

Informed Search Algorithms

Informed Search Algorithms Informed Search Algorithms CITS3001 Algorithms, Agents and Artificial Intelligence Tim French School of Computer Science and Software Engineering The University of Western Australia 2017, Semester 2 Introduction

More information

Problem solving and search

Problem solving and search Problem solving and search Chapter 3 Chapter 3 1 Outline Problem-solving agents Problem types Problem formulation Example problems Uninformed search algorithms Informed search algorithms Chapter 3 2 Restricted

More information

Are We Smart Yet? (Where we try to choose smartly) R&N: Chap. 4, Sect

Are We Smart Yet? (Where we try to choose smartly) R&N: Chap. 4, Sect Heuristic (Informed) Search (Where we try to choose smartly) R&N: Chap., Sect.. Slides from Jean-Claude Latombe at Stanford University (used with permission) Recall that the ordering of FRINGE defines

More information