Clustering (Un-supervised Learning)
|
|
- Delphia Cross
- 5 years ago
- Views:
Transcription
1 Clustering (Un-supervised Learning) Partition-based clustering: k-mean Goal: minimize sum of square of distance o Between each point and centers of the cluster. o Between each pair of points in the cluster Algorithm: Initialize K cluster centers Random K separated points o Repeat until stabilization: Assign each point to closest cluster center Generate new cluster centers Adjust clusters by merging or splitting Centers
2 Clustering (Un-supervised Learning) Distance functions Consider two records x=(x 1,,x d ), y=(y 1,,y d ): Special cases: p=1: Manhattan distance p=2: Euclidean distance p p d d p p y x y x y x y x d... ), ( ), ( p x p y y x y x y x d ) (... ) ( ) ( ), ( d d y x y x y x y x d
3 Foundations of Artificial Intelligence Problems, Problem Spaces and Search
4 Problems, Problem Spaces and Search Defining Problems as Search Spaces Weak Search Techniques Strong Search Techniques Things to achieve : Understand the difference between blind and heuristic search. Know what a blind and heuristic method is. Use some of the search techniques on real problems.
5 Defining a Problem as a Search Space Many problems exhibit no detectable regular structure to be exploited, they appear chaotic, and do not yield to efficient algorithms. Exhaustive search of large state spaces appears to be the only viable approach. We introduce techniques for exhaustive (blind) search and present some examples of intelligent, heuristic search.
6 Defining a Problem as a Search Space The concept of search plays an ambivalent role in science and engineering, in one way, any problem whatsoever can be seen as a search for the right answer.
7 Defining a Problem as a Search Space Often we can't simply write down and solve the equations for a problem. This is not to dismiss mathematical approaches to problem solving, especially the mechanistic, deterministic variety that are the central concern of science and engineering. These problems can be augmented by other kinds of problem solving approaches that will make engineering better.
8 Defining a Problem as a Search Space Formulation and Representation of Problems To solve problems that are of interest to scientists and engineers we need to apply a common vocabulary. State space, or search space Goal, or search criterion Search algorithm Data structures Nodes Search Trees Decision Trees Search Graphs Search Space
9 Search Tree Parents and Ancestors Children and Descendants
10 Combinatorial Explosion The travelling sales problem n! n=10 3,628,800
11 Combinatorial Explosion Claude Shannon delivered a paper in 1949 at a New York conference on how a computer could play chess. Chess has unique games (with an average of 40 moves - the average length of a master game). Working at 200 million positions per second, Deep Blue would require years to evaluate all possible games. To put this is some sort of perspective, the universe is only about years old and is larger than the number of atoms in the universe.
12 Representing The Problem A chessboard layout is a matrix, e.g. if the white queen is at d1. If 2 represents white queen, 2d1 can represent this fact. To play the game a computer needs to search for the wining position (state) in a huge tree of game states.
13 A game tree
14 Foxes and Chickens
15 Foxes and Chickens The Problem Three foxes and three chickens seek to cross a river. A boat is available which can hold two animals and which can be navigated by any combination of foxes and chickens involving one or two animals. The chickens insist on never being left in a minority on either riverbank, for fear of being eaten by a majority of foxes. Find a schedule of crossings that will permit all the foxes and chickens to cross the river safely.
16 Foxes and Chickens Representing The Problem
17 Foxes and Chickens Representing The Problem F F F C C C B
18 Foxes and Chickens Many questions arise If all the generated nodes are expanded we generate multiple copies of many nodes. Also many nodes which are generated are unacceptable.
19 Foxes and Chickens Untenable States
20 Foxes and Chickens Solving the Problem
21 Foxes and Chickens Untenable States
22 Foxes and Chickens Solving the Problem
23 Foxes and Chickens Solving the Problem Copy of start state
24 Foxes and Chickens START COL 1 COL 2 COL 3 COL 4 COL 5 COL 6 COL 7 COL 8 COL 9 ROW 1 ROW 2 ROW 3 ROW 4 ROW 5
25 Foxes and Chickens Copy of start state Copy of start state
26 Foxes and Chickens START COL 1 COL 2 COL 3 COL 4 COL 5 COL 6 COL 7 COL 8 COL 9 ROW 1 ROW 2 ROW 3 ROW 4 ROW 5
27 Define the Problem as a Search Space Questions come to mind. For example, is there more than one ordering sequence to performing the node expansion? Does our search method actually find a solution? Is it a good solution? Does it find the optimal solution? Which of method should be used?
28 Define the Problem as a Search Space Two categories of search methods Blind (exhaustive) search depth/breadth first search Heuristic search A* search
29 Define the Problem as a Search Space We ll evaluate all the later search techniques w.r.t the below 4 criteria 1. Completeness Is the strategy guaranteed to find a solution if one exist? 2. Time Complexity How long does it take to find a solution?
30 Define the Problem as a Search Space We ll evaluate all the later search techniques w.r.t the below 4 criteria 3. Space Complexity How much memory does it take to perform the search? 4. Optimality Does the strategy find the optimal solution where there are several solutions?
31 Blind Search Strategies Since search forms the core of many intelligent processes, it is useful to structure AI programs in a way that facilitates describing and performing the search process. We need to study the question of how to decide which strategy to apply and even what the strategies are.
32 Blind Search The algorithms and strategies for exhaustive search - that is those methods for straightforwardly expanding every single node in a search tree - are sometimes called the blind search methods because although they are very general they lack the power of knowledge-guided search. Thus, their very generality implies a certain weakness. Blind searches can usually be broken down into two forms of search, depth-first search and breadth-first search.
33 Blind Search Blind searches have no preference as to which state (node) that is expanded next The different types of blind searches are characterised by the order in which they expand the nodes This can have a dramatic effect on how well the search performs when measured against the four criteria we defined earlier
34 Blind Search Breadth first search Depth first search Uniform cost search Depth limited search
35 Blind Search Breadth First Search Expand Root Node First Expand all nodes at level 1 before expanding level 2 OR Expand all nodes at level d before expanding nodes at level d+1 A B C D E D E F G
36 Blind Search Breadth First Search Whereas depth-first search is a policy for quickly penetrating as deeply as possible, its cautious partner breadth-first search can be likened to a wave propagating through the search space at equal speed in all directions. The memory cost of maintaining the wave front is significant, since all states in the front must be stored in their entirety.
37 Blind Search Breadth First Search Very systematic If there is a solution breadth first search is guaranteed to find it If there are several solutions then breadth first search will always find the shallowest goal state first and if the cost of a solution is a non-decreasing function of the depth then it will always find the cheapest solution
38 Blind Search Breadth First Search Evaluating against four criteria Optimal Complete Time complexity Space complexity
39 Blind Search Breadth First Search Evaluating against four criteria Optimal yes Complete yes Time complexity b + b 2 + b b d-1 i.e. O(b d ) Space complexity b + b 2 + b b d-1 i.e. O(b d ) b: the branching factor d: is the depth of the search tree Note : The space/time complexity could be less as the solution may be found somewhere before the d th level (depends on the problem).
40 Blind Search Breadth First Search Exponential growth quickly makes complete state space searches unrealistic If the branch factor was 10, by level 5 we would need to search 100,000 nodes, i.e. 10 5
41 Blind Search Breadth First Search Space is more of a factor to breadth first search than time Time is still an issue Who has 35 years to wait for an answer to a level 12 problem (or even 128 days to a level 10 problem) It could be argued that as technology gets faster then exponential growth will not be a problem But even if technology is 100 times faster we would still have to wait 35 years for a level 14 problem and what if we hit a level 15 problem!
42 Blind Search Breadth First Search Is BFS (or DFS later) a better option for - Maze - TSP - n-queen - 8-puzzle -
43 Blind Search Depth First Search Depth-first search (DFS) is the prime candidate. It s simple logic: keep going as long as you see anything new, and when that is not possible, back up as far as necessary and proceed in a new direction. Expand Root Node First Explore one branch of the tree before exploring another branch
44 Blind Search Depth First Search Expand Root Node First Explore one branch of the tree before exploring another branch
45 Blind Search Depth First Search Evaluating DFS by four criteria Space complexity Only needs to store the path from the root to the leaf node as well as the unexpanded nodes For a state space with a branching factor of b and a maximum depth of m, DFS requires storage of bm nodes Time complexity b m in the worst case
46 Blind Search Depth First Search Evaluating DFS by four criteria If DFS goes down a infinite branch it will not terminate if it does not find a goal state If it does find a solution there may be a better solution at a lower level in the tree Therefore, depth first search is neither complete nor optimal
47 Blind Search Uniform Cost Search (vs. BFS) BFS will find the optimal (shallowest) solution as long as the cost is a function of the depth Suppose that we have a tree in which all the weights of branches are one Weight of a path from the root to a node N is just the depth of node N
48 Blind Search Uniform Cost Search (vs. BFS) Uniform Cost Search can be used when this is not the case will find the cheapest solution provided that the cost of the path never decreases as we proceed along the path Uniform Cost Search works by expanding the lowest cost node on the fringe (leaf)
49 Blind Search Uniform Cost Search (vs. BFS) Cost of a node n the total cost of the path from the root to n Search all nodes of cost c before those of cost c+1 In BFS deeper nodes always arrive after shallower nodes In UCS the costs of new nodes do not have such a nice pattern
50 Blind Search Uniform Cost Search (vs. BFS) In UCS we need to 1.explicitly store the cost g of a node 2.explicitly use such costs in deciding the ordering in the queue Always remove the smallest cost node first sort the queue in increasing order alternatively, search the queue and remove the smallest cost Nodes removed by cost, not by order of arrival
51 Blind Search Uniform Cost Search (vs. BFS) A 1 10 S 5 B C G BFS will find the path SAG, with a cost of 11, but SBG is cheaper with a cost of 10 UCS will find the cheaper solution (SBG). It will find SAG but will not see it as it has a higher cost so won t be explored
52 Blind Search Uniform Cost Search (vs. BFS) Completeness: If there is a path to a goal then UCS will find it If there is no path, then UCS will eventually report that the goal is unreachable Optimality: UCS will report a minimum cost path (there might be many)
53 Blind Search Uniform Cost Search (vs. BFS) Breadth First Search Optimal Only if the branch cost is the same Uniform Cost Search Optimal Even if the branch cost is different Complete Systematic search throughout the whole tree
54 Blind Search Uniform Cost Search (vs. BFS) Time and space complexity O(b d ) (bounded by b d ) UCS is usually better than BFS UCS = BFS When all solutions rather than just one solution is needed When all branches have the same cost
55 Blind Search Depth Limited Search DFS may never terminate as it could follow a path that has no solution on it DLS solves this by imposing a depth limit, at which point the search terminates at that particular branch Can be implemented by the general search algorithm using operators which keep track of the depth Choice of depth parameter is important Too deep is wasteful of time and space Too shallow and we may never reach a goal state
56 Blind Search Completeness Depth Limited Search If the depth parameter, l, is set deep enough then we are guaranteed to find a solution if one exists Therefore it is complete if l>=d (d=depth of solution) Space requirements O(bl) Time requirements O(b l ) DLS is not optimal
57 Blind Search Depth Limited Search Odarea Map of Romania Neamt Zerind Iasi Arad Sibiu Fararas Vaslui Timisoara Lugoj Rimnicu Vilcea Pitesti Urziceni Hirsova Mehadia Bucharest Dobreta Craiova On the Romania map there are 20 towns so any town is reachable in 19 steps Giurgui G51IAI Blind Searches Eforie In fact, any town is reachable in 10 steps
58 Heuristic Search Techniques Do you drive? Have you thought about how the route plan is created for you in your TomTom? How do you find the sequence of moves in 8-puzzle with the minimum number of steps?
59 Heuristic Search Techniques Do you drive? How does your GPS create the shortest (or the quickest) route between A and B for you? A* search
60 Heuristic Search Techniques The general search methods discussed do not make use of domain knowledge and are considered as weak methods simply because they do not exploit such knowledge. In order to solve many problems efficiently it is often necessary to construct a control structure that is no longer guaranteed to find the best answer, but will almost always find a very good answer. thus we introduce the idea of an heuristic.
61 Heuristic Methods Heuristics Heuristic : A technique which improves the efficiency of a search process, possibly by sacrificing claims of completeness. Heuristics are key terms in many branches of AI. A heuristic is best defined as a 'rule of thumb' or piece of advice that is usually based on prior experience and not guaranteed to work.
62 Heuristic Methods Heuristics A moment's reflection will show ourselves constantly using heuristics in the course of our everyday lives. If the sky is grey we conclude that it would be better to put on a coat before going out. We book our holidays in August because that is when the weather is best.
63 Heuristic Search A search algorithm to find the shortest path through a search space to a goal state using a heuristic. f = g + h f - function that gives an evaluation of the state g - the cost of getting from the initial state to the current state h - the cost of getting from the current state to a goal state
64 Heuristic Search Heuristic searches vs. Uniform Cost Search Uniform cost search expand the path with the lowest path cost chooses the lowest cost node thus far Heuristic search estimate how close the solution is to the goal not how cheap the solution is thus far
65 Heuristic Search Heuristic searches vs. Uniform Cost Search Uniform Cost Search path cost function g(n): the cost of the path thus far Heuristic searches evaluation function h(n): how close is the current node to the solution
66 The A* Search Heuristic A search algorithm to find the shortest path through a search space to a goal state using a heuristic. f = g + h f - function that gives an evaluation of the state g - the cost of getting from the initial state to the current state h - the cost of getting from the current state to a goal state
67 The A* Search Heuristic A search algorithm to find the shortest path through a search space to a goal state using a heuristic. f = g + h Combines the cost so far and the estimated cost to the goal That is f(n) = g(n) + h(n) This gives us an estimated cost of the cheapest solution through n
68 The A* Search Heuristic A search algorithm to find the shortest path through a search space to a goal state using a heuristic. f = g + h We need to have a proper way to estimate h outline of graph goal start g A B A h A h B g B
69 The A* Search Heuristic A search algorithm to find the shortest path through a search space to a goal state using a heuristic. f = g + h h=0 A* becomes UCS complete & optimal but search pattern undirected h too large if h is large enough to dominate g then becomes like Greedy, lose optimality
70 Nodes Expanded ANIMATION OF A*. 1.Sibiu 2.Rimnicu 3.Pitesti 4.Fagaras 5.Bucharest 278 GOAL!! Zerind Arad Timisoara Lugoj Mehadia Dobreta 120 Oradea = =253 Sibiu =273 Rimnicu 146 Annotations: g+h=f =275 Pitesti =277 Fagaras 101 Fringe in RED Visited in BLUE =386(R) 90 Craiova =475(R, P) Giurgui 86 Neamt 87 Optimal route is ( ) = 278 miles Why not 211? Urziceni Bucharest 310+0=310 (F) 278+0=278 (R,P) 98 Iasi 92 Vaslui 142 Hirsova 86 Eforie
71 Zerind 71 Oradea Neamt 87 Iasi Zerind 71 Oradea Neamt 87 Iasi 75 Arad Optimal route is ( ) = 278 miles Timisoara Sibiu 99 Faragas Lugoj Rimnicu 211 Urziceni Pitesti Mehadia Bucharest Dobreta Vaslui 142 Hirsova Arad 118 Timisoara 111 Lugoj 70 Mehadia 75 Dobreta Optimal route is ( ) = 278 miles 140 Sibiu Rimnicu 97 Fagaras Urziceni 86 Pitesti Bucharest Vaslui 142 Hirsova Craiova Giurgui Eforie 120 Craiova Giurgui Eforie UCS A* Nodes expanded: 1.Sibiu; 2.Rimnicu; 3.Faragas; 4.Arad; 5.Pitesti; 6.Zerind; 7.Craiova; 8.Timisoara; 9.Bucharest 278 Nodes Expanded: 1.Sibiu; 2.Rimnicu; 3.Pitesti; 4.Fagaras; 5.Bucharest 278
72 The A* Search Heuristic Clearly the expansion of the fringe is much more directed towards the goal The number of expansions is significantly reduced A* is optimal and complete, but it is not all good news It can be shown that the number of nodes that are searched is still exponential to the size of most problems This has implications not only for the time taken to perform the search but also the space required Of these two problems the space complexity is more serious
73 The A* Search Heuristic If you examine the animation on the previous slide you will notice an interesting phenomenon Along any path from the root, the f-cost never decreases This is no accident It holds true for all admissible heuristics
74 The A* Search Heuristic 8 puzzle problem Initial State Goal State Online demo of A* algorithm for 8 puzzle Noyes Chapman s 15 puzzle
75 The A* Search Heuristic Possible Heuristics in A* Algorithm H 1 H 2 = the number of tiles that are in the wrong position = the sum of the distances of the tiles from their goal positions using the Manhattan Distance We need admissible heuristics (never over estimate) Both are admissible but which one is better?
76 The A* Search Heuristic Possible Heuristics in A* Algorithm H 1 H 2 = the number of tiles that are in the wrong position (=4) = the sum of the distances of the tiles from their goal positions using the Manhattan Distance (=5)
77 The A* Search Heuristic Possible Heuristics in A* Algorithm H 1 = the number of tiles that are in the wrong position (=4) H 2 = the sum of the distances G51IAI of the - Heuristic tiles from their goal positions using the Manhattan Distance (=5)
78 The A* Search Heuristic Possible Heuristics 8 6 in 2 A* Algorithm H 2 = the sum of the distances of the tiles from their goal positions using the Manhattan Distance (=5)
79 The A* Search Heuristic Possible Heuristics in A* Algorithm H 1 = the number of tiles that are in the wrong position (=4)
80 The A* Search Heuristic
81 The A* Search Heuristic A 8 B 9 C 6 D 4 E 5 F 2 G 0 D 3 3 A C B 4 Distance to destination E Start Point: A Goal Point: G G 2 F Distance Between Cities
82 The A* Search Heuristic A 8 B 9 C 6 D 4 E 5 F 2 G 0 D 3 3 A C B 4 Distance to destination E Travel From City A to City C Distance travelled (g) = 2 miles Distance still to go (h) = 6 miles G 2 F Value of Current State (f) = g + h = 8 Distance Between Cities
83 The Game of Nim In this game there are initially 9 tokens and two players take it in turns to remove 1, or 2, or 3 tokens at a time. The player who has to remove the last token is the loser.
84 Minmax Algorithm Generate and Test Remember that the algorithm aims for the computer to win the game. The computer needs to assess each possible move before actually making a move. This can be done by giving each node a value, a big value to any nodes are is good for the computer and a small value to the node that is bad for it. Once the values for the leaf nodes (those at the bottom of the tree) are known we know the computer will try to move to the nodes with big values and the opponent naturally will try to move to the nodes with small values.
85 Minmax Algorithm Generate and Test Following this logic we can back the values of the leaf nodes up according to whose turn it is to move: if it is the computer s move, the maximum value is backed up and if it is the opponent s move the minimum value is backed up. Once all the nodes have been assigned a value, the computer player is now able to play the perfect game. At each node it just moves to the next node that has the highest value.
86 The Game of Nim Player MIN Computer MAX Player MIN Computer MAX Player MIN Computer MAX Player MIN -1-1 Computer MAX Player MIN 1 1 1
87 Concluding Search space (state space) Search tree Search methods Depth-, breath- first search Depth limited search Uniform cost search A* algorithm Minmax Combinatorial explosion Heuristics Untenable states
Introduction to Artificial Intelligence (G51IAI)
Introduction to Artificial Intelligence (G51IAI) Dr Rong Qu Heuristic Searches Blind Search vs. Heuristic Searches Blind search Randomly choose where to search in the search tree When problems get large,
More informationIntroduction to Artificial Intelligence (G51IAI) Dr Rong Qu. Blind Searches
Introduction to Artificial Intelligence (G51IAI) Dr Rong Qu Blind Searches Blind Searches Function GENERAL-SEARCH (problem, QUEUING-FN) returns a solution or failure nodes = MAKE-QUEUE(MAKE-NODE(INITIAL-STATE[problem]))
More informationInformed search algorithms
Informed search algorithms Chapter 4, Sections 1 2 Chapter 4, Sections 1 2 1 Outline Best-first search A search Heuristics Chapter 4, Sections 1 2 2 Review: Tree search function Tree-Search( problem, fringe)
More informationCOMP219: Artificial Intelligence. Lecture 10: Heuristic Search
COMP219: Artificial Intelligence Lecture 10: Heuristic Search 1 Class Tests Class Test 1 (Prolog): Tuesday 8 th November (Week 7) 13:00-14:00 LIFS-LT2 and LIFS-LT3 Class Test 2 (Everything but Prolog)
More informationCOMP219: Artificial Intelligence. Lecture 10: Heuristic Search
COMP219: Artificial Intelligence Lecture 10: Heuristic Search 1 Class Tests Class Test 1 (Prolog): Friday 17th November (Week 8), 15:00-17:00. Class Test 2 (Everything but Prolog) Friday 15th December
More informationIntroduction to Artificial Intelligence. Informed Search
Introduction to Artificial Intelligence Informed Search Bernhard Beckert UNIVERSITÄT KOBLENZ-LANDAU Winter Term 2004/2005 B. Beckert: KI für IM p.1 Outline Best-first search A search Heuristics B. Beckert:
More informationOverview. Path Cost Function. Real Life Problems. COMP219: Artificial Intelligence. Lecture 10: Heuristic Search
COMP219: Artificial Intelligence Lecture 10: Heuristic Search Overview Last time Depth-limited, iterative deepening and bi-directional search Avoiding repeated states Today Show how applying knowledge
More informationArtificial Intelligence. Informed search methods
Artificial Intelligence Informed search methods In which we see how information about the state space can prevent algorithms from blundering about in the dark. 2 Uninformed vs. Informed Search Uninformed
More informationInformed search algorithms
Artificial Intelligence Topic 4 Informed search algorithms Best-first search Greedy search A search Admissible heuristics Memory-bounded search IDA SMA Reading: Russell and Norvig, Chapter 4, Sections
More informationCOMP9414/ 9814/ 3411: Artificial Intelligence. 5. Informed Search. Russell & Norvig, Chapter 3. UNSW c Alan Blair,
COMP9414/ 9814/ 3411: Artificial Intelligence 5. Informed Search Russell & Norvig, Chapter 3. COMP9414/9814/3411 15s1 Informed Search 1 Search Strategies General Search algorithm: add initial state to
More informationInformed search algorithms. Chapter 4, Sections 1 2 1
Informed search algorithms Chapter 4, Sections 1 2 Chapter 4, Sections 1 2 1 Outline Best-first search A search Heuristics Chapter 4, Sections 1 2 2 Review: Tree search function Tree-Search( problem, fringe)
More informationInformed Search and Exploration
Ch. 03 p.1/47 Informed Search and Exploration Sections 3.5 and 3.6 Ch. 03 p.2/47 Outline Best-first search A search Heuristics, pattern databases IDA search (Recursive Best-First Search (RBFS), MA and
More informationCS486/686 Lecture Slides (c) 2015 P.Poupart
1 2 Solving Problems by Searching [RN2] Sec 3.1-3.5 [RN3] Sec 3.1-3.4 CS486/686 University of Waterloo Lecture 2: May 7, 2015 3 Outline Problem solving agents and search Examples Properties of search algorithms
More informationCS486/686 Lecture Slides (c) 2014 P.Poupart
1 2 1 Solving Problems by Searching [RN2] Sec 3.1-3.5 [RN3] Sec 3.1-3.4 CS486/686 University of Waterloo Lecture 2: January 9, 2014 3 Outline Problem solving agents and search Examples Properties of search
More informationSolving Problems by Searching
Solving Problems by Searching CS486/686 University of Waterloo Sept 11, 2008 1 Outline Problem solving agents and search Examples Properties of search algorithms Uninformed search Breadth first Depth first
More informationGraphs vs trees up front; use grid too; discuss for BFS, DFS, IDS, UCS Cut back on A* optimality detail; a bit more on importance of heuristics,
Graphs vs trees up front; use grid too; discuss for BFS, DFS, IDS, UCS Cut back on A* optimality detail; a bit more on importance of heuristics, performance data Pattern DBs? General Tree Search function
More informationInformed Search and Exploration
Ch. 03b p.1/51 Informed Search and Exploration Sections 3.5 and 3.6 Nilufer Onder Department of Computer Science Michigan Technological University Ch. 03b p.2/51 Outline Best-first search A search Heuristics,
More informationCOSC343: Artificial Intelligence
COSC343: Artificial Intelligence Lecture 18: Informed search algorithms Alistair Knott Dept. of Computer Science, University of Otago Alistair Knott (Otago) COSC343 Lecture 18 1 / 1 In today s lecture
More informationCS:4420 Artificial Intelligence
CS:4420 Artificial Intelligence Spring 2018 Informed Search Cesare Tinelli The University of Iowa Copyright 2004 18, Cesare Tinelli and Stuart Russell a a These notes were originally developed by Stuart
More informationPROBLEM SOLVING AND SEARCH IN ARTIFICIAL INTELLIGENCE
Artificial Intelligence, Computational Logic PROBLEM SOLVING AND SEARCH IN ARTIFICIAL INTELLIGENCE Lecture 3 Informed Search Sarah Gaggl Dresden, 22th April 2014 Agenda 1 Introduction 2 Uninformed Search
More informationArtificial Intelligence: Search Part 2: Heuristic search
Artificial Intelligence: Search Part 2: Heuristic search Thomas Trappenberg January 16, 2009 Based on the slides provided by Russell and Norvig, Chapter 4, Section 1 2,(4) Outline Best-first search A search
More informationInformed Search Algorithms. Chapter 4
Informed Search Algorithms Chapter 4 Outline Informed Search and Heuristic Functions For informed search, we use problem-specific knowledge to guide the search. Topics: Best-first search A search Heuristics
More informationArtificial Intelligence CS 6364
Artificial Intelligence CS 6364 Professor Dan Moldovan Section 4 Informed Search and Adversarial Search Outline Best-first search Greedy best-first search A* search Heuristics revisited Minimax search
More informationSolving Problems using Search
Solving Problems using Search Artificial Intelligence @ Allegheny College Janyl Jumadinova September 11, 2018 Janyl Jumadinova Solving Problems using Search September 11, 2018 1 / 35 Example: Romania On
More informationProblem solving and search
Problem solving and search Chapter 3 Chapter 3 1 Outline Problem-solving agents Problem types Problem formulation Example problems Uninformed search algorithms Informed search algorithms Chapter 3 2 Restricted
More informationCS414-Artificial Intelligence
CS414-Artificial Intelligence Lecture 6: Informed Search Algorithms Waheed Noor Computer Science and Information Technology, University of Balochistan, Quetta, Pakistan Waheed Noor (CS&IT, UoB, Quetta)
More informationPrincess Nora University Faculty of Computer & Information Systems ARTIFICIAL INTELLIGENCE (CS 370D) Computer Science Department
Princess Nora University Faculty of Computer & Information Systems ARTIFICIAL INTELLIGENCE (CS 370D) Computer Science Department (CHAPTER-3-PART3) PROBLEM SOLVING AND SEARCH Searching algorithm Uninformed
More informationPEAS: Medical diagnosis system
PEAS: Medical diagnosis system Performance measure Patient health, cost, reputation Environment Patients, medical staff, insurers, courts Actuators Screen display, email Sensors Keyboard/mouse Environment
More informationOutline. Informed search algorithms. Best-first search. Review: Tree search. A search Heuristics. Chapter 4, Sections 1 2 4
Outline Best-first search Informed search algorithms A search Heuristics Chapter 4, Sections 1 2 Chapter 4, Sections 1 2 1 Chapter 4, Sections 1 2 2 Review: Tree search function Tree-Search( problem, fringe)
More informationCOMP219: Artificial Intelligence. Lecture 7: Search Strategies
COMP219: Artificial Intelligence Lecture 7: Search Strategies 1 Overview Last time basic ideas about problem solving; state space; solutions as paths; the notion of solution cost; the importance of using
More informationInformed Search and Exploration
Ch. 04 p.1/39 Informed Search and Exploration Chapter 4 Ch. 04 p.2/39 Outline Best-first search A search Heuristics IDA search Hill-climbing Simulated annealing Ch. 04 p.3/39 Review: Tree search function
More informationPlanning, Execution & Learning 1. Heuristic Search Planning
Planning, Execution & Learning 1. Heuristic Search Planning Reid Simmons Planning, Execution & Learning: Heuristic 1 Simmons, Veloso : Fall 2001 Basic Idea Heuristic Search Planning Automatically Analyze
More informationSearching and NetLogo
Searching and NetLogo Artificial Intelligence @ Allegheny College Janyl Jumadinova September 6, 2018 Janyl Jumadinova Searching and NetLogo September 6, 2018 1 / 21 NetLogo NetLogo the Agent Based Modeling
More informationArtificial Intelligence
Artificial Intelligence hapter 1 hapter 1 1 Iterative deepening search function Iterative-Deepening-Search( problem) returns a solution inputs: problem, a problem for depth 0 to do result Depth-Limited-Search(
More informationArtificial Intelligence, CS, Nanjing University Spring, 2018, Yang Yu. Lecture 3: Search 2.
Artificial Intelligence, CS, Nanjing University Spring, 2018, Yang Yu Lecture 3: Search 2 http://cs.nju.edu.cn/yuy/course_ai18.ashx Previously... function Tree-Search( problem, fringe) returns a solution,
More informationRobot Programming with Lisp
6. Search Algorithms Gayane Kazhoyan (Stuart Russell, Peter Norvig) Institute for University of Bremen Contents Problem Definition Uninformed search strategies BFS Uniform-Cost DFS Depth-Limited Iterative
More informationProblem solving and search
Problem solving and search Chapter 3 Chapter 3 1 How to Solve a (Simple) Problem 7 2 4 1 2 5 6 3 4 5 8 3 1 6 7 8 Start State Goal State Chapter 3 2 Introduction Simple goal-based agents can solve problems
More informationArtificial Intelligence
Artificial Intelligence Academic year 2016/2017 Giorgio Fumera http://pralab.diee.unica.it fumera@diee.unica.it Pattern Recognition and Applications Lab Department of Electrical and Electronic Engineering
More informationSolving Problems by Searching
Solving Problems by Searching Agents, Goal-Based Agents, Problem-Solving Agents Search Problems Blind Search Strategies Agents sensors environment percepts actions? agent effectors Definition. An agent
More informationSolving Problems by Searching
Solving Problems by Searching Agents, Goal-Based Agents, Problem-Solving Agents Search Problems Blind Search Strategies Agents sensors environment percepts actions? agent effectors Definition. An agent
More informationWeek 3: Path Search. COMP9414/ 9814/ 3411: Artificial Intelligence. Motivation. Example: Romania. Romania Street Map. Russell & Norvig, Chapter 3.
COMP9414/9814/3411 17s1 Search 1 COMP9414/ 9814/ 3411: Artificial Intelligence Week 3: Path Search Russell & Norvig, Chapter 3. Motivation Reactive and Model-Based Agents choose their actions based only
More information4. Solving Problems by Searching
COMP9414/9814/3411 15s1 Search 1 COMP9414/ 9814/ 3411: Artificial Intelligence 4. Solving Problems by Searching Russell & Norvig, Chapter 3. Motivation Reactive and Model-Based Agents choose their actions
More informationLecture Plan. Best-first search Greedy search A* search Designing heuristics. Hill-climbing. 1 Informed search strategies. Informed strategies
Lecture Plan 1 Informed search strategies (KA AGH) 1 czerwca 2010 1 / 28 Blind vs. informed search strategies Blind search methods You already know them: BFS, DFS, UCS et al. They don t analyse the nodes
More informationInformed search algorithms
CS 580 1 Informed search algorithms Chapter 4, Sections 1 2, 4 CS 580 2 Outline Best-first search A search Heuristics Hill-climbing Simulated annealing CS 580 3 Review: General search function General-Search(
More informationSolving Problems by Searching. Artificial Intelligence Santa Clara University 2016
Solving Problems by Searching Artificial Intelligence Santa Clara University 2016 Problem Solving Agents Problem Solving Agents Use atomic representation of states Planning agents Use factored or structured
More informationAGENTS AND ENVIRONMENTS. What is AI in reality?
AGENTS AND ENVIRONMENTS What is AI in reality? AI is our attempt to create a machine that thinks (or acts) humanly (or rationally) Think like a human Cognitive Modeling Think rationally Logic-based Systems
More informationInformed Search. Topics. Review: Tree Search. What is Informed Search? Best-First Search
Topics Informed Search Best-First Search Greedy Search A* Search Sattiraju Prabhakar CS771: Classes,, Wichita State University 3/6/2005 AI_InformedSearch 2 Review: Tree Search What is Informed Search?
More informationProblem solving and search
Problem solving and search Chapter 3 TB Artificial Intelligence Slides from AIMA http://aima.cs.berkeley.edu 1 /1 Outline Problem-solving agents Problem types Problem formulation Example problems Basic
More informationTDT4136 Logic and Reasoning Systems
TDT4136 Logic and Reasoning Systems Chapter 3 & 4.1 - Informed Search and Exploration Lester Solbakken solbakke@idi.ntnu.no Norwegian University of Science and Technology 18.10.2011 1 Lester Solbakken
More informationInformed Search and Exploration
Informed Search and Exploration Chapter 4 (4.1-4.3) CS 2710 1 Introduction Ch.3 searches good building blocks for learning about search But vastly inefficient eg: Can we do better? Breadth Depth Uniform
More informationProblem Solving and Search. Geraint A. Wiggins Professor of Computational Creativity Department of Computer Science Vrije Universiteit Brussel
Problem Solving and Search Geraint A. Wiggins Professor of Computational Creativity Department of Computer Science Vrije Universiteit Brussel What is problem solving? An agent can act by establishing goals
More informationAGENTS AND ENVIRONMENTS. What is AI in reality?
AGENTS AND ENVIRONMENTS What is AI in reality? AI is our attempt to create a machine that thinks (or acts) humanly (or rationally) Think like a human Cognitive Modeling Think rationally Logic-based Systems
More informationMap coloring. 4 colors. From coloring to CSP. Informed Search Methods. Constrained Satisfaction Search. Constrained Satisfaction Search.
Constrained Satisfaction Search Informed Search Methods Example: 8-Queens Problem States: , where V is the row occupied by the ith queen. Constraint satisfaction search Heuristics Best
More informationFoundations of Artificial Intelligence
Foundations of Artificial Intelligence 4. Informed Search Methods Heuristics, Local Search Methods, Genetic Algorithms Joschka Boedecker and Wolfram Burgard and Frank Hutter and Bernhard Nebel Albert-Ludwigs-Universität
More informationCS 771 Artificial Intelligence. Informed Search
CS 771 Artificial Intelligence Informed Search Outline Review limitations of uninformed search methods Informed (or heuristic) search Uses problem-specific heuristics to improve efficiency Best-first,
More informationCSE 473. Chapter 4 Informed Search. CSE AI Faculty. Last Time. Blind Search BFS UC-BFS DFS DLS Iterative Deepening Bidirectional Search
CSE 473 Chapter 4 Informed Search CSE AI Faculty Blind Search BFS UC-BFS DFS DLS Iterative Deepening Bidirectional Search Last Time 2 1 Repeated States Failure to detect repeated states can turn a linear
More informationCS-E4800 Artificial Intelligence
CS-E4800 Artificial Intelligence Jussi Rintanen Department of Computer Science Aalto University January 12, 2017 Transition System Models The decision-making and planning at the top-level of many intelligent
More informationOutline for today s lecture. Informed Search I. One issue: How to search backwards? Very briefly: Bidirectional search. Outline for today s lecture
Outline for today s lecture Informed Search I Uninformed Search Briefly: Bidirectional Search (AIMA 3.4.6) Uniform Cost Search (UCS) Informed Search Introduction to Informed search Heuristics 1 st attempt:
More informationArtificial Intelligence
Artificial Intelligence Search Marc Toussaint University of Stuttgart Winter 2015/16 (slides based on Stuart Russell s AI course) Outline Problem formulation & examples Basic search algorithms 2/100 Example:
More informationArtificial Intelligence
Artificial Intelligence CSC348 Unit 3: Problem Solving and Search Syedur Rahman Lecturer, CSE Department North South University syedur.rahman@wolfson.oxon.org Artificial Intelligence: Lecture Notes The
More informationCAP 4630 Artificial Intelligence
CAP 4630 Artificial Intelligence Instructor: Sam Ganzfried sganzfri@cis.fiu.edu 1 http://www.ultimateaiclass.com/ https://moodle.cis.fiu.edu/ 2 Solving problems by search 3 8-puzzle 4 8-queens 5 Search
More informationArtificial Intelligence, CS, Nanjing University Spring, 2018, Yang Yu. Lecture 2: Search 1.
rtificial Intelligence, S, Nanjing University Spring, 2018, Yang Yu Lecture 2: Search 1 http://lamda.nju.edu.cn/yuy/course_ai18.ashx Problem in the lecture 7 2 4 51 2 3 5 6 4 5 6 8 3 1 7 8 Start State
More informationAlgorithm. December 7, Shortest path using A Algorithm. Phaneendhar Reddy Vanam. Introduction. History. Components of A.
December 7, 2011 1 2 3 4 5 6 7 The A is a best-first search algorithm that finds the least cost path from an initial configuration to a final configuration. The most essential part of the A is a good heuristic
More informationArtificial Intelligence: Search Part 1: Uninformed graph search
rtificial Intelligence: Search Part 1: Uninformed graph search Thomas Trappenberg January 8, 2009 ased on the slides provided by Russell and Norvig, hapter 3 Search outline Part 1: Uninformed search (tree
More informationOutline. Best-first search
Outline Best-first search Greedy best-first search A* search Heuristics Admissible Heuristics Graph Search Consistent Heuristics Local search algorithms Hill-climbing search Beam search Simulated annealing
More informationCS:4420 Artificial Intelligence
S:4420 rtificial Intelligence Spring 2018 Uninformed Search esare Tinelli The University of Iowa opyright 2004 18, esare Tinelli and Stuart Russell a a These notes were originally developed by Stuart Russell
More informationARTIFICIAL INTELLIGENCE SOLVING PROBLEMS BY SEARCHING. Chapter 3
ARTIFICIAL INTELLIGENCE SOLVING PROBLEMS BY SEARCHING Chapter 3 1 PROBLEM SOLVING We want: To automatically solve a problem We need: A representation of the problem Algorithms that use some strategy to
More informationInformatics 2D: Tutorial 2 (Solutions)
Informatics 2D: Tutorial 2 (Solutions) Adversarial Search and Informed Search Week 3 1 Adversarial Search This exercise was taken from R&N Chapter 5. Consider the two-player game shown in Figure 1. Figure
More informationInformed search methods
CS 2710 Foundations of AI Lecture 5 Informed search methods Milos Hauskrecht milos@pitt.edu 5329 Sennott Square Announcements Homework assignment 2 is out Due on Tuesday, September 19, 2017 before the
More informationFoundations of Artificial Intelligence
Foundations of Artificial Intelligence 16. State-Space Search: Greedy BFS, A, Weighted A Malte Helmert University of Basel March 28, 2018 State-Space Search: Overview Chapter overview: state-space search
More informationARTIFICIAL INTELLIGENCE (CSC9YE ) LECTURES 2 AND 3: PROBLEM SOLVING
ARTIFICIAL INTELLIGENCE (CSC9YE ) LECTURES 2 AND 3: PROBLEM SOLVING BY SEARCH Gabriela Ochoa http://www.cs.stir.ac.uk/~goc/ OUTLINE Problem solving by searching Problem formulation Example problems Search
More informationAr#ficial)Intelligence!!
Introduc*on! Ar#ficial)Intelligence!! Roman Barták Department of Theoretical Computer Science and Mathematical Logic Uninformed (blind) search algorithms can find an (optimal) solution to the problem,
More informationTDDC17. Intuitions behind heuristic search. Recall Uniform-Cost Search. Best-First Search. f(n) =... + h(n) g(n) = cost of path from root node to n
Intuitions behind heuristic search The separation property of GRAPH-SEARCH TDDC17 Seminar III Search II Informed or Heuristic Search Beyond Classical Search Find a heuristic measure h(n) which estimates
More information16.1 Introduction. Foundations of Artificial Intelligence Introduction Greedy Best-first Search 16.3 A Weighted A. 16.
Foundations of Artificial Intelligence March 28, 2018 16. State-Space Search: Greedy BFS, A, Weighted A Foundations of Artificial Intelligence 16. State-Space Search: Greedy BFS, A, Weighted A Malte Helmert
More informationA.I.: Informed Search Algorithms. Chapter III: Part Deux
A.I.: Informed Search Algorithms Chapter III: Part Deux Best-first search Greedy best-first search A * search Heuristics Outline Overview Informed Search: uses problem-specific knowledge. General approach:
More informationShortest path using A Algorithm
Shortest path using A Algorithm Phaneendhar Reddy Vanam Computer Science Indiana State University Terre Haute, IN, USA December 13, 2011 Contents Abstract The main aim of this project is to find the shortest
More informationProblem solving and search
Problem solving and search hapter 3 hapter 3 1 Outline Problem-solving agents Problem types Problem formulation Example problems asic search algorithms hapter 3 3 Restricted form of general agent: Problem-solving
More informationOutline. Solving Problems by Searching. Introduction. Problem-solving agents
Outline Solving Problems by Searching S/ University of Waterloo Sept 7, 009 Problem solving agents and search Examples Properties of search algorithms Uninformed search readth first Depth first Iterative
More informationAutomated Planning & Artificial Intelligence
Automated Planning & Artificial Intelligence Uninformed and Informed search in state space Humbert Fiorino Humbert.Fiorino@imag.fr http://membres-lig.imag.fr/fiorino Laboratory of Informatics of Grenoble
More informationInformed Search. Dr. Richard J. Povinelli. Copyright Richard J. Povinelli Page 1
Informed Search Dr. Richard J. Povinelli Copyright Richard J. Povinelli Page 1 rev 1.1, 9/25/2001 Objectives You should be able to explain and contrast uniformed and informed searches. be able to compare,
More informationOptimal Control and Dynamic Programming
Optimal Control and Dynamic Programming SC Q 7- Duarte Antunes Outline Shortest paths in graphs Dynamic programming Dijkstra s and A* algorithms Certainty equivalent control Graph Weighted Graph Nodes
More informationLecture 4: Search 3. Victor R. Lesser. CMPSCI 683 Fall 2010
Lecture 4: Search 3 Victor R. Lesser CMPSCI 683 Fall 2010 First Homework 1 st Programming Assignment 2 separate parts (homeworks) First part due on (9/27) at 5pm Second part due on 10/13 at 5pm Send homework
More informationInformed search algorithms
Informed search algorithms This lecture topic Chapter 3.5-3.7 Next lecture topic Chapter 4.1-4.2 (Please read lecture topic material before and after each lecture on that topic) Outline Review limitations
More informationFoundations of Artificial Intelligence
Foundations of Artificial Intelligence 4. Informed Search Methods Heuristics, Local Search Methods, Genetic Algorithms Joschka Boedecker and Wolfram Burgard and Bernhard Nebel Albert-Ludwigs-Universität
More informationInformed search algorithms
Informed search algorithms This lecture topic Chapter 3.5-3.7 Next lecture topic Chapter 4.1-4.2 (Please read lecture topic material before and after each lecture on that topic) Outline Review limitations
More informationSeminar: Search and Optimization
Seminar: Search and Optimization 4. asic Search lgorithms Martin Wehrle Universität asel October 4, 2012 asics lind Search lgorithms est-first Search Summary asics asics lind Search lgorithms est-first
More informationProblem Solving and Search
Artificial Intelligence Problem Solving and Search Dae-Won Kim School of Computer Science & Engineering Chung-Ang University Outline Problem-solving agents Problem types Problem formulation Example problems
More informationS A E RC R H C I H NG N G IN N S T S A T T A E E G R G A R PH P S
LECTURE 2 SEARCHING IN STATE GRAPHS Introduction Idea: Problem Solving as Search Basic formalism as State-Space Graph Graph explored by Tree Search Different algorithms to explore the graph Slides mainly
More informationTDDC17. Intuitions behind heuristic search. Best-First Search. Recall Uniform-Cost Search. f(n) =... + h(n) g(n) = cost of path from root node to n
Intuitions behind heuristic search The separation property of GRAPH-SEARCH TDDC17 Seminar III Search II Informed or Heuristic Search Beyond Classical Search Find a heuristic measure h(n) which estimates
More informationOutline. Best-first search
Outline Best-first search Greedy best-first search A* search Heuristics Local search algorithms Hill-climbing search Beam search Simulated annealing search Genetic algorithms Constraint Satisfaction Problems
More informationWarm- up. IteraAve version, not recursive. class TreeNode TreeNode[] children() boolean isgoal() DFS(TreeNode start)
Warm- up We ll o-en have a warm- up exercise for the 10 minutes before class starts. Here s the first one Write the pseudo code for breadth first search and depth first search IteraAve version, not recursive
More informationPlanning and search. Lecture 1: Introduction and Revision of Search. Lecture 1: Introduction and Revision of Search 1
Planning and search Lecture 1: Introduction and Revision of Search Lecture 1: Introduction and Revision of Search 1 Lecturer: Natasha lechina email: nza@cs.nott.ac.uk ontact and web page web page: http://www.cs.nott.ac.uk/
More informationInformed Search Lecture 5
Lecture 5 How can we exploit problem-specific knowledge to find solutions more efficiently? Where does this knowledge come from and under what conditions is it useful? 1 Agenda Review: Uninformed Search
More informationChapter 3: Informed Search and Exploration. Dr. Daisy Tang
Chapter 3: Informed Search and Exploration Dr. Daisy Tang Informed Search Definition: Use problem-specific knowledge beyond the definition of the problem itself Can find solutions more efficiently Best-first
More informationIntroduction to Artificial Intelligence (G51IAI) Dr Rong Qu. Problem Space and Search Tree
Introduction to Artificial Intelligence (G51IAI) Dr Rong Qu Problem Space and Search Tree F Trees B J C Nodes H E G Root node Children/parent of nodes Leaves A I Branches D Average branching factor average
More informationInformed Search (Ch )
Informed Search (Ch. 3.5-3.6) Informed search In uninformed search, we only had the node information (parent, children, cost of actions) Now we will assume there is some additional information, we will
More informationLecture 4: Informed/Heuristic Search
Lecture 4: Informed/Heuristic Search Outline Limitations of uninformed search methods Informed (or heuristic) search uses problem-specific heuristics to improve efficiency Best-first A* RBFS SMA* Techniques
More informationBasic Search. Fall Xin Yao. Artificial Intelligence: Basic Search
Basic Search Xin Yao Fall 2017 Fall 2017 Artificial Intelligence: Basic Search Xin Yao Outline Motivating Examples Problem Formulation From Searching to Search Tree Uninformed Search Methods Breadth-first
More informationSolving problems by searching
Solving problems by searching Chapter 3 Some slide credits to Hwee Tou Ng (Singapore) Outline Problem-solving agents Problem types Problem formulation Example problems Basic search algorithms Heuristics
More informationUninformed Search. Problem-solving agents. Tree search algorithms. Single-State Problems
Uninformed Search Problem-solving agents Tree search algorithms Single-State Problems Breadth-First Search Depth-First Search Limited-Depth Search Iterative Deepening Extensions Graph search algorithms
More information