Section Marks Pre-Midterm / 32. Logic / 29. Total / 100

Size: px
Start display at page:

Download "Section Marks Pre-Midterm / 32. Logic / 29. Total / 100"

Transcription

1 Name: CS 331 Final Exam Spring 2011 You have 110 minutes to complete this final exam. You are only allowed to use your textbook, your notes, your assignments and solutions to those assignments during this midterm. If you find that you are spending a large amount of time on a difficult question, skip it and return to it when you ve finished some of the easier questions. Total marks for this exam is 100. Section Marks Pre-Midterm / 32 Bayesian Networks / 39 Logic / 29 Total / 100 Pg 1/11

2 Section I: Pre-Midterm questions [32 points] 1. In this question, you will answer questions about an intelligent agent that is playing Minesweeper against the computer. For each part below, circle the choice which best describes the environment. Write a one or two sentence justification. If you have never played Minesweeper before, the rules are below (taken from Wikipedia): The player is initially presented with an NxN grid of undistinguished squares. Some randomly selected squares, unknown to the player, are designated to contain mines. The game is played by revealing squares of the grid, typically by clicking them with a mouse. If a square containing a mine is revealed, the player loses the game. Otherwise, a digit is revealed in the square, indicating the number of adjacent squares (typically, out of the possible eight) that contain mines. In typical implementations, if this number is zero then the square appears blank, and the surrounding squares are automatically also revealed. a) Fully observable or Partially observable [2 points] b) Deterministic or Stochastic [2 points] c) Episodic or Sequential [2 points] d) Static or Dynamic [2 points] e) Discrete or Continuous [2 points] 2. Which of the following types of agents (simple-reflex, model-based, goal-based and utility-based) will NOT perform well in Minesweeper? Explain your answer. [4 points] Simple-reflex agents won t perform well because they only react to the last percept. You need to do some reasoning if you want to succeed in Minesweeper. Pg 2/11

3 3. Answer true or false to the following: a) Suppose I have two heuristics for the tile puzzle: h1 and h2. If h1 dominates h2, then h2 is the better heuristic to use. false b) Matrix form games in game theory can only contain one Nash Equlibrium. false c) Gradient descent cannot be applied if the objective function is not differentiable. true d) Suppose you took Iterative Deepening DFS and instead of increasing the depth limit by 1 each time, you increased it by 2. If the step cost (ie. the cost from a state to its successor) is always 1, this version of ID-DFS is optimal. false e) If you can generate the entire game tree for adversarial search and fit it in memory, then you don t need an evaluation function. true f) A strictly dominated strategy is never played in a Nash Equilibrium. true g) Expectiminimax does not consider worst case scenarios. true h) Local beam search is the same as k parallel hill-climbing searches (with random restarts). false i) In genetic algorithms, crossover and point mutations are techniques for getting out of local optima. true Pg 3/11

4 Section II: Bayesian Networks [33 points] 4. Suppose you are given the following training data set with three random variables: MidtermGrade (with values A, B, or C) HasLateAssn (with values true or false) OverallGrade (with values A, B, or C). This is the class label. MidtermGrade HasLateAssn OverallGrade A true B A true A C false C B true C A false A B false B C true C A true A B false A B true B a) Using the training data set, fill in the table below for OverallGrade). Remember to use uniform Dirichlet priors. [2 points] OverallGrade OverallGrade) A (4+1)/(10+3)=5/13=0.38 B (3+1)/(10+3)=4/13=0.31 C (3+1)/(10+3)=4/13=0.31 b) Using the training data set, fill in the table below for HasLateAssn OverallGrade). Remember to use uniform Dirichlet priors. [3 points] OverallGrade HasLateAssn HasLateAssn OverallGrade) A false ( 2+1)/(4+2)= 3/6 = 0.5 A true (2+1)/(4+2) = 3/6 = 0.5 B false (1+1)/(3+2) = 2/5 = 0.4 B true (2+1)/(3+2) = 3/5= 0.6 C False ( 1+1)/(3+2) = 2/5 = 0.4 C true (2+1)/(3+2) = 3/5 = 0.6 Pg 4/11

5 c) Suppose you use a Naïve Bayes structure to predict OverallGrade. Draw the naïve Bayes structure if OverallGrade is the class label and the features are HasLateAssn and MidtermGrade. [4 points] OverallGrade MidtermGrade HasLateAssn d) When predicting the overall grade, you need to compute OverallGrade A MidtermGrade A, HasLateAssn false) Show how to compute this expression by expressing it in terms of the conditional probabilities in the naive Bayes network (you don t have to fill in the actual probability values since you don t have all of them). I ve done the first step for you below by applying Bayes rule. OverallGrade A MidtermGrade A, HasLateAssn false) MidtermGrade A, HasLateAssn false OverallGrade A) OverallGrade MidtermGrade A, HasLateAssn false) A) Do NOT ignore the denominator you need to show how to compute it in this question. [6 points] MidtermGrade A OverallGrade A) HasLateAssn false OverallGrade A) OverallGrade A) OverallGrade o, MidtermGrade A, HasLateAssn false) o MidtermGrade A OverallGrade A) HasLateAssn false OverallGrade A) OverallGrade A) MidtermGrade A OverallGrade o) HasLateAssn false OverallGrade o) OverallGrade o) o Pg 5/11

6 5. Use the Bayesian network below to answer true or false to the following questions about conditional independence. Show the blocked paths for partial credit. A C D B G E F a) I( A, C F) [3 points] False A -> B -> E -> F <- G <- C is not blocked (because of F) b) I( D, G E) [3 points] Pg 6/11

7 False D -> E -> F -> G Blocked D -> E <- B <- C -> G Not blocked 6. The following questions deal with the Bayesian network below, along with the associated conditional probability tables. B A C A A) A B B A) A B C C A,B) false 0.25 false false 0.2 false false false 0.75 true 0.75 false true 0.8 false false true 0.25 true false 0.1 false true false 0.75 true true 0.9 false true true 0.25 true false false 0.2 true false true 0.8 true true false 0.2 true true true 0.8 a) Although the Directed Acyclic Graph structure of the Bayesian network above does not contain any visible conditional independencies, there is a conditional independence that exists in the conditional probability tables. What variables are conditionally independent of each other? Explain. [3 points] I(C,B A) You ll notice that C A,B) = C A) Pg 7/11

8 A A) A B B A) A B C C A,B) false 0.25 false false 0.2 false false false 0.75 true 0.75 false true 0.8 false false true 0.25 true false 0.1 false true false 0.75 true true 0.9 false true true 0.25 true false false 0.2 true false true 0.8 true true false 0.2 true true true 0.8 b) Compute A = true B=true, C=true). (Tables copied for your convenience) [10 points] A true, B true, C true) B true, C true) A true, B true, C true) A a, B true, C true) a A true) B true A true) C true A true, B true) A a) B true A a) C true A a, B true) a (0.75)(0.9)(0.8) (0.75)(0.9)(0.8) (0.25)(0.8)(0.25) Pg 8/11

9 7. The following question deals with the three Boolean random variables below: 1. FriendAbsent: takes the value true if your friend is not in class and false otherwise. 2. SleptIn: takes the value true if your friend slept in and false otherwise. 3. Zombie: takes the value true if your friend has been eaten by a zombie and false otherwise. You would like to model the following scenario: If you observe that your friend is absent from class, and you find out that your friend slept in, then it is less likely that your friend has been eaten by a zombie. If you don t observe that your friend is absent from class, then the event of your friend sleeping in and the event of your friend being eaten by a zombie are independent. Draw the Bayesian network for these three variables representing this scenario. [5 points] Pg 9/11

10 SleptIn Zombie FriendAbsent Section III: Logic [29 points] 8. Suppose I have a Wumpus world that consists of 2 cells: (1,1) and (2,1). In the truth table below, P i,j represents the fact that there is a Pit at (i,j) and KB represents the overall truth value of the knowledge base. P 1,1 P 2,1 KB false false false false true false true false true true true true a) Does the Knowledge Base = P 2,1? Explain your answer [2 points] No it doesn t because in every model in which the KB is true, P 2,1 is not true. b) If there are n Boolean symbols in total in the Knowledge Base, what is the time complexity (in Big-O notation) of the truth table enumeration algorithm for proving entailment? [2 points] 2 n 9. Convert the following English sentences into a propositional logic KB. Use symbols listed below. Make sure your KB is in Conjunctive Normal Form. [20 points] If a student is a CS major or an EE major, he/she is smart. If a student is an EE major, he/she owns a Tekbot. If a student is a CS major, he/she drinks coffee or Red Bull. If a student owns a Tekbot, he/she doesn t drink coffee For convenience, use the following symbols: Symbol CS EE S Meaning Student is a CS major Student is a EE major Student is smart Pg 10/11

11 T C RB Student owns a Tekbot Student drinks coffee Student drinks Red Bull CS EE S. (1) EE T...(2) CS C RB (3) T C..(4) From (1) (CS EE) S = (CS EE) S = (CS S) (EE S) From (2) EE T From (3) CS C RB From (4) T C 10. Based on the KB above, can you entail that if a student is an EE major, he/she drinks Red Bull ie. does KB = (EE => RB)? Use resolution to prove this or if it can t be proven, state that it does not resolve. [5 points] Add EE RB to the KB Does not resolve Pg 11/11

University of Waterloo Department of Electrical and Computer Engineering ECE 457A: Cooperative and Adaptive Algorithms Midterm Examination

University of Waterloo Department of Electrical and Computer Engineering ECE 457A: Cooperative and Adaptive Algorithms Midterm Examination University of Waterloo Department of Electrical and Computer Engineering ECE 457A: Cooperative and Adaptive Algorithms Midterm Examination Exam Date/Time: Tuesday, June 13, 2017, 8:30-9:50 pm Exam Hall:

More information

Potential Midterm Exam Questions

Potential Midterm Exam Questions Potential Midterm Exam Questions 1. What are the four ways in which AI is usually viewed? Which of the four is the preferred view of the authors of our textbook? 2. What does each of the lettered items

More information

CS-171, Intro to A.I. Mid-term Exam Winter Quarter, 2014

CS-171, Intro to A.I. Mid-term Exam Winter Quarter, 2014 CS-171, Intro to A.I. Mid-term Exam Winter Quarter, 2014 YOUR NAME: YOUR ID: ID TO RIGHT: ROW: SEAT NO.: The exam will begin on the next page. Please, do not turn the page until told. When you are told

More information

CS 540: Introduction to Artificial Intelligence

CS 540: Introduction to Artificial Intelligence CS 540: Introduction to Artificial Intelligence Midterm Exam: 7:15-9:15 pm, October, 014 Room 140 CS Building CLOSED BOOK (one sheet of notes and a calculator allowed) Write your answers on these pages

More information

Spring 2007 Midterm Exam

Spring 2007 Midterm Exam 15-381 Spring 2007 Midterm Exam Spring 2007 March 8 Name: Andrew ID: This is an open-book, open-notes examination. You have 80 minutes to complete this examination. Unless explicitly requested, we do not

More information

CS 416, Artificial Intelligence Midterm Examination Fall 2004

CS 416, Artificial Intelligence Midterm Examination Fall 2004 CS 416, Artificial Intelligence Midterm Examination Fall 2004 Name: This is a closed book, closed note exam. All questions and subquestions are equally weighted. Introductory Material 1) True or False:

More information

CS-171, Intro to A.I. Mid-term Exam Summer Quarter, 2016

CS-171, Intro to A.I. Mid-term Exam Summer Quarter, 2016 CS-171, Intro to A.I. Mid-term Exam Summer Quarter, 2016 YOUR NAME: YOUR ID: ID TO RIGHT: ROW: SEAT: The exam will begin on the next page. Please, do not turn the page until told. When you are told to

More information

Artificial Intelligence. Chapters Reviews. Readings: Chapters 3-8 of Russell & Norvig.

Artificial Intelligence. Chapters Reviews. Readings: Chapters 3-8 of Russell & Norvig. Artificial Intelligence Chapters Reviews Readings: Chapters 3-8 of Russell & Norvig. Topics covered in the midterm Solving problems by searching (Chap. 3) How to formulate a search problem? How to measure

More information

Introduction to Fall 2014 Artificial Intelligence Midterm Solutions

Introduction to Fall 2014 Artificial Intelligence Midterm Solutions CS Introduction to Fall Artificial Intelligence Midterm Solutions INSTRUCTIONS You have minutes. The exam is closed book, closed notes except a one-page crib sheet. Please use non-programmable calculators

More information

Introduction to Spring 2007 Artificial Intelligence Midterm Solutions

Introduction to Spring 2007 Artificial Intelligence Midterm Solutions NAME: SID#: Login: Sec: CS 88 Introduction to Spring 2007 Artificial Intelligence Midterm Solutions You have 80 minutes. There are five questions with equal points. Look at all the five questions and answer

More information

CS 540: Introduction to Artificial Intelligence

CS 540: Introduction to Artificial Intelligence CS 540: Introduction to Artificial Intelligence Final Exam: 12:25-2:25pm, December 17, 2014 Room 132 Noland CLOSED BOOK (two sheets of notes and a calculator allowed) Write your answers on these pages

More information

EECS 492 Midterm #1. Example Questions. Note: Not a complete exam!

EECS 492 Midterm #1. Example Questions. Note: Not a complete exam! EECS 492 Midterm #1 Example Questions Note: Not a complete exam! General Instructions This exam is closed book, except that you are allowed to refer to a single sheet of paper. You may use a calculator

More information

CS-171, Intro to A.I. Mid-term Exam Fall Quarter, 2013

CS-171, Intro to A.I. Mid-term Exam Fall Quarter, 2013 CS-171, Intro to A.I. Mid-term Exam Fall Quarter, 2013 YOUR NAME AND ID NUMBER: YOUR ID: ID TO RIGHT: ROW: NO. FROM RIGHT: The exam will begin on the next page. Please, do not turn the page until told.

More information

CPSC 217 Assignment 3

CPSC 217 Assignment 3 CPSC 217 Assignment 3 Due: Monday November 23, 2015 at 12:00 noon Weight: 7% Sample Solution Length: 135 lines, including some comments (not including the provided code) Individual Work: All assignments

More information

Midterm Examination CS540-2: Introduction to Artificial Intelligence

Midterm Examination CS540-2: Introduction to Artificial Intelligence Midterm Examination CS540-2: Introduction to Artificial Intelligence March 15, 2018 LAST NAME: FIRST NAME: Problem Score Max Score 1 12 2 13 3 9 4 11 5 8 6 13 7 9 8 16 9 9 Total 100 Question 1. [12] Search

More information

Program of Study. Artificial Intelligence 1. Shane Torbert TJHSST

Program of Study. Artificial Intelligence 1. Shane Torbert TJHSST Program of Study Artificial Intelligence 1 Shane Torbert TJHSST Course Selection Guide Description for 2011/2012: Course Title: Artificial Intelligence 1 Grade Level(s): 10-12 Unit of Credit: 0.5 Prerequisite:

More information

Outline. Informed Search. Recall: Uninformed Search. An Idea. Heuristics Informed search techniques More on heuristics Iterative improvement

Outline. Informed Search. Recall: Uninformed Search. An Idea. Heuristics Informed search techniques More on heuristics Iterative improvement Outline Informed Search ECE457 Applied Artificial Intelligence Fall 2007 Lecture #3 Heuristics Informed search techniques More on heuristics Iterative improvement Russell & Norvig, chapter 4 Skip Genetic

More information

INTRODUCTION TO HEURISTIC SEARCH

INTRODUCTION TO HEURISTIC SEARCH INTRODUCTION TO HEURISTIC SEARCH What is heuristic search? Given a problem in which we must make a series of decisions, determine the sequence of decisions which provably optimizes some criterion. What

More information

CS 4700: Artificial Intelligence

CS 4700: Artificial Intelligence CS 4700: Foundations of Artificial Intelligence Fall 2017 Instructor: Prof. Haym Hirsh Lecture 8 Today Informed Search (R&N Ch 3,4) Adversarial search (R&N Ch 5) Adversarial Search (R&N Ch 5) Homework

More information

Propositional logic (Ch. 7)

Propositional logic (Ch. 7) Propositional logic (Ch. 7) Announcements Writing 2 graded - 2 weeks from today to resubmit Complete-state CSP So far we have been looking at incremental search (adding one value at a time) Complete-state

More information

CS1800 Discrete Structures Fall 2016 Profs. Aslam, Gold, Ossowski, Pavlu, & Sprague December 16, CS1800 Discrete Structures Final

CS1800 Discrete Structures Fall 2016 Profs. Aslam, Gold, Ossowski, Pavlu, & Sprague December 16, CS1800 Discrete Structures Final CS1800 Discrete Structures Fall 2016 Profs. Aslam, Gold, Ossowski, Pavlu, & Sprague December 16, 2016 Instructions: CS1800 Discrete Structures Final 1. The exam is closed book and closed notes. You may

More information

Constraint Satisfaction Problems (CSPs)

Constraint Satisfaction Problems (CSPs) Constraint Satisfaction Problems (CSPs) CPSC 322 CSP 1 Poole & Mackworth textbook: Sections 4.0-4.2 Lecturer: Alan Mackworth September 28, 2012 Problem Type Static Sequential Constraint Satisfaction Logic

More information

Hill Climbing. Assume a heuristic value for each assignment of values to all variables. Maintain an assignment of a value to each variable.

Hill Climbing. Assume a heuristic value for each assignment of values to all variables. Maintain an assignment of a value to each variable. Hill Climbing Many search spaces are too big for systematic search. A useful method in practice for some consistency and optimization problems is hill climbing: Assume a heuristic value for each assignment

More information

CS 540-1: Introduction to Artificial Intelligence

CS 540-1: Introduction to Artificial Intelligence CS 540-1: Introduction to Artificial Intelligence Exam 1: 7:15-9:15pm, October 11, 1995 CLOSED BOOK (one page of notes allowed) Write your answers on these pages and show your work. If you feel that a

More information

Artificial Intelligence

Artificial Intelligence Artificial Intelligence Informed Search and Exploration Chapter 4 (4.3 4.6) Searching: So Far We ve discussed how to build goal-based and utility-based agents that search to solve problems We ve also presented

More information

ANSWERS TO / Midterm, Spring 2002

ANSWERS TO / Midterm, Spring 2002 Name: Andrew Id (Block Capitals): ANSWERS TO 6-73/5-78 Midterm, Spring Tuesday Mar,. Place your name and your andrew email address on the front page.. You may use any and all notes, as well as the class

More information

Advanced A* Improvements

Advanced A* Improvements Advanced A* Improvements 1 Iterative Deepening A* (IDA*) Idea: Reduce memory requirement of A* by applying cutoff on values of f Consistent heuristic function h Algorithm IDA*: 1. Initialize cutoff to

More information

Branch & Bound (B&B) and Constraint Satisfaction Problems (CSPs)

Branch & Bound (B&B) and Constraint Satisfaction Problems (CSPs) Branch & Bound (B&B) and Constraint Satisfaction Problems (CSPs) Alan Mackworth UBC CS 322 CSP 1 January 25, 2013 P&M textbook 3.7.4 & 4.0-4.2 Lecture Overview Recap Branch & Bound Wrap up of search module

More information

10-701/15-781, Fall 2006, Final

10-701/15-781, Fall 2006, Final -7/-78, Fall 6, Final Dec, :pm-8:pm There are 9 questions in this exam ( pages including this cover sheet). If you need more room to work out your answer to a question, use the back of the page and clearly

More information

Introduction to AI Spring 2006 Dan Klein Midterm Solutions

Introduction to AI Spring 2006 Dan Klein Midterm Solutions NAME: SID#: Login: Sec: 1 CS 188 Introduction to AI Spring 2006 Dan Klein Midterm Solutions 1. (20 pts.) True/False Each problem is worth 2 points. Incorrect answers are worth 0 points. Skipped questions

More information

COMP SCI 5400 SP2017 Exam 1 Key

COMP SCI 5400 SP2017 Exam 1 Key COMP SCI 5400 SP2017 Exam 1 Key This is a closed-book, closed-notes exam. The only items you are permitted to use are writing implements. Mark each sheet of paper you use with your name and the string

More information

Name: UW CSE 473 Midterm, Fall 2014

Name: UW CSE 473 Midterm, Fall 2014 Instructions Please answer clearly and succinctly. If an explanation is requested, think carefully before writing. Points may be removed for rambling answers. If a question is unclear or ambiguous, feel

More information

3.6.2 Generating admissible heuristics from relaxed problems

3.6.2 Generating admissible heuristics from relaxed problems 3.6.2 Generating admissible heuristics from relaxed problems To come up with heuristic functions one can study relaxed problems from which some restrictions of the original problem have been removed The

More information

Propositional logic (Ch. 7)

Propositional logic (Ch. 7) Propositional logic (Ch. 7) Announcements Writing 3 due Sunday - ideally use for project - if you haven't decided project by then, you will have to redo this work Logic: definitions We say that two sentences

More information

CMSC 201 Spring 2018 Project 3 Minesweeper

CMSC 201 Spring 2018 Project 3 Minesweeper CMSC 201 Spring 2018 Project 3 Minesweeper Assignment: Project 3 Minesweeper Due Date: Design Document: Friday, May 4th, 2018 by 8:59:59 PM Project: Friday, May 11th, 2018 by 8:59:59 PM Value: 80 points

More information

Introduction to Computer Science and Programming for Astronomers

Introduction to Computer Science and Programming for Astronomers Introduction to Computer Science and Programming for Astronomers Lecture 9. István Szapudi Institute for Astronomy University of Hawaii March 21, 2018 Outline Reminder 1 Reminder 2 3 Reminder We have demonstrated

More information

Artificial Intelligence

Artificial Intelligence Artificial Intelligence Information Systems and Machine Learning Lab (ISMLL) Tomáš Horváth 10 rd November, 2010 Informed Search and Exploration Example (again) Informed strategy we use a problem-specific

More information

2006/2007 Intelligent Systems 1. Intelligent Systems. Prof. dr. Paul De Bra Technische Universiteit Eindhoven

2006/2007 Intelligent Systems 1. Intelligent Systems. Prof. dr. Paul De Bra Technische Universiteit Eindhoven test gamma 2006/2007 Intelligent Systems 1 Intelligent Systems Prof. dr. Paul De Bra Technische Universiteit Eindhoven debra@win.tue.nl 2006/2007 Intelligent Systems 2 Informed search and exploration Best-first

More information

Searching. Assume goal- or utilitybased. Next task to achieve is to determine the best path to the goal

Searching. Assume goal- or utilitybased. Next task to achieve is to determine the best path to the goal Searching Assume goal- or utilitybased agents: state information ability to perform actions goals to achieve Next task to achieve is to determine the best path to the goal CSC384 Lecture Slides Steve Engels,

More information

CS 520: Introduction to Artificial Intelligence. Review

CS 520: Introduction to Artificial Intelligence. Review CS 520: Introduction to Artificial Intelligence Prof. Louis Steinberg Lecture 2: state spaces uninformed search 1 What is AI? A set of goals Review build an artificial intelligence useful subgoals A class

More information

Data Structures and Algorithms

Data Structures and Algorithms Data Structures and Algorithms Session 26. April 29, 2009 Instructor: Bert Huang http://www.cs.columbia.edu/~bert/courses/3137 Announcements Homework 6 due before last class: May 4th Final Review May 4th

More information

CS1800 Discrete Structures Fall 2016 Profs. Aslam, Gold, Ossowski, Pavlu, & Sprague December 16, CS1800 Discrete Structures Final

CS1800 Discrete Structures Fall 2016 Profs. Aslam, Gold, Ossowski, Pavlu, & Sprague December 16, CS1800 Discrete Structures Final CS1800 Discrete Structures Fall 2016 Profs. Aslam, Gold, Ossowski, Pavlu, & Sprague December 16, 2016 Instructions: CS1800 Discrete Structures Final 1. The exam is closed book and closed notes. You may

More information

Gradient Descent. 1) S! initial state 2) Repeat: Similar to: - hill climbing with h - gradient descent over continuous space

Gradient Descent. 1) S! initial state 2) Repeat: Similar to: - hill climbing with h - gradient descent over continuous space Local Search 1 Local Search Light-memory search method No search tree; only the current state is represented! Only applicable to problems where the path is irrelevant (e.g., 8-queen), unless the path is

More information

521495A: Artificial Intelligence

521495A: Artificial Intelligence 521495A: Artificial Intelligence Search Lectured by Abdenour Hadid Associate Professor, CMVS, University of Oulu Slides adopted from http://ai.berkeley.edu Agent An agent is an entity that perceives the

More information

CSCI-630 Foundations of Intelligent Systems Fall 2015, Prof. Zanibbi

CSCI-630 Foundations of Intelligent Systems Fall 2015, Prof. Zanibbi CSCI-630 Foundations of Intelligent Systems Fall 2015, Prof. Zanibbi Midterm Examination Name: October 16, 2015. Duration: 50 minutes, Out of 50 points Instructions If you have a question, please remain

More information

10703 Deep Reinforcement Learning and Control

10703 Deep Reinforcement Learning and Control 10703 Deep Reinforcement Learning and Control Russ Salakhutdinov Machine Learning Department rsalakhu@cs.cmu.edu Policy Gradient I Used Materials Disclaimer: Much of the material and slides for this lecture

More information

CS 188: Artificial Intelligence Spring Today

CS 188: Artificial Intelligence Spring Today CS 188: Artificial Intelligence Spring 2006 Lecture 7: CSPs II 2/7/2006 Dan Klein UC Berkeley Many slides from either Stuart Russell or Andrew Moore Today More CSPs Applications Tree Algorithms Cutset

More information

CSC242: Intro to AI. Lecture 8 LOGIC

CSC242: Intro to AI. Lecture 8 LOGIC CSC242: Intro to AI Lecture 8 LOGIC Propositional Logic Fly Problem-solving state Transition Model World state Action Arad Sibiu Timosoara Zerind Rimnicu Vilcea Arad Arad Lugoj Arad Oradea Faragas Oradea

More information

Problem 1 Zero: 11% (~20 students), Partial: 66% (~120 students), Perfect: 23% (~43 students)

Problem 1 Zero: 11% (~20 students), Partial: 66% (~120 students), Perfect: 23% (~43 students) For each question on the Mid-term Exam, Zero below gives the fraction of students who scored zero, Partial gives the fraction who got partial credit, and Perfect gives the fraction who scored 100%. Problem

More information

Final Exam. Introduction to Artificial Intelligence. CS 188 Spring 2010 INSTRUCTIONS. You have 3 hours.

Final Exam. Introduction to Artificial Intelligence. CS 188 Spring 2010 INSTRUCTIONS. You have 3 hours. CS 188 Spring 2010 Introduction to Artificial Intelligence Final Exam INSTRUCTIONS You have 3 hours. The exam is closed book, closed notes except a two-page crib sheet. Please use non-programmable calculators

More information

CS510 \ Lecture Ariel Stolerman

CS510 \ Lecture Ariel Stolerman CS510 \ Lecture02 2012-10-03 1 Ariel Stolerman Midterm Evan will email about that after the lecture, at least 2 lectures from now. The exam will be given in a regular PDF (not an online form). We will

More information

CS 4700: Artificial Intelligence

CS 4700: Artificial Intelligence CS 4700: Foundations of Artificial Intelligence Fall 2017 Instructor: Prof. Haym Hirsh Lecture 7 Extra Credit Opportunity: Lecture Today 4:15pm Gates G01 Learning to See Without a Teacher Phillip Isola

More information

Faculty of Science FINAL EXAMINATION COMP-250 A Introduction to Computer Science School of Computer Science, McGill University

Faculty of Science FINAL EXAMINATION COMP-250 A Introduction to Computer Science School of Computer Science, McGill University NAME: STUDENT NUMBER:. Faculty of Science FINAL EXAMINATION COMP-250 A Introduction to Computer Science School of Computer Science, McGill University Examimer: Prof. Mathieu Blanchette December 8 th 2005,

More information

CS Introduction to Artificial Intelligence

CS Introduction to Artificial Intelligence CS 540-1 -- Introduction to Artificial Intelligence Final Exam - December 16, 1992 (Rm 6203, Soc Sci Building) CLOSED BOOK 120 minutes (5:05-7:05 pm) Write your answers on these pages and show your work.

More information

CS 188: Artificial Intelligence. Recap Search I

CS 188: Artificial Intelligence. Recap Search I CS 188: Artificial Intelligence Review of Search, CSPs, Games DISCLAIMER: It is insufficient to simply study these slides, they are merely meant as a quick refresher of the high-level ideas covered. You

More information

Homework #6 (Constraint Satisfaction, Non-Deterministic Uncertainty and Adversarial Search) Out: 2/21/11 Due: 2/29/11 (at noon)

Homework #6 (Constraint Satisfaction, Non-Deterministic Uncertainty and Adversarial Search) Out: 2/21/11 Due: 2/29/11 (at noon) CS121 Introduction to Artificial Intelligence Winter 2011 Homework #6 (Constraint Satisfaction, Non-Deterministic Uncertainty and Adversarial Search) Out: 2/21/11 Due: 2/29/11 (at noon) How to complete

More information

CS347 FS2003 Final Exam Model Answers

CS347 FS2003 Final Exam Model Answers CS347 FS003 Final Exam Model Answers This is a closed-book test. The only item not supplied that you are allowed (and required) to use, is a pen or pencil. Mark all paper you use with your name, the date,

More information

Midterm Examination CS 540-2: Introduction to Artificial Intelligence

Midterm Examination CS 540-2: Introduction to Artificial Intelligence Midterm Examination CS 54-2: Introduction to Artificial Intelligence March 9, 217 LAST NAME: FIRST NAME: Problem Score Max Score 1 15 2 17 3 12 4 6 5 12 6 14 7 15 8 9 Total 1 1 of 1 Question 1. [15] State

More information

DIT411/TIN175, Artificial Intelligence. Peter Ljunglöf. 23 January, 2018

DIT411/TIN175, Artificial Intelligence. Peter Ljunglöf. 23 January, 2018 DIT411/TIN175, Artificial Intelligence Chapters 3 4: More search algorithms CHAPTERS 3 4: MORE SEARCH ALGORITHMS DIT411/TIN175, Artificial Intelligence Peter Ljunglöf 23 January, 2018 1 TABLE OF CONTENTS

More information

Question 1: 25% of students lost more than 2 points Question 2: 50% of students lost 2-4 points; 50% got it entirely correct Question 3: 95% of

Question 1: 25% of students lost more than 2 points Question 2: 50% of students lost 2-4 points; 50% got it entirely correct Question 3: 95% of Question 1: 25% of students lost more than 2 points Question 2: 50% of students lost 2-4 points; 50% got it entirely correct Question 3: 95% of students got this problem entirely correct Question 4: Only

More information

C P E / C S C A RTIFICIAL I N T E L L I G E N C E M I D T E R M S E C T I O N 1 FA L L

C P E / C S C A RTIFICIAL I N T E L L I G E N C E M I D T E R M S E C T I O N 1 FA L L C P E / C S C 4 8 0 A RTIFICIAL I N T E L L I G E N C E M I D T E R M S E C T I O N 1 FA L L 2 0 0 5 PRO F. FRANZ J. KURFESS CAL POL Y, COMPUTER SCIENCE DE PARTMENT This is the Fall 2005 midterm exam for

More information

Introduction to Fall 2008 Artificial Intelligence Midterm Exam

Introduction to Fall 2008 Artificial Intelligence Midterm Exam CS 188 Introduction to Fall 2008 Artificial Intelligence Midterm Exam INSTRUCTIONS You have 80 minutes. 70 points total. Don t panic! The exam is closed book, closed notes except a one-page crib sheet,

More information

Uninformed Search. Problem-solving agents. Tree search algorithms. Single-State Problems

Uninformed Search. Problem-solving agents. Tree search algorithms. Single-State Problems Uninformed Search Problem-solving agents Tree search algorithms Single-State Problems Breadth-First Search Depth-First Search Limited-Depth Search Iterative Deepening Extensions Graph search algorithms

More information

Question. Lecture 6: Search II. Paradigm. Review

Question. Lecture 6: Search II. Paradigm. Review Lecture 6: Search II cs221.stanford.edu/q Question Suppose we want to travel from city 1 to city n (going only forward) and back to city 1 (only going backward). It costs c ij 0 to go from i to j. Which

More information

Informed Search Algorithms. Chapter 4

Informed Search Algorithms. Chapter 4 Informed Search Algorithms Chapter 4 Outline Informed Search and Heuristic Functions For informed search, we use problem-specific knowledge to guide the search. Topics: Best-first search A search Heuristics

More information

CS2 Algorithms and Data Structures Note 10. Depth-First Search and Topological Sorting

CS2 Algorithms and Data Structures Note 10. Depth-First Search and Topological Sorting CS2 Algorithms and Data Structures Note 10 Depth-First Search and Topological Sorting In this lecture, we will analyse the running time of DFS and discuss a few applications. 10.1 A recursive implementation

More information

Informed search algorithms. Chapter 4

Informed search algorithms. Chapter 4 Informed search algorithms Chapter 4 Outline Best-first search Greedy best-first search A * search Heuristics Memory Bounded A* Search Best-first search Idea: use an evaluation function f(n) for each node

More information

CSC242: Intro to AI. Lecture 10. Tuesday, February 26, 13

CSC242: Intro to AI. Lecture 10. Tuesday, February 26, 13 CSC242: Intro to AI Lecture 10 No Quiz Propositional Logic Propositional Logic Fly Problem-solving state Transition Model World state Action Arad Sibiu Timosoara Zerind Rimnicu Vilcea Arad Arad Lugoj

More information

York University AK/ITEC OBJECT-BASED PROGRAMMING. Midterm Test Sample. Examiner: S.Y. Chen Duration: One Hour and Fifteen Minutes

York University AK/ITEC OBJECT-BASED PROGRAMMING. Midterm Test Sample. Examiner: S.Y. Chen Duration: One Hour and Fifteen Minutes York University AK/ITEC 1620 3.0 OBJECT-BASED PROGRAMMING Midterm Test Sample Examiner: S.Y. Chen Duration: One Hour and Fifteen Minutes This exam is closed textbook(s) and closed notes. Use of any electronic

More information

Outline for today s lecture. Informed Search. Informed Search II. Review: Properties of greedy best-first search. Review: Greedy best-first search:

Outline for today s lecture. Informed Search. Informed Search II. Review: Properties of greedy best-first search. Review: Greedy best-first search: Outline for today s lecture Informed Search II Informed Search Optimal informed search: A* (AIMA 3.5.2) Creating good heuristic functions Hill Climbing 2 Review: Greedy best-first search: f(n): estimated

More information

Beyond Classical Search: Local Search. CMPSCI 383 September 23, 2011

Beyond Classical Search: Local Search. CMPSCI 383 September 23, 2011 Beyond Classical Search: Local Search CMPSCI 383 September 23, 2011 1 Today s lecture Local Search Hill-climbing Simulated annealing Local beam search Genetic algorithms Genetic programming Local search

More information

Introduction to Fall 2010 Artificial Intelligence Midterm Exam

Introduction to Fall 2010 Artificial Intelligence Midterm Exam CS 188 Introduction to Fall 2010 Artificial Intelligence Midterm Exam INSTRUCTIONS You have 3 hours. The exam is closed book, closed notes except a one-page crib sheet. Please use non-programmable calculators

More information

Lecture 9. Heuristic search, continued. CS-424 Gregory Dudek

Lecture 9. Heuristic search, continued. CS-424 Gregory Dudek Lecture 9 Heuristic search, continued A* revisited Reminder: with A* we want to find the best-cost (C ) path to the goal first. To do this, all we have to do is make sure our cost estimates are less than

More information

Informed Search and Exploration

Informed Search and Exploration Informed Search and Exploration Chapter 4 (4.1-4.3) CS 2710 1 Introduction Ch.3 searches good building blocks for learning about search But vastly inefficient eg: Can we do better? Breadth Depth Uniform

More information

CSC384 Midterm Sample Questions

CSC384 Midterm Sample Questions CSC384 Midterm Sample Questions Fall 2016 1 Search Short Answer 1. It would seem that iterative deepening search should have a higher asymptotic time complexity than breadth-first search because every

More information

EE562 ARTIFICIAL INTELLIGENCE FOR ENGINEERS

EE562 ARTIFICIAL INTELLIGENCE FOR ENGINEERS EE562 ARTIFICIAL INTELLIGENCE FOR ENGINEERS Lecture 4, 4/11/2005 University of Washington, Department of Electrical Engineering Spring 2005 Instructor: Professor Jeff A. Bilmes Today: Informed search algorithms

More information

Artificial Intelligence

Artificial Intelligence Artificial Intelligence Lesson 1 1 About Lecturer: Prof. Sarit Kraus TA: Galit Haim: haimga@cs.biu.ac.il (almost) All you need can be found on the course website: http://u.cs.biu.ac.il/~haimga/teaching/ai/

More information

CS 331: Artificial Intelligence Informed Search. Informed Search

CS 331: Artificial Intelligence Informed Search. Informed Search CS 331: Artificial Intelligence Informed Search 1 Informed Search How can we make search smarter? Use problem-specific knowledge beyond the definition of the problem itself Specifically, incorporate knowledge

More information

Today. CS 188: Artificial Intelligence Fall Example: Boolean Satisfiability. Reminder: CSPs. Example: 3-SAT. CSPs: Queries.

Today. CS 188: Artificial Intelligence Fall Example: Boolean Satisfiability. Reminder: CSPs. Example: 3-SAT. CSPs: Queries. CS 188: Artificial Intelligence Fall 2007 Lecture 5: CSPs II 9/11/2007 More CSPs Applications Tree Algorithms Cutset Conditioning Today Dan Klein UC Berkeley Many slides over the course adapted from either

More information

Introduction to Artificial Intelligence Midterm 1. CS 188 Spring You have approximately 2 hours.

Introduction to Artificial Intelligence Midterm 1. CS 188 Spring You have approximately 2 hours. CS 88 Spring 0 Introduction to Artificial Intelligence Midterm You have approximately hours. The exam is closed book, closed notes except your one-page crib sheet. Please use non-programmable calculators

More information

Uninformed Search. Reading: Chapter 4 (Tuesday, 2/5) HW#1 due next Tuesday

Uninformed Search. Reading: Chapter 4 (Tuesday, 2/5) HW#1 due next Tuesday Uninformed Search Reading: Chapter 4 (Tuesday, 2/5) HW#1 due next Tuesday 1 Uninformed Search through the space of possible solutions Use no knowledge about which path is likely to be best Exception: uniform

More information

CS 188: Artificial Intelligence Fall 2008

CS 188: Artificial Intelligence Fall 2008 CS 188: Artificial Intelligence Fall 2008 Lecture 4: CSPs 9/9/2008 Dan Klein UC Berkeley Many slides over the course adapted from either Stuart Russell or Andrew Moore 1 1 Announcements Grading questions:

More information

Announcements. CS 188: Artificial Intelligence Fall Large Scale: Problems with A* What is Search For? Example: N-Queens

Announcements. CS 188: Artificial Intelligence Fall Large Scale: Problems with A* What is Search For? Example: N-Queens CS 188: Artificial Intelligence Fall 2008 Announcements Grading questions: don t panic, talk to us Newsgroup: check it out Lecture 4: CSPs 9/9/2008 Dan Klein UC Berkeley Many slides over the course adapted

More information

CS 188: Artificial Intelligence

CS 188: Artificial Intelligence CS 188: Artificial Intelligence CSPs II + Local Search Prof. Scott Niekum The University of Texas at Austin [These slides based on those of Dan Klein and Pieter Abbeel for CS188 Intro to AI at UC Berkeley.

More information

Informed search algorithms. Chapter 4

Informed search algorithms. Chapter 4 Informed search algorithms Chapter 4 Material Chapter 4 Section 1 - Exclude memory-bounded heuristic search 3 Outline Best-first search Greedy best-first search A * search Heuristics Local search algorithms

More information

Problem A: Collatz Conjecture

Problem A: Collatz Conjecture Problem A: Collatz Conjecture The Collatz conjecture which is also known as the 3n + conjecture is a very well known and old conjecture in mathematics. The conjecture is as follows. Take any natural number

More information

Practice Midterm Exam Solutions

Practice Midterm Exam Solutions CS 470/670 Introduction to AI Spring 2016 Instructor: Marc Pomplun Practice Midterm Exam Solutions Duration: 75 minutes Question 1: out of points Question 2: out of points Question 3: out of points Question

More information

CS 331: Artificial Intelligence Informed Search. Informed Search

CS 331: Artificial Intelligence Informed Search. Informed Search CS 331: Artificial Intelligence Informed Search 1 Informed Search How can we make search smarter? Use problem-specific knowledge beyond the definition of the problem itself Specifically, incorporate knowledge

More information

Uninformed Search Methods. Informed Search Methods. Midterm Exam 3/13/18. Thursday, March 15, 7:30 9:30 p.m. room 125 Ag Hall

Uninformed Search Methods. Informed Search Methods. Midterm Exam 3/13/18. Thursday, March 15, 7:30 9:30 p.m. room 125 Ag Hall Midterm Exam Thursday, March 15, 7:30 9:30 p.m. room 125 Ag Hall Covers topics through Decision Trees and Random Forests (does not include constraint satisfaction) Closed book 8.5 x 11 sheet with notes

More information

Constraint Satisfaction Problems. Chapter 6

Constraint Satisfaction Problems. Chapter 6 Constraint Satisfaction Problems Chapter 6 Office hours Office hours for Assignment 1 (ASB9810 in CSIL): Sep 29th(Fri) 12:00 to 13:30 Oct 3rd(Tue) 11:30 to 13:00 Late homework policy You get four late

More information

6.034 Quiz 1, Spring 2004 Solutions

6.034 Quiz 1, Spring 2004 Solutions 6.034 Quiz 1, Spring 2004 Solutions Open Book, Open Notes 1 Tree Search (12 points) Consider the tree shown below. The numbers on the arcs are the arc lengths. Assume that the nodes are expanded in alphabetical

More information

Solving Minesweeper Using CSP

Solving Minesweeper Using CSP Solving Minesweeper Using CSP AI Course Final Project Gil & Chai Usage (After using Makefile) java player/aiplayer

More information

The exam is closed book, closed calculator, and closed notes except your one-page crib sheet.

The exam is closed book, closed calculator, and closed notes except your one-page crib sheet. CS Summer Introduction to Artificial Intelligence Midterm You have approximately minutes. The exam is closed book, closed calculator, and closed notes except your one-page crib sheet. Mark your answers

More information

Outline. Best-first search. Greedy best-first search A* search Heuristics Local search algorithms

Outline. Best-first search. Greedy best-first search A* search Heuristics Local search algorithms Outline Best-first search Greedy best-first search A* search Heuristics Local search algorithms Hill-climbing search Beam search Simulated annealing search Genetic algorithms Constraint Satisfaction Problems

More information

a. Given that we search depth first from left to right, list all leaf nodes above that we need to search/expand. (35 Points)

a. Given that we search depth first from left to right, list all leaf nodes above that we need to search/expand. (35 Points) Name: Course: CAP 4601 Semester: Summer 2013 Assignment: Assignment 06 Date: 08 JUL 2013 Complete the following written problems: 1. Alpha-Beta Pruning (40 Points). Consider the following min-max tree.

More information

Announcements. CS 188: Artificial Intelligence Fall Reminder: CSPs. Today. Example: 3-SAT. Example: Boolean Satisfiability.

Announcements. CS 188: Artificial Intelligence Fall Reminder: CSPs. Today. Example: 3-SAT. Example: Boolean Satisfiability. CS 188: Artificial Intelligence Fall 2008 Lecture 5: CSPs II 9/11/2008 Announcements Assignments: DUE W1: NOW P1: Due 9/12 at 11:59pm Assignments: UP W2: Up now P2: Up by weekend Dan Klein UC Berkeley

More information

CS 188: Artificial Intelligence Fall 2008

CS 188: Artificial Intelligence Fall 2008 CS 188: Artificial Intelligence Fall 2008 Lecture 5: CSPs II 9/11/2008 Dan Klein UC Berkeley Many slides over the course adapted from either Stuart Russell or Andrew Moore 1 1 Assignments: DUE Announcements

More information

Bayesian Methods in Vision: MAP Estimation, MRFs, Optimization

Bayesian Methods in Vision: MAP Estimation, MRFs, Optimization Bayesian Methods in Vision: MAP Estimation, MRFs, Optimization CS 650: Computer Vision Bryan S. Morse Optimization Approaches to Vision / Image Processing Recurring theme: Cast vision problem as an optimization

More information

CS 4349 Lecture October 18th, 2017

CS 4349 Lecture October 18th, 2017 CS 4349 Lecture October 18th, 2017 Main topics for #lecture include #minimum_spanning_trees. Prelude Homework 6 due today. Homework 7 due Wednesday, October 25th. Homework 7 has one normal homework problem.

More information

CS273 Midterm Exam Introduction to Machine Learning: Winter 2015 Tuesday February 10th, 2014

CS273 Midterm Exam Introduction to Machine Learning: Winter 2015 Tuesday February 10th, 2014 CS273 Midterm Eam Introduction to Machine Learning: Winter 2015 Tuesday February 10th, 2014 Your name: Your UCINetID (e.g., myname@uci.edu): Your seat (row and number): Total time is 80 minutes. READ THE

More information