Aspect Transition Graph: an Affordance-Based Model
|
|
- Dale Floyd
- 6 years ago
- Views:
Transcription
1 Aspect Transition Graph: an Affordance-Based Model Li Yang Ku, Shiraj Sen, Erik G. Learned-Miller, and Roderic A. Grupen School of Computer Science University of Massachusetts Amherst Amherst, Massachusetts lku, shiraj, elm, Abstract. In this work we introduce the Aspect Transition Graph (ATG), an affordance-based model that is grounded in the robot s own actions and perceptions. An ATG summarizes how observations of an object or the environment changes in the course of interaction. Through the Robonaut 2 simulator, we demonstrate that by exploiting these learned models the robot can recognize objects and manipulate them to reach certain goal state. Keywords: Robotic Perception, Object Recognition, Belief-Space Planning 1 Introduction The term affordance first introduced by Gibson [2] has many interpretations, we prefer the definition of affordance as the opportunities for action provided by a particular object or environment. Affordance can be used to explain how the value or meaning of things in the environment is perceived. Our models are based on this interactionist view of perception and action that focus on learning relationships between objects and actions specific to the robot. Some recent work [6] [8] [13] in computer vision and robotics extended this concept of affordance and applied it to object classification and object manipulation. Affordances can be associated with parts of an object as, for example in the work done by Varadarajan [16] [15], where predefined base affordances are associated with surface types. In our work, we build models that inform inference in an extension of Gibson s original ideas about direct perception [3] [5]. Affordances describe the interaction between an agent and an object (or environment). For example [2], a chair that is sittable for a grown-up might not be sittable for a child. In this work we introduce the Aspect Transition Graph (ATG), an affordance-based model that is grounded in the robot s own actions and perceptions. Instead of defining object affordances from a human perspective, they are learned by direct interaction on the part of the robot. Using the Robonaut 2 simulator [1], we demonstrate that by exploiting these learned models the robot can recognize objects and manipulate them to reach goal states.
2 2 authors running 2 Aspect Transition Graph Fig. 1. An example of an incomplete aspect transition graph (ATG) of a cube. Each aspect consists of an observation of two faces of the cube. The lower right figure shows the coordinate frame of the actions and the aspect in the upper right is the collection node representing all unknown aspects of the object that may be present. Each solid edge represents a transition between aspects associated with a particular action. Each dotted edge is a transition that may not yet have been observed. Aspect Graphs were first introduced to represent shape [9] [4] in the field of computer vision. An Aspect Graph contains distinctive views of an object captured from a viewing sphere centered on the object. The Aspect Transition Graph introduced in this paper is an extension of this concept. In addition to distinctive views, the object model summarizes how actions change viewpoints or the state of the object and thus, the observation. Besides visual sensors, extensions to tactile, auditory and other sensors also become possible with this representation. The term Aspect Transition Graph was first used in [12] but redefined in this work. An object in our framework is represented using a directed graph G = (X, U), composed of a set of aspect nodes X connected by a set of action edges U that capture the probabilistic transition between the aspect nodes. Each aspect x X represents the properties of an object that are measurable given a set of sensors and their relative geometry to the object. The ATG summarizes empirical observations of aspect transitions in the course of interaction. The ATG of an object is complete if it contains all possible aspect nodes and node transitions. However, in practice, when ATGs are learned through exploration they are almost always incomplete. In addition, an object might be represented by multiple (incomplete) ATGs. A complete model is more informative but harder to learn autonomously. In this paper, we will focus on handling
3 title running 3 incomplete object models. Each of our ATG models have a single collection node representing all unobserved aspects. Figure 1 shows an example of an incomplete ATG on a cube object with a character on each face. 3 Modeling and Recognition The robot memory M is defined as a set of ATGs that the robot created through past interaction. Each ATG in the robot memory represents a single object presented to the robot in the past. An ATG is added to the M only if the presented object is judged to be novel. Although the robot might not have seen all the objects or all the aspects of each object, to simplify this problem we make this very limiting assumption that the robot knows that O objects exist in the environment and each object has G aspects. If the robot assumes that there are more objects in the environment or more aspects of an object then there actually are, it will bias the judgment toward novelty. Let S T 1 denote the set of objects that have been presented to the robot in the first T 1 trials. Given a sequence of observations z 1:t and actions a 1:t during trial T, the probability that the object presented during trial T, O T, is novel can be calculated; p(o T / S T 1 z 1:t, a 1:t, M) = p(o T = o i z 1:t, a 1:t, M) o i / S T 1 = o i / S T 1 x t X i p(x t z 1:t, a 1:t ). (1) Where o i is an element of set O designating all of the objects in the environment. Element x t of set X i describes all the aspects comprising object o i. The conditional probability p(x t z 1:t, a 1:t ) of observing an aspect can be inferred using a Bayes filter. Object O T is classified as novel if p(o T / S T 1 z 1:t, a 1:t, M) > 0.5. If a particular object is judged to be a previously observed object, we associate it with the ATG that is most likely to generate the same set of observations. The posterior probability of object o i is calculated by summing the conditional probability of observing aspect x t over all aspects comprising object o i, p(o T = o i z 1:t, a 1:t, M) = x t X i p(x t z 1:t, a 1:t ). (2) The posterior probability of an aspect p(x t z 1:t, a 1:t ) is calculated after each measurement and control update using the Bayes Filter Algorithm [14]. 4 Action Selection Strategy The challenge of integrating task-level planners with noisy and incomplete models requires that we confront the partial observability of the state while building
4 4 authors running plans. Since the true state of the system cannot be observed, it must be inferred from the history of observations and actions. Our planner belongs to a set of approaches (for example [7][10]) that select actions to reduce the uncertainty of the state estimate maximally with respect to the task. Object recognition can be viewed as one such task in which the uncertainty over object identities (as quantified by the object entropy) is reduced with each observation. Our task planner selects the action a t that minimizes the expected entropy of the distribution over elements of set O T representing the object identity [11]; argmin E(H(O T z t+1, a t, z 1:t, a 1:t 1 )) a t = argmin H(O T z t+1, a t, z 1:t, a 1:t 1 ) a t z t+1 p(z t+1 a t, z 1:t, a 1:t 1 ). (3) Once the object entropy is lower than a threshold, the robot has high certainty regarding the ATG in robot memory that represents the same object. All aspect nodes in this ATG that are reachable from the current aspect node represent the set of aspects that the robot can observe by executing a sequence of actions. If a goal aspect is in one of these aspects, the actions on the shortest path from the current aspect node to the goal aspect node represents an optimal sequence of actions for achieving the goal state. 5 Experiments We evaluated the capabilities of the proposed affordance models and planner using the Robonaut 2 simulator shown in Figure 2. The simulation contains 100 unique objects called ARcubes that consist of a 28cm cube with unique combinations of ARtags on the six faces; 12 different ARtag patterns are used in this experiment. In an ATG for an ARcube, an aspect consists of ARtag features observed on 2 faces. Each ATG has 24 unique aspects and each aspect has 132 different pattern combinations. For the sake of simplicity, we assume that an object does not have two faces with the same ARtag. The robot can perform 3 different manipulation actions on the object: 1) flip the top face of the cube to the front, 2) rotate the left face of the cube to the front, and 3) rotate the right face of the cube to the front. We emphasize that our model is not restricted to cube like structures and that every inference is based on the combination of observation and action. Table 1 shows the result of using the planner to recognize the object presented. Each test involves 100 trials and starts with an empty robot memory M. In each trial, the task is to decide which ATG in memory the experiment corresponds to or to declare it to be novel. For each trial, an object is chosen at random and presented to the robot. The robot observes the object and executes
5 title running 5 Fig. 2. The simulated Robonaut 2 interacting with an ARcube. an action. This process is repeated 10 times. At the end of each trial the robot determines the likelihood that the presented object is novel and the most likely existing object in memory is identified. The last row in Table 1 presents the results averaged over all the tests. The success rate is the percentage of objects correctly classified, that is, correctly identified in memory or declared as a novel object. The system correctly recognizes the object 90.7% of the time, and correctly determines if the presented object is novel or not 81.6% of the time. Table 1. The success rate of an information theoretic planner in recognizing the object (10 actions per trial) Test Correct Identification Correct Recognition Success Rate 1 80/100 20/21 79% 2 79/100 25/27 77% 3 87/100 21/25 83% 4 78/100 26/28 76% 5 84/100 24/27 81% average 81.6% 90.7% 79.2% We also tested the efficiency of the planner against a random policy. The number of actions executed per trial were varied from 4 to 20. Figure 3 shows how the success rate of a test varies with the number of actions executed per trial. As is evident from the plots, the information theoretic planner outperforms a random exploration policy for all cases except when the number of actions per trial is low. Both algorithms perform equally poor when not enough information is provided. To demonstrate how ATGs can be used to reach certain goal state. We set up an environment where 3 ARcubes are located in front of the simulated Robonaut 2 as shown in Figure 2. The goal is to rotate the cubes till certain faces are ob-
6 6 authors running Fig. 3. The plot shows the average success rate of 10 tests as the number of actions per trial are increased. Selecting actions that minimize entropy leads to a higher success rate then selecting actions at random. servable. The robot starts with a robot memory learned through interacting with 20 different ARcubes including the 3 ARcubes located in the test environment. To achieve the goal state, Robonaut 2 manipulates the object to condense belief over objects. Once the object entropy is lower than a threshold, Robonaut 2 tries to execute the sequence of actions that is on the shortest path from the current aspect node to the goal aspect node in the corresponding ATG if such goal aspect node exists. In this experiment, the simulated Robonaut 2 successfully reaches the goal state by manipulating the cubes so that the observed aspects match the given goal aspects. 6 Discussion This paper introduces an affordance-based model and demonstrates that it can be learned and used to support inference in a simulated environment with discrete actions and observations. To apply this model to real world applications, several challenges need to be addressed. First, in this work we assume that all actions lead to aspect transitions for all objects. A more realistic assumption will relate actions to new aspects probabilistically. Second, unlike ARcubes, real objects do not have a set of unique aspects; metrics such as the deviation of a new observation to past observations can be used to determine if a new aspect is observed. For future work, we plan to address these difficulties and test the ATG model in a more realistic environment. We are also exploring how to represent interactions between multiple objects in the scene and extensions of the idea that can incorporate multi-modal sensory features like tactile data.
7 title running 7 Acknowledgments This material is based upon work supported under Grant NASA-GCT-NNX12AR16A and a NASA Space Technology Research Fellowship. References 1. Dinh, P., Hart, S.: NASA Robonaut 2 Simulator (2013), r2 simulator, [Online; accessed 7-July-2014] 2. Gibson, J.: Perceiving, acting, and knowing: Toward an ecological psychology. chap. The Theory of Affordance). Michigan: Lawrence Erlbaum Associates (1977) 3. Gibson, J.J.: The Ecological Approach to Visual Perception. Houghton Mifflin, Boston (1979) 4. Gigus, Z., Malik, J.: Computing the aspect graph for line drawings of polyhedral objects. Pattern Analysis and Machine Intelligence, IEEE Transactions on 12(2), (1990) 5. Goldstein, E.B.: The ecology of jj gibson s perception. Leonardo pp (1981) 6. Grabner, H., Gall, J., Van Gool, L.: What makes a chair a chair? In: Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on. pp IEEE (2011) 7. Kaelbling, L.P., Littman, M.L., Cassandra, A.R.: Planning and acting in partially observable stochastic domains. Artificial intelligence 101(1), (1998) 8. Katz, D., Venkatraman, A., Kazemi, M., Bagnell, J.A., Stentz, A.: Perceiving, learning, and exploiting object affordances for autonomous pile manipulation (2013) 9. Koenderink, J.J., van Doorn, A.J.: The internal representation of solid shape with respect to vision. Biological cybernetics 32(4), (1979) 10. Platt, R., Tedrake, R., Kaelbling, L., Lozano-Perez, T.: Belief space planning assuming maximum likelihood observations. In: Proceedings of Robotics: Science and Systems. Zaragoza, Spain (June 2010) 11. Sen, S., Grupen, R.: Manipulation planning using model-based belief dynamics. In: Proceedings of the 13th IEEE-RAS International Conference on Humanoid Robots. Atlanta, Georgia (October, 2013) 12. Sen, S.: Bridging the gap between autonomous skill learning and task-specific planning. Ph.D. thesis, University of Massachusetts Amherst (2013) 13. Stoytchev, A.: Toward learning the binding affordances of objects: A behaviorgrounded approach. In: Proceedings of AAAI Symposium on Developmental Robotics. pp (2005) 14. Thrun, S., Burgard, W., Fox, D.: Probabilistic robotics. MIT press (2005) 15. Varadarajan, K.M., Vincze, M.: Object part segmentation and classification in range images for grasping. In: Advanced Robotics (ICAR), th International Conference on. pp IEEE (2011) 16. Varadarajan, K.M., Vincze, M.: Afrob: The affordance network ontology for robots. In: Intelligent Robots and Systems (IROS), 2012 IEEE/RSJ International Conference on. pp IEEE (2012)
Aspect Transition Graph: an Affordance-Based Model
000 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 Aspect Transition Graph:
More informationObject Purpose Based Grasping
Object Purpose Based Grasping Song Cao, Jijie Zhao Abstract Objects often have multiple purposes, and the way humans grasp a certain object may vary based on the different intended purposes. To enable
More informationAutomatic Tracking of Moving Objects in Video for Surveillance Applications
Automatic Tracking of Moving Objects in Video for Surveillance Applications Manjunath Narayana Committee: Dr. Donna Haverkamp (Chair) Dr. Arvin Agah Dr. James Miller Department of Electrical Engineering
More informationAutonomous Navigation in Unknown Environments via Language Grounding
Autonomous Navigation in Unknown Environments via Language Grounding Koushik (kbhavani) Aditya (avmandal) Sanjay (svnaraya) Mentor Jean Oh Introduction As robots become an integral part of various domains
More informationThis chapter explains two techniques which are frequently used throughout
Chapter 2 Basic Techniques This chapter explains two techniques which are frequently used throughout this thesis. First, we will introduce the concept of particle filters. A particle filter is a recursive
More informationEnsemble of Bayesian Filters for Loop Closure Detection
Ensemble of Bayesian Filters for Loop Closure Detection Mohammad Omar Salameh, Azizi Abdullah, Shahnorbanun Sahran Pattern Recognition Research Group Center for Artificial Intelligence Faculty of Information
More informationProbabilistic Planning for Behavior-Based Robots
Probabilistic Planning for Behavior-Based Robots Amin Atrash and Sven Koenig College of Computing Georgia Institute of Technology Atlanta, Georgia 30332-0280 {amin, skoenig}@cc.gatech.edu Abstract Partially
More informationVisually Augmented POMDP for Indoor Robot Navigation
Visually Augmented POMDP for Indoor obot Navigation LÓPEZ M.E., BAEA., BEGASA L.M., ESCUDEO M.S. Electronics Department University of Alcalá Campus Universitario. 28871 Alcalá de Henares (Madrid) SPAIN
More informationBuilding Kinematic and Dynamic Models of Articulated Objects with Multi-Modal Interactive Perception
Building Kinematic and Dynamic Models of Articulated Objects with Multi-Modal Interactive Perception Roberto Martı n-martı n and Oliver Brock Robotics and Biology Laboratory Technische Universita t Berlin,
More informationLearning to Use a Ratchet by Modeling Spatial Relations in Demonstrations
Learning to Use a Ratchet by Modeling Spatial Relations in Demonstrations Li Yang Ku, Scott Jordan, Julia Badger, Erik Learned-Miller, and Rod Grupen Abstract We introduce a framework where visual features,
More informationA Modular Software Framework for Eye-Hand Coordination in Humanoid Robots
A Modular Software Framework for Eye-Hand Coordination in Humanoid Robots Jurgen Leitner, Simon Harding, Alexander Forster and Peter Corke Presentation: Hana Fusman Introduction/ Overview The goal of their
More informationImproving Grasp Skills Using Schema Structured Learning
Improving Grasp Skills Using Schema Structured Learning Robert Platt Dexterous Robotics Laboratory Johnson Space Center, NASA robert.platt-1@nasa.gov Roderic A. Grupen Laboratory for Perceptual Robotics
More informationGrid-Based Models for Dynamic Environments
Grid-Based Models for Dynamic Environments Daniel Meyer-Delius Maximilian Beinhofer Wolfram Burgard Abstract The majority of existing approaches to mobile robot mapping assume that the world is, an assumption
More informationLearning Objects and Grasp Affordances through Autonomous Exploration
Learning Objects and Grasp Affordances through Autonomous Exploration Dirk Kraft 1, Renaud Detry 2, Nicolas Pugeault 1, Emre Başeski 1, Justus Piater 2, and Norbert Krüger 1 1 University of Southern Denmark,
More informationRecognition of Assembly Tasks Based on the Actions Associated to the Manipulated Objects
Recognition of Assembly Tasks Based on the Actions Associated to the Manipulated Objects Kosuke Fukuda 1, Ixchel G. Ramirez-Alpizar 1, Natsuki Yamanobe 2, Damien Petit 1, Kazuyuki Nagata 2 and Kensuke
More informationA Robot Recognizing Everyday Objects
A Robot Recognizing Everyday Objects -- Towards Robot as Autonomous Knowledge Media -- Hideaki Takeda Atsushi Ueno Motoki Saji, Tsuyoshi Nakano Kei Miyamato The National Institute of Informatics Nara Institute
More informationAn Improved Policy Iteratioll Algorithm for Partially Observable MDPs
An Improved Policy Iteratioll Algorithm for Partially Observable MDPs Eric A. Hansen Computer Science Department University of Massachusetts Amherst, MA 01003 hansen@cs.umass.edu Abstract A new policy
More informationCOLOR FIDELITY OF CHROMATIC DISTRIBUTIONS BY TRIAD ILLUMINANT COMPARISON. Marcel P. Lucassen, Theo Gevers, Arjan Gijsenij
COLOR FIDELITY OF CHROMATIC DISTRIBUTIONS BY TRIAD ILLUMINANT COMPARISON Marcel P. Lucassen, Theo Gevers, Arjan Gijsenij Intelligent Systems Lab Amsterdam, University of Amsterdam ABSTRACT Performance
More informationAn Overview of a Probabilistic Tracker for Multiple Cooperative Tracking Agents
An Overview of a Probabilistic Tracker for Multiple Cooperative Tracking Agents Roozbeh Mottaghi and Shahram Payandeh School of Engineering Science Faculty of Applied Sciences Simon Fraser University Burnaby,
More informationHumanoid Robotics. Monte Carlo Localization. Maren Bennewitz
Humanoid Robotics Monte Carlo Localization Maren Bennewitz 1 Basis Probability Rules (1) If x and y are independent: Bayes rule: Often written as: The denominator is a normalizing constant that ensures
More informationEvaluation of Moving Object Tracking Techniques for Video Surveillance Applications
International Journal of Current Engineering and Technology E-ISSN 2277 4106, P-ISSN 2347 5161 2015INPRESSCO, All Rights Reserved Available at http://inpressco.com/category/ijcet Research Article Evaluation
More informationAUTONOMOUS SYSTEMS. PROBABILISTIC LOCALIZATION Monte Carlo Localization
AUTONOMOUS SYSTEMS PROBABILISTIC LOCALIZATION Monte Carlo Localization Maria Isabel Ribeiro Pedro Lima With revisions introduced by Rodrigo Ventura Instituto Superior Técnico/Instituto de Sistemas e Robótica
More informationA Sample of Monte Carlo Methods in Robotics and Vision. Credits. Outline. Structure from Motion. without Correspondences
A Sample of Monte Carlo Methods in Robotics and Vision Frank Dellaert College of Computing Georgia Institute of Technology Credits Zia Khan Tucker Balch Michael Kaess Rafal Zboinski Ananth Ranganathan
More informationCombined Trajectory Planning and Gaze Direction Control for Robotic Exploration
Combined Trajectory Planning and Gaze Direction Control for Robotic Exploration Georgios Lidoris, Kolja Kühnlenz, Dirk Wollherr and Martin Buss Institute of Automatic Control Engineering (LSR) Technische
More informationActive Object Recognition by Offline Solving of POMDPs
Carnegie Mellon University Research Showcase @ CMU Computer Science Department School of Computer Science 4-2011 Active Object Recognition by Offline Solving of POMDPs Susana Brandao Carnegie Mellon University
More informationA MOBILE ROBOT MAPPING SYSTEM WITH AN INFORMATION-BASED EXPLORATION STRATEGY
A MOBILE ROBOT MAPPING SYSTEM WITH AN INFORMATION-BASED EXPLORATION STRATEGY Francesco Amigoni, Vincenzo Caglioti, Umberto Galtarossa Dipartimento di Elettronica e Informazione, Politecnico di Milano Piazza
More informationTracking Multiple Moving Objects with a Mobile Robot
Tracking Multiple Moving Objects with a Mobile Robot Dirk Schulz 1 Wolfram Burgard 2 Dieter Fox 3 Armin B. Cremers 1 1 University of Bonn, Computer Science Department, Germany 2 University of Freiburg,
More informationA Novel Extreme Point Selection Algorithm in SIFT
A Novel Extreme Point Selection Algorithm in SIFT Ding Zuchun School of Electronic and Communication, South China University of Technolog Guangzhou, China zucding@gmail.com Abstract. This paper proposes
More informationClassification Algorithms in Data Mining
August 9th, 2016 Suhas Mallesh Yash Thakkar Ashok Choudhary CIS660 Data Mining and Big Data Processing -Dr. Sunnie S. Chung Classification Algorithms in Data Mining Deciding on the classification algorithms
More informationProbabilistic Robotics
Probabilistic Robotics Sebastian Thrun Wolfram Burgard Dieter Fox The MIT Press Cambridge, Massachusetts London, England Preface xvii Acknowledgments xix I Basics 1 1 Introduction 3 1.1 Uncertainty in
More informationAutomatic Enhancement of Correspondence Detection in an Object Tracking System
Automatic Enhancement of Correspondence Detection in an Object Tracking System Denis Schulze 1, Sven Wachsmuth 1 and Katharina J. Rohlfing 2 1- University of Bielefeld - Applied Informatics Universitätsstr.
More informationOverview of the Navigation System Architecture
Introduction Robot navigation methods that do not explicitly represent uncertainty have severe limitations. Consider for example how commonly used navigation techniques utilize distance information. Landmark
More informationA New Approach to Early Sketch Processing
A New Approach to Early Sketch Processing Sonya Cates and Randall Davis MIT Computer Science and Artificial Intelligence Laboratory 32 Vassar Street Cambridge, MA 02139 {sjcates, davis}@csail.mit.edu Abstract
More informationHUMAN COMPUTER INTERFACE BASED ON HAND TRACKING
Proceedings of MUSME 2011, the International Symposium on Multibody Systems and Mechatronics Valencia, Spain, 25-28 October 2011 HUMAN COMPUTER INTERFACE BASED ON HAND TRACKING Pedro Achanccaray, Cristian
More informationAn Approach to State Aggregation for POMDPs
An Approach to State Aggregation for POMDPs Zhengzhu Feng Computer Science Department University of Massachusetts Amherst, MA 01003 fengzz@cs.umass.edu Eric A. Hansen Dept. of Computer Science and Engineering
More informationIntroduction to Mobile Robotics Bayes Filter Particle Filter and Monte Carlo Localization. Wolfram Burgard
Introduction to Mobile Robotics Bayes Filter Particle Filter and Monte Carlo Localization Wolfram Burgard 1 Motivation Recall: Discrete filter Discretize the continuous state space High memory complexity
More informationECG782: Multidimensional Digital Signal Processing
Professor Brendan Morris, SEB 3216, brendan.morris@unlv.edu ECG782: Multidimensional Digital Signal Processing Lecture 01 Introduction http://www.ee.unlv.edu/~b1morris/ecg782/ 2 Outline Computer Vision
More informationSegmentation and Tracking of Partial Planar Templates
Segmentation and Tracking of Partial Planar Templates Abdelsalam Masoud William Hoff Colorado School of Mines Colorado School of Mines Golden, CO 800 Golden, CO 800 amasoud@mines.edu whoff@mines.edu Abstract
More informationAcquiring Observation Models through Reverse Plan Monitoring
Acquiring Observation Models through Reverse Plan Monitoring Sonia Chernova, Elisabeth Crawford, and Manuela Veloso Computer Science Department, Carnegie Mellon University, Pittsburgh PA 15213, USA Abstract.
More informationAdvanced Techniques for Mobile Robotics Bag-of-Words Models & Appearance-Based Mapping
Advanced Techniques for Mobile Robotics Bag-of-Words Models & Appearance-Based Mapping Wolfram Burgard, Cyrill Stachniss, Kai Arras, Maren Bennewitz Motivation: Analogy to Documents O f a l l t h e s e
More informationVision-Based Localization for Mobile Platforms
Vision-Based Localization for Mobile Platforms Josep M. Porta and Ben J.A. Kröse IAS Group, Informatics Institute, University of Amsterdam, Kruislaan 403, 1098SJ, Amsterdam, The Netherlands {porta,krose}@science.uva.nl
More informationINTERACTIVE ENVIRONMENT FOR INTUITIVE UNDERSTANDING OF 4D DATA. M. Murata and S. Hashimoto Humanoid Robotics Institute, Waseda University, Japan
1 INTRODUCTION INTERACTIVE ENVIRONMENT FOR INTUITIVE UNDERSTANDING OF 4D DATA M. Murata and S. Hashimoto Humanoid Robotics Institute, Waseda University, Japan Abstract: We present a new virtual reality
More informationMobile Robot Mapping and Localization in Non-Static Environments
Mobile Robot Mapping and Localization in Non-Static Environments Cyrill Stachniss Wolfram Burgard University of Freiburg, Department of Computer Science, D-790 Freiburg, Germany {stachnis burgard @informatik.uni-freiburg.de}
More informationInverse KKT Motion Optimization: A Newton Method to Efficiently Extract Task Spaces and Cost Parameters from Demonstrations
Inverse KKT Motion Optimization: A Newton Method to Efficiently Extract Task Spaces and Cost Parameters from Demonstrations Peter Englert Machine Learning and Robotics Lab Universität Stuttgart Germany
More informationMulti Robot Object Tracking and Self Localization Using Visual Percept Relations
Multi Robot Object Tracking and Self Localization Using Visual Percept Relations Daniel Göhring and Hans-Dieter Burkhard Department of Computer Science Artificial Intelligence Laboratory Humboldt-Universität
More informationCLASSIFICATION WITH RADIAL BASIS AND PROBABILISTIC NEURAL NETWORKS
CLASSIFICATION WITH RADIAL BASIS AND PROBABILISTIC NEURAL NETWORKS CHAPTER 4 CLASSIFICATION WITH RADIAL BASIS AND PROBABILISTIC NEURAL NETWORKS 4.1 Introduction Optical character recognition is one of
More informationToward Part-based Document Image Decoding
2012 10th IAPR International Workshop on Document Analysis Systems Toward Part-based Document Image Decoding Wang Song, Seiichi Uchida Kyushu University, Fukuoka, Japan wangsong@human.ait.kyushu-u.ac.jp,
More informationA Well-Behaved Algorithm for Simulating Dependence Structures of Bayesian Networks
A Well-Behaved Algorithm for Simulating Dependence Structures of Bayesian Networks Yang Xiang and Tristan Miller Department of Computer Science University of Regina Regina, Saskatchewan, Canada S4S 0A2
More informationTracking Algorithms. Lecture16: Visual Tracking I. Probabilistic Tracking. Joint Probability and Graphical Model. Deterministic methods
Tracking Algorithms CSED441:Introduction to Computer Vision (2017F) Lecture16: Visual Tracking I Bohyung Han CSE, POSTECH bhhan@postech.ac.kr Deterministic methods Given input video and current state,
More informationEE795: Computer Vision and Intelligent Systems
EE795: Computer Vision and Intelligent Systems Spring 2013 TTh 17:30-18:45 FDH 204 Lecture 18 130404 http://www.ee.unlv.edu/~b1morris/ecg795/ 2 Outline Object Recognition Intro (Chapter 14) Slides from
More informationTask-Oriented Planning for Manipulating Articulated Mechanisms under Model Uncertainty. Venkatraman Narayanan and Maxim Likhachev
Task-Oriented Planning for Manipulating Articulated Mechanisms under Model Uncertainty Venkatraman Narayanan and Maxim Likhachev Motivation Motivation A lot of household objects are ARTICULATED A lot of
More informationVision-Motion Planning with Uncertainty
Vision-Motion Planning with Uncertainty Jun MIURA Yoshiaki SHIRAI Dept. of Mech. Eng. for Computer-Controlled Machinery, Osaka University, Suita, Osaka 565, Japan jun@ccm.osaka-u.ac.jp Abstract This paper
More informationJoint Vanishing Point Extraction and Tracking. 9. June 2015 CVPR 2015 Till Kroeger, Dengxin Dai, Luc Van Gool, Computer Vision ETH Zürich
Joint Vanishing Point Extraction and Tracking 9. June 2015 CVPR 2015 Till Kroeger, Dengxin Dai, Luc Van Gool, Computer Vision Lab @ ETH Zürich Definition: Vanishing Point = Intersection of 2D line segments,
More informationCS 231A Computer Vision (Fall 2012) Problem Set 3
CS 231A Computer Vision (Fall 2012) Problem Set 3 Due: Nov. 13 th, 2012 (2:15pm) 1 Probabilistic Recursion for Tracking (20 points) In this problem you will derive a method for tracking a point of interest
More informationInteractive object classification using sensorimotor contingencies
213 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) November 3-7, 213. Tokyo, Japan Interactive object classification using sensorimotor contingencies Virgile Högman, Mårten
More informationSpace-Progressive Value Iteration: An Anytime Algorithm for a Class of POMDPs
Space-Progressive Value Iteration: An Anytime Algorithm for a Class of POMDPs Nevin L. Zhang and Weihong Zhang lzhang,wzhang @cs.ust.hk Department of Computer Science Hong Kong University of Science &
More informationActive Monte Carlo Localization in Outdoor Terrains using Multi-Level Surface Maps
Active Monte Carlo Localization in Outdoor Terrains using Multi-Level Surface Maps Rainer Kümmerle 1, Patrick Pfaff 1, Rudolph Triebel 2, and Wolfram Burgard 1 1 Department of Computer Science, University
More informationRobot Mapping. A Short Introduction to the Bayes Filter and Related Models. Gian Diego Tipaldi, Wolfram Burgard
Robot Mapping A Short Introduction to the Bayes Filter and Related Models Gian Diego Tipaldi, Wolfram Burgard 1 State Estimation Estimate the state of a system given observations and controls Goal: 2 Recursive
More informationSemantics in Human Localization and Mapping
Semantics in Human Localization and Mapping Aidos Sarsembayev, Antonio Sgorbissa University of Genova, Dept. DIBRIS Via Opera Pia 13, 16145 Genova, Italy aidos.sarsembayev@edu.unige.it, antonio.sgorbissa@unige.it
More informationContinuous Valued Q-learning for Vision-Guided Behavior Acquisition
Continuous Valued Q-learning for Vision-Guided Behavior Acquisition Yasutake Takahashi, Masanori Takeda, and Minoru Asada Dept. of Adaptive Machine Systems Graduate School of Engineering Osaka University
More informationRobust Monte-Carlo Localization using Adaptive Likelihood Models
Robust Monte-Carlo Localization using Adaptive Likelihood Models Patrick Pfaff 1, Wolfram Burgard 1, and Dieter Fox 2 1 Department of Computer Science, University of Freiburg, Germany, {pfaff,burgard}@informatik.uni-freiburg.de
More informationORGANIZATION AND REPRESENTATION OF OBJECTS IN MULTI-SOURCE REMOTE SENSING IMAGE CLASSIFICATION
ORGANIZATION AND REPRESENTATION OF OBJECTS IN MULTI-SOURCE REMOTE SENSING IMAGE CLASSIFICATION Guifeng Zhang, Zhaocong Wu, lina Yi School of remote sensing and information engineering, Wuhan University,
More informationRecap: Gaussian (or Normal) Distribution. Recap: Minimizing the Expected Loss. Topics of This Lecture. Recap: Maximum Likelihood Approach
Truth Course Outline Machine Learning Lecture 3 Fundamentals (2 weeks) Bayes Decision Theory Probability Density Estimation Probability Density Estimation II 2.04.205 Discriminative Approaches (5 weeks)
More informationMonte Carlo Localization using Dynamically Expanding Occupancy Grids. Karan M. Gupta
1 Monte Carlo Localization using Dynamically Expanding Occupancy Grids Karan M. Gupta Agenda Introduction Occupancy Grids Sonar Sensor Model Dynamically Expanding Occupancy Grids Monte Carlo Localization
More informationEmbodiment based Object Recognition for Vision-Based Mobile Agents
Embodiment based Object Recognition for Vision-Based Mobile Agents Kazunori Terada, Takayuki Nakamura, Hideaki Takeda and Tsukasa Ogasawara Dept. of Information Systems, Nara Institute of Science and Technology
More informationModel-based segmentation and recognition from range data
Model-based segmentation and recognition from range data Jan Boehm Institute for Photogrammetry Universität Stuttgart Germany Keywords: range image, segmentation, object recognition, CAD ABSTRACT This
More informationarxiv: v1 [cs.ro] 23 May 2018
Tool Exchangeable Grasp/Assembly Planner Kensuke Harada 1,2, Kento Nakayama 1, Weiwei Wan 1,2, Kazuyuki Nagata 2 Natsuki Yamanobe 2, and Ixchel G. Ramirez-Alpizar 1 arxiv:1805.08962v1 [cs.ro] 23 May 2018
More informationIntroduction to Machine Learning
Introduction to Machine Learning Brown University CSCI 1950-F, Spring 2012 Prof. Erik Sudderth Lecture 2: Probability: Discrete Random Variables Classification: Validation & Model Selection Many figures
More informationQuery Likelihood with Negative Query Generation
Query Likelihood with Negative Query Generation Yuanhua Lv Department of Computer Science University of Illinois at Urbana-Champaign Urbana, IL 61801 ylv2@uiuc.edu ChengXiang Zhai Department of Computer
More informationMachine Learning Lecture 3
Machine Learning Lecture 3 Probability Density Estimation II 19.10.2017 Bastian Leibe RWTH Aachen http://www.vision.rwth-aachen.de leibe@vision.rwth-aachen.de Announcements Exam dates We re in the process
More informationCombined Vision and Frontier-Based Exploration Strategies for Semantic Mapping
Combined Vision and Frontier-Based Exploration Strategies for Semantic Mapping Islem Jebari 1, Stéphane Bazeille 1, and David Filliat 1 1 Electronics & Computer Science Laboratory, ENSTA ParisTech, Paris,
More informationAUTONOMOUS SYSTEMS. LOCALIZATION, MAPPING & SIMULTANEOUS LOCALIZATION AND MAPPING Part V Mapping & Occupancy Grid Mapping
AUTONOMOUS SYSTEMS LOCALIZATION, MAPPING & SIMULTANEOUS LOCALIZATION AND MAPPING Part V Mapping & Occupancy Grid Mapping Maria Isabel Ribeiro Pedro Lima with revisions introduced by Rodrigo Ventura Instituto
More informationProbabilistic Robotics
Probabilistic Robotics Discrete Filters and Particle Filters Models Some slides adopted from: Wolfram Burgard, Cyrill Stachniss, Maren Bennewitz, Kai Arras and Probabilistic Robotics Book SA-1 Probabilistic
More informationObject Recognition. The Chair Room
Object Recognition high-level interpretations objects scene elements image elements raw images Object recognition object recognition is a typical goal of image analysis object recognition includes - object
More informationObject recognition (part 1)
Recognition Object recognition (part 1) CSE P 576 Larry Zitnick (larryz@microsoft.com) The Margaret Thatcher Illusion, by Peter Thompson Readings Szeliski Chapter 14 Recognition What do we mean by object
More informationSemantic Mapping and Reasoning Approach for Mobile Robotics
Semantic Mapping and Reasoning Approach for Mobile Robotics Caner GUNEY, Serdar Bora SAYIN, Murat KENDİR, Turkey Key words: Semantic mapping, 3D mapping, probabilistic, robotic surveying, mine surveying
More informationRobots Towards Making Sense of 3D Data
Nico Blodow, Zoltan-Csaba Marton, Dejan Pangercic, Michael Beetz Intelligent Autonomous Systems Group Technische Universität München RSS 2010 Workshop on Strategies and Evaluation for Mobile Manipulation
More informationSchedule for Rest of Semester
Schedule for Rest of Semester Date Lecture Topic 11/20 24 Texture 11/27 25 Review of Statistics & Linear Algebra, Eigenvectors 11/29 26 Eigenvector expansions, Pattern Recognition 12/4 27 Cameras & calibration
More informationInstant Prediction for Reactive Motions with Planning
The 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems October 11-15, 2009 St. Louis, USA Instant Prediction for Reactive Motions with Planning Hisashi Sugiura, Herbert Janßen, and
More informationLong-term motion estimation from images
Long-term motion estimation from images Dennis Strelow 1 and Sanjiv Singh 2 1 Google, Mountain View, CA, strelow@google.com 2 Carnegie Mellon University, Pittsburgh, PA, ssingh@cmu.edu Summary. Cameras
More informationMapping and Exploration with Mobile Robots using Coverage Maps
Mapping and Exploration with Mobile Robots using Coverage Maps Cyrill Stachniss Wolfram Burgard University of Freiburg Department of Computer Science D-79110 Freiburg, Germany {stachnis burgard}@informatik.uni-freiburg.de
More informationLast week. Multi-Frame Structure from Motion: Multi-View Stereo. Unknown camera viewpoints
Last week Multi-Frame Structure from Motion: Multi-View Stereo Unknown camera viewpoints Last week PCA Today Recognition Today Recognition Recognition problems What is it? Object detection Who is it? Recognizing
More informationIntroduction to Machine Learning Prof. Mr. Anirban Santara Department of Computer Science and Engineering Indian Institute of Technology, Kharagpur
Introduction to Machine Learning Prof. Mr. Anirban Santara Department of Computer Science and Engineering Indian Institute of Technology, Kharagpur Lecture - 19 Python Exercise on Naive Bayes Hello everyone.
More informationActive Sensing as Bayes-Optimal Sequential Decision-Making
Active Sensing as Bayes-Optimal Sequential Decision-Making Sheeraz Ahmad & Angela J. Yu Department of Computer Science and Engineering University of California, San Diego December 7, 2012 Outline Introduction
More informationFingerprint Recognition using Texture Features
Fingerprint Recognition using Texture Features Manidipa Saha, Jyotismita Chaki, Ranjan Parekh,, School of Education Technology, Jadavpur University, Kolkata, India Abstract: This paper proposes an efficient
More informationCollecting outdoor datasets for benchmarking vision based robot localization
Collecting outdoor datasets for benchmarking vision based robot localization Emanuele Frontoni*, Andrea Ascani, Adriano Mancini, Primo Zingaretti Department of Ingegneria Infromatica, Gestionale e dell
More informationUnit Map: Grade 3 Math
Place Value 3.3 Number and operations. The student represents and compares whole numbers and understand relationships related to place value. Place Value of Whole Numbers 3.3A compose and decompose numbers
More informationPredictive Autonomous Robot Navigation
Predictive Autonomous Robot Navigation Amalia F. Foka and Panos E. Trahanias Institute of Computer Science, Foundation for Research and Technology-Hellas (FORTH), Heraklion, Greece and Department of Computer
More informationRobust Vision-Based Detection and Grasping Object for Manipulator using SIFT Keypoint Detector
Proceedings of the 2014 International Conference on Advanced Mechatronic Systems, Kumamoto, Japan, August 10-12, 2014 Robust Vision-Based Detection and Grasping Object for Manipulator using SIFT Keypoint
More informationCONNECT-THE-DOTS IN A GRAPH AND BUFFON S NEEDLE ON A CHESSBOARD: TWO PROBLEMS IN ASSISTED NAVIGATION
1 CONNECT-THE-DOTS IN A GRAPH AND BUFFON S NEEDLE ON A CHESSBOARD: TWO PROBLEMS IN ASSISTED NAVIGATION MINGHUI JIANG and VLADIMIR KULYUKIN Department of Computer Science, Utah State University, Logan,
More informationExpectation Maximization (EM) and Gaussian Mixture Models
Expectation Maximization (EM) and Gaussian Mixture Models Reference: The Elements of Statistical Learning, by T. Hastie, R. Tibshirani, J. Friedman, Springer 1 2 3 4 5 6 7 8 Unsupervised Learning Motivation
More informationParticle Filter in Brief. Robot Mapping. FastSLAM Feature-based SLAM with Particle Filters. Particle Representation. Particle Filter Algorithm
Robot Mapping FastSLAM Feature-based SLAM with Particle Filters Cyrill Stachniss Particle Filter in Brief! Non-parametric, recursive Bayes filter! Posterior is represented by a set of weighted samples!
More informationSimple Form Recognition Using Bayesian Programming
Book Title Book Editors IOS Press, 2003 1 Simple Form Recognition Using Bayesian Programming Guy Ramel a,1, Adriana Tapus a, François Aspert a and Roland Siegwart a a Autonomous Systems Lab Swiss Federal
More informationL17. OCCUPANCY MAPS. NA568 Mobile Robotics: Methods & Algorithms
L17. OCCUPANCY MAPS NA568 Mobile Robotics: Methods & Algorithms Today s Topic Why Occupancy Maps? Bayes Binary Filters Log-odds Occupancy Maps Inverse sensor model Learning inverse sensor model ML map
More informationA New Pool Control Method for Boolean Compressed Sensing Based Adaptive Group Testing
Proceedings of APSIPA Annual Summit and Conference 27 2-5 December 27, Malaysia A New Pool Control Method for Boolean Compressed Sensing Based Adaptive roup Testing Yujia Lu and Kazunori Hayashi raduate
More information70 IEEE TRANSACTIONS ON MULTIMEDIA, VOL. 6, NO. 1, FEBRUARY ClassView: Hierarchical Video Shot Classification, Indexing, and Accessing
70 IEEE TRANSACTIONS ON MULTIMEDIA, VOL. 6, NO. 1, FEBRUARY 2004 ClassView: Hierarchical Video Shot Classification, Indexing, and Accessing Jianping Fan, Ahmed K. Elmagarmid, Senior Member, IEEE, Xingquan
More informationProbabilistic Robotics
Probabilistic Robotics FastSLAM Sebastian Thrun (abridged and adapted by Rodrigo Ventura in Oct-2008) The SLAM Problem SLAM stands for simultaneous localization and mapping The task of building a map while
More informationA Formal Approach to Score Normalization for Meta-search
A Formal Approach to Score Normalization for Meta-search R. Manmatha and H. Sever Center for Intelligent Information Retrieval Computer Science Department University of Massachusetts Amherst, MA 01003
More informationOCCUPANCY GRID MODELING FOR MOBILE ROBOT USING ULTRASONIC RANGE FINDER
OCCUPANCY GRID MODELING FOR MOBILE ROBOT USING ULTRASONIC RANGE FINDER Jyoshita, Priti 2, Tejal Sangwan 3,2,3,4 Department of Electronics and Communication Engineering Hindu College of Engineering Sonepat,
More informationRealtime Object Recognition Using Decision Tree Learning
Realtime Object Recognition Using Decision Tree Learning Dirk Wilking 1 and Thomas Röfer 2 1 Chair for Computer Science XI, Embedded Software Group, RWTH Aachen wilking@informatik.rwth-aachen.de 2 Center
More information