Lighting- and Occlusion-robust View-based Teaching/Playback for Model-free Robot Programming
|
|
- Toby Harvey
- 5 years ago
- Views:
Transcription
1 Lighting- and Occlusion-robust View-based Teaching/Playback for Model-free Robot Programming *Yusuke MAEDA (Yokohama National University) Yoshito SAITO (Ricoh Corp)
2 Background Conventional Teaching/Playback still widely used model-free: neither task-specific models nor object-specific models are necessary for constant task conditions eg) initial pose of object does not change 2
3 When the initial object pose is not constant Object localization with cameras Model-based image processing Geometric feature extraction: edge, vertex, Pattern matching Object-specific: model-freeness is lost camera 3
4 Motivation To develop a model-free robot programming method that can cope with change of task conditions View-based teaching/playback : robot programming with view-based image processing [Maeda 2011 ICRA] 4
5 Model-based vs View-based Model-based approach with object-specific models accurate cumbersome View-based (Appearance-based) approach without object-specific models versatile 5
6 View-based Teaching/Playback [Maeda 2011 ICRA] View-based image processing using PCA not object-specific no need for camera calibration Adaptability to change of initial object pose using the generalization ability of neural networks generalization from multiple demonstrations 6
7 Related Works [Zhang et al 2000]: View-based fine positioning for grippers [Zhao et al 2008]: View-based visual servoing for relative positioning [Levine et al 2016]: View-based grasping of novel objects through massive learning 7
8 Overview of View-based Teaching/Playback (1/3) Human Demonstration Record all the scene images and corresponding robot motions Goal 8
9 Overview of View-based Teaching/Playback (2/3) Mapping Acquisition From scene image to robot motion Robot motion Mapping Image 9
10 Overview of View-based Teaching/Playback (3/3) View-based Playback Autonomous task execution using the acquired image-to-motion mapping Goal 10
11 Neural Network for Mapping numerous pixels Raw Pixel Data PCA Factor Scores FS (t) Hand Configuration Config (t) Output Layer Robot Motion Move (t) Move (t-δt) Hidden Layer Input Layer 11
12 Advantage of View-based Teaching/Playback Possible to cope with changes of task conditions (to some extent) Use of generalization ability of NN Model-free Multiple Demonstrations Interpolative Playback Teach2 Playback Teach1 12
13 Objective Original view-based teaching/playback [Maeda 2011 ICRA] sensitive to lighting conditions sensitive to occlusions To make our view-based teaching/playback lighting- and occulusion-robust Use of range images Use of subimages 13
14 Experimental Setup Target task: Pushing on a plane Kinect for grayscale and range images Teaching (x2) 14
15 Change of Lighting Condition (playback with grayscale images) Teaching (x2) Playback (x2) 15
16 Change of Lighting Condition (playback with range images) Teaching (x2) Playback (x2) 16
17 Position Errors at Goal for Each Initial Positions 260 Grayscale images used 260 Range images used x [mm] Demonstration Error < 20 mm Error < 30 mm Error < 40 mm Error >= 40 mm Goal x [mm] Demonstration Error < 20 mm Error < 30 mm Error < 40 mm Error >= 40 mm Goal y [mm] y [mm] Larger errors found for range images due to their noise 17
18 Grayscale Images vs Range Images Grayscale Images Less noisy, but less robust Range Images Noisy, but robust Adaptive online switching of used images Achieve both accuracy and robustness in view-based teaching/playback 18
19 Switching Grayscale/Range Images (1/2) Neural Network for Robot Motion Factor Scores FS (t) Hand Configuration Config (t) Move (t-δt) Output Layer Hidden Layer Relative Motion Robot Motion Move (t) Additional Neural Network for Inconsistency Detection Factor Scores FS (t) Hand Configuration Config (t) Output Layer Hidden Layer Input Layer Absolute Position Hand Configuration Config (t+δt) Input Layer Hand Configuration Config (t+δt) Consistent? 19
20 Switching Grayscale/Range Images (2/2) NN for Robot Motion Config(t+Δt) NN for Inconsistency Detection Config(t+Δt) Grayscale image is usable yes Error<T A T A : threshold no Unexpected situation detected 20
21 Lighting-robust View-based Playback (light added) Playback (x2) Used Images (x2) Range images were used automatically due to change of lighting condition 21
22 Lighting-robust View-based Playback (light on/off) Playback (x2) Used Images (x2) Successfully adapted to light on/off by switching neural networks 22
23 Making View-based Teaching/Playback Occlusion-robust Neural networks are trained for not only full images but also subimages to overcome partial occlusions 23
24 Switching Full/Sub Images Loop Start Inconsistency found for full image? no yes* Loop End *subimage with minimum inconsistency used 24
25 Occlusion-robust View-based Playback Use of subimage-based NNs Playback (x2) Used Images (x2) 25
26 Switching Grayscale Image, Range Full image and Range Subimages Loop Start Inconsistency found for grayscale full image? yes Inconsistency found for range full image? yes no no Loop End 26
27 Lighting- and Occlusion-robust View-based Playback Playback (x2) Used Images (x2) 27
28 Conclusion Lighting-robust view-based teaching/playback Use of range images Switching between range and grayscale images for better accuracy Occlusion-robust view-based teaching/playback Use of subimages 28
29 Future Work Application to various robotic tasks that require higher DOF Incorporation of various sensor modalities Force information [Nakagawa et al 2016 IAS-14] 29
View-based Programming with Reinforcement Learning for Robotic Manipulation
View-based Programming with Reinforcement Learning for Robotic Manipulation Yusuke MAEDA*, Takumi WATANABE** and Yuki MORIYAMA* *Yokohama National University **Seiko Epson Corp. Background Conventional
More informationView-Based Teaching/Playback for Industrial Manipulators
View-Based Teaching/Playback for Industrial Manipulators Yusuke MAEDA and Yuki MORIYAMA Abstract In this paper, we present a new method for robot programming: view-based teaching/playback It was developed
More informationIndustrial Calibration. Chris Lewis Southwest Research Institute
Industrial Calibration Chris Lewis Southwest Research Institute clewis@swri.org Motivation Push button intrinsic and extrinsic calibration with predictable accuracy. Unified Framework for a wide variety
More informationAccurate 3D Face and Body Modeling from a Single Fixed Kinect
Accurate 3D Face and Body Modeling from a Single Fixed Kinect Ruizhe Wang*, Matthias Hernandez*, Jongmoo Choi, Gérard Medioni Computer Vision Lab, IRIS University of Southern California Abstract In this
More informationCanny Edge Based Self-localization of a RoboCup Middle-sized League Robot
Canny Edge Based Self-localization of a RoboCup Middle-sized League Robot Yoichi Nakaguro Sirindhorn International Institute of Technology, Thammasat University P.O. Box 22, Thammasat-Rangsit Post Office,
More informationObject Classification in Domestic Environments
Object Classification in Domestic Environments Markus Vincze Aitor Aldoma, Markus Bader, Peter Einramhof, David Fischinger, Andreas Huber, Lara Lammer, Thomas Mörwald, Sven Olufs, Ekaterina Potapova, Johann
More informationMotion Planning of Robot Fingertips for Graspless Manipulation
Motion Planning of Robot Fingertips for Graspless Manipulation Yusuke MAEDA* Tomohisa NAKAMURA** Tamio ARAI*** *Yokohama National University **NTT Data Corporation ***The University of Tokyo 1. 1. Introduction
More informationCollecting outdoor datasets for benchmarking vision based robot localization
Collecting outdoor datasets for benchmarking vision based robot localization Emanuele Frontoni*, Andrea Ascani, Adriano Mancini, Primo Zingaretti Department of Ingegneria Infromatica, Gestionale e dell
More informationIntern Presentation:
: Gripper Stereo and Assisted Teleoperation Stanford University December 13, 2010 Outline 1. Introduction 2. Hardware 3. Research 4. Packages 5. Conclusion Introduction Hardware Research Packages Conclusion
More informationEfficient Grasping from RGBD Images: Learning Using a New Rectangle Representation. Yun Jiang, Stephen Moseson, Ashutosh Saxena Cornell University
Efficient Grasping from RGBD Images: Learning Using a New Rectangle Representation Yun Jiang, Stephen Moseson, Ashutosh Saxena Cornell University Problem Goal: Figure out a way to pick up the object. Approach
More information3D Modeling of Objects Using Laser Scanning
1 3D Modeling of Objects Using Laser Scanning D. Jaya Deepu, LPU University, Punjab, India Email: Jaideepudadi@gmail.com Abstract: In the last few decades, constructing accurate three-dimensional models
More informationMotion and Tracking. Andrea Torsello DAIS Università Ca Foscari via Torino 155, Mestre (VE)
Motion and Tracking Andrea Torsello DAIS Università Ca Foscari via Torino 155, 30172 Mestre (VE) Motion Segmentation Segment the video into multiple coherently moving objects Motion and Perceptual Organization
More informationSeminar Dept. Automação e Sistemas - UFSC Scan-to-Map Matching Using the Hausdorff Distance for Robust Mobile Robot Localization
Seminar Dept. Automação e Sistemas - UFSC Scan-to-Map Matching Using the Hausdorff Distance for Robust Mobile Robot Localization Work presented at ICRA 2008, jointly with ANDRES GUESALAGA PUC Chile Miguel
More informationRobotic Visual Servoing. & RTX robot control in Matlab. RTX control in Matlab. Robotic Visual Servoing Overview. Robotic Visual Servoing Reminder
Robotic Visual Servoing Overview Robotic Visual Servoing Problem : guide a robot to a given target based on visual sensing of the environment & RTX robot control in Matlab Advanced Vision Lecture 12 toby.breckon@ed.ac.uk
More informationTEXTURE OVERLAY ONTO NON-RIGID SURFACE USING COMMODITY DEPTH CAMERA
TEXTURE OVERLAY ONTO NON-RIGID SURFACE USING COMMODITY DEPTH CAMERA Tomoki Hayashi 1, Francois de Sorbier 1 and Hideo Saito 1 1 Graduate School of Science and Technology, Keio University, 3-14-1 Hiyoshi,
More informationTHE FACTORY AUTOMATION COMPANY. Force Sensor. Tactile intelligence. Assembling Contouring Measuring
THE FACTORY AUTOMATION COMPANY Force Sensor Tactile intelligence WWW.FANUC.EU Assembling Contouring Measuring Automated craftsmanship for assembly, contouring and measuring applications FANUC s range of
More informationTask analysis based on observing hands and objects by vision
Task analysis based on observing hands and objects by vision Yoshihiro SATO Keni Bernardin Hiroshi KIMURA Katsushi IKEUCHI Univ. of Electro-Communications Univ. of Karlsruhe Univ. of Tokyo Abstract In
More information3D Editing System for Captured Real Scenes
3D Editing System for Captured Real Scenes Inwoo Ha, Yong Beom Lee and James D.K. Kim Samsung Advanced Institute of Technology, Youngin, South Korea E-mail: {iw.ha, leey, jamesdk.kim}@samsung.com Tel:
More informationImproving Vision-based Topological Localization by Combining Local and Global Image Features
Improving Vision-based Topological Localization by Combining Local and Global Image Features Shuai Yang and Han Wang Nanyang Technological University, Singapore Introduction Self-localization is crucial
More informationStructured light 3D reconstruction
Structured light 3D reconstruction Reconstruction pipeline and industrial applications rodola@dsi.unive.it 11/05/2010 3D Reconstruction 3D reconstruction is the process of capturing the shape and appearance
More informationRobot Vision Control of robot motion from video. M. Jagersand
Robot Vision Control of robot motion from video M. Jagersand Vision-Based Control (Visual Servoing) Initial Image User Desired Image Vision-Based Control (Visual Servoing) : Current Image Features : Desired
More informationAUTOMATIC 3D HUMAN ACTION RECOGNITION Ajmal Mian Associate Professor Computer Science & Software Engineering
AUTOMATIC 3D HUMAN ACTION RECOGNITION Ajmal Mian Associate Professor Computer Science & Software Engineering www.csse.uwa.edu.au/~ajmal/ Overview Aim of automatic human action recognition Applications
More informationJo-Car2 Autonomous Mode. Path Planning (Cost Matrix Algorithm)
Chapter 8.2 Jo-Car2 Autonomous Mode Path Planning (Cost Matrix Algorithm) Introduction: In order to achieve its mission and reach the GPS goal safely; without crashing into obstacles or leaving the lane,
More informationFOREGROUND DETECTION ON DEPTH MAPS USING SKELETAL REPRESENTATION OF OBJECT SILHOUETTES
FOREGROUND DETECTION ON DEPTH MAPS USING SKELETAL REPRESENTATION OF OBJECT SILHOUETTES D. Beloborodov a, L. Mestetskiy a a Faculty of Computational Mathematics and Cybernetics, Lomonosov Moscow State University,
More informationDense Tracking and Mapping for Autonomous Quadrocopters. Jürgen Sturm
Computer Vision Group Prof. Daniel Cremers Dense Tracking and Mapping for Autonomous Quadrocopters Jürgen Sturm Joint work with Frank Steinbrücker, Jakob Engel, Christian Kerl, Erik Bylow, and Daniel Cremers
More informationProf. Fanny Ficuciello Robotics for Bioengineering Visual Servoing
Visual servoing vision allows a robotic system to obtain geometrical and qualitative information on the surrounding environment high level control motion planning (look-and-move visual grasping) low level
More informationCS4495/6495 Introduction to Computer Vision
CS4495/6495 Introduction to Computer Vision 9C-L1 3D perception Some slides by Kelsey Hawkins Motivation Why do animals, people & robots need vision? To detect and recognize objects/landmarks Is that a
More informationFIDUCIAL BASED POSE ESTIMATION ADEWOLE AYOADE ALEX YEARSLEY
FIDUCIAL BASED POSE ESTIMATION ADEWOLE AYOADE ALEX YEARSLEY OVERVIEW Objective Motivation Previous Work Methods Target Recognition Target Identification Pose Estimation Testing Results Demonstration Conclusion
More informationHigh-Fidelity Augmented Reality Interactions Hrvoje Benko Researcher, MSR Redmond
High-Fidelity Augmented Reality Interactions Hrvoje Benko Researcher, MSR Redmond New generation of interfaces Instead of interacting through indirect input devices (mice and keyboard), the user is interacting
More informationIntegrating Grasp Planning and Visual Feedback for Reliable Manipulation
9th IEEE-RAS International Conference on Humanoid Robots December 7-0, 2009 Paris, France Integrating Grasp Planning and Visual Feedback for Reliable Manipulation Rosen Diankov Takeo Kanade James Kuffner
More informationCHAPTER 1 INTRODUCTION
CHAPTER 1 INTRODUCTION 1.1 Introduction Pattern recognition is a set of mathematical, statistical and heuristic techniques used in executing `man-like' tasks on computers. Pattern recognition plays an
More informationImage Transformations & Camera Calibration. Mašinska vizija, 2018.
Image Transformations & Camera Calibration Mašinska vizija, 2018. Image transformations What ve we learnt so far? Example 1 resize and rotate Open warp_affine_template.cpp Perform simple resize
More informationCapture of Arm-Muscle deformations using a Depth Camera
Capture of Arm-Muscle deformations using a Depth Camera November 7th, 2013 Nadia Robertini 1, Thomas Neumann 2, Kiran Varanasi 3, Christian Theobalt 4 1 University of Saarland, 2 HTW Dresden, 3 Technicolor
More informationA Modular Software Framework for Eye-Hand Coordination in Humanoid Robots
A Modular Software Framework for Eye-Hand Coordination in Humanoid Robots Jurgen Leitner, Simon Harding, Alexander Forster and Peter Corke Presentation: Hana Fusman Introduction/ Overview The goal of their
More informationPerception and Control for a Humanoid Robot using Vision
Dept. Elect. And Computer Systems Engineering, Academic Research Forum (Feb 11, 2003) 1 Perception and Control for a Humanoid Robot using Vision Geoffrey Taylor and Lindsay Kleeman Department of. Electrical.
More informationAdaptive Gesture Recognition System Integrating Multiple Inputs
Adaptive Gesture Recognition System Integrating Multiple Inputs Master Thesis - Colloquium Tobias Staron University of Hamburg Faculty of Mathematics, Informatics and Natural Sciences Technical Aspects
More informationCRF Based Point Cloud Segmentation Jonathan Nation
CRF Based Point Cloud Segmentation Jonathan Nation jsnation@stanford.edu 1. INTRODUCTION The goal of the project is to use the recently proposed fully connected conditional random field (CRF) model to
More informationA Simple 3D Scanning System of the Human Foot Using a Smartphone with Depth Camera
Abstract A Simple 3D Scanning System of the Human Foot Using a Smartphone with Depth Camera Takumi KOBAYASHI* 1, Naoto IENAGA 1, Yuta SUGIURA 1, Hideo SAITO 1, Natsuki MIYATA 2, Mitsumori TADA 2 1 Keio
More informationRGBD Occlusion Detection via Deep Convolutional Neural Networks
1 RGBD Occlusion Detection via Deep Convolutional Neural Networks Soumik Sarkar 1,2, Vivek Venugopalan 1, Kishore Reddy 1, Michael Giering 1, Julian Ryde 3, Navdeep Jaitly 4,5 1 United Technologies Research
More informationUAV Position and Attitude Sensoring in Indoor Environment Using Cameras
UAV Position and Attitude Sensoring in Indoor Environment Using Cameras 1 Peng Xu Abstract There are great advantages of indoor experiment for UAVs. Test flights of UAV in laboratory is more convenient,
More informationFast trajectory matching using small binary images
Title Fast trajectory matching using small binary images Author(s) Zhuo, W; Schnieders, D; Wong, KKY Citation The 3rd International Conference on Multimedia Technology (ICMT 2013), Guangzhou, China, 29
More informationAs stated in the main document, in each exercise, the required movements of the upper
Supplementary material Operation of the tracking system As stated in the main document, in each exercise, the required movements of the upper limb segments, fingers, and tangible objects are detected from
More information3D Shape and Indirect Appearance By Structured Light Transport
3D Shape and Indirect Appearance By Structured Light Transport CVPR 2014 - Best paper honorable mention Matthew O Toole, John Mather, Kiriakos N. Kutulakos Department of Computer Science University of
More informationField-of-view dependent registration of point clouds and incremental segmentation of table-tops using time-offlight
Field-of-view dependent registration of point clouds and incremental segmentation of table-tops using time-offlight cameras Dipl.-Ing. Georg Arbeiter Fraunhofer Institute for Manufacturing Engineering
More informationAutonomous Mobile Robot Design
Autonomous Mobile Robot Design Topic: EKF-based SLAM Dr. Kostas Alexis (CSE) These slides have partially relied on the course of C. Stachniss, Robot Mapping - WS 2013/14 Autonomous Robot Challenges Where
More informationLost! Leveraging the Crowd for Probabilistic Visual Self-Localization
Lost! Leveraging the Crowd for Probabilistic Visual Self-Localization Marcus A. Brubaker (Toyota Technological Institute at Chicago) Andreas Geiger (Karlsruhe Institute of Technology & MPI Tübingen) Raquel
More informationDirect Methods in Visual Odometry
Direct Methods in Visual Odometry July 24, 2017 Direct Methods in Visual Odometry July 24, 2017 1 / 47 Motivation for using Visual Odometry Wheel odometry is affected by wheel slip More accurate compared
More informationShortest Path Homography-Based Visual Control for Differential Drive Robots
Citation: G. López-Nicolás, C. Sagüés, and J. J. Guerrero. Vision Systems, Shortest Path Homography-Based Visual Control for Differential Drive Robots, chapter 3, pp. 583 596. Edited by Goro Obinata and
More informationScanning and Printing Objects in 3D
Scanning and Printing Objects in 3D Dr. Jürgen Sturm metaio GmbH (formerly Technical University of Munich) My Research Areas Visual navigation for mobile robots RoboCup Kinematic Learning Articulated Objects
More informationWide Area 2D/3D Imaging
Wide Area 2D/3D Imaging Benjamin Langmann Wide Area 2D/3D Imaging Development, Analysis and Applications Benjamin Langmann Hannover, Germany Also PhD Thesis, University of Siegen, 2013 ISBN 978-3-658-06456-3
More informationFinal Project Report: Mobile Pick and Place
Final Project Report: Mobile Pick and Place Xiaoyang Liu (xiaoyan1) Juncheng Zhang (junchen1) Karthik Ramachandran (kramacha) Sumit Saxena (sumits1) Yihao Qian (yihaoq) Adviser: Dr Matthew Travers Carnegie
More informationFactorization Method Using Interpolated Feature Tracking via Projective Geometry
Factorization Method Using Interpolated Feature Tracking via Projective Geometry Hideo Saito, Shigeharu Kamijima Department of Information and Computer Science, Keio University Yokohama-City, 223-8522,
More informationMONOCULAR OBJECT LOCALIZATION BY SUPERQUADRICS CURVATURE REPROJECTION AND MATCHING
GraphiCon 2012 (Moscow, Russia) University of Trento, Italy MONOCULAR OBJECT LOCALIZATION BY SUPERQUADRICS CURVATURE REPROJECTION AND MATCHING Enrico Zappia, Ilya Afanasyev, Nicolo Biasi, Mattia Tavernini,
More informationA model-based approach for tool tracking in laparoscopy
A model-based approach for tool tracking in laparoscopy Potential applications and evaluation challenges Sandrine Voros (INSERM), TIMC-IMAG laboratory Computer Assisted Medical Interventions (CAMI) team
More informationDepth Sensors Kinect V2 A. Fornaser
Depth Sensors Kinect V2 A. Fornaser alberto.fornaser@unitn.it Vision Depth data It is not a 3D data, It is a map of distances Not a 3D, not a 2D it is a 2.5D or Perspective 3D Complete 3D - Tomography
More informationManipulating a Large Variety of Objects and Tool Use in Domestic Service, Industrial Automation, Search and Rescue, and Space Exploration
Manipulating a Large Variety of Objects and Tool Use in Domestic Service, Industrial Automation, Search and Rescue, and Space Exploration Sven Behnke Computer Science Institute VI Autonomous Intelligent
More informationActive Recognition and Manipulation of Simple Parts Exploiting 3D Information
experiment ActReMa Active Recognition and Manipulation of Simple Parts Exploiting 3D Information Experiment Partners: Rheinische Friedrich-Wilhelms-Universität Bonn Metronom Automation GmbH Experiment
More informationWhat is computer vision?
What is computer vision? Computer vision (image understanding) is a discipline that studies how to reconstruct, interpret and understand a 3D scene from its 2D images in terms of the properties of the
More informationObject Shape Reconstruction and Pose Estimation by a Camera Mounted on a Mobile Robot
Object Shape Reconstruction and Pose Estimation by a Camera Mounted on a Mobile Robot Kimitoshi Yamazaki, Masahiro Tomono, Takashi Tsubouchi and Shin ichi Yuta Intelligent Robot Laboratry, Institute of
More informationPairwise Threshold for Gaussian Mixture Classification and its Application on Human Tracking Enhancement
Pairwise Threshold for Gaussian Mixture Classification and its Application on Human Tracking Enhancement Daegeon Kim Sung Chun Lee Institute for Robotics and Intelligent Systems University of Southern
More informationRobot Programming for Assembly Task
Robot Programming for Assembly Task Yukiyasu Domae and Akio Noda Mitsubishi Electric Corporation, JAPAN Motion Planning for Industrial Robots ICRA 2014, June 05 Motivation Automatic assembly system Supply
More informationFully Automatic Endoscope Calibration for Intraoperative Use
Fully Automatic Endoscope Calibration for Intraoperative Use Christian Wengert, Mireille Reeff, Philippe C. Cattin, Gábor Székely Computer Vision Laboratory, ETH Zurich, 8092 Zurich, Switzerland {wengert,
More informationCS 112 The Rendering Pipeline. Slide 1
CS 112 The Rendering Pipeline Slide 1 Rendering Pipeline n Input 3D Object/Scene Representation n Output An image of the input object/scene n Stages (for POLYGON pipeline) n Model view Transformation n
More informationGesture Recognition: Hand Pose Estimation. Adrian Spurr Ubiquitous Computing Seminar FS
Gesture Recognition: Hand Pose Estimation Adrian Spurr Ubiquitous Computing Seminar FS2014 27.05.2014 1 What is hand pose estimation? Input Computer-usable form 2 Augmented Reality Gaming Robot Control
More information3D Perception. CS 4495 Computer Vision K. Hawkins. CS 4495 Computer Vision. 3D Perception. Kelsey Hawkins Robotics
CS 4495 Computer Vision Kelsey Hawkins Robotics Motivation What do animals, people, and robots want to do with vision? Detect and recognize objects/landmarks Find location of objects with respect to themselves
More informationLearning from Successes and Failures to Grasp Objects with a Vacuum Gripper
Learning from Successes and Failures to Grasp Objects with a Vacuum Gripper Luca Monorchio, Daniele Evangelista, Marco Imperoli, and Alberto Pretto Abstract In this work we present an empirical approach
More informationSimultaneous Localization and Mapping (SLAM)
Simultaneous Localization and Mapping (SLAM) RSS Lecture 16 April 8, 2013 Prof. Teller Text: Siegwart and Nourbakhsh S. 5.8 SLAM Problem Statement Inputs: No external coordinate reference Time series of
More informationTEXTURE OVERLAY ONTO NON-RIGID SURFACE USING COMMODITY DEPTH CAMERA
TEXTURE OVERLAY ONTO NON-RIGID SURFACE USING COMMODITY DEPTH CAMERA Tomoki Hayashi, Francois de Sorbier and Hideo Saito Graduate School of Science and Technology, Keio University, 3-14-1 Hiyoshi, Kohoku-ku,
More informationOmnidirectional Visual Control of Mobile Robots based on the 1D Trifocal Tensor
Omnidirectional Visual Control of Mobile Robots based on the D Trifocal Tensor H. M. Becerra, G. López-Nicolás and C. Sagüés Dept. Informática e Ingeniería de Sistemas - Instituto de Investigación en Ingeniería
More informationRobot localization method based on visual features and their geometric relationship
, pp.46-50 http://dx.doi.org/10.14257/astl.2015.85.11 Robot localization method based on visual features and their geometric relationship Sangyun Lee 1, Changkyung Eem 2, and Hyunki Hong 3 1 Department
More informationoutput vector controller y s... y 2 y 1
A Neuro-Fuzzy Solution for Fine-Motion Control Based on Vision and Force Sensors Yorck von Collani, Jianwei Zhang, Alois Knoll Technical Computer Science, Faculty of Technology, University of Bielefeld,
More informationSmall Object Manipulation in 3D Perception Robotic Systems Using Visual Servoing
Small Object Manipulation in 3D Perception Robotic Systems Using Visual Servoing Camilo Perez Quintero, Oscar Ramirez, Mona Gridseth and Martin Jägersand* Abstract Robot manipulation has benefited from
More informationDr. Enrique Cabello Pardos July
Dr. Enrique Cabello Pardos July 20 2011 Dr. Enrique Cabello Pardos July 20 2011 ONCE UPON A TIME, AT THE LABORATORY Research Center Contract Make it possible. (as fast as possible) Use the best equipment.
More informationA novel approach to motion tracking with wearable sensors based on Probabilistic Graphical Models
A novel approach to motion tracking with wearable sensors based on Probabilistic Graphical Models Emanuele Ruffaldi Lorenzo Peppoloni Alessandro Filippeschi Carlo Alberto Avizzano 2014 IEEE International
More informationComputing the relations among three views based on artificial neural network
Computing the relations among three views based on artificial neural network Ying Kin Yu Kin Hong Wong Siu Hang Or Department of Computer Science and Engineering The Chinese University of Hong Kong E-mail:
More informationEE795: Computer Vision and Intelligent Systems
EE795: Computer Vision and Intelligent Systems Spring 2012 TTh 17:30-18:45 FDH 204 Lecture 14 130307 http://www.ee.unlv.edu/~b1morris/ecg795/ 2 Outline Review Stereo Dense Motion Estimation Translational
More informationVISION-BASED HANDLING WITH A MOBILE ROBOT
VISION-BASED HANDLING WITH A MOBILE ROBOT STEFAN BLESSING TU München, Institut für Werkzeugmaschinen und Betriebswissenschaften (iwb), 80290 München, Germany, e-mail: bl@iwb.mw.tu-muenchen.de STEFAN LANSER,
More informationRotation Invariant Image Registration using Robust Shape Matching
International Journal of Electronic and Electrical Engineering. ISSN 0974-2174 Volume 7, Number 2 (2014), pp. 125-132 International Research Publication House http://www.irphouse.com Rotation Invariant
More information3D Computer Vision. Depth Cameras. Prof. Didier Stricker. Oliver Wasenmüller
3D Computer Vision Depth Cameras Prof. Didier Stricker Oliver Wasenmüller Kaiserlautern University http://ags.cs.uni-kl.de/ DFKI Deutsches Forschungszentrum für Künstliche Intelligenz http://av.dfki.de
More informationVirtual Testbeds for Planetary Exploration: The Self Localization Aspect
Virtual Testbeds for Planetary Exploration: The Self Localization Aspect, RWTH Aachen University Björn Sondermann Markus Emde Jürgen Roßmann 1 Content Previous Work Self Localization in terrestrial forestry
More informationGuided Image Super-Resolution: A New Technique for Photogeometric Super-Resolution in Hybrid 3-D Range Imaging
Guided Image Super-Resolution: A New Technique for Photogeometric Super-Resolution in Hybrid 3-D Range Imaging Florin C. Ghesu 1, Thomas Köhler 1,2, Sven Haase 1, Joachim Hornegger 1,2 04.09.2014 1 Pattern
More informationEE 264: Image Processing and Reconstruction. Image Motion Estimation I. EE 264: Image Processing and Reconstruction. Outline
1 Image Motion Estimation I 2 Outline 1. Introduction to Motion 2. Why Estimate Motion? 3. Global vs. Local Motion 4. Block Motion Estimation 5. Optical Flow Estimation Basics 6. Optical Flow Estimation
More informationDept. of Mechanical and Materials Engineering University of Western Ontario London, Ontario, Canada
ACTIVE-VISION FOR THE AUTONOMOUS SURVEILLANCE OF DYNAMIC, MULTI-OBJECT ENVIRONMENTS Ardevan Bakhtari, Michael D. Naish, and Beno Benhabib Computer Integrated Manufacturing Laboratory Dept. of Mechanical
More information3D Modeling from Range Images
1 3D Modeling from Range Images A Comprehensive System for 3D Modeling from Range Images Acquired from a 3D ToF Sensor Dipl.-Inf. March 22th, 2007 Sensor and Motivation 2 3D sensor PMD 1k-S time-of-flight
More informationPROBLEM FORMULATION AND RESEARCH METHODOLOGY
PROBLEM FORMULATION AND RESEARCH METHODOLOGY ON THE SOFT COMPUTING BASED APPROACHES FOR OBJECT DETECTION AND TRACKING IN VIDEOS CHAPTER 3 PROBLEM FORMULATION AND RESEARCH METHODOLOGY The foregoing chapter
More informationFiltering and mapping systems for underwater 3D imaging sonar
Filtering and mapping systems for underwater 3D imaging sonar Tomohiro Koshikawa 1, a, Shin Kato 1,b, and Hitoshi Arisumi 1,c 1 Field Robotics Research Group, National Institute of Advanced Industrial
More informationAutomatic 3-D 3 D Model Acquisition from Range Images. Michael K. Reed and Peter K. Allen Computer Science Department Columbia University
Automatic 3-D 3 D Model Acquisition from Range Images Michael K. Reed and Peter K. Allen Computer Science Department Columbia University Introduction Objective: given an arbitrary object or scene, construct
More informationLocalization and Map Building
Localization and Map Building Noise and aliasing; odometric position estimation To localize or not to localize Belief representation Map representation Probabilistic map-based localization Other examples
More informationROBUST LINE-BASED CALIBRATION OF LENS DISTORTION FROM A SINGLE VIEW
ROBUST LINE-BASED CALIBRATION OF LENS DISTORTION FROM A SINGLE VIEW Thorsten Thormählen, Hellward Broszio, Ingolf Wassermann thormae@tnt.uni-hannover.de University of Hannover, Information Technology Laboratory,
More informationBabyTigers-98: Osaka Legged Robot Team
BabyTigers-98: saka Legged Robot Team Noriaki Mitsunaga and Minoru Asada and Chizuko Mishima Dept. of Adaptive Machine Systems, saka niversity, Suita, saka, 565-0871, Japan Abstract. The saka Legged Robot
More informationTopological Mapping. Discrete Bayes Filter
Topological Mapping Discrete Bayes Filter Vision Based Localization Given a image(s) acquired by moving camera determine the robot s location and pose? Towards localization without odometry What can be
More informationAdvances in 3D data processing and 3D cameras
Advances in 3D data processing and 3D cameras Miguel Cazorla Grupo de Robótica y Visión Tridimensional Universidad de Alicante Contents Cameras and 3D images 3D data compression 3D registration 3D feature
More informationRobot Vision without Calibration
XIV Imeko World Congress. Tampere, 6/97 Robot Vision without Calibration Volker Graefe Institute of Measurement Science Universität der Bw München 85577 Neubiberg, Germany Phone: +49 89 6004-3590, -3587;
More informationREFINEMENT OF COLORED MOBILE MAPPING DATA USING INTENSITY IMAGES
REFINEMENT OF COLORED MOBILE MAPPING DATA USING INTENSITY IMAGES T. Yamakawa a, K. Fukano a,r. Onodera a, H. Masuda a, * a Dept. of Mechanical Engineering and Intelligent Systems, The University of Electro-Communications,
More informationUser-assisted Segmentation and 3D Motion Tracking. Michael Fleder Sudeep Pillai Jeremy Scott
User-assisted Segmentation and 3D Motion Tracking Michael Fleder Sudeep Pillai Jeremy Scott 3D Object Tracking Virtual reality and animation Imitation in robotics Autonomous driving Augmented reality Motivation
More informationHand-Eye Calibration from Image Derivatives
Hand-Eye Calibration from Image Derivatives Abstract In this paper it is shown how to perform hand-eye calibration using only the normal flow field and knowledge about the motion of the hand. The proposed
More informationFast and robust techniques for 3D/2D registration and photo blending on massive point clouds
www.crs4.it/vic/ vcg.isti.cnr.it/ Fast and robust techniques for 3D/2D registration and photo blending on massive point clouds R. Pintus, E. Gobbetti, M.Agus, R. Combet CRS4 Visual Computing M. Callieri
More informationOcclusion Detection of Real Objects using Contour Based Stereo Matching
Occlusion Detection of Real Objects using Contour Based Stereo Matching Kenichi Hayashi, Hirokazu Kato, Shogo Nishida Graduate School of Engineering Science, Osaka University,1-3 Machikaneyama-cho, Toyonaka,
More informationReinforcement Learning for Appearance Based Visual Servoing in Robotic Manipulation
Reinforcement Learning for Appearance Based Visual Servoing in Robotic Manipulation UMAR KHAN, LIAQUAT ALI KHAN, S. ZAHID HUSSAIN Department of Mechatronics Engineering AIR University E-9, Islamabad PAKISTAN
More informationDense 3D Reconstruction. Christiano Gava
Dense 3D Reconstruction Christiano Gava christiano.gava@dfki.de Outline Previous lecture: structure and motion II Structure and motion loop Triangulation Wide baseline matching (SIFT) Today: dense 3D reconstruction
More information