VALIDATION OF 3D ENVIRONMENT PERCEPTION FOR LANDING ON SMALL BODIES USING UAV PLATFORMS

Size: px
Start display at page:

Download "VALIDATION OF 3D ENVIRONMENT PERCEPTION FOR LANDING ON SMALL BODIES USING UAV PLATFORMS"

Transcription

1 ASTRA 2015 VALIDATION OF 3D ENVIRONMENT PERCEPTION FOR LANDING ON SMALL BODIES USING UAV PLATFORMS Property of GMV All rights reserved

2 PERIGEO PROJECT The work presented here is part of the PERIGEO project Co-funded under national spanish INNPRONTA program Objective of the project: Investigate use of UAV as validation platform for the development of space technologies GMV and CATEC (R&D center in Seville) worked together on Autonomous navigation techniques On-board autonomy Optic navigation PERCEPTION FOR NEO LANDING 12/05/2015 Page 2

3 OBJECTIVE OF THE ACTIVITY Within autonomous navigation, the objective has been to: Research algorithms for 3D imaging sensor relative and absolute navigation (to be used in planetary approach and landing scenario on a Near Earth Object) Motivation: current baseline is camera + radar altimeter as navigation sensors for approach and landing. New trend towards less power-hungry 3D imagers. Can they be used for navigation on deep space missions? Development of the selected algorithms in synthetic environment (software-based) Validation of the algorithms with a representative sensor onboard a UAV Are UAV a valid mean to raise TRL for GNC technologies? PERCEPTION FOR NEO LANDING 12/05/2015 Page 3

4 DEVELOPMENT & VALIDATION ENVIRONMENT /1 A data generator (that simulates the 3d imaging sensor) and the corresponding algorithms have been designed and tested Testing has been carried our first on simulation and then on UAV Data has been used from ITOKAWA asteroid PERCEPTION FOR NEO LANDING 12/05/2015 Page 4

5 DEVELOPMENT & VALIDATION ENVIRONMENT /2 ROS has been used as software development environment ROS-GAZEBO as visualization tool Algorithms (PCL) developed in ROS easy to port on UAV PERCEPTION FOR NEO LANDING 12/05/2015 Page 5

6 RELATIVE NAVIGATION /1 Given low 3D sensor resolution, difficult to find robust descriptors. Solution is based on ICP (Iterative Closest Point) between two point clouds (correlation-based approach, considered more robust than feature based approach) ICP flow PERCEPTION FOR NEO LANDING 12/05/2015 Page 6 Alignment of point clouds in simulator

7 RELATIVE NAVIGATION /2 Consecutive point clouds are aligned An overall map is incrementally built to reduce drift In case of registered scans too far apart, the map starts over Y transversal direction Z landing direction PERCEPTION FOR NEO LANDING 12/05/2015 Page 7

8 ABSOLUTE NAVIGATION /1 Need to find a robust descriptor for absolute features Based on VFH (Viewpoint Feature Histogram) Meta-local descriptors, used for object recognition and pose estimation Histogram of angles between viewpoint direction and each normal Training stage with Itokawa model PERCEPTION FOR NEO LANDING 12/05/2015 Page 8

9 ABSOLUTE NAVIGATION /2 Compute VFH descriptor of current point cloud Search for candidates in the training set and select best match in order to get in initial pose Initial posed used for ICP of current point cloud vs map for final pose Training Artificial views generation VFH and pose computation Database storage Implementation VFH computation VFH database matching Initial pose estimation ICP Y Z Final pose estimation X Results along the landing trajectory PERCEPTION FOR NEO LANDING 12/05/2015 Page 9

10 SIMULATION TESTS Simulation tests of navigation in open loop with pre-defined descent trajectories. The following has been tested for 3 scenarios Relative navigation: sensor pose rate error along trajectory Sensor pose error wrt true pose (reference trajectory) Absolute navigation: Sensor pose error along trajectory Quasi-polar landing Quasi-equatorial landing 45deg latitude landing PERCEPTION FOR NEO LANDING 12/05/2015 Page 10

11 SIMULATION TESTS MONTECARLO CAMPAIGN Three Montecarlo campaigns have been carried out to check robustness of algorithms, before going on with experimental tests Manifold of reference trajectories with initial dispersion precalculated Final position errors for absolute navigation +/- 10m +/- 20m +/- 10m Quasi-polar landing Quasi-equatorial landing 45deg latitude landing PERCEPTION FOR NEO LANDING 12/05/2015 Page 11

12 UAV PLATFORM Custom-designed quadcopter ASUS Xtion Pro live used as on-board 3D sensor (similar to Microsoft Kinect): low cost sensor to mimic flashing LIDAR VICON system used for localization Testbed set-up at CATEC PERCEPTION FOR NEO LANDING 12/05/2015 Page 12

13 ITOKAWA MOCKUP USED FOR TESTING The ITOKAWA digital elevation map available from JAXA Hayabusa mission has been used to reproduce a scaled mock-up of the landing site Scale: x45; Fabrication precision: 1 mm Landing site dimensions: 80 m^2 Features have been added in order to enrich the surface, dark grey colour has been added PERCEPTION FOR NEO LANDING 12/05/2015 Page 13

14 HW TEST SETUP 3D NAVIGATION PERCEPTION FOR NEO LANDING 12/05/2015 Page 14

15 EXPERIMENTAL RESULTS DESCENT TRAJECTORY The descent trajectory starts at 150m, ends at 20m (sensor min working distance). Errors in position decrease with height (richer data from sensor) Pose errors stay constant Scaled up to the original scenario we obtain the following results Mean [m] St Dev Position X (m) Position Y (m) Position Z (m) PERCEPTION FOR NEO LANDING 12/05/2015 Page 15

16 EXPERIMENTAL RESULTS HOVERING TRAJECTORY Constant height trajectory, in order to test algorithms to different problems with same mockup. Altitude estimation very stable Good tracking of lateral displacement Pose errors stay constant Scaled up to the real scenario we obtain the following results Mean [m] St Dev Position X (m) Position Y (m) Position Z (m) PERCEPTION FOR NEO LANDING 12/05/2015 Page 16

17 UAV AS VALIDATION PLATFORM FOR SPACE ON-BOARD AUTONOMY GMV has been working on goal oriented on-board autonomy system since several years E4 ESA/ECSS mission autonomy level (see GOAC ESA project presented at ASTRA before) Together with CATEC, we have developed a threelayer controller for UAVs in order to: Further mature and develop a goal-oriented controller Develop planning models for UAV s (based on timelinebased planners EUROPA2) Mature TREX execution layer Test it on a UAV with a robust functional layer (based on ROS) PERCEPTION FOR NEO LANDING 12/05/2015 Page 17

18 ON-BOARD GOAL ORIENTED AUTONOMY Main features of the system: The system has been tested with the goal of performing science On-board resources are continuously checked The planner can react to changes in resources and change its course of action The plan is continuously monitored and adapted Opportunistic science also tested. If a relevant object (rock) is detected, the plan is modified Reacts against unforeseen, hazardouse events (obstacles not present in original map / failure induced in the battery..) Tested indoor in a mars-like environment The following functions are included in the functional layer Path planning Real time obstacle detection and avoidance (sonar altimeter) Target Detection (camera based) PERCEPTION FOR NEO LANDING 12/05/2015 Page 18

19 HW TEST SETUP ONBOARD AUTONOMY PERCEPTION FOR NEO LANDING 12/05/2015 Page 19

20 ARE UAV A GOOD PLATFORM FOR SPACE GNC VALIDATION? UAV has demonstrated being a valid platform for GNC testing for the following reasons: Very robust functional layer Easy transition between simulation and HW The main drawbacks are the following Limited movements and trajectory reproduction (roll/pitch) Limited range Limited control precision (vibration of the UAV), thereby scalability and reproduceability issue Such drawbacks point towards the use of robotic arms for very precise needs, as in navigation tests. PERCEPTION FOR NEO LANDING 12/05/2015 Page 20

21 CONCLUSIONS 3D sensor navigation: Promising results for point cloud estimation in asteroid landing navigation scenario Integration with navigation filter is needed for more in depth assessment Interesting results with UAV tests, although more precise tests could be carried out with robotic arms facilities Autonomous navigation A goal oriented system has been adapted to a robust UAV platform Goal oriented controller further matured UAV are a very interesting validation platform for this application PERCEPTION FOR NEO LANDING 12/05/2015 Page 21

22 Thank you Cristian Chitu (GMV) Giovanni Binet (GMV) Francisco Perez Grau (CATEC) For more information: Property of GMV All rights reserved

VALIDATION OF 3D ENVIRONMENT PERCEPTION FOR LANDING ON SMALL BODIES USING UAV PLATFORMS

VALIDATION OF 3D ENVIRONMENT PERCEPTION FOR LANDING ON SMALL BODIES USING UAV PLATFORMS VALIDATION OF 3D ENVIRONMENT PERCEPTION FOR LANDING ON SMALL BODIES USING UAV PLATFORMS Francisco Perez (1), Jesus Gil (2), Giovanni Binet (2), Antidio Viguria (1) (1) FADA-CATEC, Wilbur y Orville Wright,

More information

Guidance, Navigation and Control issues for Hayabusa follow-on missions F. Terui, N. Ogawa, O. Mori JAXA (Japan Aerospace Exploration Agency )

Guidance, Navigation and Control issues for Hayabusa follow-on missions F. Terui, N. Ogawa, O. Mori JAXA (Japan Aerospace Exploration Agency ) 18-20th May 2009 Guidance, Navigation and Control issues for Hayabusa follow-on missions F. Terui, N. Ogawa, O. Mori JAXA (Japan Aerospace Exploration Agency ) Lessons and Learned & heritage from Proximity

More information

Tightly-Integrated Visual and Inertial Navigation for Pinpoint Landing on Rugged Terrains

Tightly-Integrated Visual and Inertial Navigation for Pinpoint Landing on Rugged Terrains Tightly-Integrated Visual and Inertial Navigation for Pinpoint Landing on Rugged Terrains PhD student: Jeff DELAUNE ONERA Director: Guy LE BESNERAIS ONERA Advisors: Jean-Loup FARGES Clément BOURDARIAS

More information

Navigation for Future Space Exploration Missions Based on Imaging LiDAR Technologies. Alexandre Pollini Amsterdam,

Navigation for Future Space Exploration Missions Based on Imaging LiDAR Technologies. Alexandre Pollini Amsterdam, Navigation for Future Space Exploration Missions Based on Imaging LiDAR Technologies Alexandre Pollini Amsterdam, 12.11.2013 Presentation outline The needs: missions scenario Current benchmark in space

More information

Rendezvous sensors and navigation

Rendezvous sensors and navigation Clean Space Industrial Days Rendezvous sensors and navigation 23-27 th May 2016 Nicolas Deslaef (TAS-F) Julien Christy (TAS-F) 83230918-DOC-TAS-FR-001 OPEN Agenda 2 Collection of R&T studies enabling vision

More information

UAV Autonomous Navigation in a GPS-limited Urban Environment

UAV Autonomous Navigation in a GPS-limited Urban Environment UAV Autonomous Navigation in a GPS-limited Urban Environment Yoko Watanabe DCSD/CDIN JSO-Aerial Robotics 2014/10/02-03 Introduction 2 Global objective Development of a UAV onboard system to maintain flight

More information

CS4495/6495 Introduction to Computer Vision

CS4495/6495 Introduction to Computer Vision CS4495/6495 Introduction to Computer Vision 9C-L1 3D perception Some slides by Kelsey Hawkins Motivation Why do animals, people & robots need vision? To detect and recognize objects/landmarks Is that a

More information

H2020 Space Robotic SRC- OG4

H2020 Space Robotic SRC- OG4 H2020 Space Robotic SRC- OG4 2 nd PERASPERA workshop Presentation by Sabrina Andiappane Thales Alenia Space France This project has received funding from the European Union s Horizon 2020 research and

More information

H2020 Space Robotic SRC- OG4

H2020 Space Robotic SRC- OG4 H2020 Space Robotic SRC- OG4 CCT/COMET ORB Workshop on Space Rendezvous 05/12/2017 «Smart Sensors for Smart Missions» Contacts: Sabrina Andiappane, sabrina.andiappane@thalesaleniaspace.com Vincent Dubanchet,

More information

Planetary Rover Absolute Localization by Combining Visual Odometry with Orbital Image Measurements

Planetary Rover Absolute Localization by Combining Visual Odometry with Orbital Image Measurements Planetary Rover Absolute Localization by Combining Visual Odometry with Orbital Image Measurements M. Lourakis and E. Hourdakis Institute of Computer Science Foundation for Research and Technology Hellas

More information

USE OF COTS ROBOTICS FOR ON-GROUND VALIDATION OF SPACE GNC SYSTEMS: PLATFORM DYNAMIC TEST BENCH I-SAIRAS 2012 TURIN, ITALY 4-6 SEPTEMBER 2012

USE OF COTS ROBOTICS FOR ON-GROUND VALIDATION OF SPACE GNC SYSTEMS: PLATFORM DYNAMIC TEST BENCH I-SAIRAS 2012 TURIN, ITALY 4-6 SEPTEMBER 2012 USE OF COTS ROBOTICS FOR ON-GROUND VALIDATION OF SPACE GNC SYSTEMS: PLATFORM DYNAMIC TEST BENCH I-SAIRAS 212 TURIN, ITALY 4-6 SEPTEMBER 212 Matteo Suatoni (1), Luis Mollinedo (1), Valentín Barrena (1),

More information

Innovative Visual Navigation Solutions for ESA s Lunar Lander Mission Dr. E. Zaunick, D. Fischer, Dr. I. Ahrns, G. Orlando, B. Polle, E.

Innovative Visual Navigation Solutions for ESA s Lunar Lander Mission Dr. E. Zaunick, D. Fischer, Dr. I. Ahrns, G. Orlando, B. Polle, E. Lunar Lander Phase B1 Innovative Visual Navigation Solutions for ESA s Lunar Lander Mission Dr. E. Zaunick, D. Fischer, Dr. I. Ahrns, G. Orlando, B. Polle, E. Kervendal p. 0 9 th International Planetary

More information

Safe Long-Range Travel for Planetary Rovers through Forward Sensing

Safe Long-Range Travel for Planetary Rovers through Forward Sensing Safe Long-Range Travel for Planetary Rovers through Forward Sensing 12 th ESA Workshop on Advanced Space Technologies for Robotics & Automation Yashodhan Nevatia Space Applications Services May 16 th,

More information

Set up and Foundation of the Husky

Set up and Foundation of the Husky Set up and Foundation of the Husky Marisa Warner, Jeremy Gottlieb, Gabriel Elkaim Worcester Polytechnic Institute University of California, Santa Cruz Abstract Clearpath s Husky A200 is an unmanned ground

More information

LAUROPE Six Legged Walking Robot for Planetary Exploration participating in the SpaceBot Cup

LAUROPE Six Legged Walking Robot for Planetary Exploration participating in the SpaceBot Cup FZI RESEARCH CENTER FOR INFORMATION TECHNOLOGY LAUROPE Six Legged Walking Robot for Planetary Exploration participating in the SpaceBot Cup ASTRA 2015, ESA/ESTEC, Noordwijk 12. Mai 2015 Outline SpaceBot

More information

Unmanned Vehicle Technology Researches for Outdoor Environments. *Ju-Jang Lee 1)

Unmanned Vehicle Technology Researches for Outdoor Environments. *Ju-Jang Lee 1) Keynote Paper Unmanned Vehicle Technology Researches for Outdoor Environments *Ju-Jang Lee 1) 1) Department of Electrical Engineering, KAIST, Daejeon 305-701, Korea 1) jjlee@ee.kaist.ac.kr ABSTRACT The

More information

MULTI-MODAL MAPPING. Robotics Day, 31 Mar Frank Mascarich, Shehryar Khattak, Tung Dang

MULTI-MODAL MAPPING. Robotics Day, 31 Mar Frank Mascarich, Shehryar Khattak, Tung Dang MULTI-MODAL MAPPING Robotics Day, 31 Mar 2017 Frank Mascarich, Shehryar Khattak, Tung Dang Application-Specific Sensors Cameras TOF Cameras PERCEPTION LiDAR IMU Localization Mapping Autonomy Robotic Perception

More information

Vision Based GNC Systems for Planetary Exploration

Vision Based GNC Systems for Planetary Exploration Abstract Vision Based GNC Systems for Planetary Exploration S. Mancuso ESA ESTEC, Noordwijk, The Netherlands In the frame of planetary exploration, among the Guidance Navigation and Control activities

More information

3D Perception. CS 4495 Computer Vision K. Hawkins. CS 4495 Computer Vision. 3D Perception. Kelsey Hawkins Robotics

3D Perception. CS 4495 Computer Vision K. Hawkins. CS 4495 Computer Vision. 3D Perception. Kelsey Hawkins Robotics CS 4495 Computer Vision Kelsey Hawkins Robotics Motivation What do animals, people, and robots want to do with vision? Detect and recognize objects/landmarks Find location of objects with respect to themselves

More information

t Bench for Robotics and Autonomy Andrea Merlo

t Bench for Robotics and Autonomy Andrea Merlo t Bench for Robotics and Autonomy Andrea Merlo Agenda Introduction TBRA Overview Objectives Architecture / Technical Description Status Test Results Roadmap he context of a Rover, dance, Navigation and

More information

Preface...vii. Printed vs PDF Versions of the Book...ix. 1. Scope of this Volume Installing the ros-by-example Code...3

Preface...vii. Printed vs PDF Versions of the Book...ix. 1. Scope of this Volume Installing the ros-by-example Code...3 Contents Preface...vii Printed vs PDF Versions of the Book...ix 1. Scope of this Volume...1 2. Installing the ros-by-example Code...3 3. Task Execution using ROS...7 3.1 A Fake Battery Simulator...8 3.2

More information

ASTRIUM Space Transportation

ASTRIUM Space Transportation SIMU-LANDER Hazard avoidance & advanced GNC for interplanetary descent and soft-landing S. Reynaud, E. Ferreira, S. Trinh, T. Jean-marius 3rd International Workshop on Astrodynamics Tools and Techniques

More information

Lecture: Autonomous micro aerial vehicles

Lecture: Autonomous micro aerial vehicles Lecture: Autonomous micro aerial vehicles Friedrich Fraundorfer Remote Sensing Technology TU München 1/41 Autonomous operation@eth Zürich Start 2/41 Autonomous operation@eth Zürich 3/41 Outline MAV system

More information

AUTONOMOUS LONG-RANGE ROVER NAVIGATION EXPERIMENTAL RESULTS

AUTONOMOUS LONG-RANGE ROVER NAVIGATION EXPERIMENTAL RESULTS AUTONOMOUS LONG-RANGE ROVER NAVIGATION EXPERIMENTAL RESULTS Erick Dupuis, Joseph Nsasi Bakambu, Ioannis Rekleitis, Jean-Luc Bedwani, Sébastien Gemme, Jean-Patrice Rivest-Caissy Canadian Space Agency 6767

More information

AMR 2011/2012: Final Projects

AMR 2011/2012: Final Projects AMR 2011/2012: Final Projects 0. General Information A final project includes: studying some literature (typically, 1-2 papers) on a specific subject performing some simulations or numerical tests on an

More information

CLICK TO EDIT MASTERTITLE

CLICK TO EDIT MASTERTITLE www.gmv.com CLICK TO EDIT MASTER SUBTITLE QUEENS-FPGA: Quality Evaluation of European New SW for BRAVE FPGA * Titles must be written in capital letters CLICK TO EDIT MASTERTITLE SEFUW 2018 ESTEC 11th April

More information

InFuse: A Comprehensive Framework for Data Fusion in Space Robotics

InFuse: A Comprehensive Framework for Data Fusion in Space Robotics InFuse InFuse: A Comprehensive Framework for Data Fusion in Space Robotics June 20 th, 2017 Shashank Govindaraj (Space Applications Services, Belgium) Overview 1. Motivations & Objectives 2. InFuse within

More information

Gaussian Process-based Visual Servoing Framework for an Aerial Parallel Manipulator

Gaussian Process-based Visual Servoing Framework for an Aerial Parallel Manipulator Gaussian Process-based Visual Servoing Framework for an Aerial Parallel Manipulator Sungwook Cho, David Hyunchul Shim and Jinwhan Kim Korea Advanced Institute of Science and echnology (KAIS), Daejeon,

More information

Autonomous Navigation of Humanoid Using Kinect. Harshad Sawhney Samyak Daga 11633

Autonomous Navigation of Humanoid Using Kinect. Harshad Sawhney Samyak Daga 11633 Autonomous Navigation of Humanoid Using Kinect Harshad Sawhney 11297 Samyak Daga 11633 Motivation Humanoid Space Missions http://www.buquad.com Motivation Disaster Recovery Operations http://www.designnews.com

More information

Aerial Robotic Autonomous Exploration & Mapping in Degraded Visual Environments. Kostas Alexis Autonomous Robots Lab, University of Nevada, Reno

Aerial Robotic Autonomous Exploration & Mapping in Degraded Visual Environments. Kostas Alexis Autonomous Robots Lab, University of Nevada, Reno Aerial Robotic Autonomous Exploration & Mapping in Degraded Visual Environments Kostas Alexis Autonomous Robots Lab, University of Nevada, Reno Motivation Aerial robotic operation in GPS-denied Degraded

More information

Efficient SLAM Scheme Based ICP Matching Algorithm Using Image and Laser Scan Information

Efficient SLAM Scheme Based ICP Matching Algorithm Using Image and Laser Scan Information Proceedings of the World Congress on Electrical Engineering and Computer Systems and Science (EECSS 2015) Barcelona, Spain July 13-14, 2015 Paper No. 335 Efficient SLAM Scheme Based ICP Matching Algorithm

More information

Sampling Site Close-Up Camera for Small Body Sample Return Mission

Sampling Site Close-Up Camera for Small Body Sample Return Mission Sampling Site Close-Up Camera for Small Body Sample Return Mission Naoko Ogawa *1 Hirohide Demura *2 Naru Hirata *2 Hajime Yano *1*3 Makoto Yoshikawa *1*3 *1 JAXA Space Exploration Center, JAXA *2 The

More information

3D Time-of-Flight Image Sensor Solutions for Mobile Devices

3D Time-of-Flight Image Sensor Solutions for Mobile Devices 3D Time-of-Flight Image Sensor Solutions for Mobile Devices SEMICON Europa 2015 Imaging Conference Bernd Buxbaum 2015 pmdtechnologies gmbh c o n f i d e n t i a l Content Introduction Motivation for 3D

More information

Removing Moving Objects from Point Cloud Scenes

Removing Moving Objects from Point Cloud Scenes Removing Moving Objects from Point Cloud Scenes Krystof Litomisky and Bir Bhanu University of California, Riverside krystof@litomisky.com, bhanu@ee.ucr.edu Abstract. Three-dimensional simultaneous localization

More information

Learning Semantic Environment Perception for Cognitive Robots

Learning Semantic Environment Perception for Cognitive Robots Learning Semantic Environment Perception for Cognitive Robots Sven Behnke University of Bonn, Germany Computer Science Institute VI Autonomous Intelligent Systems Some of Our Cognitive Robots Equipped

More information

Automating Data Alignment from Multiple Collects Author: David Janssen Optech Incorporated,Senior Technical Engineer

Automating Data Alignment from Multiple Collects Author: David Janssen Optech Incorporated,Senior Technical Engineer Automating Data Alignment from Multiple Collects Author: David Janssen Optech Incorporated,Senior Technical Engineer Stand in Presenter: David Collison Optech Incorporated, Regional Sales Manager Introduction

More information

Stable Vision-Aided Navigation for Large-Area Augmented Reality

Stable Vision-Aided Navigation for Large-Area Augmented Reality Stable Vision-Aided Navigation for Large-Area Augmented Reality Taragay Oskiper, Han-Pang Chiu, Zhiwei Zhu Supun Samarasekera, Rakesh Teddy Kumar Vision and Robotics Laboratory SRI-International Sarnoff,

More information

State Estimation for Continuous-Time Systems with Perspective Outputs from Discrete Noisy Time-Delayed Measurements

State Estimation for Continuous-Time Systems with Perspective Outputs from Discrete Noisy Time-Delayed Measurements State Estimation for Continuous-Time Systems with Perspective Outputs from Discrete Noisy Time-Delayed Measurements António Pedro Aguiar aguiar@ece.ucsb.edu João Pedro Hespanha hespanha@ece.ucsb.edu Dept.

More information

NAVIGATION SYSTEM OF AN OUTDOOR SERVICE ROBOT WITH HYBRID LOCOMOTION SYSTEM

NAVIGATION SYSTEM OF AN OUTDOOR SERVICE ROBOT WITH HYBRID LOCOMOTION SYSTEM NAVIGATION SYSTEM OF AN OUTDOOR SERVICE ROBOT WITH HYBRID LOCOMOTION SYSTEM Jorma Selkäinaho, Aarne Halme and Janne Paanajärvi Automation Technology Laboratory, Helsinki University of Technology, Espoo,

More information

Field-of-view dependent registration of point clouds and incremental segmentation of table-tops using time-offlight

Field-of-view dependent registration of point clouds and incremental segmentation of table-tops using time-offlight Field-of-view dependent registration of point clouds and incremental segmentation of table-tops using time-offlight cameras Dipl.-Ing. Georg Arbeiter Fraunhofer Institute for Manufacturing Engineering

More information

Virtual Testbeds for Planetary Exploration: The Self Localization Aspect

Virtual Testbeds for Planetary Exploration: The Self Localization Aspect Virtual Testbeds for Planetary Exploration: The Self Localization Aspect, RWTH Aachen University Björn Sondermann Markus Emde Jürgen Roßmann 1 Content Previous Work Self Localization in terrestrial forestry

More information

Simultaneous Localization and Mapping (SLAM)

Simultaneous Localization and Mapping (SLAM) Simultaneous Localization and Mapping (SLAM) RSS Lecture 16 April 8, 2013 Prof. Teller Text: Siegwart and Nourbakhsh S. 5.8 SLAM Problem Statement Inputs: No external coordinate reference Time series of

More information

VALIDATION AND TUNNING OF DENSE STEREO-VISION SYSTEMS USING HI-RESOLUTION 3D REFERENCE MODELS

VALIDATION AND TUNNING OF DENSE STEREO-VISION SYSTEMS USING HI-RESOLUTION 3D REFERENCE MODELS VALIDATION AND TUNNING OF DENSE STEREOVISION SYSTEMS USING HIRESOLUTION 3D REFERENCE MODELS E. REMETEAN (CNES) S. MAS (MAGELLIUM) JB GINESTET (MAGELLIUM) L.RASTEL (CNES) ASTRA 14.04.2011 CONTENT Validation

More information

Master Automática y Robótica. Técnicas Avanzadas de Vision: Visual Odometry. by Pascual Campoy Computer Vision Group

Master Automática y Robótica. Técnicas Avanzadas de Vision: Visual Odometry. by Pascual Campoy Computer Vision Group Master Automática y Robótica Técnicas Avanzadas de Vision: by Pascual Campoy Computer Vision Group www.vision4uav.eu Centro de Automá

More information

12 June Flight Testing a Vision-Based Navigation and Hazard Detection and Avoidance (VN&HDA) Experiment over a Mars-Representative Terrain

12 June Flight Testing a Vision-Based Navigation and Hazard Detection and Avoidance (VN&HDA) Experiment over a Mars-Representative Terrain Flight Testing a Vision-Based Navigation and Hazard Detection and Avoidance (VN&HDA) Experiment over a Mars-Representative Terrain IPPW 2018: 15th International Planetary Probe Workshop 12 June 2018 Spin.Works,

More information

Transactions on Information and Communications Technologies vol 16, 1996 WIT Press, ISSN

Transactions on Information and Communications Technologies vol 16, 1996 WIT Press,   ISSN ransactions on Information and Communications echnologies vol 6, 996 WI Press, www.witpress.com, ISSN 743-357 Obstacle detection using stereo without correspondence L. X. Zhou & W. K. Gu Institute of Information

More information

Monitoring the environment with a Cloud Robotics Service

Monitoring the environment with a Cloud Robotics Service Monitoring the environment with a Cloud Robotics Service Ludovico O. Russo ludus.russo@gmail.com Outline Introduction Service Robotics Autonomous Navigation Cloud Robotics Robot Based Environmental Monitoring

More information

Personal Navigation and Indoor Mapping: Performance Characterization of Kinect Sensor-based Trajectory Recovery

Personal Navigation and Indoor Mapping: Performance Characterization of Kinect Sensor-based Trajectory Recovery Personal Navigation and Indoor Mapping: Performance Characterization of Kinect Sensor-based Trajectory Recovery 1 Charles TOTH, 1 Dorota BRZEZINSKA, USA 2 Allison KEALY, Australia, 3 Guenther RETSCHER,

More information

3D Environment Reconstruction

3D Environment Reconstruction 3D Environment Reconstruction Using Modified Color ICP Algorithm by Fusion of a Camera and a 3D Laser Range Finder The 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems October 11-15,

More information

Aided-inertial for GPS-denied Navigation and Mapping

Aided-inertial for GPS-denied Navigation and Mapping Aided-inertial for GPS-denied Navigation and Mapping Erik Lithopoulos Applanix Corporation 85 Leek Crescent, Richmond Ontario, Canada L4B 3B3 elithopoulos@applanix.com ABSTRACT This paper describes the

More information

3D Photography: Stereo

3D Photography: Stereo 3D Photography: Stereo Marc Pollefeys, Torsten Sattler Spring 2016 http://www.cvg.ethz.ch/teaching/3dvision/ 3D Modeling with Depth Sensors Today s class Obtaining depth maps / range images unstructured

More information

Team Description Paper Team AutonOHM

Team Description Paper Team AutonOHM Team Description Paper Team AutonOHM Jon Martin, Daniel Ammon, Helmut Engelhardt, Tobias Fink, Tobias Scholz, and Marco Masannek University of Applied Science Nueremberg Georg-Simon-Ohm, Kesslerplatz 12,

More information

F1/10 th Autonomous Racing. Localization. Nischal K N

F1/10 th Autonomous Racing. Localization. Nischal K N F1/10 th Autonomous Racing Localization Nischal K N System Overview Mapping Hector Mapping Localization Path Planning Control System Overview Mapping Hector Mapping Localization Adaptive Monte Carlo Localization

More information

3D Photography: Active Ranging, Structured Light, ICP

3D Photography: Active Ranging, Structured Light, ICP 3D Photography: Active Ranging, Structured Light, ICP Kalin Kolev, Marc Pollefeys Spring 2013 http://cvg.ethz.ch/teaching/2013spring/3dphoto/ Schedule (tentative) Feb 18 Feb 25 Mar 4 Mar 11 Mar 18 Mar

More information

Alignment of Centimeter Scale Bathymetry using Six Degrees of Freedom

Alignment of Centimeter Scale Bathymetry using Six Degrees of Freedom Alignment of Centimeter Scale Bathymetry using Six Degrees of Freedom Ethan Slattery, University of California Santa Cruz Mentors: David Caress Summer 2018 Keywords: point-clouds, iterative closest point,

More information

CSE 527: Introduction to Computer Vision

CSE 527: Introduction to Computer Vision CSE 527: Introduction to Computer Vision Week 10 Class 2: Visual Odometry November 2nd, 2017 Today Visual Odometry Intro Algorithm SLAM Visual Odometry Input Output Images, Video Camera trajectory, motion

More information

Camera Drones Lecture 2 Control and Sensors

Camera Drones Lecture 2 Control and Sensors Camera Drones Lecture 2 Control and Sensors Ass.Prof. Friedrich Fraundorfer WS 2017 1 Outline Quadrotor control principles Sensors 2 Quadrotor control - Hovering Hovering means quadrotor needs to hold

More information

Scan Matching. Pieter Abbeel UC Berkeley EECS. Many slides adapted from Thrun, Burgard and Fox, Probabilistic Robotics

Scan Matching. Pieter Abbeel UC Berkeley EECS. Many slides adapted from Thrun, Burgard and Fox, Probabilistic Robotics Scan Matching Pieter Abbeel UC Berkeley EECS Many slides adapted from Thrun, Burgard and Fox, Probabilistic Robotics Scan Matching Overview Problem statement: Given a scan and a map, or a scan and a scan,

More information

People Tracking for Enabling Human-Robot Interaction in Large Public Spaces

People Tracking for Enabling Human-Robot Interaction in Large Public Spaces Dražen Brščić University of Rijeka, Faculty of Engineering http://www.riteh.uniri.hr/~dbrscic/ People Tracking for Enabling Human-Robot Interaction in Large Public Spaces This work was largely done at

More information

Aided-inertial for Long-term, Self-contained GPS-denied Navigation and Mapping

Aided-inertial for Long-term, Self-contained GPS-denied Navigation and Mapping Aided-inertial for Long-term, Self-contained GPS-denied Navigation and Mapping Erik Lithopoulos, Louis Lalumiere, Ron Beyeler Applanix Corporation Greg Spurlock, LTC Bruce Williams Defense Threat Reduction

More information

Efficient Surface and Feature Estimation in RGBD

Efficient Surface and Feature Estimation in RGBD Efficient Surface and Feature Estimation in RGBD Zoltan-Csaba Marton, Dejan Pangercic, Michael Beetz Intelligent Autonomous Systems Group Technische Universität München RGB-D Workshop on 3D Perception

More information

Structured Light II. Thanks to Ronen Gvili, Szymon Rusinkiewicz and Maks Ovsjanikov

Structured Light II. Thanks to Ronen Gvili, Szymon Rusinkiewicz and Maks Ovsjanikov Structured Light II Johannes Köhler Johannes.koehler@dfki.de Thanks to Ronen Gvili, Szymon Rusinkiewicz and Maks Ovsjanikov Introduction Previous lecture: Structured Light I Active Scanning Camera/emitter

More information

Real-time Algorithmic Detection of a Landing Site using Sensors aboard a Lunar Lander

Real-time Algorithmic Detection of a Landing Site using Sensors aboard a Lunar Lander Real-time Algorithmic Detection of a Landing Site using Sensors aboard a Lunar Lander Ina Fiterau Venkat Raman Senapati School of Computer Science Electrical & Computer Engineering Carnegie Mellon University

More information

Real-time Obstacle Avoidance and Mapping for AUVs Operating in Complex Environments

Real-time Obstacle Avoidance and Mapping for AUVs Operating in Complex Environments Real-time Obstacle Avoidance and Mapping for AUVs Operating in Complex Environments Jacques C. Leedekerken, John J. Leonard, Michael C. Bosse, and Arjuna Balasuriya Massachusetts Institute of Technology

More information

Dense Tracking and Mapping for Autonomous Quadrocopters. Jürgen Sturm

Dense Tracking and Mapping for Autonomous Quadrocopters. Jürgen Sturm Computer Vision Group Prof. Daniel Cremers Dense Tracking and Mapping for Autonomous Quadrocopters Jürgen Sturm Joint work with Frank Steinbrücker, Jakob Engel, Christian Kerl, Erik Bylow, and Daniel Cremers

More information

3D object recognition used by team robotto

3D object recognition used by team robotto 3D object recognition used by team robotto Workshop Juliane Hoebel February 1, 2016 Faculty of Computer Science, Otto-von-Guericke University Magdeburg Content 1. Introduction 2. Depth sensor 3. 3D object

More information

3D Collision Avoidance for Navigation in Unstructured Environments

3D Collision Avoidance for Navigation in Unstructured Environments 3D Collision Avoidance for Navigation in Unstructured Environments Armin Hornung Humanoid Robots Lab, University of Freiburg May 5, 2011 Motivation Personal robots are to operate in arbitrary complex environments:

More information

Space Robotics. Ioannis Rekleitis

Space Robotics. Ioannis Rekleitis Space Robotics Ioannis Rekleitis On-Orbit Servicing of Satellites Work done at the Canadian Space Agency Guy Rouleau, Ioannis Rekleitis, Régent L'Archevêque, Eric Martin, Kourosh Parsa, and Erick Dupuis

More information

HOG-Based Person Following and Autonomous Returning Using Generated Map by Mobile Robot Equipped with Camera and Laser Range Finder

HOG-Based Person Following and Autonomous Returning Using Generated Map by Mobile Robot Equipped with Camera and Laser Range Finder HOG-Based Person Following and Autonomous Returning Using Generated Map by Mobile Robot Equipped with Camera and Laser Range Finder Masashi Awai, Takahito Shimizu and Toru Kaneko Department of Mechanical

More information

Dense 3D Reconstruction from Autonomous Quadrocopters

Dense 3D Reconstruction from Autonomous Quadrocopters Dense 3D Reconstruction from Autonomous Quadrocopters Computer Science & Mathematics TU Munich Martin Oswald, Jakob Engel, Christian Kerl, Frank Steinbrücker, Jan Stühmer & Jürgen Sturm Autonomous Quadrocopters

More information

MASTER: Mobile Autonomous Scientist for Terrestrial and Extra-terrestrial Research

MASTER: Mobile Autonomous Scientist for Terrestrial and Extra-terrestrial Research MASTER: Mobile Autonomous Scientist for Terrestrial and Extra-terrestrial Research Dr. Iain Wallace, Dr. Mark Woods Autonomous & Intelligent Systems Group Wednesday 13 th May 2015 What is MASTER? Why do

More information

Autonomous Corridor Flight of a UAV Using alow-costandlight-weightrgb-dcamera

Autonomous Corridor Flight of a UAV Using alow-costandlight-weightrgb-dcamera Autonomous Corridor Flight of a UAV Using alow-costandlight-weightrgb-dcamera Sven Lange, Niko Sünderhauf,Peer Neubert,Sebastian Drews, and Peter Protzel Abstract. We describe the first application of

More information

Anibal Ollero Professor and head of GRVC University of Seville (Spain)

Anibal Ollero Professor and head of GRVC University of Seville (Spain) Aerial Manipulation Anibal Ollero Professor and head of GRVC University of Seville (Spain) aollero@us.es Scientific Advisor of the Center for Advanced Aerospace Technologies (Seville, Spain) aollero@catec.aero

More information

3D Computer Vision. Structured Light II. Prof. Didier Stricker. Kaiserlautern University.

3D Computer Vision. Structured Light II. Prof. Didier Stricker. Kaiserlautern University. 3D Computer Vision Structured Light II Prof. Didier Stricker Kaiserlautern University http://ags.cs.uni-kl.de/ DFKI Deutsches Forschungszentrum für Künstliche Intelligenz http://av.dfki.de 1 Introduction

More information

Presented by Dr. Mark Woods. 15 th May 2013 ESTEC

Presented by Dr. Mark Woods. 15 th May 2013 ESTEC Presented by Dr. Mark Woods 15 th May 2013 ESTEC Seeker Long Range Autonomous Navigation in the Atacama Desert - Chile Field Trial Team - Andy Shaw, Brian Maddison, Aron Kisdi, Wayne Tubbey, Estelle Tidey,

More information

Seminar Dept. Automação e Sistemas - UFSC Scan-to-Map Matching Using the Hausdorff Distance for Robust Mobile Robot Localization

Seminar Dept. Automação e Sistemas - UFSC Scan-to-Map Matching Using the Hausdorff Distance for Robust Mobile Robot Localization Seminar Dept. Automação e Sistemas - UFSC Scan-to-Map Matching Using the Hausdorff Distance for Robust Mobile Robot Localization Work presented at ICRA 2008, jointly with ANDRES GUESALAGA PUC Chile Miguel

More information

Developing Algorithms for Robotics and Autonomous Systems

Developing Algorithms for Robotics and Autonomous Systems Developing Algorithms for Robotics and Autonomous Systems Jorik Caljouw 2015 The MathWorks, Inc. 1 Key Takeaway of this Talk Success in developing an autonomous robotics system requires: 1. Multi-domain

More information

Jena-Optronik Relative Navigation Sensor Activities

Jena-Optronik Relative Navigation Sensor Activities Jena-Optronik Relative Navigation Sensor Activities ESA AIM Industry Day Jena-Optronik Relative Navigation Sensor Activities ESA AIM Industry Day. Page 1 Space developments from Jena. 1976 1980 1991 1994

More information

Multibody reconstruction of the dynamic scene surrounding a vehicle using a wide baseline and multifocal stereo system

Multibody reconstruction of the dynamic scene surrounding a vehicle using a wide baseline and multifocal stereo system Multibody reconstruction of the dynamic scene surrounding a vehicle using a wide baseline and multifocal stereo system Laurent Mennillo 1,2, Éric Royer1, Frédéric Mondot 2, Johann Mousain 2, Michel Dhome

More information

Satellite Attitude Determination

Satellite Attitude Determination Satellite Attitude Determination AERO4701 Space Engineering 3 Week 5 Last Week Looked at GPS signals and pseudorange error terms Looked at GPS positioning from pseudorange data Looked at GPS error sources,

More information

Introduction to Information Science and Technology (IST) Part IV: Intelligent Machines and Robotics Planning

Introduction to Information Science and Technology (IST) Part IV: Intelligent Machines and Robotics Planning Introduction to Information Science and Technology (IST) Part IV: Intelligent Machines and Robotics Planning Sören Schwertfeger / 师泽仁 ShanghaiTech University ShanghaiTech University - SIST - 10.05.2017

More information

USVs for Hydrographic Survey of Inland Waterways

USVs for Hydrographic Survey of Inland Waterways USVs for Hydrographic Survey of Inland Waterways John Tamplin President Seafloor Systems, Inc. MAY 9, 2017 USVs for Hydrographic Survey of Inland Waters Tools, Preparation, and Implementation of Unmanned

More information

BendIT An Interactive Game with two Robots

BendIT An Interactive Game with two Robots BendIT An Interactive Game with two Robots Tim Niemueller, Stefan Schiffer, Albert Helligrath, Safoura Rezapour Lakani, and Gerhard Lakemeyer Knowledge-based Systems Group RWTH Aachen University, Aachen,

More information

Surveying like never before

Surveying like never before CAD functionalities GCP Mapping and Aerial Image Processing Software for Land Surveying Specialists Surveying like never before www.3dsurvey.si Modri Planet d.o.o., Distributors: info@3dsurvey.si +386

More information

User-assisted Segmentation and 3D Motion Tracking. Michael Fleder Sudeep Pillai Jeremy Scott

User-assisted Segmentation and 3D Motion Tracking. Michael Fleder Sudeep Pillai Jeremy Scott User-assisted Segmentation and 3D Motion Tracking Michael Fleder Sudeep Pillai Jeremy Scott 3D Object Tracking Virtual reality and animation Imitation in robotics Autonomous driving Augmented reality Motivation

More information

Vision-based Mobile Robot Localization and Mapping using Scale-Invariant Features

Vision-based Mobile Robot Localization and Mapping using Scale-Invariant Features Vision-based Mobile Robot Localization and Mapping using Scale-Invariant Features Stephen Se, David Lowe, Jim Little Department of Computer Science University of British Columbia Presented by Adam Bickett

More information

Towards Autonomous Vehicle. What is an autonomous vehicle? Vehicle driving on its own with zero mistakes How? Using sensors

Towards Autonomous Vehicle. What is an autonomous vehicle? Vehicle driving on its own with zero mistakes How? Using sensors 7 May 2017 Disclaimer Towards Autonomous Vehicle What is an autonomous vehicle? Vehicle driving on its own with zero mistakes How? Using sensors Why Vision Sensors? Humans use both eyes as main sense

More information

ALL-IN-ONE DRONE SOLUTION FOR 3D MODELING

ALL-IN-ONE DRONE SOLUTION FOR 3D MODELING ALL-IN-ONE DRONE SOLUTION FOR 3D MODELING Powered by PHOTO & VIDEO FULL HD 1080P - 14MPX 3-AXIS STABILIZATION AUGMENTED POWER 30MIN FLIGHT TIME 32GB INTERNAL MEMORY INCLUDES 3D MODELING SOFTWARE SAFE VIEW

More information

Angles-Only Autonomous Rendezvous Navigation to a Space Resident Object

Angles-Only Autonomous Rendezvous Navigation to a Space Resident Object aa.stanford.edu damicos@stanford.edu stanford.edu Angles-Only Autonomous Rendezvous Navigation to a Space Resident Object Josh Sullivan PhD. Candidate, Space Rendezvous Laboratory PI: Dr. Simone D Amico

More information

Applying Model Predictive Control Architecture for Efficient Autonomous Data Collection and Operations on Planetary Missions

Applying Model Predictive Control Architecture for Efficient Autonomous Data Collection and Operations on Planetary Missions Applying Model Predictive Control Architecture for Efficient Autonomous Data Collection and Operations on Planetary Missions M. Lieber, E. Schindhelm, R. Rohrschneider, C. Weimer, S. Roark Cahill Center

More information

A multilevel simulation framework for highly automated harvest processes enabled by environmental sensor systems

A multilevel simulation framework for highly automated harvest processes enabled by environmental sensor systems A multilevel simulation framework for highly automated harvest processes enabled by environmental sensor systems Jannik Redenius, M.Sc., Matthias Dingwerth, M.Sc., Prof. Dr. Arno Ruckelshausen, Faculty

More information

HARDWARE IN THE LOOP VALIDATION OF GNC FOR RVD/RVC SCENARIOS

HARDWARE IN THE LOOP VALIDATION OF GNC FOR RVD/RVC SCENARIOS AAS 13-13 HARDWARE IN THE LOOP VALIDATION OF GNC FOR RVD/RVC SCENARIOS Pablo Colmenarejo, * Valentín Barrena and Thomas Voirin The big challenge of new technologies, particularly related to GNC systems,

More information

Cooperative 3-D Map Generation Using Multiple UAVs

Cooperative 3-D Map Generation Using Multiple UAVs University of Connecticut DigitalCommons@UConn University Scholar Projects University Scholar Program Summer 6-12-2015 Cooperative 3-D Map Generation Using Multiple UAVs Andrew Erik Lawson University of

More information

CSE-571 Robotics. Sensors for Mobile Robots. Beam-based Sensor Model. Proximity Sensors. Probabilistic Sensor Models. Beam-based Scan-based Landmarks

CSE-571 Robotics. Sensors for Mobile Robots. Beam-based Sensor Model. Proximity Sensors. Probabilistic Sensor Models. Beam-based Scan-based Landmarks Sensors for Mobile Robots CSE-57 Robotics Probabilistic Sensor Models Beam-based Scan-based Landmarks Contact sensors: Bumpers Internal sensors Accelerometers (spring-mounted masses) Gyroscopes (spinning

More information

AUTONOMOUS DRONE NAVIGATION WITH DEEP LEARNING

AUTONOMOUS DRONE NAVIGATION WITH DEEP LEARNING AUTONOMOUS DRONE NAVIGATION WITH DEEP LEARNING Nikolai Smolyanskiy, Alexey Kamenev, Jeffrey Smith Project Redtail May 8, 2017 100% AUTONOMOUS FLIGHT OVER 1 KM FOREST TRAIL AT 3 M/S 2 Why autonomous path

More information

3D Computer Vision. Depth Cameras. Prof. Didier Stricker. Oliver Wasenmüller

3D Computer Vision. Depth Cameras. Prof. Didier Stricker. Oliver Wasenmüller 3D Computer Vision Depth Cameras Prof. Didier Stricker Oliver Wasenmüller Kaiserlautern University http://ags.cs.uni-kl.de/ DFKI Deutsches Forschungszentrum für Künstliche Intelligenz http://av.dfki.de

More information

Simultaneous Localization

Simultaneous Localization Simultaneous Localization and Mapping (SLAM) RSS Technical Lecture 16 April 9, 2012 Prof. Teller Text: Siegwart and Nourbakhsh S. 5.8 Navigation Overview Where am I? Where am I going? Localization Assumed

More information

Individual Lab Report #6. Pratik Chatrath. Team A / Team Avengers. Teammates: Tushar Agrawal, Sean Bryan. January 28, 2016

Individual Lab Report #6. Pratik Chatrath. Team A / Team Avengers. Teammates: Tushar Agrawal, Sean Bryan. January 28, 2016 Individual Lab Report #6 Pratik Chatrath Team A / Team Avengers Teammates: Tushar Agrawal, Sean Bryan January 28, 2016 I. Individual Progress Overall in the last semester, I worked on developing obstacle

More information

Precise Image-Based Motion Estimation for Autonomous Small Body Exploration

Precise Image-Based Motion Estimation for Autonomous Small Body Exploration Appearing in the 5th Int l Symp. on Artificial Intelligence, Robotics and Automation in Space (isairas 99), pp. 627-634. Precise Image-Based Motion Estimation for Autonomous Small Body Exploration Andrew

More information

The SIFT (Scale Invariant Feature

The SIFT (Scale Invariant Feature The SIFT (Scale Invariant Feature Transform) Detector and Descriptor developed by David Lowe University of British Columbia Initial paper ICCV 1999 Newer journal paper IJCV 2004 Review: Matt Brown s Canonical

More information