W4. Perception & Situation Awareness & Decision making
|
|
- Madison Nichols
- 6 years ago
- Views:
Transcription
1 W4. Perception & Situation Awareness & Decision making Robot Perception for Dynamic environments: Outline & DP-Grids concept Dynamic Probabilistic Grids Bayesian Occupancy Filter concept Dynamic Probabilistic Grids Implementation approaches Object level Perception functions (SLAM + DATMO) Detection and Tracking of Mobile Objects Problem & Approaches Detection and Tracking of Mobile Objects Model & Grid based approaches Embedded Bayesian Perception & Short-term collision risk (DP-Grid level) Situation Awareness Problem statement & Motion / Prediction Models Situation Awareness Collision Risk Assessment & Decision (Object level) Christian Laugier MOBILE ROBOTS AND AUTONOMOUS VEHICLES
2 Embedded Bayesian Perception Main features DP-Grids (see sessions 2 &3) Local navigable space & Conservative Collision Risk Perception process (reminder session 1) Sensor fusion +SLAM + DATMO (see sessions 5 & 6) Main difficulties Noisy data, Incompleteness, Dynamicity, Discrete measurements + Real time! Approach: Bayesian Perception Reasoning about Uncertainty & Time window (Past events & Near future) Improving robustness using Bayesian Sensor Fusion (Multiple sensors + Sensors & Dynamic models + Bayesian Inference) Scene Interpretation using Semantic & Contextual information 2
3 Embedded Bayesian Perception on a real vehicle DP-Grid based Architecture Bayesian Sensor Fusion + DATMO Fast Clustering & Tracking Algorithm (FCTA) Detected &Tracked Objects Architecture combining: DP-Grid construction Grid-based SLAM & DATMO BOF / HSBOF Construct & Update on-line (real-time) a DP-Grid model of the Dynamic Environment è Sensor Fusion & BOF / HSBOF Extract Object level data using FCTA & Specialized perception functions (e.g. lane tracking & localization) 3 [Mekhnacha 09] [Laugier et al ITSM 11]
4 Embedded Bayesian Perception on a real vehicle DP-Grid based Architecture Bayesian Sensor Fusion + DATMO Fast Clustering & Tracking Algorithm (FCTA) Laser Laser perception Detected &Tracked Objects BOF / HSBOF Laser Data Fusion (BOF / HSBOF) 8 layers, 2 lasers + Motion detection Odometry & IMU Filtered DP-Grid Laser impacts Sensor model : Independent beam model 4
5 Embedded Bayesian Perception on a real vehicle DP-Grid based Architecture Bayesian Sensor Fusion + DATMO Fast Clustering & Tracking Algorithm (FCTA) Stereo Vision Stereo Vision Detected &Tracked Objects BOF / HSBOF 5 Disparity data Obstacle U-Disparity Road U-Disparity Potential obstacle areas Road Obstacles Road (Navigable Space) U-Disparity OG Cartesian Occupancy Grid
6 Embedded Bayesian Perception on a real vehicle Stereo-vision perception (experimental results) 6 Scene view provided by vehicle front camera Superimposition of Road Free space (blue) & Obstacles (red) Display Cartesian Occupancy Grid & U-Disparity
7 Embedded Bayesian Perception on a real vehicle DP-Grid based Architecture Bayesian Sensor Fusion + DATMO Computer Vision Fast Clustering & Tracking Algorithm (FCTA) Computer Vision Specialized perception functions Detected &Tracked Objects BOF / HSBOF Detection & Classification (using Intensity & Depth Features) 7 Multi-Lane tracker & Localization (vision + Open Street Map)
8 Embedded Bayesian Perception platform Vehicle Architecture Lidars + Stereo + Inertial sensor + GPS Manycore Stereo camera 2 Lidars Current implementation PC + GPU + ROS (Manycore) GPU Nvidia Jetson New implementation (miniaturization) 8
9 Embedded Bayesian Perception platform System outputs Localization & Recorded Trajectory Open Street Map + GPS + IMU + Odometry Front view (camera) + Superimposition of detected moving objects Fusion result using BOF (DP-Grid) Navigable space & Conservative Collision risk OG from left Lidar OG from right Lidar OG from Stereo 9
10 An Embedded Bayesian Perception platform Experimental results (Bayesian sensor fusion, 25 Hz) left & right laser OG left & right laser raw data Resulting DP-Grid (occupancy + velocity) 10 Stereo vision OG
11 Estimating short-term collision risk DP-Grid level (using HSBOF) Objective Collision risk estimation at time t (horizon t+δ) Localization of risks in Space & Time Still before object analysis (DP-Grid level) δ = 0.5 s => Precrash δ = 1 s => Collision mitigation δ = 1.5 s => Warning / Braking Occupancy Grid Motion field Risk Camera view & Sensing step (δ s before the crash) Update frequency : 25 Hz 11
12 Estimating short-term collision risk DP-Grid level (using HSBOF) Approach Projecting over time the estimated scene (Particles & Occupancy) & Car model (Shape & Velocity) è Apply a conservative motion model (using current car motion data) Collision assessment for every next time step Integration of Risk over a time range [t t+δ] δ = 0.5 s => Precrash δ = 1 s => Collision mitigation δ = 1.5 s => Warning / Braking Dynamic cell Static obstacle Car model 12
13 Estimating short-term collision risk Experimental results Urban street Other Vehicle Mobile Puppet Ego Vehicle Crash scenario Results Detection a few seconds ahead of risky situations Urban è No false alarm (cars, pedestrians ) Crash scenarios è All collisions predicted before the crash (1s or 1.5s) 13
14 Estimating short-term collision risk Experimental results: Crash scenario Video Static Dynamic Risk 0.5s before crash Scenario 1 Crash scenario 1s before crash Scenario 2 14
15 Estimating short-term collision risk Experimental results: Crash scenario (video) Crash scenario 15
Qadeer Baig, Mathias Perrollaz, Jander Botelho Do Nascimento, Christian Laugier
Using Fast Classification of Static and Dynamic Environment for Improving Bayesian Occupancy Filter (BOF) and Tracking Qadeer Baig, Mathias Perrollaz, Jander Botelho Do Nascimento, Christian Laugier e-motion
More informationTowards Fully-automated Driving. tue-mps.org. Challenges and Potential Solutions. Dr. Gijs Dubbelman Mobile Perception Systems EE-SPS/VCA
Towards Fully-automated Driving Challenges and Potential Solutions Dr. Gijs Dubbelman Mobile Perception Systems EE-SPS/VCA Mobile Perception Systems 6 PhDs, 1 postdoc, 1 project manager, 2 software engineers
More informationProbabilistic Analysis of Dynamic Scenes and Collision Risk Assessment to Improve Driving Safety
Probabilistic Analysis of Dynamic Scenes and Collision Risk Assessment to Improve Driving Safety Christian Laugier, Igor Paromtchik, Mathias Perrollaz, Yong Mao, John-David Yoder, Christopher Tay, Kamel
More informationProbabilistic Grid-based Collision Risk Prediction for Driving Application
Probabilistic Grid-based Collision Risk Prediction for Driving Application Lukas Rummelhard, Amaury Nègre, Mathias Perrollaz, Christian Laugier To cite this version: Lukas Rummelhard, Amaury Nègre, Mathias
More informationCollision Risk Assessment to Improve Driving Safety
Collision Risk Assessment to Improve Driving Safety Christian Laugier, Igor E. Paromtchik, Christopher Tay, Kamel Mekhnacha, Gabriel Othmezouri, Hiromichi Yanagihara INRIA Grenoble Rhône-Alpes, 38334 Saint
More informationFast classification of static and dynamic environment for Bayesian Occupancy Filter (BOF)
Fast classification of static and dynamic environment for Bayesian Occupancy Filter (BOF) Qadeer Baig, Mathias Perrollaz, Jander Botelho Do Nascimento, Christian Laugier The authors are with the E-Motion
More informationOn Board 6D Visual Sensors for Intersection Driving Assistance Systems
On Board 6D Visual Sensors for Intersection Driving Assistance Systems S. Nedevschi, T. Marita, R. Danescu, F. Oniga, S. Bota, I. Haller, C. Pantilie, M. Drulea, C. Golban Sergiu.Nedevschi@cs.utcluj.ro
More informationTurning an Automated System into an Autonomous system using Model-Based Design Autonomous Tech Conference 2018
Turning an Automated System into an Autonomous system using Model-Based Design Autonomous Tech Conference 2018 Asaf Moses Systematics Ltd., Technical Product Manager aviasafm@systematics.co.il 1 Autonomous
More informationSolid State LiDAR for Ubiquitous 3D Sensing
April 6, 2016 Solid State LiDAR for Ubiquitous 3D Sensing Louay Eldada, Ph.D. CEO, Co-founder Quanergy Systems New Paradigm in 3D Sensing Disruptive Technologies: Solid State 3D LiDAR sensors Embedded
More informationDetection and Tracking of Moving Objects Using 2.5D Motion Grids
Detection and Tracking of Moving Objects Using 2.5D Motion Grids Alireza Asvadi, Paulo Peixoto and Urbano Nunes Institute of Systems and Robotics, University of Coimbra September 2015 1 Outline: Introduction
More informationGrid-based Localization and Online Mapping with Moving Objects Detection and Tracking: new results
Grid-based Localization and Online Mapping with Moving Objects Detection and Tracking: new results Trung-Dung Vu, Julien Burlet and Olivier Aycard Laboratoire d Informatique de Grenoble, France firstname.lastname@inrialpes.fr
More informationAutomated Driving Development
Automated Driving Development with MATLAB and Simulink MANOHAR REDDY M 2015 The MathWorks, Inc. 1 Using Model-Based Design to develop high quality and reliable Active Safety & Automated Driving Systems
More informationCreating Affordable and Reliable Autonomous Vehicle Systems
Creating Affordable and Reliable Autonomous Vehicle Systems Shaoshan Liu shaoshan.liu@perceptin.io Autonomous Driving Localization Most crucial task of autonomous driving Solutions: GNSS but withvariations,
More informationIntegration of ADAS algorithm in a Vehicle Prototype
Integration of ADAS algorithm in a Vehicle Prototype Jerome Lussereau, Procópio Stein, Jean-Alix David, Lukas Rummelhard, Amaury Negre, Christian Laugier, Nicolas Vignard, Gabriel Othmezouri To cite this
More informationAdvanced Driver Assistance: Modular Image Sensor Concept
Vision Advanced Driver Assistance: Modular Image Sensor Concept Supplying value. Integrated Passive and Active Safety Systems Active Safety Passive Safety Scope Reduction of accident probability Get ready
More informationSpring Localization II. Roland Siegwart, Margarita Chli, Martin Rufli. ASL Autonomous Systems Lab. Autonomous Mobile Robots
Spring 2016 Localization II Localization I 25.04.2016 1 knowledge, data base mission commands Localization Map Building environment model local map position global map Cognition Path Planning path Perception
More informationVehicle Localization. Hannah Rae Kerner 21 April 2015
Vehicle Localization Hannah Rae Kerner 21 April 2015 Spotted in Mtn View: Google Car Why precision localization? in order for a robot to follow a road, it needs to know where the road is to stay in a particular
More informationProbabilistic analysis of dynamic scenes and collision risks assessment to improve driving safety
Probabilistic analysis of dynamic scenes and collision risks assessment to improve driving safety Christian Laugier, Igor E. Paromtchik, Mathias Perrollaz, John-David Yoder, Christopher Tay, Mao Yong,
More informationA generic architecture for dynamic outdoor environment
A generic architecture for dynamic outdoor environment Olivier Aycard, Trung-Dung Vu, Qadeer Baig, and Thierry Fraichard Laboratoire d Informatique de Grenoble - University of Grenoble1, France firstname.lastname@imag.fr
More informationJo-Car2 Autonomous Mode. Path Planning (Cost Matrix Algorithm)
Chapter 8.2 Jo-Car2 Autonomous Mode Path Planning (Cost Matrix Algorithm) Introduction: In order to achieve its mission and reach the GPS goal safely; without crashing into obstacles or leaving the lane,
More informationIntroduction to Mobile Robotics
Introduction to Mobile Robotics Olivier Aycard Associate Professor University of Grenoble Laboratoire d Informatique de Grenoble http://membres-liglab.imag.fr/aycard 1/29 Some examples of mobile robots
More informationFusion Between Laser and Stereo Vision Data For Moving Objects Tracking In Intersection Like Scenario
Fusion Between Laser and Stereo Vision Data For Moving Objects Tracking In Intersection Like Scenario Qadeer Baig, Olivier Aycard, Trung Dung Vu and Thierry Fraichard Abstract Using multiple sensors in
More informationSpring Localization II. Roland Siegwart, Margarita Chli, Juan Nieto, Nick Lawrance. ASL Autonomous Systems Lab. Autonomous Mobile Robots
Spring 2018 Localization II Localization I 16.04.2018 1 knowledge, data base mission commands Localization Map Building environment model local map position global map Cognition Path Planning path Perception
More informationThe ArosDyn Project: Robust Analysis of Dynamic Scenes
Author manuscript, published in "International Conference on Control, Automation, Robotics and Vision (2010)" The ArosDyn Project: Robust Analysis of Dynamic Scenes Igor E. Paromtchik, Christian Laugier,
More informationMULTI-MODAL MAPPING. Robotics Day, 31 Mar Frank Mascarich, Shehryar Khattak, Tung Dang
MULTI-MODAL MAPPING Robotics Day, 31 Mar 2017 Frank Mascarich, Shehryar Khattak, Tung Dang Application-Specific Sensors Cameras TOF Cameras PERCEPTION LiDAR IMU Localization Mapping Autonomy Robotic Perception
More informationConditional Monte Carlo Dense Occupancy Tracker
Conditional Monte Carlo Dense Occupancy Tracker Lukas Rummelhard, Amaury Negre, Christian Laugier To cite this version: Lukas Rummelhard, Amaury Negre, Christian Laugier. Conditional Monte Carlo Dense
More informationMeasuring the World: Designing Robust Vehicle Localization for Autonomous Driving. Frank Schuster, Dr. Martin Haueis
Measuring the World: Designing Robust Vehicle Localization for Autonomous Driving Frank Schuster, Dr. Martin Haueis Agenda Motivation: Why measure the world for autonomous driving? Map Content: What do
More informationIntroduction to Autonomous Mobile Robots
Introduction to Autonomous Mobile Robots second edition Roland Siegwart, Illah R. Nourbakhsh, and Davide Scaramuzza The MIT Press Cambridge, Massachusetts London, England Contents Acknowledgments xiii
More informationNonlinear State Estimation for Robotics and Computer Vision Applications: An Overview
Nonlinear State Estimation for Robotics and Computer Vision Applications: An Overview Arun Das 05/09/2017 Arun Das Waterloo Autonomous Vehicles Lab Introduction What s in a name? Arun Das Waterloo Autonomous
More informationIntersection Safety using Lidar and Stereo Vision sensors
Intersection Safety using Lidar and Stereo Vision sensors Olivier Aycard, Qadeer Baig, Siviu Bota, Fawzi Nashashibi, Sergiu Nedevschi, Cosmin Pantilie, Michel Parent, Paulo Resende, Trung-Dung Vu University
More informationUAV Autonomous Navigation in a GPS-limited Urban Environment
UAV Autonomous Navigation in a GPS-limited Urban Environment Yoko Watanabe DCSD/CDIN JSO-Aerial Robotics 2014/10/02-03 Introduction 2 Global objective Development of a UAV onboard system to maintain flight
More informationMobile Robotics. Mathematics, Models, and Methods. HI Cambridge. Alonzo Kelly. Carnegie Mellon University UNIVERSITY PRESS
Mobile Robotics Mathematics, Models, and Methods Alonzo Kelly Carnegie Mellon University HI Cambridge UNIVERSITY PRESS Contents Preface page xiii 1 Introduction 1 1.1 Applications of Mobile Robots 2 1.2
More informationFunctional Discretization of Space Using Gaussian Processes for Road Intersection Crossing
Functional Discretization of Space Using Gaussian Processes for Road Intersection Crossing M A T H I E U B A R B I E R 1,2, C H R I S T I A N L A U G I E R 1, O L I V I E R S I M O N I N 1, J A V I E R
More informationRobotics. Chapter 25. Chapter 25 1
Robotics Chapter 25 Chapter 25 1 Outline Robots, Effectors, and Sensors Localization and Mapping Motion Planning Chapter 25 2 Mobile Robots Chapter 25 3 Manipulators P R R R R R Configuration of robot
More informationTeam Aware Perception System using Stereo Vision and Radar
Team Aware Perception System using Stereo Vision and Radar System Development Review 03/ 08 / 2017 Amit Agarwal Harry Golash Yihao Qian Menghan Zhang Zihao (Theo) Zhang Project Description Develop a standalone
More informationAUTOMATED GENERATION OF VIRTUAL DRIVING SCENARIOS FROM TEST DRIVE DATA
F2014-ACD-014 AUTOMATED GENERATION OF VIRTUAL DRIVING SCENARIOS FROM TEST DRIVE DATA 1 Roy Bours (*), 1 Martijn Tideman, 2 Ulrich Lages, 2 Roman Katz, 2 Martin Spencer 1 TASS International, Rijswijk, The
More informationPattern Recognition for Autonomous. Pattern Recognition for Autonomous. Driving. Freie Universität t Berlin. Raul Rojas
Pattern Recognition for Autonomous Pattern Recognition for Autonomous Driving Raul Rojas Freie Universität t Berlin FU Berlin Berlin 3d model from Berlin Partner Freie Universitaet Berlin Outline of the
More informationRealtime Object Detection and Segmentation for HD Mapping
Realtime Object Detection and Segmentation for HD Mapping William Raveane Lead AI Engineer Bahram Yoosefizonooz Technical Director NavInfo Europe Advanced Research Lab Presented at GTC Europe 2018 AI in
More informationHigh Level Sensor Data Fusion for Automotive Applications using Occupancy Grids
High Level Sensor Data Fusion for Automotive Applications using Occupancy Grids Ruben Garcia, Olivier Aycard, Trung-Dung Vu LIG and INRIA Rhônes Alpes Grenoble, France Email: firstname.lastname@inrialpes.fr
More informationComputing Occupancy Grids from Multiple Sensors using Linear Opinion Pools
Computing Occupancy Grids from Multiple Sensors using Linear Opinion Pools Juan David Adarve, Mathias Perrollaz, Alexandros Makris, Christian Laugier To cite this version: Juan David Adarve, Mathias Perrollaz,
More informationAutonomous navigation in industrial cluttered environments using embedded stereo-vision
Autonomous navigation in industrial cluttered environments using embedded stereo-vision Julien Marzat ONERA Palaiseau Aerial Robotics workshop, Paris, 8-9 March 2017 1 Copernic Lab (ONERA Palaiseau) Research
More informationOverview. EECS 124, UC Berkeley, Spring 2008 Lecture 23: Localization and Mapping. Statistical Models
Introduction ti to Embedded dsystems EECS 124, UC Berkeley, Spring 2008 Lecture 23: Localization and Mapping Gabe Hoffmann Ph.D. Candidate, Aero/Astro Engineering Stanford University Statistical Models
More informationLost! Leveraging the Crowd for Probabilistic Visual Self-Localization
Lost! Leveraging the Crowd for Probabilistic Visual Self-Localization Marcus A. Brubaker (Toyota Technological Institute at Chicago) Andreas Geiger (Karlsruhe Institute of Technology & MPI Tübingen) Raquel
More information3D LIDAR Point Cloud based Intersection Recognition for Autonomous Driving
3D LIDAR Point Cloud based Intersection Recognition for Autonomous Driving Quanwen Zhu, Long Chen, Qingquan Li, Ming Li, Andreas Nüchter and Jian Wang Abstract Finding road intersections in advance is
More informationA Review of the Bayesian Occupancy Filter
sensors Article A Review of the Bayesian Occupancy Filter Marcelo Saval-Calvo 1, Luis Medina-Valdés 1, José María Castillo-Secilla 1, *, Sergio Cuenca-Asensi 1, Antonio Martínez-Álvarez 1 and Jorge Villagrá
More informationIntelligent Vehicle Perception: Toward the Integration on Embedded Many-core
Intelligent Vehicle Perception: Toward the Integration on Embedded Many-core Tiana Rakotovao, Diego Puschini, Julien Mottin, Lukas Rummelhard, Amaury Negre, Christian Laugier To cite this version: Tiana
More informationMapping of environment, Detection and Tracking of Moving Objects using Occupancy Grids
Mapping of environment, Detection and Tracking of Moving Objects using Occupancy Grids Trung-Dung Vu, Julien Burlet and Olivier Aycard Laboratoire d Informatique de Grenoble, France firstname.lastname@inrialpes.fr
More informationRobotics. Haslum COMP3620/6320
Robotics P@trik Haslum COMP3620/6320 Introduction Robotics Industrial Automation * Repetitive manipulation tasks (assembly, etc). * Well-known, controlled environment. * High-power, high-precision, very
More informationZürich. Roland Siegwart Margarita Chli Martin Rufli Davide Scaramuzza. ETH Master Course: L Autonomous Mobile Robots Summary
Roland Siegwart Margarita Chli Martin Rufli Davide Scaramuzza ETH Master Course: 151-0854-00L Autonomous Mobile Robots Summary 2 Lecture Overview Mobile Robot Control Scheme knowledge, data base mission
More informationApplying AI to Mapping
Applying AI to Mapping Dr. Ryan Wolcott Manager, Simultaneous Localization and Mapping (SLAM) 1 TRI: Who We Are Our mission is to improve the quality of human life through advances in artificial intelligence,
More informationDesigning a Pick and Place Robotics Application Using MATLAB and Simulink
Designing a Pick and Place Robotics Application Using MATLAB and Simulink Carlos Santacruz-Rosero, PhD Sr Application Engineer Robotics Pulkit Kapur Sr Industry Marketing Manager Robotics 2017 The MathWorks,
More informationDYNAMIC STEREO VISION FOR INTERSECTION ASSISTANCE
FISITA 2008 World Automotive Congress Munich, Germany, September 2008. DYNAMIC STEREO VISION FOR INTERSECTION ASSISTANCE 1 Franke, Uwe *, 2 Rabe, Clemens, 1 Gehrig, Stefan, 3 Badino, Hernan, 1 Barth, Alexander
More informationWhy the Self-Driving Revolution Hinges on one Enabling Technology: LiDAR
Why the Self-Driving Revolution Hinges on one Enabling Technology: LiDAR Markus Prison Director Business Development Europe Quanergy ID: 23328 Who We Are The leader in LiDAR (laser-based 3D spatial sensor)
More informationIntroduction to Mobile Robotics
Introduction to Mobile Robotics Olivier Aycard Associate Professor University of Grenoble Laboratoire d Informatique de Grenoble http://membres-liglab.imag.fr/aycard olivier. 1/22 What is a robot? Robot
More informationLaserscanner Based Cooperative Pre-Data-Fusion
Laserscanner Based Cooperative Pre-Data-Fusion 63 Laserscanner Based Cooperative Pre-Data-Fusion F. Ahlers, Ch. Stimming, Ibeo Automobile Sensor GmbH Abstract The Cooperative Pre-Data-Fusion is a novel
More informationOnline Localization and Mapping with Moving Object Tracking in Dynamic Outdoor Environments with new Demonstrator Data
Online Localization and Mapping with Moving Object Tracking in Dynamic Outdoor Environments with new Demonstrator Data Qadeer Baig, Trung-Dung Vu and Olivier Aycard Abstract In this paper, we present a
More informationSpring 2016 :: :: Robot Autonomy :: Team 7 Motion Planning for Autonomous All-Terrain Vehicle
Spring 2016 :: 16662 :: Robot Autonomy :: Team 7 Motion Planning for Autonomous All-Terrain Vehicle Guan-Horng Liu, Samuel Wang, Shu-Kai Lin, Chris Wang, Tiffany May Advisor : Mr. George Kantor OUTLINE
More informationGrid-based localization and local mapping with moving object detection and tracking
Grid-based localization and local mapping with moving object detection and tracking Trung-Dung Vu, Julien Burlet, Olivier Aycard To cite this version: Trung-Dung Vu, Julien Burlet, Olivier Aycard. Grid-based
More informationEgomotion Estimation by Point-Cloud Back-Mapping
Egomotion Estimation by Point-Cloud Back-Mapping Haokun Geng, Radu Nicolescu, and Reinhard Klette Department of Computer Science, University of Auckland, New Zealand hgen001@aucklanduni.ac.nz Abstract.
More informationRevising Stereo Vision Maps in Particle Filter Based SLAM using Localisation Confidence and Sample History
Revising Stereo Vision Maps in Particle Filter Based SLAM using Localisation Confidence and Sample History Simon Thompson and Satoshi Kagami Digital Human Research Center National Institute of Advanced
More informationOpenStreetSLAM: Global Vehicle Localization using OpenStreetMaps
OpenStreetSLAM: Global Vehicle Localization using OpenStreetMaps Georgios Floros, Benito van der Zander and Bastian Leibe RWTH Aachen University, Germany http://www.vision.rwth-aachen.de floros@vision.rwth-aachen.de
More informationThe area processing unit of Caroline
2nd Workshop Robot Vision RobVis '08 February 18-20, 2008 Auckland, New Zealand The area processing unit of Caroline Finding the way through DARPA's urban challenge February 18th, 2008 Kai Berger Christian
More informationCOS Lecture 13 Autonomous Robot Navigation
COS 495 - Lecture 13 Autonomous Robot Navigation Instructor: Chris Clark Semester: Fall 2011 1 Figures courtesy of Siegwart & Nourbakhsh Control Structure Prior Knowledge Operator Commands Localization
More informationDetecting the Unexpected: The Path to Road Obstacles Prevention in Autonomous Driving
Detecting the Unexpected: The Path to Road Obstacles Prevention in Autonomous Driving Shmoolik Mangan, PhD Algorithms Development Manager, VAYAVISION AutonomousTech TLV Israel 2018 VAYAVISION s approach
More informationECE276A: Sensing & Estimation in Robotics Lecture 11: Simultaneous Localization and Mapping using a Particle Filter
ECE276A: Sensing & Estimation in Robotics Lecture 11: Simultaneous Localization and Mapping using a Particle Filter Lecturer: Nikolay Atanasov: natanasov@ucsd.edu Teaching Assistants: Siwei Guo: s9guo@eng.ucsd.edu
More informationPrecision Roadway Feature Mapping Jay A. Farrell, University of California-Riverside James A. Arnold, Department of Transportation
Precision Roadway Feature Mapping Jay A. Farrell, University of California-Riverside James A. Arnold, Department of Transportation February 26, 2013 ESRA Fed. GIS Outline: Big picture: Positioning and
More informationFusion Framework for Moving-Object Classification. Omar Chavez, Trung-Dung Vu (UJF) Trung-Dung Vu (UJF) Olivier Aycard (UJF) Fabio Tango (CRF)
Fusion Framework for Moving-Object Classification Omar Chavez, Trung-Dung Vu (UJF) Trung-Dung Vu (UJF) Olivier Aycard (UJF) Fabio Tango (CRF) Introduction Advance Driver Assistant Systems (ADAS) help drivers
More informationTowards Autonomous Vehicle. What is an autonomous vehicle? Vehicle driving on its own with zero mistakes How? Using sensors
7 May 2017 Disclaimer Towards Autonomous Vehicle What is an autonomous vehicle? Vehicle driving on its own with zero mistakes How? Using sensors Why Vision Sensors? Humans use both eyes as main sense
More informationPedestrian Detection with Radar and Computer Vision
Pedestrian Detection with Radar and Computer Vision camera radar sensor Stefan Milch, Marc Behrens, Darmstadt, September 25 25 / 26, 2001 Pedestrian accidents and protection systems Impact zone: 10% opposite
More informationConstruction of Semantic Maps for Personal Mobility Robots in Dynamic Outdoor Environments
Construction of Semantic Maps for Personal Mobility Robots in Dynamic Outdoor Environments Naotaka Hatao, Satoshi Kagami, Ryo Hanai, Kimitoshi Yamazaki and Masayuki Inaba Abstract In this paper, a construction
More informationDeveloping Algorithms for Robotics and Autonomous Systems
Developing Algorithms for Robotics and Autonomous Systems Jorik Caljouw 2015 The MathWorks, Inc. 1 Key Takeaway of this Talk Success in developing an autonomous robotics system requires: 1. Multi-domain
More information3D Simultaneous Localization and Mapping and Navigation Planning for Mobile Robots in Complex Environments
3D Simultaneous Localization and Mapping and Navigation Planning for Mobile Robots in Complex Environments Sven Behnke University of Bonn, Germany Computer Science Institute VI Autonomous Intelligent Systems
More informationIntroduction to Mobile Robotics Path Planning and Collision Avoidance. Wolfram Burgard, Maren Bennewitz, Diego Tipaldi, Luciano Spinello
Introduction to Mobile Robotics Path Planning and Collision Avoidance Wolfram Burgard, Maren Bennewitz, Diego Tipaldi, Luciano Spinello 1 Motion Planning Latombe (1991): is eminently necessary since, by
More informationTraining models for road scene understanding with automated ground truth Dan Levi
Training models for road scene understanding with automated ground truth Dan Levi With: Noa Garnett, Ethan Fetaya, Shai Silberstein, Rafi Cohen, Shaul Oron, Uri Verner, Ariel Ayash, Kobi Horn, Vlad Golder,
More informationSpring 2010: Lecture 9. Ashutosh Saxena. Ashutosh Saxena
CS 4758/6758: Robot Learning Spring 2010: Lecture 9 Why planning and control? Video Typical Architecture Planning 0.1 Hz Control 50 Hz Does it apply to all robots and all scenarios? Previous Lecture: Potential
More informationDense Tracking and Mapping for Autonomous Quadrocopters. Jürgen Sturm
Computer Vision Group Prof. Daniel Cremers Dense Tracking and Mapping for Autonomous Quadrocopters Jürgen Sturm Joint work with Frank Steinbrücker, Jakob Engel, Christian Kerl, Erik Bylow, and Daniel Cremers
More informationBayesian Occupancy Filtering for Multi-Target Tracking: an Automotive Application
Bayesian Occupancy Filtering for Multi-Target Tracking: an Automotive Application Christophe Coué, Cédric Pradalier, Christian Laugier, Thierry Fraichard and Pierre Bessière Inria Rhône-Alpes & Gravir
More informationSensor Data Fusion for Active Safety Systems
Sensor Data Fusion for Active Safety Systems 2010-01-2332 Published 10/19/2010 Jorge Sans Sangorrin, Jan Sparbert, Ulrike Ahlrichs and Wolfgang Branz Robert Bosch GmbH Oliver Schwindt Robert Bosch LLC
More informationAUTOMATIC PARKING OF SELF-DRIVING CAR BASED ON LIDAR
AUTOMATIC PARKING OF SELF-DRIVING CAR BASED ON LIDAR Bijun Lee a, Yang Wei a, I. Yuan Guo a a State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University,
More informationProbabilistic Robotics
Probabilistic Robotics Sebastian Thrun Wolfram Burgard Dieter Fox The MIT Press Cambridge, Massachusetts London, England Preface xvii Acknowledgments xix I Basics 1 1 Introduction 3 1.1 Uncertainty in
More informationOnline Localization and Mapping with Moving Object Tracking in Dynamic Outdoor Environments
Online Localization and Mapping with Moving Object Tracking in Dynamic Outdoor Environments Trung-Dung Vu, Olivier Aycard, Nils Appenrodt To cite this version: Trung-Dung Vu, Olivier Aycard, Nils Appenrodt.
More informationOntologies for Advanced Driver Assistance Systems
Ontologies for Advanced Driver Assistance Systems Lihua Zhao 1 Ryutaro Ichise 2 Seiichi Mita 1 Yutaka Sasaki 1 1 Toyota Technological Institute, Japan 2 National Institute of Informatics, Japan Abstract:
More informationMulti-View 3D Object Detection Network for Autonomous Driving
Multi-View 3D Object Detection Network for Autonomous Driving Xiaozhi Chen, Huimin Ma, Ji Wan, Bo Li, Tian Xia CVPR 2017 (Spotlight) Presented By: Jason Ku Overview Motivation Dataset Network Architecture
More informationSensor Fusion: Potential, Challenges and Applications. Presented by KVH Industries and Geodetics, Inc. December 2016
Sensor Fusion: Potential, Challenges and Applications Presented by KVH Industries and Geodetics, Inc. December 2016 1 KVH Industries Overview Innovative technology company 600 employees worldwide Focused
More informationVisual Perception for Robots
Visual Perception for Robots Sven Behnke Computer Science Institute VI Autonomous Intelligent Systems Our Cognitive Robots Complete systems for example scenarios Equipped with rich sensors Flying robot
More informationPedestrian Detection Using Multi-layer LIDAR
1 st International Conference on Transportation Infrastructure and Materials (ICTIM 2016) ISBN: 978-1-60595-367-0 Pedestrian Detection Using Multi-layer LIDAR Mingfang Zhang 1, Yuping Lu 2 and Tong Liu
More informationAdvances in the Bayesian Occupancy Filter framework using robust motion detection technique for dynamic environment monitoring
Advances in the Bayesian Occupancy Filter framework using robust motion detection technique for dynamic environment monitoring Qadeer Baig, Mathias Perrollaz, Christian Laugier To cite this version: Qadeer
More informationEvaluation of a laser-based reference system for ADAS
23 rd ITS World Congress, Melbourne, Australia, 10 14 October 2016 Paper number ITS- EU-TP0045 Evaluation of a laser-based reference system for ADAS N. Steinhardt 1*, S. Kaufmann 2, S. Rebhan 1, U. Lages
More informationMini Survey Paper (Robotic Mapping) Ryan Hamor CPRE 583 September 2011
Mini Survey Paper (Robotic Mapping) Ryan Hamor CPRE 583 September 2011 Introduction The goal of this survey paper is to examine the field of robotic mapping and the use of FPGAs in various implementations.
More informationAcoustic/Lidar Sensor Fusion for Car Tracking in City Traffic Scenarios
Sensor Fusion for Car Tracking Acoustic/Lidar Sensor Fusion for Car Tracking in City Traffic Scenarios, Daniel Goehring 1 Motivation Direction to Object-Detection: What is possible with costefficient microphone
More informationOPEN SIMULATION INTERFACE. INTRODUCTION AND OVERVIEW.
OPEN SIMULATION INTERFACE. INTRODUCTION AND OVERVIEW. DIFFERENTIATION OF SIMULATION DATA INTERFACES. Odometry / Dynamics Interface Open Interface (OSI) Map Interface Dynamics Model Map Model Vehicle Dynamics
More information5. Tests and results Scan Matching Optimization Parameters Influence
126 5. Tests and results This chapter presents results obtained using the proposed method on simulated and real data. First, it is analyzed the scan matching optimization; after that, the Scan Matching
More informationAdvanced Driver Assistance Systems: A Cost-Effective Implementation of the Forward Collision Warning Module
Advanced Driver Assistance Systems: A Cost-Effective Implementation of the Forward Collision Warning Module www.lnttechservices.com Table of Contents Abstract 03 Introduction 03 Solution Overview 03 Output
More informationAUTONOMOUS SYSTEMS. LOCALIZATION, MAPPING & SIMULTANEOUS LOCALIZATION AND MAPPING Part V Mapping & Occupancy Grid Mapping
AUTONOMOUS SYSTEMS LOCALIZATION, MAPPING & SIMULTANEOUS LOCALIZATION AND MAPPING Part V Mapping & Occupancy Grid Mapping Maria Isabel Ribeiro Pedro Lima with revisions introduced by Rodrigo Ventura Instituto
More informationDealing with Scale. Stephan Weiss Computer Vision Group NASA-JPL / CalTech
Dealing with Scale Stephan Weiss Computer Vision Group NASA-JPL / CalTech Stephan.Weiss@ieee.org (c) 2013. Government sponsorship acknowledged. Outline Why care about size? The IMU as scale provider: The
More informationSensory Augmentation for Increased Awareness of Driving Environment
Sensory Augmentation for Increased Awareness of Driving Environment Pranay Agrawal John M. Dolan Dec. 12, 2014 Technologies for Safe and Efficient Transportation (T-SET) UTC The Robotics Institute Carnegie
More informationSimultaneous Localization and Mapping
Sebastian Lembcke SLAM 1 / 29 MIN Faculty Department of Informatics Simultaneous Localization and Mapping Visual Loop-Closure Detection University of Hamburg Faculty of Mathematics, Informatics and Natural
More informationNaturalistic observations to investigate conflicts between drivers and VRU in the PROSPECT project
Naturalistic observations to investigate conflicts between drivers and VRU in the PROSPECT project Marie-Pierre Bruyas, Sébastien Ambellouis, Céline Estraillier, Fabien Moreau (IFSTTAR, France) Andrés
More informationHigh-precision, consistent EKF-based visual-inertial odometry
High-precision, consistent EKF-based visual-inertial odometry Mingyang Li and Anastasios I. Mourikis, IJRR 2013 Ao Li Introduction What is visual-inertial odometry (VIO)? The problem of motion tracking
More informationAdvanced Techniques for Mobile Robotics Bag-of-Words Models & Appearance-Based Mapping
Advanced Techniques for Mobile Robotics Bag-of-Words Models & Appearance-Based Mapping Wolfram Burgard, Cyrill Stachniss, Kai Arras, Maren Bennewitz Motivation: Analogy to Documents O f a l l t h e s e
More information