Vehicle Localization. Hannah Rae Kerner 21 April 2015

Similar documents
W4. Perception & Situation Awareness & Decision making

Where s the Boss? : Monte Carlo Localization for an Autonomous Ground Vehicle using an Aerial Lidar Map

Pattern Recognition for Autonomous. Pattern Recognition for Autonomous. Driving. Freie Universität t Berlin. Raul Rojas

Camera Drones Lecture 2 Control and Sensors

Nonlinear State Estimation for Robotics and Computer Vision Applications: An Overview

Acoustic/Lidar Sensor Fusion for Car Tracking in City Traffic Scenarios

Humanoid Robotics. Monte Carlo Localization. Maren Bennewitz

F1/10 th Autonomous Racing. Localization. Nischal K N

Correcting INS Drift in Terrain Surface Measurements. Heather Chemistruck Ph.D. Student Mechanical Engineering Vehicle Terrain Performance Lab

Evaluation of a laser-based reference system for ADAS

Pedestrian Detection Using Correlated Lidar and Image Data EECS442 Final Project Fall 2016

Probabilistic Robotics. FastSLAM

Evaluating the Performance of a Vehicle Pose Measurement System

Advanced Driver Assistance: Modular Image Sensor Concept

Robot Localization based on Geo-referenced Images and G raphic Methods

Sensor Fusion: Potential, Challenges and Applications. Presented by KVH Industries and Geodetics, Inc. December 2016

Probabilistic Robotics

Aerial and Ground-based Collaborative Mapping: An Experimental Study

Aided-inertial for GPS-denied Navigation and Mapping

LaserGuard LG300 area alarm system. 3D laser radar alarm system for motion control and alarm applications. Instruction manual

Jo-Car2 Autonomous Mode. Path Planning (Cost Matrix Algorithm)

Fast Local Planner for Autonomous Helicopter

Designing a software framework for automated driving. Dr.-Ing. Sebastian Ohl, 2017 October 12 th

AUTOMATIC PARKING OF SELF-DRIVING CAR BASED ON LIDAR

Segway RMP Experiments at Georgia Tech

Localization and Map Building

Towards Fully-automated Driving. tue-mps.org. Challenges and Potential Solutions. Dr. Gijs Dubbelman Mobile Perception Systems EE-SPS/VCA

CAMERA POSE ESTIMATION OF RGB-D SENSORS USING PARTICLE FILTERING

Sensory Augmentation for Increased Awareness of Driving Environment

Measuring the World: Designing Robust Vehicle Localization for Autonomous Driving. Frank Schuster, Dr. Martin Haueis

Matching Evaluation of 2D Laser Scan Points using Observed Probability in Unstable Measurement Environment

> Acoustical feedback in the form of a beep with increasing urgency with decreasing distance to an obstacle

Precision Roadway Feature Mapping Jay A. Farrell, University of California-Riverside James A. Arnold, Department of Transportation

Efficient Techniques for Dynamic Vehicle Detection

Basics of Localization, Mapping and SLAM. Jari Saarinen Aalto University Department of Automation and systems Technology

Aided-inertial for Long-term, Self-contained GPS-denied Navigation and Mapping

PacSLAM Arunkumar Byravan, Tanner Schmidt, Erzhuo Wang

3D Point Cloud Processing

ECE276A: Sensing & Estimation in Robotics Lecture 11: Simultaneous Localization and Mapping using a Particle Filter

Federica Zampa Sineco SpA V. le Isonzo, 14/1, Milan, 20135, Italy

Particle Filters. CSE-571 Probabilistic Robotics. Dependencies. Particle Filter Algorithm. Fast-SLAM Mapping

3D LIDAR Point Cloud based Intersection Recognition for Autonomous Driving

Application of Vision-based Particle Filter and Visual Odometry for UAV Localization

An Experimental Exploration of Low-Cost Solutions for Precision Ground Vehicle Navigation

Analysis of Obstacle Detection Technologies used in Mobile Robots

6D SLAM with Kurt3D. Andreas Nüchter, Kai Lingemann, Joachim Hertzberg

Technical Bulletin Global Vehicle Target Specification Version 1.0 May 2018 TB 025

Robotics. Haslum COMP3620/6320

Overview. EECS 124, UC Berkeley, Spring 2008 Lecture 23: Localization and Mapping. Statistical Models

NAVIGATION SYSTEM OF AN OUTDOOR SERVICE ROBOT WITH HYBRID LOCOMOTION SYSTEM

Removing Drift from Inertial Navigation System Measurements RPUG Robert Binns Mechanical Engineering Vehicle Terrain Performance Lab

Robust Vehicle Localization in Urban Environments Using Probabilistic Maps

Vision-based Mobile Robot Localization and Mapping using Scale-Invariant Features

EE631 Cooperating Autonomous Mobile Robots

IROS 05 Tutorial. MCL: Global Localization (Sonar) Monte-Carlo Localization. Particle Filters. Rao-Blackwellized Particle Filters and Loop Closing

VFAST Transactions on Software Engineering 2013 ISSN Volume 1, Number 1, June 2013 pp.

Analyzing the Relationship Between Head Pose and Gaze to Model Driver Visual Attention

A Whole New World of Mapping and Sensing: Uses from Asset to Management to In Vehicle Sensing for Collision Avoidance

Autonomous navigation in industrial cluttered environments using embedded stereo-vision

Proc. 14th Int. Conf. on Intelligent Autonomous Systems (IAS-14), 2016

A Repository Of Sensor Data For Autonomous Driving Research

AN INCREMENTAL SLAM ALGORITHM FOR INDOOR AUTONOMOUS NAVIGATION

3D Convolutional Neural Networks for Landing Zone Detection from LiDAR

Distributed Vision-Aided Cooperative Navigation Based on Three-View Geometry

Probabilistic Robotics

Creating Affordable and Reliable Autonomous Vehicle Systems

CANAL FOLLOWING USING AR DRONE IN SIMULATION

A Longitudinal Control Algorithm for Smart Cruise Control with Virtual Parameters

A Genetic Algorithm for Simultaneous Localization and Mapping

Perspective Sensing for Inertial Stabilization

Today MAPS AND MAPPING. Features. process of creating maps. More likely features are things that can be extracted from images:

IP-S2 HD HD IP-S2. 3D Mobile Mapping System. 3D Mobile Mapping System

Proceedings of the 2016 Winter Simulation Conference T. M. K. Roeder, P. I. Frazier, R. Szechtman, E. Zhou, T. Huschka, and S. E. Chick, eds.

OpenStreetSLAM: Global Vehicle Localization using OpenStreetMaps

TomTom Innovation. Hans Aerts VP Software Development Business Unit Automotive November 2015

An Introduction to Lidar & Forestry May 2013

Synthetic 2D LIDAR for Precise Vehicle Localization in 3D Urban Environment

Lost! Leveraging the Crowd for Probabilistic Visual Self-Localization

Calibration of a rotating multi-beam Lidar

Laserscanner Based Cooperative Pre-Data-Fusion

Localization and Mapping in Urban Environments Using Mobile Robots

Obstacle Detection From Roadside Laser Scans. Research Project

Stable Vision-Aided Navigation for Large-Area Augmented Reality

Spring Localization II. Roland Siegwart, Margarita Chli, Martin Rufli. ASL Autonomous Systems Lab. Autonomous Mobile Robots

MULTI-MODAL MAPPING. Robotics Day, 31 Mar Frank Mascarich, Shehryar Khattak, Tung Dang

Spring Localization II. Roland Siegwart, Margarita Chli, Juan Nieto, Nick Lawrance. ASL Autonomous Systems Lab. Autonomous Mobile Robots

Robot Mapping. SLAM Front-Ends. Cyrill Stachniss. Partial image courtesy: Edwin Olson 1

Intelligent Outdoor Navigation of a Mobile Robot Platform Using a Low Cost High Precision RTK-GPS and Obstacle Avoidance System

Lecture: Autonomous micro aerial vehicles

MAPPING ALGORITHM FOR AUTONOMOUS NAVIGATION OF LAWN MOWER USING SICK LASER

Real Time Multi-Sensor Data Acquisition and Processing for a Road Mapping System

AUTOMATED GENERATION OF VIRTUAL DRIVING SCENARIOS FROM TEST DRIVE DATA

Vision-based ACC with a Single Camera: Bounds on Range and Range Rate Accuracy

Geometrical Feature Extraction Using 2D Range Scanner

This chapter explains two techniques which are frequently used throughout

Introduction to Mobile Robotics SLAM Grid-based FastSLAM. Wolfram Burgard, Cyrill Stachniss, Maren Bennewitz, Diego Tipaldi, Luciano Spinello

SLAM: Robotic Simultaneous Location and Mapping

A multilevel simulation framework for highly automated harvest processes enabled by environmental sensor systems

Jeffrey A. Schepers P.S. EIT Geospatial Services Holland Engineering Inc. 220 Hoover Blvd, Suite 2, Holland, MI Desk

Using Particle Image Velocimetry for Road Vehicle Tracking and Performance Monitoring. Samuel C. Kucera Jeremy S. Daily

Transcription:

Vehicle Localization Hannah Rae Kerner 21 April 2015

Spotted in Mtn View: Google Car

Why precision localization? in order for a robot to follow a road, it needs to know where the road is to stay in a particular lane, it needs to know where the lane is for an autonomous robot to stay in a lane, localization must be accurate to decimeters at least

Vehicle Localization Problem Autonomous driving and ADAS applications can be significantly improved by more accurate (cm-level) vehicle localization important for safety in urban environments narrow passages, turns, etc GPS-denied areas e.g. parking garages, in between buildings, etc GPS-IMU-odometry based methods are not adequate for this positioning accuracy

Techniques for Improvement Many techniques for increasing location accuracy for urban driving Extended Kalman Filters, Belief Theory, multivehicle cooperation, and more We ll look at the one published by the group that led the development of the Google driverless car

Map-Based Precision Vehicle Localization in Urban Environments Jesse Levinson, Michael Montemerlo, Sebastian Thrun Stanford Artificial Intelligence Laboratory (2008) Augment inertial navigation (GPS + odometry) by: 1. learning a detailed map of the environment 2. using the vehicle s LIDAR sensor to localize relative to that map http://www.roboticsproceedings.org/rss03/p16.pdf

1. Learning a detailed map Map contains: 2-D overhead views of the road surface infrared spectrum captures lane markings, tire marks, pavement, vegetation (grass), etc

Acquiring the map multiple SICK laser range finders pointing downward at the road, mounted on vehicle return range to sampling of points on the ground return measure of infrared reflectivity result: 3-D infrared images of ground reflectivity

Eliminating Dynamic Objects fits a ground plane to each laser scan and removes objects above the plane other cars, buildings, lamp posts, etc along the road are not included in the map

Map Storage rectangular area acquired by range scan decomposed into square grid saves only squares for which there is data after lossless compression, grid images require ~10MB per mile of road at 5cm res. thus a 200GB hard drive can hold 20,000 miles of data particle filter maintains cache of image squares near the vehicle, thus requiring constant amount of memory

2. Localizing relative to map in RT 1. Particle filter analyzes range data to determine the ground plane the vehicle is on (also combines GPS data when available) 2. Correlates measured infrared reflectivity with the map (using the Pearson product-moment correlation) 3. Tracks location by projecting particles forward through time via the velocity outputs from inertial navigation system

Localization uses hardware-accelerated OpenGL to render map for localization (faster than realtime even with low-end graphics card) localization computed with 200 Hz motion update measurements arrive from each laser at 75 Hz uses a particle filter (Monte-Carlo localizer) maintains 3-D pose vector: x, y, yaw

Weather Complications wet surfaces tend to reflect less IR light than dry ones, so maps in the same loc. differ slightly particle filter normalizes brightness and standard deviation for each range scan as well as corresponding map stripes

Experimental Results state-of-the-art inertial nav system three down-facing laser range finders: left, right, and rear 5-cm pixel resolution

Experimental Results tested mapping algorithm successfully on variety of urban roads, e.g. this map acquired in Burlingame in 32 loops:

Ghosting removal

Empirical Results very reliably tracks location of vehicle with relative accuracy of ~10cm used 200 to 300 particles both mapping and localization processes robust to dynamic and hilly environments so long as the road surface remains approx. laterally planar in the neighborhood of the vehicle

Localization without GPS successfully localizes even with GPS turned off (using only odometry and steering angle)

Localization using only LIDAR GPS, IMU, and odometry were all ignored particle state vector: x, y, yaw, steering angle, velocity, and acc. initialized near true position assumed reasonable rates of change reasonably successfully tracked pos. and velocity

Empirical Results localization results after 20 minutes of driving on top of acquired map lateral error almost always within 10cm but on turns sometimes as much as 30cm

Importance of Localization Techniques average disagreement between real-time GPS pose and their localization method was 66-cm

Autonomous Driving Experiments ten attempts to drive autonomously through an urban area gas and brakes operated mostly manually, but all steering done by computer followed fixed reference trajectory through Stanford campus without error 10/10 times often the lane width not occupied by vehicle was less than 2 meters, yet GPS-only consistently failed within meters: GPS localization not sufficient

Conclusions accurate localization enables autonomous cars to perform accurate lane keeping and obey traffic laws GPS is not sufficient for autonomous vehicle localization, yet almost all outdoor localization work is GPS-based this method is better for both accuracy and availability disadvantage of approach: reliance on maps