Applying Model Predictive Control Architecture for Efficient Autonomous Data Collection and Operations on Planetary Missions

Size: px
Start display at page:

Download "Applying Model Predictive Control Architecture for Efficient Autonomous Data Collection and Operations on Planetary Missions"

Transcription

1 Applying Model Predictive Control Architecture for Efficient Autonomous Data Collection and Operations on Planetary Missions M. Lieber, E. Schindhelm, R. Rohrschneider, C. Weimer, S. Roark Cahill Center for Astronomy and Astrophysics August 2017

2 Overview Model Predictive Control(MPC) - Optimized, autonomous data collection for planetary missions What is MPC and why is it relevant to planetary missions Ball relevant technology development Multi-beam adaptive lidar application developed Predictive control architecture Target application for Mars mission Challenges to implementation Page_2

3 Model Predictive Control(MPC) - Optimized, Autonomous Data Collection for Planetary Missions LCPM stands to benefit from recent developments in miniaturization of satellite technology (e.g. CubeSats) and an increase in autonomous operations. MPC is an ideal framework for autonomous, real-time control of complex systems, in part, because it re-optimizes actions with respect to multiple goals and constraints at every time step. Technology Readiness Level (TRL) = 4, illustrated for adaptive, multibeam imaging lidar with Predictive Control Architecture for Earth Science (PCAES) funded by NASA. We have developed an initial prototype MPC architecture which can optimize data collection with adaptive lidar systems using a data-driven or scene-based approach. Also NASA and Ball Internal funding has developed a 3D imaging lidar with real-time adaptive multi-beam lidar hardware for the Asteroid Redirect Mission. This HW configuration was tested on the STOORM mission in 2011 and part of the RAVEN technology demonstration on the International Space station. Vision Navigation System (VNS) Page_3

4 MPC and it s History of Applications MPC was invented in the process industry. Large, complex, multivariable systems with constraints (flow rates, volumes, temperatures, etc), multi-level or hierarchical but with very slow time constants. It s an architecture not a set controller. Although there has not been problems with systems going unstable, the first stability proofs were not developed until the mid-late 90 s. Two things have been a deterrent to adoption computational burden and technology migration. Technology still evolving many forms. Proposed Robotic vision systems Autonomous vehicles & rovers Process industries Economics modeling Wastewater treatment Power grids Automotive systems Formation flying Adaptive lidar and real-time decisions SMD/ Planetary Science applications Computational capability Biological systems Rendezvous & docking 1970, 1980 mainframe computers Space-qualified, FPGA and heterogeneous processing Page_4

5 Fundamental Problem Being Solved Using Adaptive and autonomous Sensor Systems A common theme that emerges is that adaptive sensing should be formulated as the process of evaluating different sensing actions that the robot (..instrument) can take and choosing the action that maximizes the information acquired by the robot (..instrument). The challenge in implementing this concept in practice is to develop a methodology for quantifying the expected information for different sensing actions and evaluate them in a computationally feasible manner given limited a priori information. ** [Feder1999] Feder, J.S.H., Leonard, J. J., Smith, C. M., Adaptive Mobile Robot Navigation and Mapping, IJRR, 18(7), 1999, ** As noted, we borrow heavily from rapid developments in autonomous controlled & complex ground-based systems (cars, mobile robots, etc.) Page_5

6 than the 4.7 seconds shown, the evolution of the 10x10 power maps would be more apparent. This simplistic case was done without any control (except human) the MPC optimizer would be evolving a predicted map from the camera and adjusting the power map according to con- Technology Development Ball Internal R&D and NASA Funding straints and weights. The actual power map would have a threshold applied and so that many of Ball development of adaptive lidar with independent, multiple beamlet control. Electronically Steerable Flash Lidar (ESFL) Predictive Control Architecture Developed initially under Ball internal R&D funding. Funded for further development under the ESTO AIST program as Model Predictive Control Architecture for Optimizing Earth Science Data Collection (PCAES) Application directed to autonomous and optimal control of multi-beam lidar. Data driven modeling approach (MPC comes in many different forms) the power maps pixels shown in Figure 4 would in fact have a zero power allocation. The important point is that the fast layer of the MPC controller needs to operate on the space-based platform to keep up with the rapidly changing scene dynamics. In Section 1.3 we compare MPC to other technologies but here we describe in more detail it s features and challenges. Model predictive control possesses some attractive characteristics as a candidate ESFL control framework. Firstly, because model predictive control re-plans optimal beamlet directions and power allocation at each sampling instant, it is conceivable that information extraction can be maximized in the presence of uncertainty in comparison to higher-level A Ball Aerospace & Technologies Corp. Proprietary Information 6 Use or disclosure of the information contained in this proposal is subject to the restrictions on the title page of this document. Page_6

7 MPC for Optimizing Science Data Collection Real-time scene classification/ understanding for limited set of features. Reduces dimensionality for known objects data driven approach while retaining predictive dynamics feature. Scene classification algorithms can be tailored Deep Learning synergy Single adaptive instrument with hierarchical control Distributed adaptive instrument with hierarchical control Page_7

8 Directed Application - Multi-Beam Adaptive Lidar We apply MPC architecture to an electronically steerable flash lidar (ESFL) AOM controls amplitude and angle (frequency) of each beamlet independently. Spatial light modulator also demonstrated for 2D multi-beamlet control Laser pulse frequency and total power levels are constants. 2D multi-beam steering Constraints: Total power available SNR Steering angle Page_8

9 Challenges to Implementation a Predictive Control Architecture for LCPM MPC is a computationally intensive control architecture. Verification/ validation requires different testing processes than systems that do not possess adaptive or autonomous capability. Each planetary body has it s own unique science opportunities and phenomenological characteristics requiring different mission approaches. Orbiting, flyby, roving, multiple interacting sensor platforms, transient. Field Programmable Gate Array (FPGAs) and heterogeneous computing platforms SpaceCube and SpaceCubeX. Support >30 Hz updates for scene classification and prediction modeling. Mission analysis very unique Page_9

10 Example Earth Remote Sensing application : Adaptive, multi-beam lidar lab demonstration of MPC software Page_10

11 SW Graphical User Interface (GUI) & RT Control Interface Nominal ground track nadir pointing lidar Output to projection system Instantaneous FOV of multibeam lidar Landsat Vis/ IR bands (darkened bands are scene classification & cloud ID Scene classes available Test/ SW validation patterns for calibration User selects scene from folder Enables RT control of SLM Optimized data collection metric (see next chart) Page_11

12 PCAES Lab Interface Software RT Control of Multi-beam Laser using Scene ID from Multiple Spectral Bands Double click image to the right to start short video demonstrating the user interface to the lab hardware. Selections by user of data file and settings are shown also. Page_12

13 Utilizing MPC with Adaptive LIDAR at Mars Scene classifier to use multispectral (VIS/IR) or spatial information from changing terrain as metric to guide laser pointing, therefore optimizing efficiency 2D adaptive LIDAR could find range, adjust gates for higher precision measurements without requiring onboard DEMs or advanced planning Swiss cheese terrain, Christensen 2006 Lobes of ice-rich material from THEMIS, Christensen 2006 HiRISE CO 2 /H 2 O band depth ratios, Pommerol et al Page_13

14 Other Applications of a Predictive Control Architecture for Planetary Missions Onboard science operations Looking for features with imaging instruments, honing in with higher spatial/spectral resolution instruments. Record, prioritize, compress and send back data autonomously. Controlling swarm of smallsats/cubesats Radio occultation for atmospheric temperature, density In-situ instruments to sample multiple regions of upper atmosphere at once Bistatic LIDAR from multiple scattering angles increases measurement accuracy Landing/Flyby optimization Adaptive LIDAR for autonomous ranging, hazard avoidance Scout satellite for asteroid flybys provides cross-track information so mothership can autonomously plan/optimize operations/observations Page_14

Navigation for Future Space Exploration Missions Based on Imaging LiDAR Technologies. Alexandre Pollini Amsterdam,

Navigation for Future Space Exploration Missions Based on Imaging LiDAR Technologies. Alexandre Pollini Amsterdam, Navigation for Future Space Exploration Missions Based on Imaging LiDAR Technologies Alexandre Pollini Amsterdam, 12.11.2013 Presentation outline The needs: missions scenario Current benchmark in space

More information

Rendezvous sensors and navigation

Rendezvous sensors and navigation Clean Space Industrial Days Rendezvous sensors and navigation 23-27 th May 2016 Nicolas Deslaef (TAS-F) Julien Christy (TAS-F) 83230918-DOC-TAS-FR-001 OPEN Agenda 2 Collection of R&T studies enabling vision

More information

Analysis Ready Data For Land (CARD4L-ST)

Analysis Ready Data For Land (CARD4L-ST) Analysis Ready Data For Land Product Family Specification Surface Temperature (CARD4L-ST) Document status For Adoption as: Product Family Specification, Surface Temperature This Specification should next

More information

Quinnipiac Post Flight Aerial Acquisition Report

Quinnipiac Post Flight Aerial Acquisition Report Quinnipiac Post Flight Aerial Acquisition Report August 2011 Post-Flight Aerial Acquisition and Calibration Report FEMA REGION 1 Quinnipiac Watershed, Connecticut, Massachusesetts FEDERAL EMERGENCY MANAGEMENT

More information

MULTISPECTRAL MAPPING

MULTISPECTRAL MAPPING VOLUME 5 ISSUE 1 JAN/FEB 2015 MULTISPECTRAL MAPPING 8 DRONE TECH REVOLUTION Forthcoming order of magnitude reduction in the price of close-range aerial scanning 16 HANDHELD SCANNING TECH 32 MAX MATERIAL,

More information

LiDAR Data Processing:

LiDAR Data Processing: LiDAR Data Processing: Concepts and Methods for LEFI Production Gordon W. Frazer GWF LiDAR Analytics Outline of Presentation Data pre-processing Data quality checking and options for repair Data post-processing

More information

Mobile Mapping and Navigation. Brad Kohlmeyer NAVTEQ Research

Mobile Mapping and Navigation. Brad Kohlmeyer NAVTEQ Research Mobile Mapping and Navigation Brad Kohlmeyer NAVTEQ Research Mobile Mapping & Navigation Markets Automotive Enterprise Internet & Wireless Mobile Devices 2 Local Knowledge & Presence Used to Create Most

More information

An Introduction to Lidar & Forestry May 2013

An Introduction to Lidar & Forestry May 2013 An Introduction to Lidar & Forestry May 2013 Introduction to Lidar & Forestry Lidar technology Derivatives from point clouds Applied to forestry Publish & Share Futures Lidar Light Detection And Ranging

More information

Spectral imagers for nanosatellites

Spectral imagers for nanosatellites VTT TECHNICAL RESEARCH CENTRE OF FINLAND LTD Spectral imagers for nanosatellites Finnish Satellite Workshop 2018 Antti Näsilä VTT Microspectrometers Fabry-Perot (FPI) technology for miniaturizing optical

More information

9/14/2011. Contents. Lecture 3: Spatial Data Acquisition in GIS. Dr. Bo Wu Learning Outcomes. Data Input Stream in GIS

9/14/2011. Contents. Lecture 3: Spatial Data Acquisition in GIS. Dr. Bo Wu Learning Outcomes. Data Input Stream in GIS Contents Lecture 3: Spatial Data Acquisition in GIS Dr. Bo Wu lsbowu@polyu.edu.hk 1. Learning outcomes. Data acquisition: Manual digitization 3. Data acquisition: Field survey 4. Data acquisition: Remote

More information

Analysis Ready Data For Land

Analysis Ready Data For Land Analysis Ready Data For Land Product Family Specification Optical Surface Reflectance (CARD4L-OSR) Document status For Adoption as: Product Family Specification, Surface Reflectance, Working Draft (2017)

More information

Computational Imaging for Self-Driving Vehicles

Computational Imaging for Self-Driving Vehicles CVPR 2018 Computational Imaging for Self-Driving Vehicles Jan Kautz--------Ramesh Raskar--------Achuta Kadambi--------Guy Satat Computational Imaging for Self-Driving Vehicles Jan Kautz--------Ramesh Raskar--------Achuta

More information

Planetary & Cometary Exploration

Planetary & Cometary Exploration Planetary & Cometary Exploration Cameras on Orbiters and Landers Nick Hoekzema Purpose of the camera (I) Navigation, orientation Solar sensors orientation with ~ 0.5º accuracy Star trackers to recognize

More information

Case Study for Long- Range Beyond Visual Line of Sight Project. March 15, 2018 RMEL Transmission and Planning Conference

Case Study for Long- Range Beyond Visual Line of Sight Project. March 15, 2018 RMEL Transmission and Planning Conference Case Study for Long- Range Beyond Visual Line of Sight Project March 15, 2018 RMEL Transmission and Planning Conference 2014 HDR Architecture, 2016 2014 HDR, Inc., all all rights reserved. Helicopters

More information

Using infrared proximity sensors for close 2D localization and object size recognition. Richard Berglind Neonode

Using infrared proximity sensors for close 2D localization and object size recognition. Richard Berglind Neonode Using infrared proximity sensors for close 2D localization and object size recognition Richard Berglind Neonode Outline Overview of sensor types IR proximity sensors and their drawbacks Principles of a

More information

Aerial and Mobile LiDAR Data Fusion

Aerial and Mobile LiDAR Data Fusion Creating Value Delivering Solutions Aerial and Mobile LiDAR Data Fusion Dr. Srini Dharmapuri, CP, PMP What You Will Learn About LiDAR Fusion Mobile and Aerial LiDAR Technology Components & Parameters Project

More information

Integration of airborne LiDAR and hyperspectral remote sensing data to support the Vegetation Resources Inventory and sustainable forest management

Integration of airborne LiDAR and hyperspectral remote sensing data to support the Vegetation Resources Inventory and sustainable forest management Integration of airborne LiDAR and hyperspectral remote sensing data to support the Vegetation Resources Inventory and sustainable forest management Executive Summary This project has addressed a number

More information

Jena-Optronik Relative Navigation Sensor Activities

Jena-Optronik Relative Navigation Sensor Activities Jena-Optronik Relative Navigation Sensor Activities ESA AIM Industry Day Jena-Optronik Relative Navigation Sensor Activities ESA AIM Industry Day. Page 1 Space developments from Jena. 1976 1980 1991 1994

More information

ENY-C2005 Geoinformation in Environmental Modeling Lecture 4b: Laser scanning

ENY-C2005 Geoinformation in Environmental Modeling Lecture 4b: Laser scanning 1 ENY-C2005 Geoinformation in Environmental Modeling Lecture 4b: Laser scanning Petri Rönnholm Aalto University 2 Learning objectives To recognize applications of laser scanning To understand principles

More information

ToF Camera for high resolution 3D images with affordable pricing

ToF Camera for high resolution 3D images with affordable pricing ToF Camera for high resolution 3D images with affordable pricing Basler AG Jana Bartels, Product Manager 3D Agenda Coming next I. Basler AG II. 3D Purpose and Time-of-Flight - Working Principle III. Advantages

More information

Terrestrial GPS setup Fundamentals of Airborne LiDAR Systems, Collection and Calibration. JAMIE YOUNG Senior Manager LiDAR Solutions

Terrestrial GPS setup Fundamentals of Airborne LiDAR Systems, Collection and Calibration. JAMIE YOUNG Senior Manager LiDAR Solutions Terrestrial GPS setup Fundamentals of Airborne LiDAR Systems, Collection and Calibration JAMIE YOUNG Senior Manager LiDAR Solutions Topics Terrestrial GPS reference Planning and Collection Considerations

More information

EE631 Cooperating Autonomous Mobile Robots

EE631 Cooperating Autonomous Mobile Robots EE631 Cooperating Autonomous Mobile Robots Lecture: Multi-Robot Motion Planning Prof. Yi Guo ECE Department Plan Introduction Premises and Problem Statement A Multi-Robot Motion Planning Algorithm Implementation

More information

Mayden VP of Business Development Surdex Corporation

Mayden VP of Business Development Surdex Corporation Making Sense of Sensors Randy Mayden, Mayden VP of Business Development Surdex Corporation randym@surdex.com EARLYAERIAL PHOTOGRAPHY 2 FIRSTAERIAL CAMERA 3 AERIAL CAMERA SYSTEM DEVELOPMENT Aerial Camera

More information

Sensor Modalities. Sensor modality: Different modalities:

Sensor Modalities. Sensor modality: Different modalities: Sensor Modalities Sensor modality: Sensors which measure same form of energy and process it in similar ways Modality refers to the raw input used by the sensors Different modalities: Sound Pressure Temperature

More information

Video Georegistration: Key Challenges. Steve Blask Harris Corporation GCSD Melbourne, FL 32934

Video Georegistration: Key Challenges. Steve Blask Harris Corporation GCSD Melbourne, FL 32934 Video Georegistration: Key Challenges Steve Blask sblask@harris.com Harris Corporation GCSD Melbourne, FL 32934 Definitions Registration: image to image alignment Find pixel-to-pixel correspondences between

More information

H2020 Space Robotic SRC- OG4

H2020 Space Robotic SRC- OG4 H2020 Space Robotic SRC- OG4 2 nd PERASPERA workshop Presentation by Sabrina Andiappane Thales Alenia Space France This project has received funding from the European Union s Horizon 2020 research and

More information

IMPROVED TARGET DETECTION IN URBAN AREA USING COMBINED LIDAR AND APEX DATA

IMPROVED TARGET DETECTION IN URBAN AREA USING COMBINED LIDAR AND APEX DATA IMPROVED TARGET DETECTION IN URBAN AREA USING COMBINED LIDAR AND APEX DATA Michal Shimoni 1 and Koen Meuleman 2 1 Signal and Image Centre, Dept. of Electrical Engineering (SIC-RMA), Belgium; 2 Flemish

More information

Thematic Mapping with Remote Sensing Satellite Networks

Thematic Mapping with Remote Sensing Satellite Networks Thematic Mapping with Remote Sensing Satellite Networks College of Engineering and Computer Science The Australian National University outline satellite networks implications for analytical methods candidate

More information

Overview of MOLI data product (MOLI: Multi-footprint Observation Lidar and Imager)

Overview of MOLI data product (MOLI: Multi-footprint Observation Lidar and Imager) Overview of MOLI data product (MOLI: Multi-footprint Observation Lidar and Imager) Jan 7, 2016 JAXA Jumpei Murooka 1 Contents 1. Mission instruments: MOLI 2. Standard products of MOLI 3. Lidar product

More information

3D Laser Range Finder Topological sensor gathering spatial data from the surrounding environment

3D Laser Range Finder Topological sensor gathering spatial data from the surrounding environment Initial Project and Group Identification Document September 19, 2013 3D Laser Range Finder Topological sensor gathering spatial data from the surrounding environment Christian Conrose Jonathan Ulrich Andrew

More information

Turning an Automated System into an Autonomous system using Model-Based Design Autonomous Tech Conference 2018

Turning an Automated System into an Autonomous system using Model-Based Design Autonomous Tech Conference 2018 Turning an Automated System into an Autonomous system using Model-Based Design Autonomous Tech Conference 2018 Asaf Moses Systematics Ltd., Technical Product Manager aviasafm@systematics.co.il 1 Autonomous

More information

Tightly-Integrated Visual and Inertial Navigation for Pinpoint Landing on Rugged Terrains

Tightly-Integrated Visual and Inertial Navigation for Pinpoint Landing on Rugged Terrains Tightly-Integrated Visual and Inertial Navigation for Pinpoint Landing on Rugged Terrains PhD student: Jeff DELAUNE ONERA Director: Guy LE BESNERAIS ONERA Advisors: Jean-Loup FARGES Clément BOURDARIAS

More information

An Automatic Method for Adjustment of a Camera Calibration Room

An Automatic Method for Adjustment of a Camera Calibration Room An Automatic Method for Adjustment of a Camera Calibration Room Presented at the FIG Working Week 2017, May 29 - June 2, 2017 in Helsinki, Finland Theory, algorithms, implementation, and two advanced applications.

More information

FRACTIONATED SATELLITES

FRACTIONATED SATELLITES EXECUTIVE SUMMARY February 2010 Page : ii/12 FRACTIONATED Executive Summary Toulouse, February 2010-02-08 Prepared by: C. Cougnet, B. Gerber ESA Project Manager: EADS Astrium Project Manager: J. F. Dufour

More information

2014 Google Earth Engine Research Award Report

2014 Google Earth Engine Research Award Report 2014 Google Earth Engine Research Award Report Title: Mapping Invasive Vegetation using Hyperspectral Data, Spectral Angle Mapping, and Mixture Tuned Matched Filtering Section I: Section II: Section III:

More information

LIDAR MAPPING FACT SHEET

LIDAR MAPPING FACT SHEET 1. LIDAR THEORY What is lidar? Lidar is an acronym for light detection and ranging. In the mapping industry, this term is used to describe an airborne laser profiling system that produces location and

More information

Missile Simulation in Support of Research, Development, Test Evaluation and Acquisition

Missile Simulation in Support of Research, Development, Test Evaluation and Acquisition NDIA 2012 Missile Simulation in Support of Research, Development, Test Evaluation and Acquisition 15 May 2012 Briefed by: Stephanie Brown Reitmeier United States Army Aviation and Missile Research, Development,

More information

Integrated Multi-Source LiDAR and Imagery

Integrated Multi-Source LiDAR and Imagery Figure 1: AirDaC aerial scanning system Integrated Multi-Source LiDAR and Imagery The derived benefits of LiDAR scanning in the fields of engineering, surveying, and planning are well documented. It has

More information

Stereo and Monocular Vision Applied to Computer Aided Navigation for Aerial and Ground Vehicles

Stereo and Monocular Vision Applied to Computer Aided Navigation for Aerial and Ground Vehicles Riccardo Giubilato Centro di Ateneo di Studi e Attivita Spaziali Giuseppe Colombo CISAS University of Padova 1 Introduction Previous Work Research Objectives Research Methodology Robot vision: Process

More information

W4. Perception & Situation Awareness & Decision making

W4. Perception & Situation Awareness & Decision making W4. Perception & Situation Awareness & Decision making Robot Perception for Dynamic environments: Outline & DP-Grids concept Dynamic Probabilistic Grids Bayesian Occupancy Filter concept Dynamic Probabilistic

More information

AN ANALYTICAL APPROACH TO AUTONOMOUS OPTICAL NAVIGATION FOR A CUBESAT MISSION TO A BINARY ASTEROID SYSTEM

AN ANALYTICAL APPROACH TO AUTONOMOUS OPTICAL NAVIGATION FOR A CUBESAT MISSION TO A BINARY ASTEROID SYSTEM 4 th IAA Conference on University Satellite Missions and CubeSat Workshop 4-7 December 2017 Rome, Italy AN ANALYTICAL APPROACH TO AUTONOMOUS OPTICAL NAVIGATION FOR A CUBESAT MISSION TO A BINARY ASTEROID

More information

Space Robotics. Ioannis Rekleitis

Space Robotics. Ioannis Rekleitis Space Robotics Ioannis Rekleitis On-Orbit Servicing of Satellites Work done at the Canadian Space Agency Guy Rouleau, Ioannis Rekleitis, Régent L'Archevêque, Eric Martin, Kourosh Parsa, and Erick Dupuis

More information

Archiving Low-Cost Mission Data in NASA s Planetary Data System

Archiving Low-Cost Mission Data in NASA s Planetary Data System Archiving Low-Cost Mission Data in NASA s Planetary Data System Nancy Chanover New Mexico State University PDS Atmospheres Node 8/15/17 LCPM-12 1 Why Archive Data? Many of the data are irreplaceable and

More information

Photoneo's brand new PhoXi 3D Camera is the highest resolution and highest accuracy area based 3D

Photoneo's brand new PhoXi 3D Camera is the highest resolution and highest accuracy area based 3D Company: Photoneo s.r.o. Germany Contact: Veronika Pulisova E-mail: pulisova@photoneo.com PhoXi 3D Camera Author: Tomas Kovacovsky & Jan Zizka Description of the innovation: General description Photoneo's

More information

TELEDYNE GEOSPATIAL SOLUTIONS

TELEDYNE GEOSPATIAL SOLUTIONS GEOSPATIAL SOLUTIONS THE CONTENTS TELEDYNE GEOSPATIAL SOLUTIONS Capability Overview... 4 Hosted Payloads... 6 Payload Operations as a Service... 8 TCloud Data Management... 10 Imagery Sales... 12 About

More information

CLASSIFICATION OF NONPHOTOGRAPHIC REMOTE SENSORS

CLASSIFICATION OF NONPHOTOGRAPHIC REMOTE SENSORS CLASSIFICATION OF NONPHOTOGRAPHIC REMOTE SENSORS PASSIVE ACTIVE DIGITAL CAMERA THERMAL (e.g. TIMS) VIDEO CAMERA MULTI- SPECTRAL SCANNERS VISIBLE & NIR MICROWAVE HYPERSPECTRAL (e.g. AVIRIS) SLAR Real Aperture

More information

Digital Image Processing Lectures 1 & 2

Digital Image Processing Lectures 1 & 2 Lectures 1 & 2, Professor Department of Electrical and Computer Engineering Colorado State University Spring 2013 Introduction to DIP The primary interest in transmitting and handling images in digital

More information

Why the Self-Driving Revolution Hinges on one Enabling Technology: LiDAR

Why the Self-Driving Revolution Hinges on one Enabling Technology: LiDAR Why the Self-Driving Revolution Hinges on one Enabling Technology: LiDAR Markus Prison Director Business Development Europe Quanergy ID: 23328 Who We Are The leader in LiDAR (laser-based 3D spatial sensor)

More information

Optical Sensors: Key Technology for the Autonomous Car

Optical Sensors: Key Technology for the Autonomous Car Optical Sensors: Key Technology for the Autonomous Car Rajeev Thakur, P.E., Product Marketing Manager, Infrared Business Unit, Osram Opto Semiconductors Autonomously driven cars will combine a variety

More information

Airborne Laser Scanning: Remote Sensing with LiDAR

Airborne Laser Scanning: Remote Sensing with LiDAR Airborne Laser Scanning: Remote Sensing with LiDAR ALS / LIDAR OUTLINE Laser remote sensing background Basic components of an ALS/LIDAR system Two distinct families of ALS systems Waveform Discrete Return

More information

Overview of Proximity Operations Missions Relevant to NanoSats

Overview of Proximity Operations Missions Relevant to NanoSats Overview of Proximity Operations Missions Relevant to NanoSats Scott MacGillivray, President Tyvak Nano-Satellite Systems LLC (714) 392-9095 scott@tyvak.com 18 April 2012 This document does not contain

More information

Gianluca Palermo Sapienza - Università di Roma. Paolo Gaudenzi Sapienza - Università di Roma

Gianluca Palermo Sapienza - Università di Roma. Paolo Gaudenzi Sapienza - Università di Roma Optimization of satellite s onboard data processing workload and related system resources, by offloading specific CPUintensive tasks onto external computational nodes Gianluca Palermo Sapienza - Università

More information

Automated Extraction of Buildings from Aerial LiDAR Point Cloud and Digital Imaging Datasets for 3D Cadastre - Preliminary Results

Automated Extraction of Buildings from Aerial LiDAR Point Cloud and Digital Imaging Datasets for 3D Cadastre - Preliminary Results Automated Extraction of Buildings from Aerial LiDAR Point Cloud and Digital Imaging Datasets for 3D Pankaj Kumar 1*, Alias Abdul Rahman 1 and Gurcan Buyuksalih 2 ¹Department of Geoinformation Universiti

More information

What s New in STK 11?

What s New in STK 11? What s New in STK 11? Major Enhancements for STK 11 Performance Improvements 64-bit Desktop Deck access parallelization Terrain Server Worldwide streaming terrain Available for analysis and visualization

More information

Announcements. Exam #2 next Thursday (March 13) Covers material from Feb. 11 through March 6

Announcements. Exam #2 next Thursday (March 13) Covers material from Feb. 11 through March 6 Multi-Robot Path Planning and Multi-Robot Traffic Management March 6, 2003 Class Meeting 16 Announcements Exam #2 next Thursday (March 13) Covers material from Feb. 11 through March 6 Up to Now Swarm-Type

More information

'Smartphone satellite' developed by Surrey space researchers

'Smartphone satellite' developed by Surrey space researchers Press Release 24th January 2011 'Smartphone satellite' developed by Surrey space researchers Space researchers at the University of Surrey and Surrey Satellite Technology Limited (SSTL) have developed

More information

GEOG 4110/5100 Advanced Remote Sensing Lecture 4

GEOG 4110/5100 Advanced Remote Sensing Lecture 4 GEOG 4110/5100 Advanced Remote Sensing Lecture 4 Geometric Distortion Relevant Reading: Richards, Sections 2.11-2.17 Review What factors influence radiometric distortion? What is striping in an image?

More information

Pilot Assistive Safe Landing Site Detection System, an Experimentation Using Fuzzy C Mean Clustering

Pilot Assistive Safe Landing Site Detection System, an Experimentation Using Fuzzy C Mean Clustering International OPEN ACCESS Journal Of Modern Engineering Research (IJMER) Pilot Assistive Safe Landing Site Detection System, an Experimentation Using Fuzzy C Mean Clustering Jeena Wilson 1 1 Federal Institute

More information

Airborne LiDAR Data Acquisition for Forestry Applications. Mischa Hey WSI (Corvallis, OR)

Airborne LiDAR Data Acquisition for Forestry Applications. Mischa Hey WSI (Corvallis, OR) Airborne LiDAR Data Acquisition for Forestry Applications Mischa Hey WSI (Corvallis, OR) WSI Services Corvallis, OR Airborne Mapping: Light Detection and Ranging (LiDAR) Thermal Infrared Imagery 4-Band

More information

GEOG 4110/5100 Advanced Remote Sensing Lecture 2

GEOG 4110/5100 Advanced Remote Sensing Lecture 2 GEOG 4110/5100 Advanced Remote Sensing Lecture 2 Data Quality Radiometric Distortion Radiometric Error Correction Relevant reading: Richards, sections 2.1 2.8; 2.10.1 2.10.3 Data Quality/Resolution Spatial

More information

Comparison of Stereo Vision Techniques for cloud-top height retrieval

Comparison of Stereo Vision Techniques for cloud-top height retrieval Comparison of Stereo Vision Techniques for cloud-top height retrieval Anna Anzalone *,, Francesco Isgrò^, Domenico Tegolo *INAF-Istituto Istituto di Astrofisica e Fisica cosmica di Palermo, Italy ^Dipartimento

More information

LOW COST ADVANCDED DRIVER ASSISTANCE SYSTEM (ADAS) DEVELOPMENT

LOW COST ADVANCDED DRIVER ASSISTANCE SYSTEM (ADAS) DEVELOPMENT 2013 NDIA GROUND VEHICLE SYSTEMS ENGINEERING AND TECHNOLOGY SYMPOSIUM AUTONOMOUS GROUND SYSTEMS (AGS) MINI-SYMPOSIUM AUGUST 21-22, 2013 - TROY, MICHIGAN LOW COST ADVANCDED DRIVER ASSISTANCE SYSTEM (ADAS)

More information

Center for Advanced Imaging LADAR. A 3D Texel Camera

Center for Advanced Imaging LADAR. A 3D Texel Camera Center for Advanced Imaging LADAR Utah State University A 3D Texel Camera Kylee Sealy Industry Day 12/28/2006 Problem/Opportunity Existing 3D Cameras: > Systems are relatively slow and awkward > Hard to

More information

Motion estimation of unmanned marine vehicles Massimo Caccia

Motion estimation of unmanned marine vehicles Massimo Caccia Motion estimation of unmanned marine vehicles Massimo Caccia Consiglio Nazionale delle Ricerche Istituto di Studi sui Sistemi Intelligenti per l Automazione Via Amendola 122 D/O, 70126, Bari, Italy massimo.caccia@ge.issia.cnr.it

More information

Autonomous Robot Navigation: Using Multiple Semi-supervised Models for Obstacle Detection

Autonomous Robot Navigation: Using Multiple Semi-supervised Models for Obstacle Detection Autonomous Robot Navigation: Using Multiple Semi-supervised Models for Obstacle Detection Adam Bates University of Colorado at Boulder Abstract: This paper proposes a novel approach to efficiently creating

More information

Autonomous navigation in industrial cluttered environments using embedded stereo-vision

Autonomous navigation in industrial cluttered environments using embedded stereo-vision Autonomous navigation in industrial cluttered environments using embedded stereo-vision Julien Marzat ONERA Palaiseau Aerial Robotics workshop, Paris, 8-9 March 2017 1 Copernic Lab (ONERA Palaiseau) Research

More information

What s New in ecognition 9.0

What s New in ecognition 9.0 What s New in ecognition 9.0 Dr. Waldemar Krebs tranforming data into GIS ready information Trends in Earth Observation Increasing need for detailed, up-to-date information as a basis for planning and

More information

Department of Defense Emerging Needs for Standardization

Department of Defense Emerging Needs for Standardization Department of Defense Emerging Needs for Standardization Robert Gold Director, Engineering Enterprise Office of the Deputy Assistant Secretary of Defense for Systems Engineering SAE International 2016

More information

On-Orbit Testing of Target-less TriDAR 3D Rendezvous and Docking Sensor

On-Orbit Testing of Target-less TriDAR 3D Rendezvous and Docking Sensor On-Orbit Testing of Target-less TriDAR 3D Rendezvous and Docking Sensor Stephane Ruel, Tim Luu, Andrew Berube* *Neptec Design Group, Canada e-mail: sruel@neptec.com Abstract TriDAR is a vision system developed

More information

Lecture 13.1: Airborne Lidar Systems

Lecture 13.1: Airborne Lidar Systems Lecture 13.1: Airborne Lidar Systems 1. Introduction v The main advantages of airborne lidar systems are that they expand the geographical range of studies beyond those possible by surface-based fixed

More information

S2 MPC Data Quality Report Ref. S2-PDGS-MPC-DQR

S2 MPC Data Quality Report Ref. S2-PDGS-MPC-DQR S2 MPC Data Quality Report Ref. S2-PDGS-MPC-DQR 2/13 Authors Table Name Company Responsibility Date Signature Written by S. Clerc & MPC Team ACRI/Argans Technical Manager 2015-11-30 Verified by O. Devignot

More information

Dense Tracking and Mapping for Autonomous Quadrocopters. Jürgen Sturm

Dense Tracking and Mapping for Autonomous Quadrocopters. Jürgen Sturm Computer Vision Group Prof. Daniel Cremers Dense Tracking and Mapping for Autonomous Quadrocopters Jürgen Sturm Joint work with Frank Steinbrücker, Jakob Engel, Christian Kerl, Erik Bylow, and Daniel Cremers

More information

Solid-State Hybrid LiDAR for Autonomous Driving Product Description

Solid-State Hybrid LiDAR for Autonomous Driving Product Description Solid-State Hybrid LiDAR for Autonomous Driving Product Description What is LiDAR Sensor Who is Using LiDARs How does LiDAR Work Hesai LiDAR Demo Features Terminologies Specifications What is LiDAR A LiDAR

More information

Guidance, Navigation and Control issues for Hayabusa follow-on missions F. Terui, N. Ogawa, O. Mori JAXA (Japan Aerospace Exploration Agency )

Guidance, Navigation and Control issues for Hayabusa follow-on missions F. Terui, N. Ogawa, O. Mori JAXA (Japan Aerospace Exploration Agency ) 18-20th May 2009 Guidance, Navigation and Control issues for Hayabusa follow-on missions F. Terui, N. Ogawa, O. Mori JAXA (Japan Aerospace Exploration Agency ) Lessons and Learned & heritage from Proximity

More information

STARTING WITH DRONES. Data Collection and Remote Sensing with UAVs, etc. Dr. Bill Hazelton LS

STARTING WITH DRONES. Data Collection and Remote Sensing with UAVs, etc. Dr. Bill Hazelton LS STARTING WITH DRONES Data Collection and Remote Sensing with UAVs, etc. Dr. Bill Hazelton LS What this Talk is About UAV-based data acquisition: What you need to get involved Processes in getting spatial

More information

Remote Sensing Introduction to the course

Remote Sensing Introduction to the course Remote Sensing Introduction to the course Remote Sensing (Prof. L. Biagi) Exploitation of remotely assessed data for information retrieval Data: Digital images of the Earth, obtained by sensors recording

More information

Leica - Airborne Digital Sensors (ADS80, ALS60) Update / News in the context of Remote Sensing applications

Leica - Airborne Digital Sensors (ADS80, ALS60) Update / News in the context of Remote Sensing applications Luzern, Switzerland, acquired with GSD=5 cm, 2008. Leica - Airborne Digital Sensors (ADS80, ALS60) Update / News in the context of Remote Sensing applications Arthur Rohrbach, Sensor Sales Dir Europe,

More information

Pressure Sensitive Paint (PSP)/ Temperature Sensitive Paint (TSP) Part 2

Pressure Sensitive Paint (PSP)/ Temperature Sensitive Paint (TSP) Part 2 AerE 545 class notes #15 Pressure Sensitive Paint (PSP)/ Temperature Sensitive Paint (TSP) Part 2 Hui Hu Department of Aerospace Engineering, Iowa State University Ames, Iowa 511, U.S.A Lab 2: Power spectrum

More information

force [n] precision machined body (custom design welcome) Mating pin diameter [mm] force [n]

force [n] precision machined body (custom design welcome) Mating pin diameter [mm] force [n] CoNtact data StaNdard CLIP Clip code 0610 4-FiNGer 0.56-0.84 mm 0.28 mm 3.5 mm 5 a Clip code 4710 0.64-0.92 mm 0.24 mm 2.6 mm 5 a Clip code 1810 0.92-1.06 mm 0.14 mm 2.2 mm 8 a 190 CoNtact data StaNdard

More information

VALIDATION OF 3D ENVIRONMENT PERCEPTION FOR LANDING ON SMALL BODIES USING UAV PLATFORMS

VALIDATION OF 3D ENVIRONMENT PERCEPTION FOR LANDING ON SMALL BODIES USING UAV PLATFORMS ASTRA 2015 VALIDATION OF 3D ENVIRONMENT PERCEPTION FOR LANDING ON SMALL BODIES USING UAV PLATFORMS Property of GMV All rights reserved PERIGEO PROJECT The work presented here is part of the PERIGEO project

More information

AIRBORNE GEIGER MODE LIDAR - LATEST ADVANCEMENTS IN REMOTE SENSING APPLICATIONS RANDY RHOADS

AIRBORNE GEIGER MODE LIDAR - LATEST ADVANCEMENTS IN REMOTE SENSING APPLICATIONS RANDY RHOADS Place image here (10 x 3.5 ) AIRBORNE GEIGER MODE LIDAR - LATEST ADVANCEMENTS IN REMOTE SENSING APPLICATIONS RANDY RHOADS Geospatial Industry Manager HARRIS.COM #HARRISCORP Harris Company Information SECURITY

More information

Accuracy Assessment of Ames Stereo Pipeline Derived DEMs Using a Weighted Spatial Dependence Model

Accuracy Assessment of Ames Stereo Pipeline Derived DEMs Using a Weighted Spatial Dependence Model Accuracy Assessment of Ames Stereo Pipeline Derived DEMs Using a Weighted Spatial Dependence Model Intro Problem Statement A successful lunar mission requires accurate, high resolution data products to

More information

Ice Cover and Sea and Lake Ice Concentration with GOES-R ABI

Ice Cover and Sea and Lake Ice Concentration with GOES-R ABI GOES-R AWG Cryosphere Team Ice Cover and Sea and Lake Ice Concentration with GOES-R ABI Presented by Yinghui Liu 1 Team Members: Yinghui Liu 1, Jeffrey R Key 2, and Xuanji Wang 1 1 UW-Madison CIMSS 2 NOAA/NESDIS/STAR

More information

Introduction to Control Systems Design

Introduction to Control Systems Design Experiment One Introduction to Control Systems Design Control Systems Laboratory Dr. Zaer Abo Hammour Dr. Zaer Abo Hammour Control Systems Laboratory 1.1 Control System Design The design of control systems

More information

MULTI-MODAL MAPPING. Robotics Day, 31 Mar Frank Mascarich, Shehryar Khattak, Tung Dang

MULTI-MODAL MAPPING. Robotics Day, 31 Mar Frank Mascarich, Shehryar Khattak, Tung Dang MULTI-MODAL MAPPING Robotics Day, 31 Mar 2017 Frank Mascarich, Shehryar Khattak, Tung Dang Application-Specific Sensors Cameras TOF Cameras PERCEPTION LiDAR IMU Localization Mapping Autonomy Robotic Perception

More information

JEM Internal Ball Camera (Int-Ball)

JEM Internal Ball Camera (Int-Ball) JEM Internal Ball Camera (Int-Ball) July 14, 2017 Japan Aerospace Exploration Agency 1 Objective of Project Currently, when working in the Japanese Experiment Module ( Kibo ), the crew (astronaut) often

More information

UV-NIR LASER BEAM PROFILER

UV-NIR LASER BEAM PROFILER CinCam CMOS - Technical Data - CMOS-1201 CMOS-1202 CMOS-1203 CMOS-1204 Standard Series Standard Series Standard Series Standard Series SENSOR DATA Format: 1/2 1/1.8 1/1.8 1/2.5 Active area (without cover

More information

The Staggered SAR Concept: Imaging a Wide Continuous Swath with High Resolution

The Staggered SAR Concept: Imaging a Wide Continuous Swath with High Resolution The Staggered SAR Concept: Imaging a Wide Continuous Swath with High Resolution Michelangelo Villano *, Gerhard Krieger *, Alberto Moreira * * German Aerospace Center (DLR), Microwaves and Radar Institute

More information

Solid State LiDAR for Ubiquitous 3D Sensing

Solid State LiDAR for Ubiquitous 3D Sensing April 6, 2016 Solid State LiDAR for Ubiquitous 3D Sensing Louay Eldada, Ph.D. CEO, Co-founder Quanergy Systems New Paradigm in 3D Sensing Disruptive Technologies: Solid State 3D LiDAR sensors Embedded

More information

Total and Spectral solar Irradiance Sensor (TSIS-1) Project Overview

Total and Spectral solar Irradiance Sensor (TSIS-1) Project Overview November 12, 2015 TSIS-1 Project Overview 1 Total and Spectral solar Irradiance Sensor (TSIS-1) Project Overview 2015 Sun-Climate Symposium Project Manager: Candace Carlisle Deputy Project Manager / Resources:

More information

Classify Multi-Spectral Data Classify Geologic Terrains on Venus Apply Multi-Variate Statistics

Classify Multi-Spectral Data Classify Geologic Terrains on Venus Apply Multi-Variate Statistics Classify Multi-Spectral Data Classify Geologic Terrains on Venus Apply Multi-Variate Statistics Operations What Do I Need? Classify Merge Combine Cross Scan Score Warp Respace Cover Subscene Rotate Translators

More information

Revolutionizing 2D measurement. Maximizing longevity. Challenging expectations. R2100 Multi-Ray LED Scanner

Revolutionizing 2D measurement. Maximizing longevity. Challenging expectations. R2100 Multi-Ray LED Scanner Revolutionizing 2D measurement. Maximizing longevity. Challenging expectations. R2100 Multi-Ray LED Scanner A Distance Ahead A Distance Ahead: Your Crucial Edge in the Market The new generation of distancebased

More information

Third Rock from the Sun

Third Rock from the Sun Geodesy 101 AHD LiDAR Best Practice The Mystery of LiDAR Best Practice Glenn Jones SSSi GIS in the Coastal Environment Batemans Bay November 9, 2010 Light Detection and Ranging (LiDAR) Basic principles

More information

Mobile Robotics. Mathematics, Models, and Methods. HI Cambridge. Alonzo Kelly. Carnegie Mellon University UNIVERSITY PRESS

Mobile Robotics. Mathematics, Models, and Methods. HI Cambridge. Alonzo Kelly. Carnegie Mellon University UNIVERSITY PRESS Mobile Robotics Mathematics, Models, and Methods Alonzo Kelly Carnegie Mellon University HI Cambridge UNIVERSITY PRESS Contents Preface page xiii 1 Introduction 1 1.1 Applications of Mobile Robots 2 1.2

More information

CONTENT ENGINEERING & VISION LABORATORY. Régis Vinciguerra

CONTENT ENGINEERING & VISION LABORATORY. Régis Vinciguerra CONTENT ENGINEERING & VISION LABORATORY Régis Vinciguerra regis.vinciguerra@cea.fr ALTERNATIVE ENERGIES AND ATOMIC ENERGY COMMISSION Military Applications Division (DAM) Nuclear Energy Division (DEN) Technological

More information

Sensor Fusion: Potential, Challenges and Applications. Presented by KVH Industries and Geodetics, Inc. December 2016

Sensor Fusion: Potential, Challenges and Applications. Presented by KVH Industries and Geodetics, Inc. December 2016 Sensor Fusion: Potential, Challenges and Applications Presented by KVH Industries and Geodetics, Inc. December 2016 1 KVH Industries Overview Innovative technology company 600 employees worldwide Focused

More information

Figure Potential 5G applications

Figure Potential 5G applications 6. 5G Key Concept 6.1 Key Concepts of 5G End-to-end (E2E) quality required by applications and/or users will be far more diversified in the 5G era than what we have seen in the preceding generations. For

More information

Laser Beacon Tracking for High-Accuracy Attitude Determination

Laser Beacon Tracking for High-Accuracy Attitude Determination Laser Beacon Tracking for High-Accuracy Attitude Determination Tam Nguyen Massachusetts Institute of Technology 29 th AIAA/USU Conference on Small Satellites SSC15-VIII-2 08/12/2015 Outline Motivation

More information

Ocean Colour Vicarious Calibration Community requirements for future infrastructures

Ocean Colour Vicarious Calibration Community requirements for future infrastructures Ocean Colour Vicarious Calibration Community requirements for future infrastructures IOCS 2017 - Breakout Workshop#3 IOCS 2017 ocean colour vicarious calibration 1 Part II: Discussion on community requirements

More information

CARBON NANOTUBE FLAT PLATE BLACKBODY CALIBRATOR. John C. Fleming

CARBON NANOTUBE FLAT PLATE BLACKBODY CALIBRATOR. John C. Fleming CARBON NANOTUBE FLAT PLATE BLACKBODY CALIBRATOR John C. Fleming Ball Aerospace, jfleming@ball.com Sandra Collins, Beth Kelsic, Nathan Schwartz, David Osterman, Bevan Staple Ball Aerospace, scollins@ball.com

More information