Autonomous on-orbit Calibration Of Star Trackers

Size: px
Start display at page:

Download "Autonomous on-orbit Calibration Of Star Trackers"

Transcription

1 Autonomous on-orbit Calibration Of Star Trackers Malak Samaan 1, Todd Griffith 2,Puneet Singla 3, and John L. Junkins 4 Department of Aerospace Engineering, Texas A&M University, College Station, TX Abstract This paper presents two calibration methods to obtain the estimates for the focal length and principal point offsets and the focal plane distortions for a star camera with a CCD array. These quantities can be obtained from star image frames where the stars have been identified. These estimation techniques can be used either on gourd or in flight. To model the optics of the camera, the pin-hole model, which is found to be very accurate for most star cameras, is used. The first method used is that of standard nonlinear least-squares optimal estimation. This method is used iteratively until it converges with a set tolerance. The second technique presented uses the on-orbit calibration corrections to calibrate the focal plane distortions. Introduction An important problem in spacecraft autonomy is the frequently occurring situation that instrument acting an other unpredictable effects result in significant changes in the star tracker. Recent missions, e.g. MSX have shown the consequence that attitude estimate precision is degraded. In the proposed paper, we show a novel method for solving this problem. The method makes use of residuals between measured inter star cosine angles and the interstar cosine angles between the corresponding cataloged stars (ˆv T i ˆv j = ŵ T i ŵj) to learn the calibration corrections on-orbit, starting from ground-based calibration results. 1 Graduate Student, Department of Aerospace Engineering, Texas A&M University, College Station, TX , mas1894@aero.tamu.edu, AIAA and AAS Member. 2 Graduate Student, Department of Aerospace Engineering, Texas A&M University, College Station, TX , dtg8332@aero.tamu.edu, AIAA and AAS Member. 3 Graduate Student, Department of Aerospace Engineering, Texas A&M University, College Station, TX , puneet@neo.tamu.edu, AIAA and AAS Member. 4 George Eppright Chair, Distinguished Professor, Department of Aerospace Engineering, Texas A&M University, College Station, TX , junkins@tamu.edu, AIAA and AAS Memeber. 1

2 Approach makes use of the truth that interstar angles are an invariant of rotational transformations, and therefore we do not require knowledge of the generally unknown spacecraft attitude. The calibration process is naturally divided into two major parts: Calibration of the principal point offset (x o, y o ) and focal length (f). Calibration of the focal plane distortions due to all other effects (lens distortion, misalignment, detector alignment, etc.) Both Batch (Ground-based) and sequential (On-orbit) algorithms have been developed. The paper will deal with algorithmic details for some simulation and early night sky experiments. The Ground (Batch) Calibration The main objective of the Ground calibration algorithms are to find accurate calibrated values for the focal length used for obtaining the CCD image and the offsets value for the x and y coordinates as shown in Fig. 1. Figure 1: The star coordinates and offsets Without the focal plane calibration the problem of the Star Identification (Ref [1]-[3]) may not give an accurate results due to the fact the the imaged stars have to be modified by the amount of the bore-sight offsets and the focal length used to get the star image. The method of least squares optimal estimation has proved to be an extremely powerful technique, and has been used extensively in the parameters identification algorithms (Calibration). To begin the ground calibration algorithm the stars of the CCD image has to be manually identified so that the inertial and the body direction vectors are given as an input to the algorithm. From the centroiding algorithm we have x i and y i for (i = 1,..., n) where n is the number of stars in the FOV. We can use initial guess of the focal length to get 2

3 ŵ i = 1 ((xi x o ) 2 p 2 sx + (y i y o ) 2 p 2 sy + f 2 ) (x i x o )p sx (y i y o )p sy f (1) where f is the camera focal length, (x o, y o ) are the bore-sight errors, and p sx and p sy are the pixel size in x - direction and y - direction respectively. image width p sx = No. of pixels of the CCD in x-dir. image height p sy = No. of pixels of the CCD in y-dir. So, f, x o and y o are the unknowns to be estimated using the Nonlinear Least Square Optimal Estimation. The Cataloged Vectors The inertial cataloged star direction cosines could be calculated using; ˆv i = cos α i cos δ i sin α i cos δ i sin δ i (2) (3) Where α i and δ i are the right ascension and declination for star i (i = 1,..., n) respectively. Now, to solve for the unknowns we can use the fact that the interstar angles for the imaged vectors and the cataloged vectors have to be the same, mathematically; Now, using equation (1) we can show that; Where ˆv T i ˆv j = ˆv T i ˆv j = ŵ T i ŵj (4) N D 1 D 2 = g ij (x o, y o, f) (5) N = (x i x o )(x j x o )p 2 sx + (y i y o )(y j y o )p 2 sy + f 2 D 1 = (x i x o ) 2 p 2 sx + (y i y o ) 2 p 2 sy + f 2 D 2 = (x j x o ) 2 p 2 sx + (y j y o ) 2 p 2 sy + f 2 (6) 3

4 By using the linearization about the nominal value (ˆx o,ŷ o, ˆf) we have x o = ˆx o + x, y o = ŷ o + y and f = ˆf + f (7) Substitute equation (7) in (5) to get ˆv T i ˆv j = g ij (ˆx o, ŷ o, ˆf) + [ x o y o f ] x o y o f (8) Let R ij = ˆv T i ˆv j g ij (ˆx o, ŷ o, ˆf) = [ x o y o f ] x o y o f (9) For (i = 1,..., n 1) and (j = i + 1,..., n) we can write equation (9) as {R} = [A]{ Z} (10) Where A = g 12 g 12 g 12 x o y o f g 13 g 13 g 13 x o y o f g n 1,n x o g n 1,n y o g n 1,n f R = R 12 R 13.. R n 1,n and Z = x o y o f (11) Least Squares Optimal Estimation The method of least squares is a powerful and widely applied tool from estimation theory. There are many excellent sources on the subject where derivations of the equations can be found in Ref. [4], [5]. By using the least squares we can show that the solution Z which minimize the residual of equation (10) in the least squares sense is given by; where k = 1, 2,..., No. of iterations { Z} k = [A T A] 1 A T {R} (12) 4

5 ˆx o ŷ oˆf k+1 = ˆx o ŷ oˆf k + x o y o f k The differentiation terms in equations (8), (9) are given by; (13) = D 1D 2 (2x o x i x j ) + N[(x i x o )D 2 /D 1 + (x j x o )D 1 /D 2 ] (14) x o (D 1 D 2 ) 2 = D 1D 2 (2y o y i y j ) + N[(y i y o )D 2 /D 1 + (y j y o )D 1 /D 2 ] (15) y o (D 1 D 2 ) 2 f = D 1D 2 (2f) Nf[D 2 /D 1 + D 1 /D 2 ] (D 1 D 2 ) 2 (16) Figure 2: Flow Chart for the Calibration Algorithm 5

6 Figure 3: Night Sky Image for TAURUS Figure 4: The Estimation of the Offsets and the Focal Length The Calibration Algorithm Results The flow chart of the MATLAB program used to solve the problem of the calibration of the focal length and the image coordinates offsets is given in figure 2. In order to run the calibration program, the image processing algorithm is applied for the TAURUS CCD image (3) to get the star coordinates (x i, y i ). Manual star identification is done to each one of the centroided stars to have the inertial position vector of all the imaged stars. Figure 4 shows the Calibration errors for the bore-sight position (x o, y o ) and the focal length ( f ) versus the number of iterations for the TAURUS image. It can be shown that the values of (x o, y o ) and f are converged after 2 or 3 iterations. The test results showed that the Calibrated Focal length = , the Calibrated Y-axis offset x o = and the Calibrated X-axis offset y o = The time consumed in Calibration sec. Figure 5 shows the effect of the calibration parameters on the identified stars of the TAURUS image. All the stars have been identified after including the results of the offsets and the focal length on the imaged vectors. 6

7 Figure 5: The Measured and the Identified Stars for TAURUS The Sequential (On-Orbit) Calibration Todd and Puneet Sections,... Conclusions This paper presents how to solve for the estimation of the three focal plane parameters, the focal length and the two principal point offsets using the standard nonlinear least-squares estimation. Also, the focal plane calibration (distortions) is also solved using Bla Bla Bla. References [1] Samaan, M.A., Mortari, D., and Junkins, J.L., Recursive Mode Star Identification Algorithms, Paper AAS AAS/AIAA Space Flight Mechanics Meeting, Santa Barbara, California, 11 Jan Feb [2] Mortari, D., Junkins, J.L., and Samaan, M.A. Lost-In-Space Pyramid Algorithm for Robust Star Pattern Recognition, Paper AAS Guidance and Control Conference, Breckenridge, Colorado, 31 Jan. - 4 Feb

8 [3] Ju, G., Kim, Y.H., Pollock, T.C., Junkins, J.L., Juang, J.N., and Mortari, D. Lost-In-Space: A Star Pattern Recognition and Attitude Estimation Approach for the Case of No A Priori Attitude Information, Paper of the 2000 AAS Guidance & Control Conference, Breckenridge, CO, Feb. 2-6, [4] Junkins, J. L. Optimal Estimation of Dynamical Systems, Sijthoff and Noordhoff International Publishers B. V., Alphan aan den Rijn, The Netherlands, [5] Kowalick, J. Methods for Unconstrained Optimization Problem, American Elsevier Publishing Company, New York, New York, [6] Mortari, D. ESOQ: A Closed-Form Solution to the Wahba Problem, Journal of the Astronautical Sciences, Vol. 45, No. 2, April-June 1997, pp [7] Mortari, D. Second Estimator of the Optimal Quaternion, Journal of Guidance, Control, and Dynamics, Vol. 23, No. 5, Sept.-Oct. 2000, pp [8] Junkins, J. L., and Kim, Y., Introduction to Dynamics and Control of Flexible Structures, AIAA Education Series, Reston, VA,

CCD Data Processing Improvements for Star Cameras

CCD Data Processing Improvements for Star Cameras CCD Data Processing Improvements for Star Cameras D. Mortari a, C. Bruccoleri a, S. La Rosa b, and J.L. Junkins c a Università degli Studi di Roma, Via Salaria 51, 0013 Roma, b Università di Perugia, Via

More information

How to Avoid Singularity For Euler Angle Set? Puneet Singla, Daniele Mortari, and John L. Junkins

How to Avoid Singularity For Euler Angle Set? Puneet Singla, Daniele Mortari, and John L. Junkins AAS 04-190 How to Avoid Singularity For Euler Angle Set? Puneet Singla, Daniele Mortari, and John L. Junkins In this paper, an algorithm is proposed to avoid singularity associated with famous minimum

More information

The Pyramid Star Identification Technique

The Pyramid Star Identification Technique The Pyramid Star Identification Technique Daniele Mortari, Malak A. Samaan, Christian Bruccoleri, and John L. Junkins Texas A&M University, College Station, Texas Abstract A new highly robust algorithm,

More information

GLOBAL-LOCAL APPROXIMATIONS

GLOBAL-LOCAL APPROXIMATIONS GLOBAL-LOCAL APPROXIMATIONS Puneet Singla MAE 2 Department of Mechanical & Aerospace Engineering University at Buffalo http://www.acsu.buffalo.edu/ psingla/mae2/ October 31, 27 PUNEET SINGLA 1 / 1 MOVING

More information

Satellite Tracking System using Amateur Telescope and Star Camera for Portable Optical Ground Station

Satellite Tracking System using Amateur Telescope and Star Camera for Portable Optical Ground Station Satellite Tracking System using Amateur Telescope and Star Camera for Portable Optical Ground Station Hyosang Yoon, Kathleen Riesing, and Kerri Cahoy MIT STAR Lab 30 th SmallSat Conference 8/10/2016 Hyosang

More information

Efficient Covariance Intersection of Attitude Estimates Using a Local Error Representation

Efficient Covariance Intersection of Attitude Estimates Using a Local Error Representation Efficient Covariance Intersection of Attitude Estimates Using a Local Error Representation Christopher K. Nebelecky, John L. Crassidis University at Buffalo, State University of New York, Amherst, NY 14260-4400

More information

Perspective Projection Describes Image Formation Berthold K.P. Horn

Perspective Projection Describes Image Formation Berthold K.P. Horn Perspective Projection Describes Image Formation Berthold K.P. Horn Wheel Alignment: Camber, Caster, Toe-In, SAI, Camber: angle between axle and horizontal plane. Toe: angle between projection of axle

More information

ON-ORBIT STELLAR CAMERA CALIBRATION BASED ON SPACE RESECTION WITH MULTI-IMAGES

ON-ORBIT STELLAR CAMERA CALIBRATION BASED ON SPACE RESECTION WITH MULTI-IMAGES ON-ORBIT STELLAR CAMERA CALIBRATION BASED ON SPACE RESECTION WITH MULTI-IMAGES Xie Junfeng a, Jiang Wanshou a *, Gong Jianya a *, Wang xiao a a State Key Laboratory of Information Engineering in Surveying,

More information

Chapter 3 Image Registration. Chapter 3 Image Registration

Chapter 3 Image Registration. Chapter 3 Image Registration Chapter 3 Image Registration Distributed Algorithms for Introduction (1) Definition: Image Registration Input: 2 images of the same scene but taken from different perspectives Goal: Identify transformation

More information

DEVELOPMENT OF CAMERA MODEL AND GEOMETRIC CALIBRATION/VALIDATION OF XSAT IRIS IMAGERY

DEVELOPMENT OF CAMERA MODEL AND GEOMETRIC CALIBRATION/VALIDATION OF XSAT IRIS IMAGERY DEVELOPMENT OF CAMERA MODEL AND GEOMETRIC CALIBRATION/VALIDATION OF XSAT IRIS IMAGERY Leong Keong Kwoh, Xiaojing Huang, Wee Juan Tan Centre for Remote, Imaging Sensing and Processing (CRISP), National

More information

Journal of Guidance, Navigation and Control

Journal of Guidance, Navigation and Control SINGULARITY AVOIDANCE USING NULL MOTION AND VARIABLE-SPEED CONTROL MOMENT GYROS Hanspeter Schaub and John L. Junkins Texas A&M University, College Station, TX 77843 Simulated Reprint from Journal of Guidance,

More information

Exterior Orientation Parameters

Exterior Orientation Parameters Exterior Orientation Parameters PERS 12/2001 pp 1321-1332 Karsten Jacobsen, Institute for Photogrammetry and GeoInformation, University of Hannover, Germany The georeference of any photogrammetric product

More information

ROBUST LINE-BASED CALIBRATION OF LENS DISTORTION FROM A SINGLE VIEW

ROBUST LINE-BASED CALIBRATION OF LENS DISTORTION FROM A SINGLE VIEW ROBUST LINE-BASED CALIBRATION OF LENS DISTORTION FROM A SINGLE VIEW Thorsten Thormählen, Hellward Broszio, Ingolf Wassermann thormae@tnt.uni-hannover.de University of Hannover, Information Technology Laboratory,

More information

Camera Calibration for Video See-Through Head-Mounted Display. Abstract. 1.0 Introduction. Mike Bajura July 7, 1993

Camera Calibration for Video See-Through Head-Mounted Display. Abstract. 1.0 Introduction. Mike Bajura July 7, 1993 Camera Calibration for Video See-Through Head-Mounted Display Mike Bajura July 7, 1993 Abstract This report describes a method for computing the parameters needed to model a television camera for video

More information

Satellite Attitude Determination II

Satellite Attitude Determination II Satellite Attitude Determination II AERO4701 Space Engineering 3 Week 7 Last Week Looked at the problem of attitude determination for satellites Examined several common methods such as inertial navigation,

More information

Star Identification Using Delaunay Triangulation and Distributed Neural Networks

Star Identification Using Delaunay Triangulation and Distributed Neural Networks Star Identification Using Delaunay Triangulation and Distributed Neural Networks Saeideh Sadat Miri and Mohammad Ebrahim Shiri Abstract In this paper, a new star recognition method based on Delaunay Triangulation

More information

CIS 580, Machine Perception, Spring 2015 Homework 1 Due: :59AM

CIS 580, Machine Perception, Spring 2015 Homework 1 Due: :59AM CIS 580, Machine Perception, Spring 2015 Homework 1 Due: 2015.02.09. 11:59AM Instructions. Submit your answers in PDF form to Canvas. This is an individual assignment. 1 Camera Model, Focal Length and

More information

Instrument Distortion Calibration File Transformation

Instrument Distortion Calibration File Transformation Instrument Distortion Calibration File Transformation David Borncamp, Vera Kozhurina-Platais, Colin Cox, Warren Hack Space Telescope Science Institute July 1, 2014 ABSTRACT The current generation of detectors

More information

arxiv: v2 [astro-ph.im] 27 Dec 2016

arxiv: v2 [astro-ph.im] 27 Dec 2016 Noname manuscript No. (will be inserted by the editor) A software package for evaluating the performance of a star sensor operation Mayuresh Sarpotdar Joice Mathew A.G. Sreejith Nirmal K. S. Ambily Ajin

More information

Robotics - Projective Geometry and Camera model. Marcello Restelli

Robotics - Projective Geometry and Camera model. Marcello Restelli Robotics - Projective Geometr and Camera model Marcello Restelli marcello.restelli@polimi.it Dipartimento di Elettronica, Informazione e Bioingegneria Politecnico di Milano Ma 2013 Inspired from Matteo

More information

Implemented by Valsamis Douskos Laboratoty of Photogrammetry, Dept. of Surveying, National Tehnical University of Athens

Implemented by Valsamis Douskos Laboratoty of Photogrammetry, Dept. of Surveying, National Tehnical University of Athens An open-source toolbox in Matlab for fully automatic calibration of close-range digital cameras based on images of chess-boards FAUCCAL (Fully Automatic Camera Calibration) Implemented by Valsamis Douskos

More information

EXECUTION TIME OF QUEST ALGORITHM IN EMBEDDED PROCESSORS

EXECUTION TIME OF QUEST ALGORITHM IN EMBEDDED PROCESSORS EXECUTION TIME OF QUEST ALGORITHM IN EMBEDDED PROCESSORS Nelson S. Takahashi, seiji8503@gmail.com André L. S. M. de Souza, andresouza1000@gmail.com Marcelo C. Tosin, mctosin@uel.br State University of

More information

Mathematics in Orbit

Mathematics in Orbit Mathematics in Orbit Dan Kalman American University Slides and refs at www.dankalman.net Outline Basics: 3D geospacial models Keyhole Problem: Related Rates! GPS: space-time triangulation Sensor Diagnosis:

More information

NAVAL POSTGRADUATE SCHOOL THESIS

NAVAL POSTGRADUATE SCHOOL THESIS NAVAL POSTGRADUATE SCHOOL MONTEREY, CALIFORNIA THESIS DEVELOPMENT OF STAR TRACKER SYSTEM FOR ACCURATE ESTIMATION OF SPACECRAFT ATTITUDE by Jack A. Tappe December 009 Thesis Co-Advisors: Jae Jun Kim Brij

More information

Fast Star Tracker Centroid Algorithm for High Performance CubeSat with Air Bearing Validation. Matthew Knutson, David Miller. June 2012 SSL # 5-12

Fast Star Tracker Centroid Algorithm for High Performance CubeSat with Air Bearing Validation. Matthew Knutson, David Miller. June 2012 SSL # 5-12 Fast Star Tracker Centroid Algorithm for High Performance CubeSat with Air Bearing Validation Matthew Knutson, David Miller June 2012 SSL # 5-12 Fast Star Tracker Centroid Algorithm for High Performance

More information

An Angle Estimation to Landmarks for Autonomous Satellite Navigation

An Angle Estimation to Landmarks for Autonomous Satellite Navigation 5th International Conference on Environment, Materials, Chemistry and Power Electronics (EMCPE 2016) An Angle Estimation to Landmarks for Autonomous Satellite Navigation Qing XUE a, Hongwen YANG, Jian

More information

GYRO MISALIGNMENT AND SCALE FACTOR ERROR DETERMINATION IN MARS ORBITER MISSION

GYRO MISALIGNMENT AND SCALE FACTOR ERROR DETERMINATION IN MARS ORBITER MISSION IAA-AAS-DCoSS2-14-07-11 GYRO MISALIGNMENT AND SCALE FACTOR ERROR DETERMINATION IN MARS ORBITER MISSION Naga Manjusha, * M. Srikanth, Ritu Karidhal, $ and V. Kesava Raju INTRODUCTION This paper deals with

More information

Subpixel Corner Detection Using Spatial Moment 1)

Subpixel Corner Detection Using Spatial Moment 1) Vol.31, No.5 ACTA AUTOMATICA SINICA September, 25 Subpixel Corner Detection Using Spatial Moment 1) WANG She-Yang SONG Shen-Min QIANG Wen-Yi CHEN Xing-Lin (Department of Control Engineering, Harbin Institute

More information

Automatic Feature Extraction of Pose-measuring System Based on Geometric Invariants

Automatic Feature Extraction of Pose-measuring System Based on Geometric Invariants Automatic Feature Extraction of Pose-measuring System Based on Geometric Invariants Yan Lin 1,2 Bin Kong 2 Fei Zheng 2 1 Center for Biomimetic Sensing and Control Research, Institute of Intelligent Machines,

More information

Smartphone Video Guidance Sensor for Small Satellites

Smartphone Video Guidance Sensor for Small Satellites SSC13-I-7 Smartphone Video Guidance Sensor for Small Satellites Christopher Becker, Richard Howard, John Rakoczy NASA Marshall Space Flight Center Mail Stop EV42, Huntsville, AL 35812; 256-544-0114 christophermbecker@nasagov

More information

PREPARATIONS FOR THE ON-ORBIT GEOMETRIC CALIBRATION OF THE ORBVIEW 3 AND 4 SATELLITES

PREPARATIONS FOR THE ON-ORBIT GEOMETRIC CALIBRATION OF THE ORBVIEW 3 AND 4 SATELLITES PREPARATIONS FOR THE ON-ORBIT GEOMETRIC CALIBRATION OF THE ORBVIEW 3 AND 4 SATELLITES David Mulawa, Ph.D. ORBIMAGE mulawa.david@orbimage.com KEY WORDS: Geometric, Camera, Calibration, and Satellite ABSTRACT

More information

Particle Filtering for Attitude Estimation Using a Minimal. Local-Error Representation: A Revisit

Particle Filtering for Attitude Estimation Using a Minimal. Local-Error Representation: A Revisit Particle Filtering for Attitude Estimation Using a Minimal Local-Error Representation: A Revisit Lubin Chang Department of navigation engineering, Naval University of Engineering, China For spacecraft

More information

An Automatic Method for Adjustment of a Camera Calibration Room

An Automatic Method for Adjustment of a Camera Calibration Room An Automatic Method for Adjustment of a Camera Calibration Room Presented at the FIG Working Week 2017, May 29 - June 2, 2017 in Helsinki, Finland Theory, algorithms, implementation, and two advanced applications.

More information

AC : ADAPTIVE ROBOT MANIPULATORS IN GLOBAL TECHNOLOGY

AC : ADAPTIVE ROBOT MANIPULATORS IN GLOBAL TECHNOLOGY AC 2009-130: ADAPTIVE ROBOT MANIPULATORS IN GLOBAL TECHNOLOGY Alireza Rahrooh, University of Central Florida Alireza Rahrooh is aprofessor of Electrical Engineering Technology at the University of Central

More information

Efficient Conjunction Assessment using Modified Chebyshev Picard Iteration

Efficient Conjunction Assessment using Modified Chebyshev Picard Iteration Efficient Conjunction Assessment using Modified Chebyshev Picard Iteration Austin B. Probe, Brent Macomber, Julie Read, Robyn Woollands, Abhay Masher, and John L. Junkins Texas A&M University ABSTRACT

More information

Camera Model and Calibration

Camera Model and Calibration Camera Model and Calibration Lecture-10 Camera Calibration Determine extrinsic and intrinsic parameters of camera Extrinsic 3D location and orientation of camera Intrinsic Focal length The size of the

More information

521466S Machine Vision Exercise #1 Camera models

521466S Machine Vision Exercise #1 Camera models 52466S Machine Vision Exercise # Camera models. Pinhole camera. The perspective projection equations or a pinhole camera are x n = x c, = y c, where x n = [x n, ] are the normalized image coordinates,

More information

Camera model and multiple view geometry

Camera model and multiple view geometry Chapter Camera model and multiple view geometry Before discussing how D information can be obtained from images it is important to know how images are formed First the camera model is introduced and then

More information

Calibration of Inertial Measurement Units Using Pendulum Motion

Calibration of Inertial Measurement Units Using Pendulum Motion Technical Paper Int l J. of Aeronautical & Space Sci. 11(3), 234 239 (2010) DOI:10.5139/IJASS.2010.11.3.234 Calibration of Inertial Measurement Units Using Pendulum Motion Keeyoung Choi* and Se-ah Jang**

More information

High Altitude Balloon Localization from Photographs

High Altitude Balloon Localization from Photographs High Altitude Balloon Localization from Photographs Paul Norman and Daniel Bowman Bovine Aerospace August 27, 2013 Introduction On December 24, 2011, we launched a high altitude balloon equipped with a

More information

CV: 3D to 2D mathematics. Perspective transformation; camera calibration; stereo computation; and more

CV: 3D to 2D mathematics. Perspective transformation; camera calibration; stereo computation; and more CV: 3D to 2D mathematics Perspective transformation; camera calibration; stereo computation; and more Roadmap of topics n Review perspective transformation n Camera calibration n Stereo methods n Structured

More information

A Reactive Bearing Angle Only Obstacle Avoidance Technique for Unmanned Ground Vehicles

A Reactive Bearing Angle Only Obstacle Avoidance Technique for Unmanned Ground Vehicles Proceedings of the International Conference of Control, Dynamic Systems, and Robotics Ottawa, Ontario, Canada, May 15-16 2014 Paper No. 54 A Reactive Bearing Angle Only Obstacle Avoidance Technique for

More information

Camera calibration. Robotic vision. Ville Kyrki

Camera calibration. Robotic vision. Ville Kyrki Camera calibration Robotic vision 19.1.2017 Where are we? Images, imaging Image enhancement Feature extraction and matching Image-based tracking Camera models and calibration Pose estimation Motion analysis

More information

Chapters 1 7: Overview

Chapters 1 7: Overview Chapters 1 7: Overview Chapter 1: Introduction Chapters 2 4: Data acquisition Chapters 5 7: Data manipulation Chapter 5: Vertical imagery Chapter 6: Image coordinate measurements and refinements Chapter

More information

Video Alignment. Literature Survey. Spring 2005 Prof. Brian Evans Multidimensional Digital Signal Processing Project The University of Texas at Austin

Video Alignment. Literature Survey. Spring 2005 Prof. Brian Evans Multidimensional Digital Signal Processing Project The University of Texas at Austin Literature Survey Spring 2005 Prof. Brian Evans Multidimensional Digital Signal Processing Project The University of Texas at Austin Omer Shakil Abstract This literature survey compares various methods

More information

CIS 580, Machine Perception, Spring 2016 Homework 2 Due: :59AM

CIS 580, Machine Perception, Spring 2016 Homework 2 Due: :59AM CIS 580, Machine Perception, Spring 2016 Homework 2 Due: 2015.02.24. 11:59AM Instructions. Submit your answers in PDF form to Canvas. This is an individual assignment. 1 Recover camera orientation By observing

More information

An Acquisition Geometry-Independent Calibration Tool for Industrial Computed Tomography

An Acquisition Geometry-Independent Calibration Tool for Industrial Computed Tomography 4th International Symposium on NDT in Aerospace 2012 - Tu.3.A.3 An Acquisition Geometry-Independent Calibration Tool for Industrial Computed Tomography Jonathan HESS *, Patrick KUEHNLEIN *, Steven OECKL

More information

Tightly-Integrated Visual and Inertial Navigation for Pinpoint Landing on Rugged Terrains

Tightly-Integrated Visual and Inertial Navigation for Pinpoint Landing on Rugged Terrains Tightly-Integrated Visual and Inertial Navigation for Pinpoint Landing on Rugged Terrains PhD student: Jeff DELAUNE ONERA Director: Guy LE BESNERAIS ONERA Advisors: Jean-Loup FARGES Clément BOURDARIAS

More information

Single View Geometry. Camera model & Orientation + Position estimation. What am I?

Single View Geometry. Camera model & Orientation + Position estimation. What am I? Single View Geometry Camera model & Orientation + Position estimation What am I? Vanishing point Mapping from 3D to 2D Point & Line Goal: Point Homogeneous coordinates represent coordinates in 2 dimensions

More information

A Robust GPS Receiver Self Survey Algorithm

A Robust GPS Receiver Self Survey Algorithm A Robust GPS Receiver Self Survey Algorithm Keunjoo Park and John L. Crassidis Abstract To use a GPS receiver as an attitude sensor several system parameters, such as integer ambiguities, line biases and

More information

ADS40 Calibration & Verification Process. Udo Tempelmann*, Ludger Hinsken**, Utz Recke*

ADS40 Calibration & Verification Process. Udo Tempelmann*, Ludger Hinsken**, Utz Recke* ADS40 Calibration & Verification Process Udo Tempelmann*, Ludger Hinsken**, Utz Recke* *Leica Geosystems GIS & Mapping GmbH, Switzerland **Ludger Hinsken, Author of ORIMA, Konstanz, Germany Keywords: ADS40,

More information

Precise Image-Based Motion Estimation for Autonomous Small Body Exploration

Precise Image-Based Motion Estimation for Autonomous Small Body Exploration Appearing in the 5th Int l Symp. on Artificial Intelligence, Robotics and Automation in Space (isairas 99), pp. 627-634. Precise Image-Based Motion Estimation for Autonomous Small Body Exploration Andrew

More information

Flexible Calibration of a Portable Structured Light System through Surface Plane

Flexible Calibration of a Portable Structured Light System through Surface Plane Vol. 34, No. 11 ACTA AUTOMATICA SINICA November, 2008 Flexible Calibration of a Portable Structured Light System through Surface Plane GAO Wei 1 WANG Liang 1 HU Zhan-Yi 1 Abstract For a portable structured

More information

Quasi-Euclidean Uncalibrated Epipolar Rectification

Quasi-Euclidean Uncalibrated Epipolar Rectification Dipartimento di Informatica Università degli Studi di Verona Rapporto di ricerca Research report September 2006 RR 43/2006 Quasi-Euclidean Uncalibrated Epipolar Rectification L. Irsara A. Fusiello Questo

More information

Heterogeneous Multi-Robot Localization in Unknown 3D Space

Heterogeneous Multi-Robot Localization in Unknown 3D Space Heterogeneous Multi-Robot Localization in Unknown 3D Space Yi Feng Department of Computer Science The Graduate Center, CUNY New York, NY 10016 Email: yfeng@gc.cuny.edu Zhigang Zhu Department of Computer

More information

3D Sensing. 3D Shape from X. Perspective Geometry. Camera Model. Camera Calibration. General Stereo Triangulation.

3D Sensing. 3D Shape from X. Perspective Geometry. Camera Model. Camera Calibration. General Stereo Triangulation. 3D Sensing 3D Shape from X Perspective Geometry Camera Model Camera Calibration General Stereo Triangulation 3D Reconstruction 3D Shape from X shading silhouette texture stereo light striping motion mainly

More information

Measurement and Precision Analysis of Exterior Orientation Element Based on Landmark Point Auxiliary Orientation

Measurement and Precision Analysis of Exterior Orientation Element Based on Landmark Point Auxiliary Orientation 2016 rd International Conference on Engineering Technology and Application (ICETA 2016) ISBN: 978-1-60595-8-0 Measurement and Precision Analysis of Exterior Orientation Element Based on Landmark Point

More information

PRELIMINARY RESULTS ON REAL-TIME 3D FEATURE-BASED TRACKER 1. We present some preliminary results on a system for tracking 3D motion using

PRELIMINARY RESULTS ON REAL-TIME 3D FEATURE-BASED TRACKER 1. We present some preliminary results on a system for tracking 3D motion using PRELIMINARY RESULTS ON REAL-TIME 3D FEATURE-BASED TRACKER 1 Tak-keung CHENG derek@cs.mu.oz.au Leslie KITCHEN ljk@cs.mu.oz.au Computer Vision and Pattern Recognition Laboratory, Department of Computer Science,

More information

Calibration of IRS-1C PAN-camera

Calibration of IRS-1C PAN-camera Calibration of IRS-1C PAN-camera Karsten Jacobsen Institute for Photogrammetry and Engineering Surveys University of Hannover Germany Tel 0049 511 762 2485 Fax -2483 Email karsten@ipi.uni-hannover.de 1.

More information

Multi-view Surface Inspection Using a Rotating Table

Multi-view Surface Inspection Using a Rotating Table https://doi.org/10.2352/issn.2470-1173.2018.09.iriacv-278 2018, Society for Imaging Science and Technology Multi-view Surface Inspection Using a Rotating Table Tomoya Kaichi, Shohei Mori, Hideo Saito,

More information

IAC-12-A6.1.7 DETECTING GEO DEBRIS IMAGES VIA VOTING OF MOTION TRAJECTORY FEATURES. Koki Fujita Kyushu University, Japan,

IAC-12-A6.1.7 DETECTING GEO DEBRIS IMAGES VIA VOTING OF MOTION TRAJECTORY FEATURES. Koki Fujita Kyushu University, Japan, 63rd International Astronautical Congress, Naples, Italy. Copyright C 212 by the International Astronautical Federation. All rights reserved. IAC-12-A6.1.7 DETECTING GEO DEBRIS IMAGES VIA VOTING OF MOTION

More information

ξ ν ecliptic sun m λ s equator

ξ ν ecliptic sun m λ s equator Attitude parameterization for GAIA L. Lindegren (1 July ) SAG LL Abstract. The GAIA attaitude may be described by four continuous functions of time, q1(t), q(t), q(t), q4(t), which form a quaternion of

More information

Outline. ETN-FPI Training School on Plenoptic Sensing

Outline. ETN-FPI Training School on Plenoptic Sensing Outline Introduction Part I: Basics of Mathematical Optimization Linear Least Squares Nonlinear Optimization Part II: Basics of Computer Vision Camera Model Multi-Camera Model Multi-Camera Calibration

More information

Chapter 13. Vision Based Guidance. Beard & McLain, Small Unmanned Aircraft, Princeton University Press, 2012,

Chapter 13. Vision Based Guidance. Beard & McLain, Small Unmanned Aircraft, Princeton University Press, 2012, Chapter 3 Vision Based Guidance Beard & McLain, Small Unmanned Aircraft, Princeton University Press, 22, Chapter 3: Slide Architecture w/ Camera targets to track/avoid vision-based guidance waypoints status

More information

Chapter 7: Computation of the Camera Matrix P

Chapter 7: Computation of the Camera Matrix P Chapter 7: Computation of the Camera Matrix P Arco Nederveen Eagle Vision March 18, 2008 Arco Nederveen (Eagle Vision) The Camera Matrix P March 18, 2008 1 / 25 1 Chapter 7: Computation of the camera Matrix

More information

Midterm Exam Solutions

Midterm Exam Solutions Midterm Exam Solutions Computer Vision (J. Košecká) October 27, 2009 HONOR SYSTEM: This examination is strictly individual. You are not allowed to talk, discuss, exchange solutions, etc., with other fellow

More information

Integration of 3D Stereo Vision Measurements in Industrial Robot Applications

Integration of 3D Stereo Vision Measurements in Industrial Robot Applications Integration of 3D Stereo Vision Measurements in Industrial Robot Applications Frank Cheng and Xiaoting Chen Central Michigan University cheng1fs@cmich.edu Paper 34, ENG 102 Abstract Three dimensional (3D)

More information

POME A mobile camera system for accurate indoor pose

POME A mobile camera system for accurate indoor pose POME A mobile camera system for accurate indoor pose Paul Montgomery & Andreas Winter November 2 2016 2010. All rights reserved. 1 ICT Intelligent Construction Tools A 50-50 joint venture between Trimble

More information

Laser Beacon Tracking for High-Accuracy Attitude Determination

Laser Beacon Tracking for High-Accuracy Attitude Determination Laser Beacon Tracking for High-Accuracy Attitude Determination Tam Nguyen Massachusetts Institute of Technology 29 th AIAA/USU Conference on Small Satellites SSC15-VIII-2 08/12/2015 Outline Motivation

More information

IRS Large Offset Test

IRS Large Offset Test IRS Large Offset Test The IRS Large Offset Test (ILOT) was conceived as a simple test of the pointing accuracy during the long gyro-based offsets available to observers utilizing the SPOT Cluster Target

More information

COMBINED BUNDLE BLOCK ADJUSTMENT VERSUS DIRECT SENSOR ORIENTATION ABSTRACT

COMBINED BUNDLE BLOCK ADJUSTMENT VERSUS DIRECT SENSOR ORIENTATION ABSTRACT COMBINED BUNDLE BLOCK ADJUSTMENT VERSUS DIRECT SENSOR ORIENTATION Karsten Jacobsen Institute for Photogrammetry and Engineering Surveys University of Hannover Nienburger Str.1 D-30167 Hannover, Germany

More information

ACCURACY ANALYSIS FOR NEW CLOSE-RANGE PHOTOGRAMMETRIC SYSTEMS

ACCURACY ANALYSIS FOR NEW CLOSE-RANGE PHOTOGRAMMETRIC SYSTEMS ACCURACY ANALYSIS FOR NEW CLOSE-RANGE PHOTOGRAMMETRIC SYSTEMS Dr. Mahmoud El-Nokrashy O. ALI Prof. of Photogrammetry, Civil Eng. Al Azhar University, Cairo, Egypt m_ali@starnet.com.eg Dr. Mohamed Ashraf

More information

An Experimental Study of the Autonomous Helicopter Landing Problem

An Experimental Study of the Autonomous Helicopter Landing Problem An Experimental Study of the Autonomous Helicopter Landing Problem Srikanth Saripalli 1, Gaurav S. Sukhatme 1, and James F. Montgomery 2 1 Department of Computer Science, University of Southern California,

More information

Algorithm Enhancements for the SS-411 Digital Sun Sensor

Algorithm Enhancements for the SS-411 Digital Sun Sensor Algorithm Enhancements for the SS-411 Digital Sun Sensor John Enright Space Avionics & Instrumentation Laboratory Dept. of Aerospace Engineering Ryerson University Doug Sinclair Sinclair Interplanetary

More information

Quaternion-Based Tracking of Multiple Objects in Synchronized Videos

Quaternion-Based Tracking of Multiple Objects in Synchronized Videos Quaternion-Based Tracking of Multiple Objects in Synchronized Videos Quming Zhou 1, Jihun Park 2, and J.K. Aggarwal 1 1 Department of Electrical and Computer Engineering The University of Texas at Austin

More information

Reconfigurable Hardware-in-the-Loop Test Bench for the SHEFEX2 Hybrid Navigation System Experiment

Reconfigurable Hardware-in-the-Loop Test Bench for the SHEFEX2 Hybrid Navigation System Experiment Reconfigurable Hardware-in-the-Loop Test Bench for the SHEFEX2 Hybrid Navigation System Experiment Stephen Steffes, Malak Samaan, Michael Conradt, Stephan Theil DLR German Aerospace Center, Institute of

More information

Colorado School of Mines. Computer Vision. Professor William Hoff Dept of Electrical Engineering &Computer Science.

Colorado School of Mines. Computer Vision. Professor William Hoff Dept of Electrical Engineering &Computer Science. Professor Willia Hoff Dept of Electrical Engineering &Coputer Science http://inside.ines.edu/~whoff/ 1 Caera Calibration 2 Caera Calibration Needed for ost achine vision and photograetry tasks (object

More information

Camera models and calibration

Camera models and calibration Camera models and calibration Read tutorial chapter 2 and 3. http://www.cs.unc.edu/~marc/tutorial/ Szeliski s book pp.29-73 Schedule (tentative) 2 # date topic Sep.8 Introduction and geometry 2 Sep.25

More information

DEVELOPMENT OF ORIENTATION AND DEM/ORTHOIMAGE GENERATION PROGRAM FOR ALOS PRISM

DEVELOPMENT OF ORIENTATION AND DEM/ORTHOIMAGE GENERATION PROGRAM FOR ALOS PRISM DEVELOPMENT OF ORIENTATION AND DEM/ORTHOIMAGE GENERATION PROGRAM FOR ALOS PRISM Izumi KAMIYA Geographical Survey Institute 1, Kitasato, Tsukuba 305-0811 Japan Tel: (81)-29-864-5944 Fax: (81)-29-864-2655

More information

Calibrating an Overhead Video Camera

Calibrating an Overhead Video Camera Calibrating an Overhead Video Camera Raul Rojas Freie Universität Berlin, Takustraße 9, 495 Berlin, Germany http://www.fu-fighters.de Abstract. In this section we discuss how to calibrate an overhead video

More information

Accurate and Dense Wide-Baseline Stereo Matching Using SW-POC

Accurate and Dense Wide-Baseline Stereo Matching Using SW-POC Accurate and Dense Wide-Baseline Stereo Matching Using SW-POC Shuji Sakai, Koichi Ito, Takafumi Aoki Graduate School of Information Sciences, Tohoku University, Sendai, 980 8579, Japan Email: sakai@aoki.ecei.tohoku.ac.jp

More information

Southern African Large Telescope. PFIS Distortion and Alignment Model

Southern African Large Telescope. PFIS Distortion and Alignment Model Southern African Large Telescope PFIS Distortion and Alignment Model Kenneth Nordsieck University of Wisconsin Document Number: SALT-3120AS0023 Revision 2.0 31 May 2006 Change History Rev Date Description

More information

Videogrammetric Technique for Aerospace Applications: From Model Attitude and Deformation to Surface Geometry

Videogrammetric Technique for Aerospace Applications: From Model Attitude and Deformation to Surface Geometry Videogrammetric Technique for Aerospace Applications: From Model Attitude and Deformation to Surface Geometry Tianshu Liu Department of Mechanical and Aerospace Engineering Western Michigan University,

More information

Development of a Ground Based Cooperating Spacecraft Testbed for Research and Education

Development of a Ground Based Cooperating Spacecraft Testbed for Research and Education DIPARTIMENTO DI INGEGNERIA INDUSTRIALE Development of a Ground Based Cooperating Spacecraft Testbed for Research and Education Mattia Mazzucato, Sergio Tronco, Andrea Valmorbida, Fabio Scibona and Enrico

More information

Designing Simple Indoor Navigation System for UAVs

Designing Simple Indoor Navigation System for UAVs 19th Mediterranean Conference on Control and Automation Aquis Corfu Holiday Palace, Corfu, Greece June 2-23, 211 ThBT3.1 Designing Simple Indoor Navigation System for UAVs Mohamed Kara Mohamed, Sourav

More information

Space Robot Path Planning for Collision Avoidance

Space Robot Path Planning for Collision Avoidance Space Robot Path Planning for ollision voidance Yuya Yanoshita and Shinichi Tsuda bstract This paper deals with a path planning of space robot which includes a collision avoidance algorithm. For the future

More information

Visual Odometry for Non-Overlapping Views Using Second-Order Cone Programming

Visual Odometry for Non-Overlapping Views Using Second-Order Cone Programming Visual Odometry for Non-Overlapping Views Using Second-Order Cone Programming Jae-Hak Kim 1, Richard Hartley 1, Jan-Michael Frahm 2 and Marc Pollefeys 2 1 Research School of Information Sciences and Engineering

More information

Available online at Procedia Engineering 7 (2010) Procedia Engineering 00 (2010)

Available online at   Procedia Engineering 7 (2010) Procedia Engineering 00 (2010) Available online at www.sciencedirect.com Procedia Engineering 7 (2010) 290 296 Procedia Engineering 00 (2010) 000 000 Procedia Engineering www.elsevier.com/locate/procedia www.elsevier.com/locate/procedia

More information

URBAN STRUCTURE ESTIMATION USING PARALLEL AND ORTHOGONAL LINES

URBAN STRUCTURE ESTIMATION USING PARALLEL AND ORTHOGONAL LINES URBAN STRUCTURE ESTIMATION USING PARALLEL AND ORTHOGONAL LINES An Undergraduate Research Scholars Thesis by RUI LIU Submitted to Honors and Undergraduate Research Texas A&M University in partial fulfillment

More information

CSCI 5980: Assignment #3 Homography

CSCI 5980: Assignment #3 Homography Submission Assignment due: Feb 23 Individual assignment. Write-up submission format: a single PDF up to 3 pages (more than 3 page assignment will be automatically returned.). Code and data. Submission

More information

AN INVESTIGATION IrJTO FACrORS AFFECTING VER'I'ICAL EXAGGERATION

AN INVESTIGATION IrJTO FACrORS AFFECTING VER'I'ICAL EXAGGERATION AN INVESTIGATION IrJTO FACrORS AFFECTING VER'I'ICAL EXAGGERATION By Dr. Ali Radwan Sltawer Assistant Professor Civil Department, College of Engineering University of Riyadh Abstract When a pair of overlapping

More information

Nonlinear State Estimation for Robotics and Computer Vision Applications: An Overview

Nonlinear State Estimation for Robotics and Computer Vision Applications: An Overview Nonlinear State Estimation for Robotics and Computer Vision Applications: An Overview Arun Das 05/09/2017 Arun Das Waterloo Autonomous Vehicles Lab Introduction What s in a name? Arun Das Waterloo Autonomous

More information

IN-FLIGHT GEOMETRIC CALIBRATION OF FORE AND AFT CAMERAS OF CARTOSAT- 1

IN-FLIGHT GEOMETRIC CALIBRATION OF FORE AND AFT CAMERAS OF CARTOSAT- 1 IN-FLIGHT GEOMETRIC CALIBRATION OF FORE AND AFT CAMERAS OF CARTOSAT- 1 By P.V. RADHADEVI* (adrin_radhadevi@yahoo.co.in) Advanced Data Processing Research Institute (ADRIN), Department of Space, Government

More information

Vision-Aided Inertial Navigation for Flight Control

Vision-Aided Inertial Navigation for Flight Control AIAA Guidance, Navigation, and Control Conference and Exhibit 15-18 August 5, San Francisco, California AIAA 5-5998 Vision-Aided Inertial Navigation for Flight Control Allen D. Wu, Eric N. Johnson, and

More information

Leaderless Formation Control for Multiple Autonomous Vehicles. Wei Ren

Leaderless Formation Control for Multiple Autonomous Vehicles. Wei Ren AIAA Guidance, Navigation, and Control Conference and Exhibit - 4 August 6, Keystone, Colorado AIAA 6-669 Leaderless Formation Control for Multiple Autonomous Vehicles Wei Ren Department of Electrical

More information

Angles-Only Autonomous Rendezvous Navigation to a Space Resident Object

Angles-Only Autonomous Rendezvous Navigation to a Space Resident Object aa.stanford.edu damicos@stanford.edu stanford.edu Angles-Only Autonomous Rendezvous Navigation to a Space Resident Object Josh Sullivan PhD. Candidate, Space Rendezvous Laboratory PI: Dr. Simone D Amico

More information

DERIVING PEDESTRIAN POSITIONS FROM UNCALIBRATED VIDEOS

DERIVING PEDESTRIAN POSITIONS FROM UNCALIBRATED VIDEOS DERIVING PEDESTRIAN POSITIONS FROM UNCALIBRATED VIDEOS Zoltan Koppanyi, Post-Doctoral Researcher Charles K. Toth, Research Professor The Ohio State University 2046 Neil Ave Mall, Bolz Hall Columbus, OH,

More information

Robot Vision: Camera calibration

Robot Vision: Camera calibration Robot Vision: Camera calibration Ass.Prof. Friedrich Fraundorfer SS 201 1 Outline Camera calibration Cameras with lenses Properties of real lenses (distortions, focal length, field-of-view) Calibration

More information

Lumaxis, Sunset Hills Rd., Ste. 106, Reston, VA 20190

Lumaxis, Sunset Hills Rd., Ste. 106, Reston, VA 20190 White Paper High Performance Projection Engines for 3D Metrology Systems www.lumaxis.net Lumaxis, 11495 Sunset Hills Rd., Ste. 106, Reston, VA 20190 Introduction 3D optical metrology using structured light

More information

Jump Stitch Metadata & Depth Maps Version 1.1

Jump Stitch Metadata & Depth Maps Version 1.1 Jump Stitch Metadata & Depth Maps Version 1.1 jump-help@google.com Contents 1. Introduction 1 2. Stitch Metadata File Format 2 3. Coverage Near the Poles 4 4. Coordinate Systems 6 5. Camera Model 6 6.

More information