Calibration. Reality. Error. Measuring device. Model of Reality Fall 2001 Copyright R. H. Taylor 1999, 2001

Similar documents
Calibration. Reality. Error. Measuring device. Model of Reality Fall 2001 Copyright R. H. Taylor 1999, 2001

Calibration of a rotating multi-beam Lidar

Blacksburg, VA July 24 th 30 th, 2010 Georeferencing images and scanned maps Page 1. Georeference

Computer Vision. Coordinates. Prof. Flávio Cardeal DECOM / CEFET- MG.

CSCI 5980: Assignment #3 Homography

Project Title: Welding Machine Monitoring System Phase II. Name of PI: Prof. Kenneth K.M. LAM (EIE) Progress / Achievement: (with photos, if any)

GEOG 4110/5100 Advanced Remote Sensing Lecture 4

Subpixel Corner Detection Using Spatial Moment 1)

Chapter 18. Geometric Operations

Operation Trajectory Control of Industrial Robots Based on Motion Simulation

An Automated Image-based Method for Multi-Leaf Collimator Positioning Verification in Intensity Modulated Radiation Therapy

THE ANALYTIC AND NUMERICAL DEFINITION OF THE GEOMETRY OF THE BRITISH MUSEUM GREAT COURT ROOF

Georeferencing & Spatial Adjustment

Robust and Accurate Detection of Object Orientation and ID without Color Segmentation

To graph the point (r, θ), simply go out r units along the initial ray, then rotate through the angle θ. The point (1, 5π 6

Assessing Accuracy Factors in Deformable 2D/3D Medical Image Registration Using a Statistical Pelvis Model

Robot mechanics and kinematics

ENGN2911I: 3D Photography and Geometry Processing Assignment 1: 3D Photography using Planar Shadows

Georeferencing & Spatial Adjustment 2/13/2018

Optimized Design of 3D Laser Triangulation Systems

Flexible Calibration of a Portable Structured Light System through Surface Plane

The Problem. Georeferencing & Spatial Adjustment. Nature Of The Problem: For Example: Georeferencing & Spatial Adjustment 9/20/2016

Robot Vision: Camera calibration

Motion Control (wheeled robots)

CHAPTER 3 DISPARITY AND DEPTH MAP COMPUTATION

Robot mechanics and kinematics

Visual Recognition: Image Formation

Inverse Kinematics. Given a desired position (p) & orientation (R) of the end-effector

DD2429 Computational Photography :00-19:00

A Robust Two Feature Points Based Depth Estimation Method 1)

Creating a distortion characterisation dataset for visual band cameras using fiducial markers.

Structured Light. Tobias Nöll Thanks to Marc Pollefeys, David Nister and David Lowe

Image warping , , Computational Photography Fall 2017, Lecture 10

CALIBRATION BETWEEN DEPTH AND COLOR SENSORS FOR COMMODITY DEPTH CAMERAS. Cha Zhang and Zhengyou Zhang

Issues with Curve Detection Grouping (e.g., the Canny hysteresis thresholding procedure) Model tting They can be performed sequentially or simultaneou

To graph the point (r, θ), simply go out r units along the initial ray, then rotate through the angle θ. The point (1, 5π 6. ) is graphed below:

ROBUST LINE-BASED CALIBRATION OF LENS DISTORTION FROM A SINGLE VIEW

Transformations. Ed Angel Professor of Computer Science, Electrical and Computer Engineering, and Media Arts University of New Mexico

The Problem. Georeferencing & Spatial Adjustment. Nature of the problem: For Example: Georeferencing & Spatial Adjustment 2/4/2014

Forward kinematics and Denavit Hartenburg convention

Calibration of a rotating multi-beam Lidar

Robot Geometry and Kinematics

Binocular Stereo Vision. System 6 Introduction Is there a Wedge in this 3D scene?

A Simulation Study and Experimental Verification of Hand-Eye-Calibration using Monocular X-Ray

We can conclude that if f is differentiable in an interval containing a, then. f(x) L(x) = f(a) + f (a)(x a).

University of Technology Building & Construction Department / Remote Sensing & GIS lecture

DTU M.SC. - COURSE EXAM Revised Edition

Concept of Curve Fitting Difference with Interpolation

Intrinsic and Extrinsic Camera Parameter Estimation with Zoomable Camera for Augmented Reality

Tracked surgical drill calibration

Towards full-body X-ray images

Volumetric Operations with Surface Margins

CHAPTER 4 RAY COMPUTATION. 4.1 Normal Computation

Capture and Dewarping of Page Spreads with a Handheld Compact 3D Camera

Restoring Warped Document Image Based on Text Line Correction

3D Imaging from Video and Planar Radiography

Adding vectors. Let s consider some vectors to be added.

Grasping Known Objects with Aldebaran Nao

Rectification and Distortion Correction

Camera Model and Calibration

Project 2 due today Project 3 out today. Readings Szeliski, Chapter 10 (through 10.5)

Midterm Exam Solutions

Introduction to Homogeneous coordinates

Computer Vision I - Appearance-based Matching and Projective Geometry

3D Guide Wire Navigation from Single Plane Fluoroscopic Images in Abdominal Catheterizations

Visual Odometry. Features, Tracking, Essential Matrix, and RANSAC. Stephan Weiss Computer Vision Group NASA-JPL / CalTech

calibrated coordinates Linear transformation pixel coordinates

Surfaces, meshes, and topology

Stereo imaging ideal geometry

The diagram above shows a sketch of the curve C with parametric equations

CSE 490R P3 - Model Learning and MPPI Due date: Sunday, Feb 28-11:59 PM

3-D D Euclidean Space - Vectors

Chapter 10 Homework: Parametric Equations and Polar Coordinates

Improving Vision-Based Distance Measurements using Reference Objects

EECS 4330/7330 Introduction to Mechatronics and Robotic Vision, Fall Lab 1. Camera Calibration

More Mosaic Madness. CS194: Image Manipulation & Computational Photography. Steve Seitz and Rick Szeliski. Jeffrey Martin (jeffrey-martin.

Multi-slice CT Image Reconstruction Jiang Hsieh, Ph.D.

Thickness of the standard piece: 10 mm The most important calibration data are engraved in the side face of the specimen.

COS429: COMPUTER VISON CAMERAS AND PROJECTIONS (2 lectures)

Outline. ETN-FPI Training School on Plenoptic Sensing

Multi-view Surface Inspection Using a Rotating Table

Homework Assignment /645 Fall Instructions and Score Sheet (hand in with answers)

A Tool for Kinematic Error Analysis of Robots/Active Vision Systems

Today. Stereo (two view) reconstruction. Multiview geometry. Today. Multiview geometry. Computational Photography

CALCULATING TRANSFORMATIONS OF KINEMATIC CHAINS USING HOMOGENEOUS COORDINATES

Self-Calibration of a Camera Equipped SCORBOT ER-4u Robot

2D Image Transforms Computer Vision (Kris Kitani) Carnegie Mellon University

Math 11 Fall 2016 Section 1 Monday, October 17, 2016

Computer Vision Projective Geometry and Calibration. Pinhole cameras

GBT Commissioning Memo 11: Plate Scale and pointing effects of subreflector positioning at 2 GHz.

EMRP JRP IND62 TIM: Use of on-board metrology systems for area-scanning on machine tools

3D Geometry and Camera Calibration

Robotic Arm Motion for Verifying Signatures

Computer Vision I. Dense Stereo Correspondences. Anita Sellent 1/15/16

Computer Graphics 7: Viewing in 3-D

Information page for written examinations at Linköping University TER2

Interpolation by Spline Functions

Camera calibration for miniature, low-cost, wide-angle imaging systems

Camera Calibration. Schedule. Jesus J Caban. Note: You have until next Monday to let me know. ! Today:! Camera calibration

FLAP P6.2 Rays and geometrical optics COPYRIGHT 1998 THE OPEN UNIVERSITY S570 V1.1

Transcription:

Calibration Calibrate (vt) : 1. to determine the caliber of (as a thermometer tube); 2. to determine, rectify, or mark the gradations of (as a thermometer tube); 3. to standardize (as a measuring instrument) by determining the deviation from a standard so as to ascertain the proper correction factors; 4. ADJUST, TUNE

Calibration Reality Measuring device + - Error Model of Reality

Calibration Reality Actuation device + - Error Model of Reality

Basic Techniques Parameter Estimation Mapping the space

Parameter Estimation Compare observed system performance to reference standard ( ground truth ) Compute parameters of mathematical model that minimizes residual error. System Parameters + - Model of reality Reality Error Calibration process

Pointing device calibration p pivot p t (unknown) F = ( R, p ) i i i

Pointing device calibration p pivot p t (unknown) F = ( R, p ) i i i

Pointing device calibration p pivot p t F = ( R, p ) i i i

Pointing device calibration p pivot p t (unknown) Rp + p = p i t i pivot F = ( R, p ) i i i

Pointing device calibration p pivot p t (unknown) p t R I p p j pivot j F = ( R, p ) i i i

Linear Parameter Estimation p = f( q) where q= [ q,... q nom 1 n T ] are parameters * p = f( q+ q) L fi f( q) + ( q) q NM j f( q) + J ( q) q f O L QP NM q q 1 n O QP

Linear Parameter Estimation Given f(q), and a set of observations p k * corresponding to nominal parameter values q k *, solve the least squares problem L NM O QP L NM * f ( q ) q p f( q ) J k k k O QP

Example: 2 link robot calibration a 2 * p k a 1

Example: 2 link robot calibration a 2 * p k a 1

Example: 2 link robot calibration p = L NM a a sinθ + a sin( θ ) 1 1 2 12 0 cosθ + a cos( θ ) 1 1 2 12 O QP where θ = θ + θ 12 1 2 p * = L NM ( a1+ a1)sin( θ1+ θ1) + ( a2 + a2)sin( θ12 + θ1+ θ2) 0 ( a + a cos( θ + θ ) + ( a + a ) cos( θ + θ + θ ) 1 1 1 1 2 2 12 1 2 O QP

Example: 2 link robot calibration p = f( q ) = f( a, a, θ, θ ) = k k 1 2 1 2 L NM a1sinθ1, k + a2sin( θ12, k) 0 a cosθ + a cos( θ ) 1 1, k 2 12, k O QP where θ = θ + θ 12 1 2 so we solve the least squares problem L NM f a OL QP NM a1 f f f a 2 ( q ) ( q ) ( q ) ( q ) a θ θ θ 1P θ arot 1 ( y, θ 1 k ) + arot( y, θ ) * k k k k p, k 1 2 1 2 2 1, k 2 O Q L NM L M N O QP O P Q

Example: 2 link robot calibration Here so J f L NM ( q ) = k L NM sinθ sin θ a (cosθ + cos θ ) a cosθ 0 0 0 0 1, k 12, k 1 1, k 12, k 2 12, k cosθ cos θ a (sinθ + sin θ ) a cosθ 1, k 12, k 1 1, k 12, k 2 12, k a 1 sinθ, k sin θ, k a (cosθ, k + cos θ, k) a cosθ 1 12 1 1 12 2 12, k a cosθ, k cos θ, k a (sinθ, k + sin θ, k) a cosθ 2 1 12 1 1 12 2 12, k θ PM 1P θ OL QN 2 O Q O QP L NM x a sinθ + a sin( θ ) z a cos a cos( ) * k 1 1, k 2 12, k * k 1 θ1, k + 2 θ12, k O QP

Example: Robodoc Wrist Calibration Basic robot had very accurate calibration Custom wrist was less accurate Crucial goal was to determine position of cutter tip Cutter Calibration post

Kinematic Model p = p + R( z, θ + θ ) ( α x+ v ) tool wrist 4 4 distal v = R( x, β ) [ R( y, θ + θ )( v + v )] distal 5 5 c c

Linearization p p + [ R R ( v + v )] +... post wrist 4 5 c c

Linear Least Squares Most commonly used method for parameter estimation Many numerical libraries See the web site Here is a quick review Microsoft PowerPoint Presentation

Example: Undistorted fluoroscope calibration

Calibration if no distortion (version 1) Assume no distortion. For the moment also assume that you have N point calibration features (e.g., small steel balls) at known { } positions a0,, a N 1 relative to the detector. Assume further that the points { } create images at corresponding points d0,, d N 1 on the detector. Estimate the position s of the x-ray source relative to the detector

Approach F obj s Calibration object a k d k Detector

Projection of a point feature s s= λ(a-d)+d (a - d) (s - d) λ = (a - d) (a - d) a d d= µ ( a s) + s µ = (a - s) (d - s) (a - s) (a - s)

Approach s d a ( a d) ( s d) = 0 skew( a d) s = ( a d) d = a d d d = a d 0 dz az ay dy az dz 0 dx ax s = a d dy ay ax dx 0

Solve least squares problem Approach skew( a0 d0) sx a0 d0 s y s z skew( N 1 N 1) a d an 1 dn 1 s a d

What if pose of calibration object is imprecisely known? This is a hairier problem, but solvable In fact, it makes a great homework assignment.

Mapping the space Compare observed system performance to reference standard ( ground truth ) Interpolate residual errors System + - Model of reality Reality Error Model Correction Lookup Table

Example: Fluoroscope calibration

Projection of a point feature with distortion a s s= λ(a-d)+d (a-d) (s-d) λ = (a - d) (a - d) d u u = f( d, ν )

C-Arm Detector and dewarp plate Experimental Setup Robot Arm Corkscrew Phantom Surgical Cutter

Dewarping Method

Intrinsic Image Calibration Intrinsic imaging parameters (Schreiner et. al.) Image Warping (Checkerboard Based Method) 1/16 4/16 3/16 4/16 Top View Side View

Step 0: Acquire Image

Step 1: Find groove points Find image points corresponding to the centerline of each vertical and horizontal groove

Step 2: Fit 5 th order Bernstein Fit least square smooth curve to each vertical and horizontal groove 5 th order Bernstein Polynomial Polynomial Curves 5 5 5 k B( a0,, a5; v) = ak ( 1 v) v k = 0 k k

Step 3: Dewarp Employ a two pass scan line algorithm to dewarp the image

Advantages Fast 2 seconds on Pentium II 400 Robust works well even with overlaid objects Sub-pixel Accuracy mean error 0.12 mm on the central area Does not completely obscure the image trades off image contrast depth for image area

Two Plane Method Plane 1 pattern Plane 2 pattern E.g., Lavallee E.g., Helm

Two Plane Method Plane 1 pattern Plane 2 pattern Given q = a point in image coordinates, determine the points f f The desired ray in space passes through and * 1 * 2 f = the point on grid 1 corresponding to = the point on grid 2 corresponding to * 2. f * 1 q q

Photos: Sofamor Danek

Interpolation Ubiquitous throughout CIS research and applications Many techniques and methods Here are a few more notes Microsoft PowerPoint Presentation

Two plane calibration Again, the essential problem is to determine the coordinates in the two planes at which the source-to-detector ray passes through the plane. Many methods for this. E.g., Find the four surrounding bead locations on each plane and use bilinear interpolation Fit a general spline model for the distortion on each plane and then directly interpolate