Perspective Projection Transformation
|
|
- Antony Preston
- 6 years ago
- Views:
Transcription
1 Perspective Projection Transformation Where does a point of a scene appear in an image?? p p Transformation in 3 steps:. scene coordinates => camera coordinates. projection of camera coordinates into image plane 3. camera coordinates => image coordinates Perspective projection equations are essential for Computer Graphics. For Image Understanding we will need the inverse: What are possible scene coordinates of a point visible in the image? This will follow later. Perspective Projection in Independent Coordinate Sstems It is often useful to describe real-world points, camera geometr and image points in separate coordinate sstems. The formal description of projection involves transformations between these coordinate sstems. camera coordinates image coordinates optical ais scene point v = optical center v image point v p = p p p v p = p p p v p = p p scene (world) coordinates
2 3D Coordinate Transformation () The new coordinate sstem is specified b a translation and rotation with respect to the old coordinate sstem: v = R (v - v ) R ma be decomposed into 3 rotations about the coordinate aes: R = R R R v is displacement vector R is rotation matri R = Note that these matrices describe coo transforms for positive rotations of the coo sstem. cos α sin α sin α cos α If rotations are performed in the above order: ) γ = rotation angle about -ais ) β = rotation angle about (new) -ais 3) α = rotation angle about (new) -ais ("tilt angle", "pan angle", and "nick angle" for the camera coordinate assignment shown before) R = R = cos β sin β cos γ sin γ sin γ cos γ - sin β cos β 3 3D Coordinate Transformation () B multipling the 3 matrices R, R and R, one gets R = cos β cos γ cos β sin γ - sin β sin α sin β cos γ cos α sin γ sin α sin β sin γ + cos α cos γ sin α cos β cos α sin β cos γ + sin α sin γ cos α sin β sin γ sin α cos γ cos α cos β For formula manipulations, one tries to avoid the trigonometric functions and takes R = r r r 3 r r r 3 r 3 r 3 r 33 Note that the coefficients of R are constrained: A rotation matri is orthonormal: R R T = I (unit matri) 4
3 Eample for Coordinate Transformation v camera coo sstem: displacement b v rotation b pan angle β = -3 rotation b nick angle α = 45 v = R (v - v ) with R = R R R = R = Perspective Projection Geometr Projective geometr relates the coordinates of a point in a scene to the coordinates of its projection onto an image plane. Perspective projection is an adequate model for most cameras. optical center focal distance f V p = p p p p p p = f image point scene point v = = optical ais image plane Projection equations: p = f p = f 6 3
4 Perspective and Orthographic Projection Within the camera coordinate sstem the perspective projection of a scene point onto the image plane is described b f p = f p = p = f (f = focal distance) nonlinear transformation loss of information If all objects are far awa (large ), f/ is approimatel constant => orthographic projection p = s p = s (s = scaling factor) Orthographic projection can be viewed as projection with parallel ras + scaling 7 From Camera Coordinates to Image Coordinates Transform ma be necessar because - optical ais ma not penetrate image plane at origin of desired coordinate sstem - transition to discrete coordinates ma require scaling p = ( p - p ) a p = ( p - p ) b a, b scaling parameters p, p origin of image coordinate sstem Eample: c d c d Image boundaries in camera coordinates: ma = c min = c ma = d min = d Discrete image coordinates: =.. 5 = Transformation parameters: p = c p = d a = 5 / (c - c) b = 576 / (d - d) 8 4
5 Complete Perspective Projection Equation We combine the 3 transformation steps:. scene coordinates => camera coordinates. projection of camera coordinates into image plane 3. camera coordinates => image coordinates p = { f/ [cos β cos γ ( - ) + cos β sin γ ( - ) + sin β ( - )] - p } a p = { f/ [ (- sin α sin β cos γ - cos α sin γ ) ( - ) + ( sin α sin β sin γ + cos α cos γ ) ( - ) + sin α cos β ( - )] - p } b with = (- cos α sin β cos γ + sin α sin γ ) ( - ) + ( - cos α sin β sin γ - sin α cos γ ) ( - ) + cos α cos β ( - ) 9 Homogeneous Coordinates () 4D notation for 3D coordinates which allows to epress nonlinear 3D transformations as linear 4D transformations. Normal: v = R (v - v ) Homogeneous coordinates: v = A v A = R T = r r r 3 r r r 3 r 3 r 3 r (note italics for homogeneous coordinates) Transition to homogeneous coordinates: v T = [ ] => v T = [w w w w] w is arbitrar constant Return to normal coordinates:. Divide components - 3 b 4th component. Omit 4th component 5
6 Homogeneous Coordinates () Perspective projection in homogeneous coordinates: v p = P v with P = /f and v = w w w w gives v p = w w w w/f Returning to normal coordinates gives v p = f/ f/ f compare with earlier slide Transformation from camera into image coordinates: v p = B v p with B = a - a b - b and v p = w p w p w gives v p = wa( p - ) wb( p - ) w Homogeneous Coordinates (3) Perspective projection can be completel described in terms of a linear transformation in homogeneous coordinates: v p = B P R T v B P R T ma be combined into a single 4 4 matri C : v p = C v In the literature the parameters of these equations ma var because of different choices of coordinate sstems, different order of translation and rotation, different camera models, etc. 6
7 Inverse Perspective Equations Which points in a scene correspond to a point in the image? p p? Each image point defines a projection ra as the locus of possible scene points (for simplicit in camera coordinates): v λ v p => v λ = λ v v p p origin v = v + R T λ v p 3 equations with the 4 unknowns,,, λ and camera parameters R and v Applications of inverse perspective mapping for e.g. - distance measurements - binocular stereo - camera calibration - motion stereo 3 Binocular Stereo () v optical ais optical ais o u u o b l l l, l b o, o f, f v u, u camera positions (optical center) stereo base camera orientations (unit vectors) focal distances scene point projection ras of scene point (unit vectors) 4 7
8 Binocular Stereo () Determine distance to v b measuring u and u Formall: α u = b + β u => v = α u + l α and β are overconstrained b the vector equation. In practice, measurements are ineact, no eact solution eists (ras do not intersect). Better approach: Solve for the point of closest approimation of both ras: v = α u + (b + β u ) Solution: α = u T b - (u T u ) (u T b) + l => minimie α u - (b + β u ) - (u T u ) β = (u T u ) ( u T b) - (u T b) - (u T u ) 5 Distance in Digital Images Intuitive concepts of continuous images do not alwas carr over to digital images. Several methods for measuring distance between piels: Eucledian distance D E ((i, j),(h,k)) = (i h) + ( j k) costl computation of square root, can be avoided for distance comparisons Cit-block distance D 4 ((i, j)(h, k)) = i - h + j - k number of horiontal and vertical steps in a rectangular grid Chessboard distance D 8 ((i, j)(h, k)) = ma { i - h, j - k } number of steps in a rectangular grid if diagonal steps are allowed (number of moves of a king on a chessboard) 6 8
9 Connectivit in Digital Images Connectivit is an important propert of subsets of piels. It is based on adjacenc (or neighbourhood): Piels are 4-neighbours if their distance is D 4 = Piels are 8-neighbours if their distance is D 8 = all 4-neighbours of center piel all 8-neighbours of center piel A path from piel P to piel Q is a sequence of piels beginning at Q and ending at P, where consecutive piels are neighbours. In a set of piels, two piels P and Q are connected, if there is a path between P and Q with piels belonging to the set. A region is a set of piels where each pair of piels is connected. 7 Closed Curve Paradoon solid lines if 8-neighbourhood is used line line a similar paradoon arises if 4-neighbourhoods are used line does not intersect line although it crosses from the outside to the inside 8 9
10 Geometric Transformations Various applications: change of view point elimination of geometric distortions from image capturing registration of corresponding images artificial distortions, Computer Graphics applications Step : Determine mapping T(, ) from old to new coordinate sstem Step : Compute new coordinates (, ) for (, ) Step 3: Interpolate grevalues at grid positions from grevalues at transformed positions grevalue must be interpolated 9 Polnomial Coordinate Transformations General format of transformation: m m-r = a rk r k r = k= m m-r = b rk r k r = k= Assume polnomial mapping between (, ) and (, ) of degree m Determine corresponding points a) Solve linear equations for a rk, b rk (r, k =... m) b) Minimie mean square error (MSE) for point correspondences Approimation b biquadratic transformation: = a + a + a + a + a + a = b + b + b + b + b + b Approimation b affine transformation: = a + a + a = b + b + b at least 6 corresponding pairs needed at least 3 corresponding pairs needed
11 Translation, Rotation, Scaling, Skewing Translation b vector t: v = v + t with v = v = t = t t Rotation of image coordinates b angle α: v = R v with R = cos α sin α sin α cos α Scaling b factor a in -direction and factor b in -direction: v = S v with S = a b Skewing b angle β: v = W v with W = tan β Eample of Geometr Correction b Scaling Distortions of electron-tube cameras ma be - % => more than 5 lines for TV images Correction procedure ma be based on - fiducial marks engraved into optical sstem - a test image with regularl spaced marks ideal image actual image Ideal mark positions: mn = a + mb, mn = c + nd Actual mark positions: mn, mn m =... M- n =... N- Determine a, b, c, d such that MSE (mean square error) of deviations is minimied c d b a
12 Minimiing the MSE Minimie M N E = ( mn mn ) + ( mn mn ) m = M n = N = (a+ mb mn ) + (c+ nd mn ) m = n = From de/da = de/db = de/dc = de/dd = we get: a = MN(M+ ) m 6 b = MN(M ) c = MN(N + ) m 6 d = MN(N ) n m n (M 3m) mn n m (m M + ) mn (N 3n) mn n (n N + ) mn Special case M=N=: a = / ( + ) b = / ( ) c = / ( + ) d = / ( ) 3 Principle of Grevalue Interpolation Grevalue interpolation = computation of unknown grevalues at locations (u v ) from known grevalues at locations ( ) Two was of viewing interpolation in the contet of geometric transformations: A B Grevalues at grid locations ( ) in old image are placed at corresponding locations ( ) in new image: g( ) = g(t( )) => interpolation in new image Grid locations (u v ) in new image are transformed into corresponding locations (u v) in old image: g(u v) = g(t - (u v )) => interpolation in old image We will take view B: Compute grevalues between grid from grevalues at grid locations. 4
13 Nearest Neighbour Grevalue Interpolation Assign to ( ) grevalue of nearest grid location ( i j ) ( i+ j ) ( i j+ ) ( i+ j+ ) grid locations ( ) location between grid with i i+, j j+ ( i j ) ( i+ j ) ( ) ( i j+ ) ( i+ j+ ) Each grid location represents the grevalues in a rectangle centered around this location: Straight lines or edges ma appear step-like after this transformation: 5 Bilinear Grevalue Interpolation The grevalue at location ( ) between 4 grid points ( i j ) ( i+ j ) ( i j+ ) ( i+ j+ ) is computed b linear interpolation in both directions: g(,)= {( i + )( j+ )g( i j ) + ( i )( j+ )g( i+ j ) + ( i+ i )( j+ i ) ( i+ )( j )g( i j+ ) + ( i )( j )g( i + j+ )} Simple idea behind long formula:. Compute g = linear interpolation of g and g. Compute g 34 = linear interpolation of g 3 and g 4 3. Compute g = linear interpolation of g and g 34 g g g g g 3 g 34 g 4 The step-like boundar effect is reduced. But bilear interpolation ma blur sharp edges. 6 3
14 Bicubic Interpolation Each grevalue at a grid point is taken to represent the center value of a local bicubic interpolation surface with cross section h for < < h 3 = for < < otherwise The grevalue at an arbitrar point [u, v] (black dot in figure) can be computed b - 4 horiontal interpolations to obtain grevalues at points [u, j-]... [u, j+] (red dots), followed b - vertical interpolation (between red dots) to obtain grevalue at [u, v]. Note: For an image with constant gevalues g the interpolated grevalues at all points between the grid lines are also g. cross section of interpolation kernel j- j - - j+ j+ i- i i+ i+ 7 4
3D Geometry and Camera Calibration
3D Geometr and Camera Calibration 3D Coordinate Sstems Right-handed vs. left-handed 2D Coordinate Sstems ais up vs. ais down Origin at center vs. corner Will often write (u, v) for image coordinates v
More informationUses of Transformations. 2D transformations Homogeneous coordinates. Transformations. Transformations. Transformations. Transformations and matrices
Uses of Transformations 2D transformations Homogeneous coordinates odeling: position and resie parts of a comple model; Viewing: define and position the virtual camera Animation: define how objects move/change
More informationComputer Graphics. Geometric Transformations
Contents coordinate sstems scalar values, points, vectors, matrices right-handed and left-handed coordinate sstems mathematical foundations transformations mathematical descriptions of geometric changes,
More informationComputer Graphics. Geometric Transformations
Computer Graphics Geometric Transformations Contents coordinate sstems scalar values, points, vectors, matrices right-handed and left-handed coordinate sstems mathematical foundations transformations mathematical
More informationMAN-522: COMPUTER VISION SET-2 Projections and Camera Calibration
MAN-522: COMPUTER VISION SET-2 Projections and Camera Calibration Image formation How are objects in the world captured in an image? Phsical parameters of image formation Geometric Tpe of projection Camera
More informationGeometric Model of Camera
Geometric Model of Camera Dr. Gerhard Roth COMP 42A Winter 25 Version 2 Similar Triangles 2 Geometric Model of Camera Perspective projection P(X,Y,Z) p(,) f X Z f Y Z 3 Parallel lines aren t 4 Figure b
More informationGeometry of image formation
Geometr of image formation Tomáš Svoboda, svoboda@cmp.felk.cvut.c ech Technical Universit in Prague, enter for Machine Perception http://cmp.felk.cvut.c Last update: November 0, 2008 Talk Outline Pinhole
More information3-Dimensional Viewing
CHAPTER 6 3-Dimensional Vieing Vieing and projection Objects in orld coordinates are projected on to the vie plane, hich is defined perpendicular to the vieing direction along the v -ais. The to main tpes
More informationCS 2770: Intro to Computer Vision. Multiple Views. Prof. Adriana Kovashka University of Pittsburgh March 14, 2017
CS 277: Intro to Computer Vision Multiple Views Prof. Adriana Kovashka Universit of Pittsburgh March 4, 27 Plan for toda Affine and projective image transformations Homographies and image mosaics Stereo
More information9.1 Exercises. Section 9.1 The Square Root Function 879. In Exercises 1-10, complete each of the following tasks.
Section 9. The Square Root Function 879 9. Eercises In Eercises -, complete each of the following tasks. i. Set up a coordinate sstem on a sheet of graph paper. Label and scale each ais. ii. Complete the
More information3D Sensing. Translation and Scaling in 3D. Rotation about Arbitrary Axis. Rotation in 3D is about an axis
3D Sensing Camera Model: Recall there are 5 Different Frames of Reference c Camera Model and 3D Transformations Camera Calibration (Tsai s Method) Depth from General Stereo (overview) Pose Estimation from
More informationTwo Dimensional Viewing
Two Dimensional Viewing Dr. S.M. Malaek Assistant: M. Younesi Two Dimensional Viewing Basic Interactive Programming Basic Interactive Programming User controls contents, structure, and appearance of objects
More informationCamera model and multiple view geometry
Chapter Camera model and multiple view geometry Before discussing how D information can be obtained from images it is important to know how images are formed First the camera model is introduced and then
More informationLecture 4: Viewing. Topics:
Lecture 4: Viewing Topics: 1. Classical viewing 2. Positioning the camera 3. Perspective and orthogonal projections 4. Perspective and orthogonal projections in OpenGL 5. Perspective and orthogonal projection
More informationCS 335 Graphics and Multimedia. Geometric Warping
CS 335 Graphics and Multimedia Geometric Warping Geometric Image Operations Eample transformations Straightforward methods and their problems The affine transformation Transformation algorithms: Forward
More informationWhat and Why Transformations?
2D transformations What and Wh Transformations? What? : The geometrical changes of an object from a current state to modified state. Changing an object s position (translation), orientation (rotation)
More informationGeometry of a single camera. Odilon Redon, Cyclops, 1914
Geometr o a single camera Odilon Redon, Cclops, 94 Our goal: Recover o 3D structure Recover o structure rom one image is inherentl ambiguous??? Single-view ambiguit Single-view ambiguit Rashad Alakbarov
More informationModeling Transformations
Modeling Transformations Michael Kazhdan (601.457/657) HB Ch. 5 FvDFH Ch. 5 Overview Ra-Tracing so far Modeling transformations Ra Tracing Image RaTrace(Camera camera, Scene scene, int width, int heigh,
More informationAffine and Projective Transformations
CS 674: Intro to Computer Vision Affine and Projective Transformations Prof. Adriana Kovaska Universit of Pittsburg October 3, 26 Alignment problem We previousl discussed ow to matc features across images,
More information3-D D Euclidean Space - Vectors
3-D D Euclidean Space - Vectors Rigid Body Motion and Image Formation A free vector is defined by a pair of points : Jana Kosecka http://cs.gmu.edu/~kosecka/cs682.html Coordinates of the vector : 3D Rotation
More informationInteractive Computer Graphics. Warping and morphing. Warping and Morphing. Warping and Morphing. Lecture 14+15: Warping and Morphing. What is.
Interactive Computer Graphics Warping and morphing Lecture 14+15: Warping and Morphing Lecture 14: Warping and Morphing: Slide 1 Lecture 14: Warping and Morphing: Slide 2 Warping and Morphing What is Warping
More information3D Geometry and Camera Calibration
3D Geometry and Camera Calibration 3D Coordinate Systems Right-handed vs. left-handed x x y z z y 2D Coordinate Systems 3D Geometry Basics y axis up vs. y axis down Origin at center vs. corner Will often
More informationN-Views (1) Homographies and Projection
CS 4495 Computer Vision N-Views (1) Homographies and Projection Aaron Bobick School of Interactive Computing Administrivia PS 2: Get SDD and Normalized Correlation working for a given windows size say
More informationToday s class. Geometric objects and transformations. Informationsteknologi. Wednesday, November 7, 2007 Computer Graphics - Class 5 1
Toda s class Geometric objects and transformations Wednesda, November 7, 27 Computer Graphics - Class 5 Vector operations Review of vector operations needed for working in computer graphics adding two
More informationTransformations. Examples of transformations: shear. scaling
Transformations Eamples of transformations: translation rotation scaling shear Transformations More eamples: reflection with respect to the y-ais reflection with respect to the origin Transformations Linear
More informationComputer Vision. Coordinates. Prof. Flávio Cardeal DECOM / CEFET- MG.
Computer Vision Coordinates Prof. Flávio Cardeal DECOM / CEFET- MG cardeal@decom.cefetmg.br Abstract This lecture discusses world coordinates and homogeneous coordinates, as well as provides an overview
More informationGeometric Image Transformations and Related Topics
Geometric Image Transformations and Related Topics 9 th Lesson on Image Processing Martina Mudrová 2004 Topics What will be the topic of the following lesson? Geometric image transformations Interpolation
More informationCS4670: Computer Vision
CS467: Computer Vision Noah Snavely Lecture 8: Geometric transformations Szeliski: Chapter 3.6 Reading Announcements Project 2 out today, due Oct. 4 (demo at end of class today) Image alignment Why don
More informationTHE INVERSE GRAPH. Finding the equation of the inverse. What is a function? LESSON
LESSON THE INVERSE GRAPH The reflection of a graph in the line = will be the graph of its inverse. f() f () The line = is drawn as the dotted line. Imagine folding the page along the dotted line, the two
More informationImage Transformations
Image Transformations Outline Gre-level transformations Histogram equalization Geometric transformations Affine transformations Interpolation Warping and morphing. Gre-level transformations Changes the
More informationModeling Transformations
Modeling Transformations Michael Kazhdan (601.457/657) HB Ch. 5 FvDFH Ch. 5 Announcement Assignment 2 has been posted: Due: 10/24 ASAP: Download the code and make sure it compiles» On windows: just build
More informationAnnouncements. Equation of Perspective Projection. Image Formation and Cameras
Announcements Image ormation and Cameras Introduction to Computer Vision CSE 52 Lecture 4 Read Trucco & Verri: pp. 22-4 Irfanview: http://www.irfanview.com/ is a good Windows utilit for manipulating images.
More informationMEM380 Applied Autonomous Robots Winter Robot Kinematics
MEM38 Applied Autonomous obots Winter obot Kinematics Coordinate Transformations Motivation Ultimatel, we are interested in the motion of the robot with respect to a global or inertial navigation frame
More information(ii) Use Simpson s rule with two strips to find an approximation to Use your answers to parts (i) and (ii) to show that ln 2.
C umerical Methods. June 00 qu. 6 (i) Show by calculation that the equation tan = 0, where is measured in radians, has a root between.0 and.. [] Use the iteration formula n+ = tan + n with a suitable starting
More information4. Two Dimensional Transformations
4. Two Dimensional Transformations CS362 Introduction to Computer Graphics Helena Wong, 2 In man applications, changes in orientations, sizes, and shapes are accomplished with geometric transformations
More informationImage Warping CSE399b, Spring 07 Computer Vision
Image Warping CSE399b, Spring 7 Computer Vision http://maps.a9.com http://www.cs.ubc.ca/~mbrown/autostitch/autostitch.html http://www.cs.ubc.ca/~mbrown/autostitch/autostitch.html Autostiching on A9.com
More informationRigid Body Motion and Image Formation. Jana Kosecka, CS 482
Rigid Body Motion and Image Formation Jana Kosecka, CS 482 A free vector is defined by a pair of points : Coordinates of the vector : 1 3D Rotation of Points Euler angles Rotation Matrices in 3D 3 by 3
More informationAnnouncements. The equation of projection. Image Formation and Cameras
Announcements Image ormation and Cameras Introduction to Computer Vision CSE 52 Lecture 4 Read Trucco & Verri: pp. 5-4 HW will be on web site tomorrow or Saturda. Irfanview: http://www.irfanview.com/ is
More informationLimitations of Thresholding
Limitations of Thresholding Wh can we segment images much better b ee than through thresholding processes? We might improve results b considering image contet: Surface Coherence Gradient.illusion.arp.jpg
More informationLast Lecture. Edge Detection. Filtering Pyramid
Last Lecture Edge Detection Filtering Pramid Toda Motion Deblur Image Transformation Removing Camera Shake from a Single Photograph Rob Fergus, Barun Singh, Aaron Hertzmann, Sam T. Roweis and William T.
More informationAgenda. Rotations. Camera models. Camera calibration. Homographies
Agenda Rotations Camera models Camera calibration Homographies D Rotations R Y = Z r r r r r r r r r Y Z Think of as change of basis where ri = r(i,:) are orthonormal basis vectors r rotated coordinate
More informationImage warping/morphing
Image warping/morphing Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/3/20 with slides b Richard Szeliski, Steve Seitz, Tom Funkhouser and Aleei Efros Image warping Image formation B A Sampling
More informationLast Time. Correct Transparent Shadow. Does Ray Tracing Simulate Physics? Does Ray Tracing Simulate Physics? Refraction and the Lifeguard Problem
Graphics Pipeline: Projective Last Time Shadows cast ra to light stop after first intersection Reflection & Refraction compute direction of recursive ra Recursive Ra Tracing maimum number of bounces OR
More informationMotivation. What we ve seen so far. Demo (Projection Tutorial) Outline. Projections. Foundations of Computer Graphics
Foundations of Computer Graphics Online Lecture 5: Viewing Orthographic Projection Ravi Ramamoorthi Motivation We have seen transforms (between coord sstems) But all that is in 3D We still need to make
More informationImage Warping, mesh, and triangulation CSE399b, Spring 07 Computer Vision
http://grail.cs.washington.edu/projects/rotoscoping/ Image Warping, mesh, and triangulation CSE399b, Spring 7 Computer Vision Man of the slides from A. Efros. Parametric (global) warping Eamples of parametric
More informationEpipolar Constraint. Epipolar Lines. Epipolar Geometry. Another look (with math).
Epipolar Constraint Epipolar Lines Potential 3d points Red point - fied => Blue point lies on a line There are 3 degrees of freedom in the position of a point in space; there are four DOF for image points
More informationChapter 18. Geometric Operations
Chapter 18 Geometric Operations To this point, the image processing operations have computed the gray value (digital count) of the output image pixel based on the gray values of one or more input pixels;
More informationStereo Observation Models
Stereo Observation Models Gabe Sibley June 16, 2003 Abstract This technical report describes general stereo vision triangulation and linearized error modeling. 0.1 Standard Model Equations If the relative
More informationECE 470: Homework 5. Due Tuesday, October 27 in Seth Hutchinson. Luke A. Wendt
ECE 47: Homework 5 Due Tuesday, October 7 in class @:3pm Seth Hutchinson Luke A Wendt ECE 47 : Homework 5 Consider a camera with focal length λ = Suppose the optical axis of the camera is aligned with
More informationCamera Models and Image Formation. Srikumar Ramalingam School of Computing University of Utah
Camera Models and Image Formation Srikumar Ramalingam School of Computing University of Utah srikumar@cs.utah.edu Reference Most slides are adapted from the following notes: Some lecture notes on geometric
More informationCamera Models and Image Formation. Srikumar Ramalingam School of Computing University of Utah
Camera Models and Image Formation Srikumar Ramalingam School of Computing University of Utah srikumar@cs.utah.edu VisualFunHouse.com 3D Street Art Image courtesy: Julian Beaver (VisualFunHouse.com) 3D
More informationNumerical Analysis Notes
Numerical Analsis Notes Foes Team Plotting of = f() contour-lines with Ecel Macro isol.ls The Ecel (XP/) macro isol.ls developed b SimonLuca Santoro and kindl released in the free public domain allows
More informationInterpolation is a basic tool used extensively in tasks such as zooming, shrinking, rotating, and geometric corrections.
Image Interpolation 48 Interpolation is a basic tool used extensively in tasks such as zooming, shrinking, rotating, and geometric corrections. Fundamentally, interpolation is the process of using known
More informationImage Metamorphosis By Affine Transformations
Image Metamorphosis B Affine Transformations Tim Mers and Peter Spiegel December 16, 2005 Abstract Among the man was to manipulate an image is a technique known as morphing. Image morphing is a special
More informationReview for Exam I, EE552 2/2009
Gonale & Woods Review or Eam I, EE55 /009 Elements o Visual Perception Image Formation in the Ee and relation to a photographic camera). Brightness Adaption and Discrimination. Light and the Electromagnetic
More informationImage warping. image filtering: change range of image. image warping: change domain of image g(x) = f(h(x)) h(y)=0.5y+0.5. h([x,y])=[x,y/2] f h
Image warping Image warping image filtering: change range of image g() () = h(f()) h(f()) f h g h()=0.5+0.5 image warping: change domain of image g() = f(h()) f h g h([,])=[,/2] Parametric (global) warping
More informationHow is project #1 going?
How is project # going? Last Lecture Edge Detection Filtering Pramid Toda Motion Deblur Image Transformation Removing Camera Shake from a Single Photograph Rob Fergus, Barun Singh, Aaron Hertzmann, Sam
More informationDIGITAL ORTHOPHOTO GENERATION
DIGITAL ORTHOPHOTO GENERATION Manuel JAUREGUI, José VÍLCHE, Leira CHACÓN. Universit of Los Andes, Venezuela Engineering Facult, Photogramdemr Institute, Email leirac@ing.ula.ven Working Group IV/2 KEY
More informationDetermining the 2d transformation that brings one image into alignment (registers it) with another. And
Last two lectures: Representing an image as a weighted combination of other images. Toda: A different kind of coordinate sstem change. Solving the biggest problem in using eigenfaces? Toda Recognition
More informationGLOBAL EDITION. Interactive Computer Graphics. A Top-Down Approach with WebGL SEVENTH EDITION. Edward Angel Dave Shreiner
GLOBAL EDITION Interactive Computer Graphics A Top-Down Approach with WebGL SEVENTH EDITION Edward Angel Dave Shreiner This page is intentionall left blank. 4.10 Concatenation of Transformations 219 in
More informationCamera Model and Calibration
Camera Model and Calibration Lecture-10 Camera Calibration Determine extrinsic and intrinsic parameters of camera Extrinsic 3D location and orientation of camera Intrinsic Focal length The size of the
More informationCS559: Computer Graphics
CS559: Computer Graphics Lecture 8: 3D Transforms Li Zhang Spring 28 Most Slides from Stephen Chenne Finish Color space Toda 3D Transforms and Coordinate sstem Reading: Shirle ch 6 RGB and HSV Green(,,)
More information3D Photography: Epipolar geometry
3D Photograph: Epipolar geometr Kalin Kolev, Marc Pollefes Spring 203 http://cvg.ethz.ch/teaching/203spring/3dphoto/ Schedule (tentative) Feb 8 Feb 25 Mar 4 Mar Mar 8 Mar 25 Apr Apr 8 Apr 5 Apr 22 Apr
More informationCS 548: COMPUTER GRAPHICS REVIEW: OVERVIEW OF POLYGONS SPRING 2015 DR. MICHAEL J. REALE
CS 548: COMPUTER GRPHICS REVIEW: OVERVIEW OF POLYGONS SPRING 05 DR. MICHEL J. RELE NOTE: COUNTERCLOCKWISE ORDER ssuming: Right-handed sstem Vertices in counterclockwise order looking at front of polgon
More informationShort on camera geometry and camera calibration
Short on camera geometry and camera calibration Maria Magnusson, maria.magnusson@liu.se Computer Vision Laboratory, Department of Electrical Engineering, Linköping University, Sweden Report No: LiTH-ISY-R-3070
More informationTo Do. Demo (Projection Tutorial) Motivation. What we ve seen so far. Outline. Foundations of Computer Graphics (Fall 2012) CS 184, Lecture 5: Viewing
Foundations of Computer Graphics (Fall 0) CS 84, Lecture 5: Viewing http://inst.eecs.berkele.edu/~cs84 To Do Questions/concerns about assignment? Remember it is due Sep. Ask me or TAs re problems Motivation
More informationBut First: Multi-View Projective Geometry
View Morphing (Seitz & Dyer, SIGGRAPH 96) Virtual Camera Photograph Morphed View View interpolation (ala McMillan) but no depth no camera information Photograph But First: Multi-View Projective Geometry
More informationViewing and Projection
Viewing and Projection Sheelagh Carpendale Camera metaphor. choose camera position 2. set up and organie objects 3. choose a lens 4. take the picture View Volumes what gets into the scene perspective view
More informationcalibrated coordinates Linear transformation pixel coordinates
1 calibrated coordinates Linear transformation pixel coordinates 2 Calibration with a rig Uncalibrated epipolar geometry Ambiguities in image formation Stratified reconstruction Autocalibration with partial
More informationWhat does OpenGL do?
Theor behind Geometrical Transform What does OpenGL do? So the user specifies a lot of information Ee Center Up Near, far, UP EE Left, right top, bottom, etc. f b CENTER left right top bottom What does
More informationChapter 3 : Computer Animation
Chapter 3 : Computer Animation Histor First animation films (Disne) 30 drawings / second animator in chief : ke frames others : secondar drawings Use the computer to interpolate? positions orientations
More information3D Modeling using multiple images Exam January 2008
3D Modeling using multiple images Exam January 2008 All documents are allowed. Answers should be justified. The different sections below are independant. 1 3D Reconstruction A Robust Approche Consider
More information[ ] [ ] Orthogonal Transformation of Cartesian Coordinates in 2D & 3D. φ = cos 1 1/ φ = tan 1 [ 2 /1]
Orthogonal Transformation of Cartesian Coordinates in 2D & 3D A vector is specified b its coordinates, so it is defined relative to a reference frame. The same vector will have different coordinates in
More informationHomework #1. Displays, Alpha Compositing, Image Processing, Affine Transformations, Hierarchical Modeling
Computer Graphics Instructor: Brian Curless CSE 457 Spring 2014 Homework #1 Displays, Alpha Compositing, Image Processing, Affine Transformations, Hierarchical Modeling Assigned: Saturday, April th Due:
More informationStructure from motion
Structure from motion Structure from motion Given a set of corresponding points in two or more images, compute the camera parameters and the 3D point coordinates?? R 1,t 1 R 2,t 2 R 3,t 3 Camera 1 Camera
More information1. We ll look at: Types of geometrical transformation. Vector and matrix representations
Tob Howard COMP272 Computer Graphics and Image Processing 3: Transformations Tob.Howard@manchester.ac.uk Introduction We ll look at: Tpes of geometrical transformation Vector and matri representations
More informationELEC Dr Reji Mathew Electrical Engineering UNSW
ELEC 4622 Dr Reji Mathew Electrical Engineering UNSW Review of Motion Modelling and Estimation Introduction to Motion Modelling & Estimation Forward Motion Backward Motion Block Motion Estimation Motion
More informationDD2423 Image Analysis and Computer Vision IMAGE FORMATION. Computational Vision and Active Perception School of Computer Science and Communication
DD2423 Image Analysis and Computer Vision IMAGE FORMATION Mårten Björkman Computational Vision and Active Perception School of Computer Science and Communication November 8, 2013 1 Image formation Goal:
More informationTo Do. Motivation. Demo (Projection Tutorial) What we ve seen so far. Computer Graphics. Summary: The Whole Viewing Pipeline
Computer Graphics CSE 67 [Win 9], Lecture 5: Viewing Ravi Ramamoorthi http://viscomp.ucsd.edu/classes/cse67/wi9 To Do Questions/concerns about assignment? Remember it is due tomorrow! (Jan 6). Ask me or
More informationStructure from Motion
Structure from Motion Outline Bundle Adjustment Ambguities in Reconstruction Affine Factorization Extensions Structure from motion Recover both 3D scene geoemetry and camera positions SLAM: Simultaneous
More informationGraphics Output Primitives
Important Graphics Output Primitives Graphics Output Primitives in 2D polgons, circles, ellipses & other curves piel arra operations in 3D triangles & other polgons Werner Purgathofer / Computergraphik
More informationCS231M Mobile Computer Vision Structure from motion
CS231M Mobile Computer Vision Structure from motion - Cameras - Epipolar geometry - Structure from motion Pinhole camera Pinhole perspective projection f o f = focal length o = center of the camera z y
More informationIntegrating ICT into mathematics at KS4&5
Integrating ICT into mathematics at KS4&5 Tom Button tom.button@mei.org.uk www.mei.org.uk/ict/ This session will detail the was in which ICT can currentl be used in the teaching and learning of Mathematics
More informationCS F-07 Objects in 2D 1
CS420-2010F-07 Objects in 2D 1 07-0: Representing Polgons We want to represent a simple polgon Triangle, rectangle, square, etc Assume for the moment our game onl uses these simple shapes No curves for
More informationC / 35. C18 Computer Vision. David Murray. dwm/courses/4cv.
C18 2015 1 / 35 C18 Computer Vision David Murray david.murray@eng.ox.ac.uk www.robots.ox.ac.uk/ dwm/courses/4cv Michaelmas 2015 C18 2015 2 / 35 Computer Vision: This time... 1. Introduction; imaging geometry;
More informationVisual Recognition: Image Formation
Visual Recognition: Image Formation Raquel Urtasun TTI Chicago Jan 5, 2012 Raquel Urtasun (TTI-C) Visual Recognition Jan 5, 2012 1 / 61 Today s lecture... Fundamentals of image formation You should know
More informationWarping, Morphing and Mosaics
Computational Photograph and Video: Warping, Morphing and Mosaics Prof. Marc Pollefes Dr. Gabriel Brostow Toda s schedule Last week s recap Warping Morphing Mosaics Toda s schedule Last week s recap Warping
More informationMachine vision. Summary # 11: Stereo vision and epipolar geometry. u l = λx. v l = λy
1 Machine vision Summary # 11: Stereo vision and epipolar geometry STEREO VISION The goal of stereo vision is to use two cameras to capture 3D scenes. There are two important problems in stereo vision:
More informationEXAM SOLUTIONS. Image Processing and Computer Vision Course 2D1421 Monday, 13 th of March 2006,
School of Computer Science and Communication, KTH Danica Kragic EXAM SOLUTIONS Image Processing and Computer Vision Course 2D1421 Monday, 13 th of March 2006, 14.00 19.00 Grade table 0-25 U 26-35 3 36-45
More informationWorksheet A GRAPHS OF FUNCTIONS
C GRAPHS F FUNCTINS Worksheet A Sketch and label each pair of graphs on the same set of aes showing the coordinates of any points where the graphs intersect. Write down the equations of any asymptotes.
More informationPin Hole Cameras & Warp Functions
Pin Hole Cameras & Warp Functions Instructor - Simon Lucey 16-423 - Designing Computer Vision Apps Today Pinhole Camera. Homogenous Coordinates. Planar Warp Functions. Motivation Taken from: http://img.gawkerassets.com/img/18w7i1umpzoa9jpg/original.jpg
More informationLinear Algebra and Image Processing: Additional Theory regarding Computer Graphics and Image Processing not covered by David C.
Linear Algebra and Image Processing: Additional Theor regarding Computer Graphics and Image Processing not covered b David C. La Dr. D.P. Huijsmans LIACS, Leiden Universit Februar 202 Differences in conventions
More informationA New Concept on Automatic Parking of an Electric Vehicle
A New Concept on Automatic Parking of an Electric Vehicle C. CAMUS P. COELHO J.C. QUADRADO Instituto Superior de Engenharia de Lisboa Rua Conselheiro Emídio Navarro PORTUGAL Abstract: - A solution to perform
More informationImage formation - About the course. Grading & Project. Tentative Schedule. Course Content. Students introduction
About the course Instructors: Haibin Ling (hbling@temple, Wachman 305) Hours Lecture: Tuesda 5:30-8:00pm, TTLMAN 403B Office hour: Tuesda 3:00-5:00pm, or b appointment Tetbook Computer Vision: Models,
More informationParallelization. Memory coherency helps when distributing rays to various threads/processors
/ Ra Tracing OpenGL projects triangles onto the image plane and rasteries them to determine which piels the cover Scanline rendering is a per triangle operation Ra Tracing instead works as a per piel operation
More informationPartial Calibration and Mirror Shape Recovery for Non-Central Catadioptric Systems
Partial Calibration and Mirror Shape Recovery for Non-Central Catadioptric Systems Abstract In this paper we present a method for mirror shape recovery and partial calibration for non-central catadioptric
More informationCT5510: Computer Graphics. Transformation BOCHANG MOON
CT5510: Computer Graphics Transformation BOCHANG MOON 2D Translation Transformations such as rotation and scale can be represented using a matrix M.., How about translation? No way to express this using
More informationAnnouncements. Tutorial this week Life of the polygon A1 theory questions
Announcements Assignment programming (due Frida) submission directories are ied use (submit -N Ab cscd88 a_solution.tgz) theor will be returned (Wednesda) Midterm Will cover all o the materials so ar including
More informationCS6670: Computer Vision
CS6670: Computer Vision Noah Snavely Lecture 7: Image Alignment and Panoramas What s inside your fridge? http://www.cs.washington.edu/education/courses/cse590ss/01wi/ Projection matrix intrinsics projection
More informationMAPI Computer Vision
MAPI Computer Vision Multiple View Geometry In tis module we intend to present several tecniques in te domain of te 3D vision Manuel Joao University of Mino Dep Industrial Electronics - Applications -
More information