Pin Hole Cameras & Warp Functions

Transcription

1 Pin Hole Cameras & Warp Functions Instructor - Simon Lucey Designing Computer Vision Apps

2 Today Pinhole Camera. Homogenous Coordinates. Planar Warp Functions.

3 Motivation

4 Taken from: Pinhole Camera

5 Pinhole Camera Real camera image is inverted Instead model impossible but more convenient virtual image

6 Pinhole Camera Terminology

7 Normalized Camera By similar triangles:

8 Focal length parameters

9 Focal length parameters Can model both the effect of the distance to the focal plane the density of the receptors with a single focal length parameter φ In practice, the receptors may not be square: So use different focal length parameter for x and y dims

10 Offset parameters Current model assumes that pixel (0,0) is where the principal ray strikes the image plane (i.e. the center) Model offset to center

11 Skew parameter Finally, add skew parameter Accounts for image plane being not exactly perpendicular to the principal ray

12 Radial distortion

13 Camera & World Coordinates w w 0 u 0 camera coordinate frame o 0 o world coordinate frame u apple apple apple apple u 0!1! 2 u x w + w 0 = Rotation Matrix Translation Vector! 3! 4 z

14 Position and orientation of camera Position w=(u,v,w) T of point in the world is generally not expressed in the frame of reference of the camera. Transform using 3D transformation or Point in frame of reference of camera Point in frame of reference of world

15 Constraints on As is a rotation matrix it is constrained by the following, T = I det( ) =1 We refer to these matrices as belonging to the Special Orthogonal Group - SO(3). How many degrees of freedom do you think has?

16 Something to try In MATLAB type, >> R1 = orth(randn(3,3)); >> R1(:,end) = det(r1)*r1(:,end); >> R2 = orth(randn(3,3)); >> R2(:,end) = det(r2)*r2(:,end); If you form a new matrix as a linear combination of R1 & R2, >> R3 = 0.5*R *R2; Does R3 lie in SO(3)?

17 Reminder: Convex Set 17

18 Reminder: Non-Convex Set 18

19 Complete pinhole camera model Intrinsic parameters (stored as intrinsic matrix) Extrinsic parameters

20 Complete pinhole camera model For short: Question: is a linear function?

21 Perspective Transform

22 Learning extrinsic parameters ˆ, ˆ =min, NX n=1 {x n pinhole[w n,,, ]} e.g. {x} = x 2 2

23 Learning intrinsic parameters ˆ =min [min, NX n=1 {x n pinhole[w n,,, ]}] e.g. {x} = x 2 2

24 Camera Calibration Use 3D target with known 3D points.

25 For you to try.. There exists camera calibration tools in MATLAB, see Bouget s Calibration Toolbox in MATLAB. Or if you prefer, you can use OpenCV s tutorial. What are the intrinsics of your device? How sensitive are vision algorithms to the correct intrinsics?

26 Today Pinhole Camera. Homogenous Coordinates. Planar Warp Functions.

27 Homogeneous Coordinates Convert 2D coordinate to 3D To convert back

28 Geometric interpretation

29 Pinhole camera Camera model: In homogeneous coordinates: (linear!)

30 Pinhole camera Writing out these three equations Eliminate λ to retrieve original equations

31 Adding in extrinsics Or for short: Or even shorter:

32 Today Pinhole Camera. Homogenous Coordinates. Planar Warp Functions.

33 Planar Warp Functions Consider viewing a planar scene There is now a 1 to 1 mapping between points on the plane and points in the image We will investigate models for this 1 to 1 mapping Euclidean Similarity Affine Homography

34 Piecewise planarity Many scenes are not planar, but are nonetheless piecewise planar Can we match all of the planes to one another?

35 Euclidean warp Consider viewing a fronto-parallel plane at a fixed distance D. In homogeneous coordinates, the imaging equations are: 3D rotation matrix becomes 2D (in plane) Plane at known distance D Point is on plane (w=0)

36 Euclidean warp Simplifying Rearranging the last equation

37 Euclidean warp Homogeneous: Cartesian: For short: How many unknowns?

38 More to read Prince et al. Chapter 14, Section 1 & 3. Chapter 15, Section 1.